2024-08-31T06:30:30.084 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-08-31T06:30:30.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T06:30:30.197 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426 branch: wip-mchangir-testing-20240828.085847-main-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} email: mchangir@redhat.com first_in_suite: false job_id: '7881426' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-testing-20240828.085847-main-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug cephsqlite: 20 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20240828.085847-main-debug sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 owner: scheduled_mchangir@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5413 sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 sleep_before_teardown: 0 subset: 347/512 suite: fs suite_branch: wip-mchangir-testing-20240828.085847-main-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuDsevoFWigmdBWfHW/wW0FJ9N3ioMTjrEnk0PedFAOTh8Hlor+7268nyvcafEp05SPpzc4/bwyHiGmWud5l58= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/LMqWLa2KjIJ+nUf68uHrE7wBQmK7CnHla9KR4Tlft5I2inDx0K0af1P2mYRNkcoOCClnblT9sg198R6cuyPk= smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIiXVs1U5N3iYiUY0uw21QUwmqG2g2o5DyEkMNMcUm8E6gtHd4znaDvCfJsmwS0/KD9JzJpdUUDJv+NcyYFU6Xg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-08-30_08:30:37 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-31T06:30:30.197 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa; will attempt to use it 2024-08-31T06:30:30.197 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks 2024-08-31T06:30:30.198 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-31T06:30:30.199 INFO:teuthology.task.internal:Checking packages... 2024-08-31T06:30:30.219 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd19e6118f7015f0047264006cb0c873528eb3ae6' 2024-08-31T06:30:30.219 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-31T06:30:30.219 INFO:teuthology.packaging:ref: None 2024-08-31T06:30:30.219 INFO:teuthology.packaging:tag: None 2024-08-31T06:30:30.219 INFO:teuthology.packaging:branch: wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T06:30:30.219 INFO:teuthology.packaging:sha1: d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:30:30.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T06:30:30.363 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4560.gd19e6118 2024-08-31T06:30:30.365 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-31T06:30:30.372 INFO:teuthology.task.internal:no buildpackages task found 2024-08-31T06:30:30.373 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-31T06:30:30.380 INFO:teuthology.task.internal:Saving configuration 2024-08-31T06:30:30.399 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-31T06:30:30.406 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-31T06:30:30.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 06:24:52.714270', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOuDsevoFWigmdBWfHW/wW0FJ9N3ioMTjrEnk0PedFAOTh8Hlor+7268nyvcafEp05SPpzc4/bwyHiGmWud5l58='} 2024-08-31T06:30:30.455 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 06:24:52.715673', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/LMqWLa2KjIJ+nUf68uHrE7wBQmK7CnHla9KR4Tlft5I2inDx0K0af1P2mYRNkcoOCClnblT9sg198R6cuyPk='} 2024-08-31T06:30:30.477 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-31 06:24:52.716928', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIiXVs1U5N3iYiUY0uw21QUwmqG2g2o5DyEkMNMcUm8E6gtHd4znaDvCfJsmwS0/KD9JzJpdUUDJv+NcyYFU6Xg='} 2024-08-31T06:30:30.477 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-31T06:30:30.483 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-31T06:30:30.484 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-31T06:30:30.484 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-31T06:30:30.484 INFO:teuthology.run_tasks:Running task console_log... 2024-08-31T06:30:30.557 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fea23d8f0a0>, signals=[15]) 2024-08-31T06:30:30.557 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-31T06:30:30.563 INFO:teuthology.task.internal:Opening connections... 2024-08-31T06:30:30.563 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:30:30.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T06:30:30.639 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-08-31T06:30:30.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T06:30:30.717 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-08-31T06:30:30.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T06:30:30.793 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-31T06:30:30.800 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-08-31T06:30:30.818 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-08-31T06:30:30.818 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-08-31T06:30:30.875 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-08-31T06:30:30.875 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-08-31T06:30:30.875 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-08-31T06:30:30.875 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T06:30:30.876 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T06:30:30.877 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-08-31T06:30:30.899 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-08-31T06:30:30.918 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-08-31T06:30:30.918 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-08-31T06:30:30.976 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T06:30:30.977 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-08-31T06:30:30.977 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T06:30:30.977 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T06:30:30.977 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T06:30:30.977 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-08-31T06:30:30.999 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-08-31T06:30:31.018 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-08-31T06:30:31.018 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon" 2024-08-31T06:30:31.076 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-31T06:30:31.077 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/" 2024-08-31T06:30:31.077 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-31T06:30:31.077 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-31T06:30:31.077 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-31T06:30:31.077 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-08-31T06:30:31.125 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-31T06:30:31.136 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-31T06:30:31.141 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-31T06:30:31.142 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-08-31T06:30:31.144 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-08-31T06:30:31.148 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-08-31T06:30:31.165 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-31T06:30:31.249 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-31T06:30:31.249 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-08-31T06:30:31.251 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-08-31T06:30:31.254 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-08-31T06:30:31.362 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-31T06:30:31.427 INFO:teuthology.run_tasks:Running task kernel... 2024-08-31T06:30:31.441 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-31T06:30:31.441 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-31T06:30:31.441 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T06:30:31.442 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T06:30:31.442 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-31T06:30:31.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:30:31.459 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-08-31T06:30:31.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:30:31.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:30:31.461 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-08-31T06:30:31.461 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-08-31T06:30:31.517 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-503.el9.x86_64 2024-08-31T06:30:31.517 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-503.el9.x86_64 2024-08-31T06:30:31.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-08-31T06:30:31.519 INFO:teuthology.orchestra.run.smithi106.stdout:5.14.0-503.el9.x86_64 2024-08-31T06:30:31.520 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.14.0-503.el9.x86_64 2024-08-31T06:30:31.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum install -y kernel 2024-08-31T06:30:31.521 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-503.el9.x86_64 2024-08-31T06:30:31.521 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.14.0-503.el9.x86_64 2024-08-31T06:30:31.521 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum install -y kernel 2024-08-31T06:30:34.006 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-08-31T06:30:34.966 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-08-31T06:30:35.856 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-08-31T06:30:36.992 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-31T06:30:40.291 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.6 MB 00:00 2024-08-31T06:30:41.841 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 18 kB 00:00 2024-08-31T06:30:42.635 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.6 MB 00:01 2024-08-31T06:30:42.637 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 34 MB/s | 22 MB 00:00 2024-08-31T06:30:42.901 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 877 kB/s | 8.2 MB 00:09 2024-08-31T06:30:44.135 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 18 kB 00:00 2024-08-31T06:30:45.422 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-08-31T06:30:47.718 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 20 MB 00:03 2024-08-31T06:30:48.393 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-08-31T06:30:50.483 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T06:30:50.483 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T06:30:50.557 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-08-31T06:30:50.559 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-08-31T06:30:50.559 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-08-31T06:30:50.698 DEBUG:teuthology.orchestra.run.smithi066:> echo no | sudo yum reinstall kernel || true 2024-08-31T06:30:51.212 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-08-31T06:30:51.340 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 06:30:48 AM UTC. 2024-08-31T06:30:51.479 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-08-31T06:30:51.489 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-08-31T06:30:51.489 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout:Reinstalling: 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 1.9 M 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 0 2024-08-31T06:30:51.490 INFO:teuthology.orchestra.run.smithi066.stderr:Operation aborted. 2024-08-31T06:30:51.543 INFO:teuthology.orchestra.run.smithi066.stdout:Is this ok [y/N]: 2024-08-31T06:30:51.544 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum reinstall -y kernel || true 2024-08-31T06:30:51.935 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.6 MB 00:00 2024-08-31T06:30:52.104 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:04 ago on Sat 31 Aug 2024 06:30:48 AM UTC. 2024-08-31T06:30:52.236 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-08-31T06:30:52.236 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout:Reinstalling: 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:30:52.237 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 1.9 M 2024-08-31T06:30:52.238 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 0 2024-08-31T06:30:52.238 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-08-31T06:30:52.453 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-503.el9.x86_64.rpm 9.7 MB/s | 1.9 MB 00:00 2024-08-31T06:30:52.453 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-08-31T06:30:52.453 INFO:teuthology.orchestra.run.smithi066.stdout:Total 8.7 MB/s | 1.9 MB 00:00 2024-08-31T06:30:52.483 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-08-31T06:30:52.714 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-08-31T06:30:52.715 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-08-31T06:30:52.746 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-08-31T06:30:52.747 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-08-31T06:30:52.924 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-08-31T06:30:53.022 INFO:teuthology.orchestra.run.smithi066.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T06:30:53.022 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:30:53.361 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 81 kB/s | 18 kB 00:00 2024-08-31T06:30:53.393 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T06:30:53.393 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T06:30:53.480 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-08-31T06:30:53.481 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-08-31T06:30:53.481 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-08-31T06:30:53.577 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2024-08-31T06:30:53.793 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:30:53.793 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T06:30:54.130 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 06:30:51 AM UTC. 2024-08-31T06:30:54.280 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:30:54.284 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 1.9 M 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2024-08-31T06:30:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:Operation aborted. 2024-08-31T06:30:54.345 INFO:teuthology.orchestra.run.smithi037.stdout:Is this ok [y/N]: 2024-08-31T06:30:54.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2024-08-31T06:30:54.515 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 22 MB/s | 22 MB 00:01 2024-08-31T06:30:54.525 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:30:54.525 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:30:54.525 INFO:teuthology.orchestra.run.smithi066.stdout:Reinstalled: 2024-08-31T06:30:54.525 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T06:30:54.525 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:30:54.525 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-08-31T06:30:54.746 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T06:30:54.847 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T06:30:54.848 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T06:30:54.848 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T06:30:54.848 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-31T06:30:54.848 DEBUG:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T06:30:54.883 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2024-08-31T06:30:54.892 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 06:30:51 AM UTC. 2024-08-31T06:30:54.907 DEBUG:teuthology.parallel:result is None 2024-08-31T06:30:55.023 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-08-31T06:30:55.023 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-08-31T06:30:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-08-31T06:30:55.023 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-08-31T06:30:55.023 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2024-08-31T06:30:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T06:30:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:30:55.024 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-08-31T06:30:55.024 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-08-31T06:30:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:30:55.024 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 1.9 M 2024-08-31T06:30:55.024 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2024-08-31T06:30:55.025 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-08-31T06:30:55.430 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-503.el9.x86_64.rpm 6.1 MB/s | 1.9 MB 00:00 2024-08-31T06:30:55.431 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-08-31T06:30:55.431 INFO:teuthology.orchestra.run.smithi037.stdout:Total 4.6 MB/s | 1.9 MB 00:00 2024-08-31T06:30:55.460 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-08-31T06:30:55.713 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-08-31T06:30:55.713 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-08-31T06:30:55.745 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-08-31T06:30:55.745 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-08-31T06:30:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-08-31T06:30:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T06:30:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:30:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:30:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T06:30:57.483 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:30:57.483 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:30:57.484 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalled: 2024-08-31T06:30:57.484 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T06:30:57.484 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:30:57.484 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-08-31T06:30:57.669 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T06:30:57.728 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T06:30:57.728 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T06:30:57.728 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T06:30:57.729 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-31T06:30:57.729 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T06:30:57.775 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2024-08-31T06:30:57.798 DEBUG:teuthology.parallel:result is None 2024-08-31T06:30:59.963 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-31T06:31:01.994 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-31T06:31:01.995 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-08-31T06:31:02.074 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-08-31T06:31:02.075 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2024-08-31T06:31:02.075 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-08-31T06:31:02.175 DEBUG:teuthology.orchestra.run.smithi106:> echo no | sudo yum reinstall kernel || true 2024-08-31T06:31:02.717 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:03 ago on Sat 31 Aug 2024 06:30:59 AM UTC. 2024-08-31T06:31:02.856 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-08-31T06:31:02.865 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-31T06:31:02.865 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout:Reinstalling: 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 1.9 M 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 0 2024-08-31T06:31:02.866 INFO:teuthology.orchestra.run.smithi106.stderr:Operation aborted. 2024-08-31T06:31:02.916 INFO:teuthology.orchestra.run.smithi106.stdout:Is this ok [y/N]: 2024-08-31T06:31:02.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum reinstall -y kernel || true 2024-08-31T06:31:03.449 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:04 ago on Sat 31 Aug 2024 06:30:59 AM UTC. 2024-08-31T06:31:03.575 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-08-31T06:31:03.575 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-31T06:31:03.575 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2024-08-31T06:31:03.575 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-31T06:31:03.575 INFO:teuthology.orchestra.run.smithi106.stdout:Reinstalling: 2024-08-31T06:31:03.575 INFO:teuthology.orchestra.run.smithi106.stdout: kernel x86_64 5.14.0-503.el9 baseos 1.9 M 2024-08-31T06:31:03.575 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:31:03.575 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-08-31T06:31:03.576 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2024-08-31T06:31:03.576 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:31:03.576 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 1.9 M 2024-08-31T06:31:03.576 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 0 2024-08-31T06:31:03.576 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-08-31T06:31:04.307 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-5.14.0-503.el9.x86_64.rpm 2.7 MB/s | 1.9 MB 00:00 2024-08-31T06:31:04.307 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-08-31T06:31:04.307 INFO:teuthology.orchestra.run.smithi106.stdout:Total 2.6 MB/s | 1.9 MB 00:00 2024-08-31T06:31:04.335 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-08-31T06:31:04.577 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-08-31T06:31:04.577 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-08-31T06:31:04.607 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-08-31T06:31:04.607 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-08-31T06:31:04.772 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-08-31T06:31:04.850 INFO:teuthology.orchestra.run.smithi106.stdout: Reinstalling : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T06:31:04.851 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:31:05.568 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:31:05.568 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 1/2 2024-08-31T06:31:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-5.14.0-503.el9.x86_64 2/2 2024-08-31T06:31:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:31:06.310 INFO:teuthology.orchestra.run.smithi106.stdout:Reinstalled: 2024-08-31T06:31:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-5.14.0-503.el9.x86_64 2024-08-31T06:31:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:31:06.310 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-08-31T06:31:06.497 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q kernel | sort -rV | head -n 1 2024-08-31T06:31:06.557 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-5.14.0-503.el9.x86_64 2024-08-31T06:31:06.560 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-503.el9.x86_64 2024-08-31T06:31:06.560 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-31T06:31:06.560 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-08-31T06:31:06.560 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-31T06:31:06.592 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2024-08-31T06:31:06.615 DEBUG:teuthology.parallel:result is None 2024-08-31T06:31:06.615 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-31T06:31:06.622 INFO:teuthology.task.internal:Creating test directory... 2024-08-31T06:31:06.622 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T06:31:06.625 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T06:31:06.627 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-31T06:31:06.670 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-31T06:31:06.677 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-31T06:31:06.684 INFO:teuthology.task.internal:Creating archive directory... 2024-08-31T06:31:06.684 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T06:31:06.687 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T06:31:06.689 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-31T06:31:06.742 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-31T06:31:06.748 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-31T06:31:06.748 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T06:31:06.752 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T06:31:06.758 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-31T06:31:06.786 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T06:31:06.798 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T06:31:06.806 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T06:31:06.819 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T06:31:06.847 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T06:31:06.857 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-31T06:31:06.859 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-31T06:31:06.865 INFO:teuthology.task.internal:Configuring sudo... 2024-08-31T06:31:06.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T06:31:06.867 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T06:31:06.870 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-31T06:31:06.896 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-31T06:31:06.904 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-31T06:31:06.905 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T06:31:06.935 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T06:31:06.939 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-31T06:31:06.954 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T06:31:07.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T06:31:07.083 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T06:31:07.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T06:31:07.207 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:31:07.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T06:31:07.272 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T06:31:07.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T06:31:07.373 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T06:31:07.459 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T06:31:07.506 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:31:07.506 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T06:31:07.575 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T06:31:07.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-31T06:31:07.668 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T06:31:07.746 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-31T06:31:07.791 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:31:07.791 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-31T06:31:07.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-08-31T06:31:07.859 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-08-31T06:31:07.861 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-08-31T06:31:07.900 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:31:07.903 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:31:07.931 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T06:31:08.396 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-31T06:31:08.404 INFO:teuthology.task.internal:Starting timer... 2024-08-31T06:31:08.404 INFO:teuthology.run_tasks:Running task pcp... 2024-08-31T06:31:08.427 INFO:teuthology.run_tasks:Running task selinux... 2024-08-31T06:31:08.435 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-31T06:31:08.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-08-31T06:31:08.491 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-08-31T06:31:08.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2024-08-31T06:31:08.540 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2024-08-31T06:31:08.542 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2024-08-31T06:31:08.632 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2024-08-31T06:31:08.633 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-31T06:31:08.633 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-08-31T06:31:08.655 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-08-31T06:31:08.655 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2024-08-31T06:31:08.686 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2024-08-31T06:31:08.686 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2024-08-31T06:31:08.723 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2024-08-31T06:31:08.723 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi066.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi106.front.sepia.ceph.com': 'permissive'} 2024-08-31T06:31:08.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:31:08.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:31:08.751 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:31:08.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:31:08.779 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T06:31:08.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:31:08.804 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-31T06:31:08.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-08-31T06:31:08.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2024-08-31T06:31:08.882 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2024-08-31T06:31:08.919 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-31T06:31:08.927 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-31T06:31:08.930 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-31T06:31:09.074 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-31T06:31:09.085 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-31T06:31:09.085 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi066.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-31T06:32:54.397 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2024-08-31T06:32:54.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-31T06:32:54.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T06:32:54.475 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-08-31T06:32:54.564 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-31T06:32:54.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-08-31T06:32:54.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T06:32:54.641 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-08-31T06:32:54.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-08-31T06:32:54.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-08-31T06:32:54.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-31T06:32:54.807 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-08-31T06:32:54.891 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-08-31T06:32:54.891 INFO:teuthology.run_tasks:Running task clock... 2024-08-31T06:32:54.902 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-31T06:32:54.902 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T06:32:54.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:32:54.905 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T06:32:54.905 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:32:54.908 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-31T06:32:54.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T06:32:54.934 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T06:32:54.939 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T06:32:54.948 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T06:32:54.955 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T06:32:54.965 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-31T06:32:54.974 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-08-31T06:32:54.981 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-31T06:32:54.982 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2024-08-31T06:32:54.985 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-08-31T06:32:54.994 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2024-08-31T06:32:55.000 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T06:32:55.007 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2024-08-31T06:32:55.009 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T06:32:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T06:32:55.019 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2024-08-31T06:32:55.023 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T06:32:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-31T06:32:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-31T06:32:55.071 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:32:55.076 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:32:55.076 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-08-31T06:32:55.076 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.076 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.076 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.076 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.080 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:32:55.084 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:32:55.084 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-08-31T06:32:55.084 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.084 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.084 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.084 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.110 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2024-08-31T06:32:55.114 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T06:32:55.114 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-08-31T06:32:55.114 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.114 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.114 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.115 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T06:32:55.115 INFO:teuthology.run_tasks:Running task install... 2024-08-31T06:32:55.123 DEBUG:teuthology.task.install:project ceph 2024-08-31T06:32:55.123 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'}} 2024-08-31T06:32:55.123 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6'} 2024-08-31T06:32:55.123 INFO:teuthology.task.install:Using flavor: default 2024-08-31T06:32:55.129 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-31T06:32:55.129 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-31T06:32:55.130 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T06:32:55.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:32:55.132 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T06:32:55.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:32:55.133 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'tag': None, 'wait_for_package': False} 2024-08-31T06:32:55.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:32:55.277 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T06:32:55.277 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T06:32:55.282 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T06:32:55.282 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T06:32:55.292 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/ 2024-08-31T06:32:55.292 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4560.gd19e6118 2024-08-31T06:32:55.386 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T06:32:55.386 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:32:55.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T06:32:55.397 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T06:32:55.397 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:32:55.398 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T06:32:55.402 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-31T06:32:55.402 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:32:55.402 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-31T06:32:55.412 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T06:32:55.412 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T06:32:55.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T06:32:55.424 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T06:32:55.429 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-31T06:32:55.429 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d19e6118f7015f0047264006cb0c873528eb3ae6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-31T06:32:55.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T06:32:55.489 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T06:32:55.496 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-31T06:32:55.553 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T06:32:55.564 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T06:32:55.574 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-31T06:32:55.617 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-08-31T06:32:55.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-08-31T06:32:55.628 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2024-08-31T06:32:55.630 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2024-08-31T06:32:55.639 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2024-08-31T06:32:55.641 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2024-08-31T06:32:55.850 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-08-31T06:32:55.853 INFO:teuthology.orchestra.run.smithi106.stdout:45 files removed 2024-08-31T06:32:55.876 INFO:teuthology.orchestra.run.smithi066.stdout:45 files removed 2024-08-31T06:32:55.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T06:32:55.880 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T06:32:55.903 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-31T06:32:56.421 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-08-31T06:32:56.424 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-08-31T06:32:56.456 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-08-31T06:32:56.717 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-08-31T06:32:56.722 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-08-31T06:32:56.749 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-08-31T06:32:56.992 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T06:32:57.006 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-08-31T06:32:57.024 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-08-31T06:32:57.699 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-08-31T06:32:58.606 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.2 MB 00:01 2024-08-31T06:33:00.292 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-08-31T06:33:00.441 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-08-31T06:33:00.442 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.2 MB 00:03 2024-08-31T06:33:05.727 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.6 MB 00:01 2024-08-31T06:33:08.086 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 18 kB 00:01 2024-08-31T06:33:08.831 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 37 MB/s | 22 MB 00:00 2024-08-31T06:33:13.417 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 20 MB 00:11 2024-08-31T06:33:14.454 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-31T06:33:16.824 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T06:33:16.824 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T06:33:16.836 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T06:33:16.837 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T06:33:16.838 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T06:33:16.839 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T06:33:16.840 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T06:33:16.843 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T06:33:16.844 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T06:33:16.908 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T06:33:16.917 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T06:33:16.918 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T06:33:16.919 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T06:33:16.920 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T06:33:16.921 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T06:33:16.922 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T06:33:16.923 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T06:33:16.924 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T06:33:16.925 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T06:33:16.926 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T06:33:16.927 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T06:33:16.928 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-08-31T06:33:16.929 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-08-31T06:33:16.930 INFO:teuthology.orchestra.run.smithi066.stdout:Install 148 Packages 2024-08-31T06:33:16.930 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 2 Packages 2024-08-31T06:33:16.930 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:33:16.930 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 224 M 2024-08-31T06:33:16.930 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-08-31T06:33:17.588 INFO:teuthology.orchestra.run.smithi066.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-08-31T06:33:17.764 INFO:teuthology.orchestra.run.smithi066.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.9 MB/s | 874 kB 00:00 2024-08-31T06:33:17.839 INFO:teuthology.orchestra.run.smithi066.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 1.9 MB/s | 148 kB 00:00 2024-08-31T06:33:17.956 INFO:teuthology.orchestra.run.smithi066.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-31T06:33:18.014 INFO:teuthology.orchestra.run.smithi066.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 13 MB/s | 2.3 MB 00:00 2024-08-31T06:33:18.081 INFO:teuthology.orchestra.run.smithi066.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 1.5 MB 00:00 2024-08-31T06:33:18.440 INFO:teuthology.orchestra.run.smithi066.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 12 MB/s | 4.9 MB 00:00 2024-08-31T06:33:18.648 INFO:teuthology.orchestra.run.smithi066.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-31T06:33:18.699 INFO:teuthology.orchestra.run.smithi066.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 507 kB/s | 25 kB 00:00 2024-08-31T06:33:19.157 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 459 kB/s | 6.6 MB 00:14 2024-08-31T06:33:19.199 INFO:teuthology.orchestra.run.smithi066.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 16 MB/s | 18 MB 00:01 2024-08-31T06:33:19.308 INFO:teuthology.orchestra.run.smithi066.stdout:(11/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 12 MB/s | 10 MB 00:00 2024-08-31T06:33:19.349 INFO:teuthology.orchestra.run.smithi066.stdout:(12/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 1.5 MB/s | 226 kB 00:00 2024-08-31T06:33:19.375 INFO:teuthology.orchestra.run.smithi066.stdout:(13/150): cephfs-shell-19.3.0-4560.gd19e6118.el 405 kB/s | 27 kB 00:00 2024-08-31T06:33:19.400 INFO:teuthology.orchestra.run.smithi066.stdout:(14/150): libcephfs-devel-19.3.0-4560.gd19e6118 630 kB/s | 32 kB 00:00 2024-08-31T06:33:19.451 INFO:teuthology.orchestra.run.smithi066.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 3.1 MB/s | 159 kB 00:00 2024-08-31T06:33:19.484 INFO:teuthology.orchestra.run.smithi066.stdout:(16/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 6.9 MB/s | 766 kB 00:00 2024-08-31T06:33:19.509 INFO:teuthology.orchestra.run.smithi066.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 2.1 MB/s | 127 kB 00:00 2024-08-31T06:33:19.543 INFO:teuthology.orchestra.run.smithi066.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 8.4 MB/s | 506 kB 00:00 2024-08-31T06:33:19.660 INFO:teuthology.orchestra.run.smithi066.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 387 kB/s | 45 kB 00:00 2024-08-31T06:33:19.735 INFO:teuthology.orchestra.run.smithi066.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.8 MB/s | 141 kB 00:00 2024-08-31T06:33:19.827 INFO:teuthology.orchestra.run.smithi066.stdout:(21/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 17 MB/s | 5.3 MB 00:00 2024-08-31T06:33:19.853 INFO:teuthology.orchestra.run.smithi066.stdout:(22/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.4 MB/s | 161 kB 00:00 2024-08-31T06:33:19.886 INFO:teuthology.orchestra.run.smithi066.stdout:(23/150): python3-rados-19.3.0-4560.gd19e6118.e 5.4 MB/s | 321 kB 00:00 2024-08-31T06:33:19.911 INFO:teuthology.orchestra.run.smithi066.stdout:(24/150): python3-rbd-19.3.0-4560.gd19e6118.el9 5.1 MB/s | 305 kB 00:00 2024-08-31T06:33:19.937 INFO:teuthology.orchestra.run.smithi066.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.9 MB/s | 99 kB 00:00 2024-08-31T06:33:19.962 INFO:teuthology.orchestra.run.smithi066.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.7 MB/s | 86 kB 00:00 2024-08-31T06:33:20.021 INFO:teuthology.orchestra.run.smithi066.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.9 MB/s | 170 kB 00:00 2024-08-31T06:33:20.113 INFO:teuthology.orchestra.run.smithi066.stdout:(28/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 18 MB/s | 3.1 MB 00:00 2024-08-31T06:33:20.138 INFO:teuthology.orchestra.run.smithi066.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 293 kB/s | 34 kB 00:00 2024-08-31T06:33:20.172 INFO:teuthology.orchestra.run.smithi066.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.6 MB/s | 154 kB 00:00 2024-08-31T06:33:20.655 INFO:teuthology.orchestra.run.smithi066.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-08-31T06:33:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 3.8 MB/s | 290 kB 00:00 2024-08-31T06:33:21.148 INFO:teuthology.orchestra.run.smithi066.stdout:(33/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 18 MB/s | 44 MB 00:02 2024-08-31T06:33:21.173 INFO:teuthology.orchestra.run.smithi066.stdout:(34/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 111 kB/s | 49 kB 00:00 2024-08-31T06:33:21.198 INFO:teuthology.orchestra.run.smithi066.stdout:(35/150): ceph-prometheus-alerts-19.3.0-4560.gd 329 kB/s | 16 kB 00:00 2024-08-31T06:33:21.223 INFO:teuthology.orchestra.run.smithi066.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 5.6 MB/s | 285 kB 00:00 2024-08-31T06:33:21.382 INFO:teuthology.orchestra.run.smithi066.stdout:(37/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 11 MB/s | 14 MB 00:01 2024-08-31T06:33:21.407 INFO:teuthology.orchestra.run.smithi066.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 99 kB/s | 18 kB 00:00 2024-08-31T06:33:21.432 INFO:teuthology.orchestra.run.smithi066.stdout:(39/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 3.3 MB/s | 781 kB 00:00 2024-08-31T06:33:22.058 INFO:teuthology.orchestra.run.smithi066.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 118 kB/s | 80 kB 00:00 2024-08-31T06:33:22.158 INFO:teuthology.orchestra.run.smithi066.stdout:(41/150): libquadmath-11.5.0-2.el9.x86_64.rpm 263 kB/s | 191 kB 00:00 2024-08-31T06:33:22.309 INFO:teuthology.orchestra.run.smithi066.stdout:(42/150): libgfortran-11.5.0-2.el9.x86_64.rpm 889 kB/s | 801 kB 00:00 2024-08-31T06:33:22.817 INFO:teuthology.orchestra.run.smithi066.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 334 kB/s | 253 kB 00:00 2024-08-31T06:33:22.992 INFO:teuthology.orchestra.run.smithi066.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-08-31T06:33:23.126 INFO:teuthology.orchestra.run.smithi066.stdout:(45/150): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-08-31T06:33:23.526 INFO:teuthology.orchestra.run.smithi066.stdout:(46/150): python3-pycparser-2.20-6.el9.noarch.r 191 kB/s | 135 kB 00:00 2024-08-31T06:33:23.701 INFO:teuthology.orchestra.run.smithi066.stdout:(47/150): python3-requests-2.25.1-8.el9.noarch. 176 kB/s | 125 kB 00:00 2024-08-31T06:33:23.735 INFO:teuthology.orchestra.run.smithi066.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-08-31T06:33:23.785 INFO:teuthology.orchestra.run.smithi066.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-08-31T06:33:23.827 INFO:teuthology.orchestra.run.smithi066.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 525 kB/s | 22 kB 00:00 2024-08-31T06:33:23.877 INFO:teuthology.orchestra.run.smithi066.stdout:(51/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-31T06:33:23.911 INFO:teuthology.orchestra.run.smithi066.stdout:(52/150): python3-urllib3-1.26.5-6.el9.noarch.r 274 kB/s | 215 kB 00:00 2024-08-31T06:33:23.936 INFO:teuthology.orchestra.run.smithi066.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-08-31T06:33:23.961 INFO:teuthology.orchestra.run.smithi066.stdout:(54/150): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 943 kB 00:00 2024-08-31T06:33:23.978 INFO:teuthology.orchestra.run.smithi066.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 434 kB/s | 18 kB 00:00 2024-08-31T06:33:23.995 INFO:teuthology.orchestra.run.smithi066.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 332 kB/s | 11 kB 00:00 2024-08-31T06:33:24.029 INFO:teuthology.orchestra.run.smithi066.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-31T06:33:24.046 INFO:teuthology.orchestra.run.smithi066.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-08-31T06:33:24.096 INFO:teuthology.orchestra.run.smithi066.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-08-31T06:33:24.138 INFO:teuthology.orchestra.run.smithi066.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-08-31T06:33:24.155 INFO:teuthology.orchestra.run.smithi066.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-08-31T06:33:24.180 INFO:teuthology.orchestra.run.smithi066.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-08-31T06:33:24.206 INFO:teuthology.orchestra.run.smithi066.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-31T06:33:24.231 INFO:teuthology.orchestra.run.smithi066.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-08-31T06:33:24.256 INFO:teuthology.orchestra.run.smithi066.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-08-31T06:33:24.315 INFO:teuthology.orchestra.run.smithi066.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2024-08-31T06:33:24.382 INFO:teuthology.orchestra.run.smithi066.stdout:(67/150): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-08-31T06:33:24.457 INFO:teuthology.orchestra.run.smithi066.stdout:(68/150): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-08-31T06:33:24.491 INFO:teuthology.orchestra.run.smithi066.stdout:(69/150): postgresql-contrib-13.16-1.el9.x86_64 8.2 MB/s | 910 kB 00:00 2024-08-31T06:33:24.516 INFO:teuthology.orchestra.run.smithi066.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-08-31T06:33:24.591 INFO:teuthology.orchestra.run.smithi066.stdout:(71/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-08-31T06:33:24.633 INFO:teuthology.orchestra.run.smithi066.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-08-31T06:33:24.659 INFO:teuthology.orchestra.run.smithi066.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-31T06:33:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 818 kB/s | 61 kB 00:00 2024-08-31T06:33:24.809 INFO:teuthology.orchestra.run.smithi066.stdout:(75/150): postgresql-server-13.16-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-08-31T06:33:24.843 INFO:teuthology.orchestra.run.smithi066.stdout:(76/150): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-08-31T06:33:24.868 INFO:teuthology.orchestra.run.smithi066.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-08-31T06:33:24.893 INFO:teuthology.orchestra.run.smithi066.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-08-31T06:33:24.919 INFO:teuthology.orchestra.run.smithi066.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-08-31T06:33:24.944 INFO:teuthology.orchestra.run.smithi066.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-31T06:33:24.969 INFO:teuthology.orchestra.run.smithi066.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-08-31T06:33:25.045 INFO:teuthology.orchestra.run.smithi066.stdout:(82/150): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-08-31T06:33:25.070 INFO:teuthology.orchestra.run.smithi066.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-08-31T06:33:25.095 INFO:teuthology.orchestra.run.smithi066.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-08-31T06:33:25.120 INFO:teuthology.orchestra.run.smithi066.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-31T06:33:25.145 INFO:teuthology.orchestra.run.smithi066.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-08-31T06:33:25.179 INFO:teuthology.orchestra.run.smithi066.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-08-31T06:33:25.213 INFO:teuthology.orchestra.run.smithi066.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-08-31T06:33:25.238 INFO:teuthology.orchestra.run.smithi066.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-08-31T06:33:25.263 INFO:teuthology.orchestra.run.smithi066.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-31T06:33:25.288 INFO:teuthology.orchestra.run.smithi066.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-31T06:33:25.372 INFO:teuthology.orchestra.run.smithi066.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-31T06:33:25.389 INFO:teuthology.orchestra.run.smithi066.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-08-31T06:33:25.406 INFO:teuthology.orchestra.run.smithi066.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-08-31T06:33:25.439 INFO:teuthology.orchestra.run.smithi066.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-31T06:33:25.456 INFO:teuthology.orchestra.run.smithi066.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-08-31T06:33:25.473 INFO:teuthology.orchestra.run.smithi066.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-08-31T06:33:25.515 INFO:teuthology.orchestra.run.smithi066.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-08-31T06:33:25.532 INFO:teuthology.orchestra.run.smithi066.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-08-31T06:33:25.557 INFO:teuthology.orchestra.run.smithi066.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.3 MB/s | 96 kB 00:00 2024-08-31T06:33:25.575 INFO:teuthology.orchestra.run.smithi066.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-08-31T06:33:25.591 INFO:teuthology.orchestra.run.smithi066.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-08-31T06:33:25.608 INFO:teuthology.orchestra.run.smithi066.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 666 kB/s | 22 kB 00:00 2024-08-31T06:33:25.656 INFO:teuthology.orchestra.run.smithi066.stdout:(104/150): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-08-31T06:33:25.698 INFO:teuthology.orchestra.run.smithi066.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 6.0 MB/s | 548 kB 00:00 2024-08-31T06:33:25.723 INFO:teuthology.orchestra.run.smithi066.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-08-31T06:33:25.765 INFO:teuthology.orchestra.run.smithi066.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-08-31T06:33:25.782 INFO:teuthology.orchestra.run.smithi066.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-08-31T06:33:25.807 INFO:teuthology.orchestra.run.smithi066.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-31T06:33:25.841 INFO:teuthology.orchestra.run.smithi066.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-08-31T06:33:25.867 INFO:teuthology.orchestra.run.smithi066.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-31T06:33:26.034 INFO:teuthology.orchestra.run.smithi066.stdout:(112/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-08-31T06:33:26.075 INFO:teuthology.orchestra.run.smithi066.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-08-31T06:33:26.092 INFO:teuthology.orchestra.run.smithi066.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.9 MB/s | 43 kB 00:00 2024-08-31T06:33:26.109 INFO:teuthology.orchestra.run.smithi066.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-08-31T06:33:26.126 INFO:teuthology.orchestra.run.smithi066.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 864 kB/s | 14 kB 00:00 2024-08-31T06:33:26.151 INFO:teuthology.orchestra.run.smithi066.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-08-31T06:33:26.185 INFO:teuthology.orchestra.run.smithi066.stdout:(118/150): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-08-31T06:33:26.210 INFO:teuthology.orchestra.run.smithi066.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-31T06:33:26.261 INFO:teuthology.orchestra.run.smithi066.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-08-31T06:33:26.286 INFO:teuthology.orchestra.run.smithi066.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-08-31T06:33:26.319 INFO:teuthology.orchestra.run.smithi066.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-08-31T06:33:26.345 INFO:teuthology.orchestra.run.smithi066.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 424 kB/s | 11 kB 00:00 2024-08-31T06:33:26.370 INFO:teuthology.orchestra.run.smithi066.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-08-31T06:33:26.396 INFO:teuthology.orchestra.run.smithi066.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-08-31T06:33:26.421 INFO:teuthology.orchestra.run.smithi066.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-08-31T06:33:26.446 INFO:teuthology.orchestra.run.smithi066.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-08-31T06:33:26.530 INFO:teuthology.orchestra.run.smithi066.stdout:(128/150): libarrow-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-08-31T06:33:26.555 INFO:teuthology.orchestra.run.smithi066.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T06:33:26.597 INFO:teuthology.orchestra.run.smithi066.stdout:(130/150): python3-grpcio-1.46.7-10.el9.x86_64. 6.1 MB/s | 2.0 MB 00:00 2024-08-31T06:33:26.622 INFO:teuthology.orchestra.run.smithi066.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-08-31T06:33:26.647 INFO:teuthology.orchestra.run.smithi066.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-08-31T06:33:26.681 INFO:teuthology.orchestra.run.smithi066.stdout:(133/150): python3-kubernetes-26.1.0-2.el9.noar 4.4 MB/s | 1.0 MB 00:00 2024-08-31T06:33:26.706 INFO:teuthology.orchestra.run.smithi066.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-08-31T06:33:26.732 INFO:teuthology.orchestra.run.smithi066.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-31T06:33:26.757 INFO:teuthology.orchestra.run.smithi066.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-31T06:33:26.782 INFO:teuthology.orchestra.run.smithi066.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-08-31T06:33:26.932 INFO:teuthology.orchestra.run.smithi066.stdout:(138/150): python3-pecan-1.4.2-3.el9.noarch.rpm 879 kB/s | 272 kB 00:00 2024-08-31T06:33:26.957 INFO:teuthology.orchestra.run.smithi066.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 338 kB/s | 59 kB 00:00 2024-08-31T06:33:26.983 INFO:teuthology.orchestra.run.smithi066.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 836 kB/s | 188 kB 00:00 2024-08-31T06:33:27.008 INFO:teuthology.orchestra.run.smithi066.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-08-31T06:33:27.033 INFO:teuthology.orchestra.run.smithi066.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-08-31T06:33:27.059 INFO:teuthology.orchestra.run.smithi066.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-31T06:33:27.084 INFO:teuthology.orchestra.run.smithi066.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-31T06:33:27.109 INFO:teuthology.orchestra.run.smithi066.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-31T06:33:27.135 INFO:teuthology.orchestra.run.smithi066.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T06:33:27.160 INFO:teuthology.orchestra.run.smithi066.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-31T06:33:27.210 INFO:teuthology.orchestra.run.smithi066.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-31T06:33:27.385 INFO:teuthology.orchestra.run.smithi066.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 14 MB/s | 3.4 MB 00:00 2024-08-31T06:33:27.452 INFO:teuthology.orchestra.run.smithi066.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 3.1 MB 00:00 2024-08-31T06:33:27.459 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-08-31T06:33:27.459 INFO:teuthology.orchestra.run.smithi066.stdout:Total 21 MB/s | 224 MB 00:10 2024-08-31T06:33:28.602 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-08-31T06:33:28.743 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-08-31T06:33:28.743 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-08-31T06:33:30.248 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 1.9 kB/s | 18 kB 00:09 2024-08-31T06:33:30.607 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-08-31T06:33:30.608 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-08-31T06:33:31.143 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-08-31T06:33:32.267 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - CRB 445 kB/s | 6.6 MB 00:15 2024-08-31T06:33:34.142 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 18 kB 00:00 2024-08-31T06:33:34.940 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 34 MB/s | 22 MB 00:00 2024-08-31T06:33:36.669 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-08-31T06:33:36.747 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T06:33:36.780 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T06:33:36.824 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T06:33:36.841 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-08-31T06:33:37.183 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T06:33:37.306 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T06:33:37.427 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T06:33:37.457 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:33:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:33:37.592 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T06:33:37.620 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T06:33:37.645 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T06:33:37.808 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T06:33:37.860 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T06:33:37.895 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:33:38.003 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:33:38.038 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T06:33:38.102 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T06:33:38.131 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T06:33:38.155 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T06:33:38.429 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T06:33:38.473 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T06:33:38.594 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T06:33:38.629 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T06:33:38.665 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T06:33:38.741 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T06:33:38.792 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T06:33:38.832 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T06:33:38.875 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T06:33:38.925 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T06:33:38.952 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T06:33:39.033 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T06:33:39.092 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T06:33:39.124 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T06:33:39.177 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T06:33:39.202 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T06:33:39.203 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T06:33:39.214 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T06:33:39.215 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T06:33:39.216 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T06:33:39.217 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T06:33:39.219 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T06:33:39.221 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T06:33:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T06:33:39.264 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T06:33:39.286 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-08-31T06:33:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-08-31T06:33:39.295 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-08-31T06:33:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-08-31T06:33:39.295 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-08-31T06:33:39.295 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T06:33:39.296 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T06:33:39.297 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-08-31T06:33:39.298 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T06:33:39.299 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T06:33:39.300 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T06:33:39.301 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T06:33:39.302 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T06:33:39.303 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T06:33:39.304 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T06:33:39.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T06:33:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T06:33:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T06:33:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T06:33:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T06:33:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T06:33:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T06:33:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T06:33:39.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T06:33:39.307 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:Install 148 Packages 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2024-08-31T06:33:39.308 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:33:39.309 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T06:33:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 224 M 2024-08-31T06:33:39.309 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-08-31T06:33:39.345 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T06:33:39.372 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T06:33:39.446 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T06:33:39.505 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T06:33:39.568 INFO:teuthology.orchestra.run.smithi037.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 57 kB/s | 6.6 kB 00:00 2024-08-31T06:33:39.591 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T06:33:39.738 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T06:33:39.743 INFO:teuthology.orchestra.run.smithi037.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.9 MB/s | 874 kB 00:00 2024-08-31T06:33:39.791 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T06:33:39.810 INFO:teuthology.orchestra.run.smithi037.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 2.2 MB/s | 148 kB 00:00 2024-08-31T06:33:39.952 INFO:teuthology.orchestra.run.smithi037.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-31T06:33:40.019 INFO:teuthology.orchestra.run.smithi037.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 11 MB/s | 2.3 MB 00:00 2024-08-31T06:33:40.086 INFO:teuthology.orchestra.run.smithi037.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 11 MB/s | 1.5 MB 00:00 2024-08-31T06:33:40.353 INFO:teuthology.orchestra.run.smithi037.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 15 MB/s | 4.9 MB 00:00 2024-08-31T06:33:40.363 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T06:33:40.448 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T06:33:40.461 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 6.4 kB/s | 1.7 kB 00:00 2024-08-31T06:33:40.481 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T06:33:40.524 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T06:33:40.562 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T06:33:40.595 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T06:33:40.637 INFO:teuthology.orchestra.run.smithi037.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 17 MB/s | 20 MB 00:01 2024-08-31T06:33:40.679 INFO:teuthology.orchestra.run.smithi037.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 608 kB/s | 25 kB 00:00 2024-08-31T06:33:40.693 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T06:33:40.754 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T06:33:40.827 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T06:33:40.872 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T06:33:40.909 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T06:33:40.956 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T06:33:40.991 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T06:33:41.035 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T06:33:41.062 INFO:teuthology.orchestra.run.smithi037.stdout:(10/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 15 MB/s | 10 MB 00:00 2024-08-31T06:33:41.077 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T06:33:41.222 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T06:33:41.246 INFO:teuthology.orchestra.run.smithi037.stdout:(11/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 15 MB/s | 18 MB 00:01 2024-08-31T06:33:41.261 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T06:33:41.279 INFO:teuthology.orchestra.run.smithi037.stdout:(12/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 1.0 MB/s | 226 kB 00:00 2024-08-31T06:33:41.304 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T06:33:41.304 INFO:teuthology.orchestra.run.smithi037.stdout:(13/150): cephfs-shell-19.3.0-4560.gd19e6118.el 464 kB/s | 27 kB 00:00 2024-08-31T06:33:41.330 INFO:teuthology.orchestra.run.smithi037.stdout:(14/150): libcephfs-devel-19.3.0-4560.gd19e6118 634 kB/s | 32 kB 00:00 2024-08-31T06:33:41.380 INFO:teuthology.orchestra.run.smithi037.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 3.1 MB/s | 159 kB 00:00 2024-08-31T06:33:41.411 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T06:33:41.414 INFO:teuthology.orchestra.run.smithi037.stdout:(16/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 6.9 MB/s | 766 kB 00:00 2024-08-31T06:33:41.439 INFO:teuthology.orchestra.run.smithi037.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 2.1 MB/s | 127 kB 00:00 2024-08-31T06:33:41.453 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T06:33:41.493 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T06:33:41.527 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T06:33:41.537 INFO:teuthology.orchestra.run.smithi037.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 4.0 MB/s | 506 kB 00:00 2024-08-31T06:33:41.551 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T06:33:41.598 INFO:teuthology.orchestra.run.smithi037.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 742 kB/s | 45 kB 00:00 2024-08-31T06:33:41.631 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T06:33:41.656 INFO:teuthology.orchestra.run.smithi037.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 2.4 MB/s | 141 kB 00:00 2024-08-31T06:33:41.715 INFO:teuthology.orchestra.run.smithi037.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 2.7 MB/s | 161 kB 00:00 2024-08-31T06:33:41.760 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T06:33:41.782 INFO:teuthology.orchestra.run.smithi037.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 4.7 MB/s | 321 kB 00:00 2024-08-31T06:33:41.800 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T06:33:41.828 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T06:33:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 4.5 MB/s | 305 kB 00:00 2024-08-31T06:33:41.871 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T06:33:41.916 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T06:33:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:(24/150): python3-rgw-19.3.0-4560.gd19e6118.el9 1.5 MB/s | 99 kB 00:00 2024-08-31T06:33:41.953 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T06:33:41.975 INFO:teuthology.orchestra.run.smithi037.stdout:(25/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.4 MB/s | 86 kB 00:00 2024-08-31T06:33:41.993 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T06:33:42.022 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T06:33:42.057 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T06:33:42.083 INFO:teuthology.orchestra.run.smithi037.stdout:(26/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 8.2 MB/s | 5.3 MB 00:00 2024-08-31T06:33:42.090 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T06:33:42.150 INFO:teuthology.orchestra.run.smithi037.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.5 MB/s | 170 kB 00:00 2024-08-31T06:33:42.242 INFO:teuthology.orchestra.run.smithi037.stdout:(28/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 12 MB/s | 3.1 MB 00:00 2024-08-31T06:33:42.259 INFO:teuthology.orchestra.run.smithi037.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 315 kB/s | 34 kB 00:00 2024-08-31T06:33:42.293 INFO:teuthology.orchestra.run.smithi037.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 3.0 MB/s | 154 kB 00:00 2024-08-31T06:33:42.325 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T06:33:42.634 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T06:33:42.733 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T06:33:42.753 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T06:33:42.754 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-31T06:33:42.765 INFO:teuthology.orchestra.run.smithi106.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-31T06:33:42.766 INFO:teuthology.orchestra.run.smithi106.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-31T06:33:42.767 INFO:teuthology.orchestra.run.smithi106.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-08-31T06:33:42.768 INFO:teuthology.orchestra.run.smithi106.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-31T06:33:42.769 INFO:teuthology.orchestra.run.smithi106.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-31T06:33:42.772 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-31T06:33:42.773 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-31T06:33:42.791 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T06:33:42.810 INFO:teuthology.orchestra.run.smithi037.stdout:(31/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 21 MB/s | 44 MB 00:02 2024-08-31T06:33:42.832 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2024-08-31T06:33:42.837 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T06:33:42.840 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 6.6 k 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.5 M 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 874 k 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 148 k 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 1.5 M 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 154 k 2024-08-31T06:33:42.841 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 14 M 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 7.4 M 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 49 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 10 M 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 44 M 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 285 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 781 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 226 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-shell x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 27 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 18 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-31T06:33:42.842 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 32 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 766 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 127 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel x86_64 1:3.2.2-4.el9 appstream 4.4 M 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 161 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 321 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 305 k 2024-08-31T06:33:42.843 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 99 k 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 86 k 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 170 k 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.4 M 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 3.1 M 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 20 M 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 34 k 2024-08-31T06:33:42.844 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 2.3 M 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 290 k 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 4.9 M 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 18 M 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4560.gd19e6118.el9 ceph-noarch 16 k 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 25 k 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-31T06:33:42.845 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 159 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 506 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 5.3 M 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-31T06:33:42.846 INFO:teuthology.orchestra.run.smithi106.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-31T06:33:42.847 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 45 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:19.3.0-4560.gd19e6118.el9 ceph 141 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-31T06:33:42.848 INFO:teuthology.orchestra.run.smithi106.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-31T06:33:42.849 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-31T06:33:42.850 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-08-31T06:33:42.851 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout:Installing weak dependencies: 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-31T06:33:42.852 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:33:42.853 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2024-08-31T06:33:42.853 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2024-08-31T06:33:42.853 INFO:teuthology.orchestra.run.smithi106.stdout:Install 148 Packages 2024-08-31T06:33:42.853 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 2 Packages 2024-08-31T06:33:42.853 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:33:42.853 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 224 M 2024-08-31T06:33:42.853 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2024-08-31T06:33:42.869 INFO:teuthology.orchestra.run.smithi037.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 4.9 MB/s | 290 kB 00:00 2024-08-31T06:33:42.949 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T06:33:42.986 INFO:teuthology.orchestra.run.smithi037.stdout:(33/150): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-08-31T06:33:43.006 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T06:33:43.011 INFO:teuthology.orchestra.run.smithi037.stdout:(34/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 348 kB/s | 49 kB 00:00 2024-08-31T06:33:43.036 INFO:teuthology.orchestra.run.smithi037.stdout:(35/150): ceph-prometheus-alerts-19.3.0-4560.gd 329 kB/s | 16 kB 00:00 2024-08-31T06:33:43.061 INFO:teuthology.orchestra.run.smithi037.stdout:(36/150): ceph-volume-19.3.0-4560.gd19e6118.el9 5.6 MB/s | 285 kB 00:00 2024-08-31T06:33:43.120 INFO:teuthology.orchestra.run.smithi037.stdout:(37/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 9.1 MB/s | 781 kB 00:00 2024-08-31T06:33:43.145 INFO:teuthology.orchestra.run.smithi037.stdout:(38/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 218 kB/s | 18 kB 00:00 2024-08-31T06:33:43.362 INFO:teuthology.orchestra.run.smithi106.stdout:(1/150): ceph-19.3.0-4560.gd19e6118.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-08-31T06:33:43.496 INFO:teuthology.orchestra.run.smithi037.stdout:(39/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 11 MB/s | 14 MB 00:01 2024-08-31T06:33:43.554 INFO:teuthology.orchestra.run.smithi106.stdout:(2/150): ceph-fuse-19.3.0-4560.gd19e6118.el9.x8 4.5 MB/s | 874 kB 00:00 2024-08-31T06:33:43.571 INFO:teuthology.orchestra.run.smithi037.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 177 kB/s | 80 kB 00:00 2024-08-31T06:33:43.621 INFO:teuthology.orchestra.run.smithi106.stdout:(3/150): ceph-immutable-object-cache-19.3.0-456 2.2 MB/s | 148 kB 00:00 2024-08-31T06:33:43.763 INFO:teuthology.orchestra.run.smithi106.stdout:(4/150): ceph-base-19.3.0-4560.gd19e6118.el9.x8 10 MB/s | 5.5 MB 00:00 2024-08-31T06:33:43.795 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T06:33:43.821 INFO:teuthology.orchestra.run.smithi106.stdout:(5/150): ceph-mds-19.3.0-4560.gd19e6118.el9.x86 11 MB/s | 2.3 MB 00:00 2024-08-31T06:33:43.843 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T06:33:43.846 INFO:teuthology.orchestra.run.smithi037.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 921 kB/s | 253 kB 00:00 2024-08-31T06:33:43.876 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T06:33:43.896 INFO:teuthology.orchestra.run.smithi106.stdout:(6/150): ceph-mgr-19.3.0-4560.gd19e6118.el9.x86 11 MB/s | 1.5 MB 00:00 2024-08-31T06:33:43.990 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T06:33:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:(42/150): libquadmath-11.5.0-2.el9.x86_64.rpm 382 kB/s | 191 kB 00:00 2024-08-31T06:33:44.038 INFO:teuthology.orchestra.run.smithi037.stdout:(43/150): libgfortran-11.5.0-2.el9.x86_64.rpm 897 kB/s | 801 kB 00:00 2024-08-31T06:33:44.043 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T06:33:44.088 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T06:33:44.097 INFO:teuthology.orchestra.run.smithi037.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-08-31T06:33:44.147 INFO:teuthology.orchestra.run.smithi037.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-08-31T06:33:44.172 INFO:teuthology.orchestra.run.smithi106.stdout:(7/150): ceph-mon-19.3.0-4560.gd19e6118.el9.x86 14 MB/s | 4.9 MB 00:00 2024-08-31T06:33:44.190 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T06:33:44.197 INFO:teuthology.orchestra.run.smithi037.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-08-31T06:33:44.222 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T06:33:44.256 INFO:teuthology.orchestra.run.smithi037.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-08-31T06:33:44.298 INFO:teuthology.orchestra.run.smithi037.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 2.7 MB/s | 1.2 MB 00:00 2024-08-31T06:33:44.382 INFO:teuthology.orchestra.run.smithi037.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-08-31T06:33:44.413 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T06:33:44.415 INFO:teuthology.orchestra.run.smithi037.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-08-31T06:33:44.444 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T06:33:44.449 INFO:teuthology.orchestra.run.smithi037.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-08-31T06:33:44.474 INFO:teuthology.orchestra.run.smithi037.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-08-31T06:33:44.481 INFO:teuthology.orchestra.run.smithi106.stdout:(8/150): ceph-common-19.3.0-4560.gd19e6118.el9. 16 MB/s | 20 MB 00:01 2024-08-31T06:33:44.516 INFO:teuthology.orchestra.run.smithi037.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-08-31T06:33:44.522 INFO:teuthology.orchestra.run.smithi106.stdout:(9/150): ceph-selinux-19.3.0-4560.gd19e6118.el9 608 kB/s | 25 kB 00:00 2024-08-31T06:33:44.524 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T06:33:44.541 INFO:teuthology.orchestra.run.smithi037.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-08-31T06:33:44.583 INFO:teuthology.orchestra.run.smithi037.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-08-31T06:33:44.608 INFO:teuthology.orchestra.run.smithi037.stdout:(56/150): flexiblas-openblas-openmp-3.0.4-8.el9 197 kB/s | 18 kB 00:00 2024-08-31T06:33:44.676 INFO:teuthology.orchestra.run.smithi037.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-08-31T06:33:44.726 INFO:teuthology.orchestra.run.smithi037.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-08-31T06:33:44.743 INFO:teuthology.orchestra.run.smithi037.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 337 kB/s | 45 kB 00:00 2024-08-31T06:33:44.785 INFO:teuthology.orchestra.run.smithi037.stdout:(60/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-08-31T06:33:44.818 INFO:teuthology.orchestra.run.smithi037.stdout:(61/150): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-08-31T06:33:44.852 INFO:teuthology.orchestra.run.smithi037.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 4.5 MB/s | 581 kB 00:00 2024-08-31T06:33:44.869 INFO:teuthology.orchestra.run.smithi037.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-08-31T06:33:44.919 INFO:teuthology.orchestra.run.smithi037.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-08-31T06:33:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:(65/150): openblas-0.3.26-2.el9.x86_64.rpm 513 kB/s | 38 kB 00:00 2024-08-31T06:33:44.948 INFO:teuthology.orchestra.run.smithi106.stdout:(10/150): ceph-osd-19.3.0-4560.gd19e6118.el9.x8 17 MB/s | 18 MB 00:01 2024-08-31T06:33:44.970 INFO:teuthology.orchestra.run.smithi037.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-08-31T06:33:45.057 INFO:teuthology.orchestra.run.smithi106.stdout:(11/150): ceph-radosgw-19.3.0-4560.gd19e6118.el 12 MB/s | 10 MB 00:00 2024-08-31T06:33:45.082 INFO:teuthology.orchestra.run.smithi106.stdout:(12/150): cephfs-mirror-19.3.0-4560.gd19e6118.e 1.7 MB/s | 226 kB 00:00 2024-08-31T06:33:45.104 INFO:teuthology.orchestra.run.smithi037.stdout:(67/150): openblas-openmp-0.3.26-2.el9.x86_64.r 27 MB/s | 4.9 MB 00:00 2024-08-31T06:33:45.115 INFO:teuthology.orchestra.run.smithi106.stdout:(13/150): cephfs-shell-19.3.0-4560.gd19e6118.el 464 kB/s | 27 kB 00:00 2024-08-31T06:33:45.132 INFO:teuthology.orchestra.run.smithi106.stdout:(14/150): libcephfs-devel-19.3.0-4560.gd19e6118 631 kB/s | 32 kB 00:00 2024-08-31T06:33:45.145 INFO:teuthology.orchestra.run.smithi037.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 9.1 MB/s | 1.6 MB 00:00 2024-08-31T06:33:45.219 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T06:33:45.224 INFO:teuthology.orchestra.run.smithi106.stdout:(15/150): libcephsqlite-19.3.0-4560.gd19e6118.e 1.7 MB/s | 159 kB 00:00 2024-08-31T06:33:45.246 INFO:teuthology.orchestra.run.smithi037.stdout:(69/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-08-31T06:33:45.258 INFO:teuthology.orchestra.run.smithi106.stdout:(16/150): libcephfs2-19.3.0-4560.gd19e6118.el9. 5.3 MB/s | 766 kB 00:00 2024-08-31T06:33:45.271 INFO:teuthology.orchestra.run.smithi037.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 1.1 MB/s | 137 kB 00:00 2024-08-31T06:33:45.300 INFO:teuthology.orchestra.run.smithi106.stdout:(17/150): librados-devel-19.3.0-4560.gd19e6118. 1.6 MB/s | 127 kB 00:00 2024-08-31T06:33:45.304 INFO:teuthology.orchestra.run.smithi037.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-08-31T06:33:45.340 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T06:33:45.350 INFO:teuthology.orchestra.run.smithi106.stdout:(18/150): libradosstriper1-19.3.0-4560.gd19e611 5.4 MB/s | 506 kB 00:00 2024-08-31T06:33:45.380 INFO:teuthology.orchestra.run.smithi037.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-08-31T06:33:45.422 INFO:teuthology.orchestra.run.smithi037.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-08-31T06:33:45.442 INFO:teuthology.orchestra.run.smithi106.stdout:(19/150): python3-ceph-argparse-19.3.0-4560.gd1 493 kB/s | 45 kB 00:00 2024-08-31T06:33:45.489 INFO:teuthology.orchestra.run.smithi037.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 922 kB/s | 61 kB 00:00 2024-08-31T06:33:45.534 INFO:teuthology.orchestra.run.smithi106.stdout:(20/150): python3-ceph-common-19.3.0-4560.gd19e 1.5 MB/s | 141 kB 00:00 2024-08-31T06:33:45.572 INFO:teuthology.orchestra.run.smithi037.stdout:(75/150): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-08-31T06:33:45.634 INFO:teuthology.orchestra.run.smithi106.stdout:(21/150): python3-cephfs-19.3.0-4560.gd19e6118. 1.6 MB/s | 161 kB 00:00 2024-08-31T06:33:45.672 INFO:teuthology.orchestra.run.smithi037.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-08-31T06:33:45.735 INFO:teuthology.orchestra.run.smithi106.stdout:(22/150): python3-rados-19.3.0-4560.gd19e6118.e 3.1 MB/s | 321 kB 00:00 2024-08-31T06:33:45.835 INFO:teuthology.orchestra.run.smithi106.stdout:(23/150): python3-rbd-19.3.0-4560.gd19e6118.el9 3.0 MB/s | 305 kB 00:00 2024-08-31T06:33:45.910 INFO:teuthology.orchestra.run.smithi106.stdout:(24/150): librgw2-19.3.0-4560.gd19e6118.el9.x86 8.7 MB/s | 5.3 MB 00:00 2024-08-31T06:33:45.935 INFO:teuthology.orchestra.run.smithi106.stdout:(25/150): python3-rgw-19.3.0-4560.gd19e6118.el9 994 kB/s | 99 kB 00:00 2024-08-31T06:33:45.969 INFO:teuthology.orchestra.run.smithi106.stdout:(26/150): rbd-fuse-19.3.0-4560.gd19e6118.el9.x8 1.4 MB/s | 86 kB 00:00 2024-08-31T06:33:45.998 INFO:teuthology.orchestra.run.smithi037.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 79 kB/s | 26 kB 00:00 2024-08-31T06:33:46.053 INFO:teuthology.orchestra.run.smithi106.stdout:(27/150): rbd-nbd-19.3.0-4560.gd19e6118.el9.x86 2.0 MB/s | 170 kB 00:00 2024-08-31T06:33:46.081 INFO:teuthology.orchestra.run.smithi037.stdout:(78/150): postgresql-server-13.16-1.el9.x86_64. 6.9 MB/s | 5.8 MB 00:00 2024-08-31T06:33:46.107 INFO:teuthology.orchestra.run.smithi037.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-08-31T06:33:46.162 INFO:teuthology.orchestra.run.smithi106.stdout:(28/150): rbd-mirror-19.3.0-4560.gd19e6118.el9. 14 MB/s | 3.1 MB 00:00 2024-08-31T06:33:46.165 INFO:teuthology.orchestra.run.smithi037.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 598 kB/s | 35 kB 00:00 2024-08-31T06:33:46.187 INFO:teuthology.orchestra.run.smithi106.stdout:(29/150): ceph-grafana-dashboards-19.3.0-4560.g 256 kB/s | 34 kB 00:00 2024-08-31T06:33:46.190 INFO:teuthology.orchestra.run.smithi037.stdout:(81/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-08-31T06:33:46.229 INFO:teuthology.orchestra.run.smithi106.stdout:(30/150): ceph-mgr-cephadm-19.3.0-4560.gd19e611 2.3 MB/s | 154 kB 00:00 2024-08-31T06:33:46.274 INFO:teuthology.orchestra.run.smithi037.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-08-31T06:33:46.383 INFO:teuthology.orchestra.run.smithi037.stdout:(83/150): python3-babel-2.9.1-2.el9.noarch.rpm 5.9 MB/s | 6.0 MB 00:01 2024-08-31T06:33:46.466 INFO:teuthology.orchestra.run.smithi037.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-08-31T06:33:46.492 INFO:teuthology.orchestra.run.smithi037.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 713 kB/s | 77 kB 00:00 2024-08-31T06:33:46.542 INFO:teuthology.orchestra.run.smithi037.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 561 kB/s | 42 kB 00:00 2024-08-31T06:33:46.593 INFO:teuthology.orchestra.run.smithi037.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-08-31T06:33:46.643 INFO:teuthology.orchestra.run.smithi037.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-08-31T06:33:46.687 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T06:33:46.701 INFO:teuthology.orchestra.run.smithi037.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-08-31T06:33:46.727 INFO:teuthology.orchestra.run.smithi037.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 611 kB/s | 51 kB 00:00 2024-08-31T06:33:46.764 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T06:33:46.784 INFO:teuthology.orchestra.run.smithi037.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 653 kB/s | 54 kB 00:00 2024-08-31T06:33:46.792 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T06:33:46.796 INFO:teuthology.orchestra.run.smithi106.stdout:(31/150): ceph-mgr-diskprediction-local-19.3.0- 13 MB/s | 7.4 MB 00:00 2024-08-31T06:33:46.825 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T06:33:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-08-31T06:33:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 760 kB/s | 44 kB 00:00 2024-08-31T06:33:46.896 INFO:teuthology.orchestra.run.smithi106.stdout:(32/150): ceph-mgr-modules-core-19.3.0-4560.gd1 2.8 MB/s | 290 kB 00:00 2024-08-31T06:33:46.971 INFO:teuthology.orchestra.run.smithi106.stdout:(33/150): ceph-mgr-rook-19.3.0-4560.gd19e6118.e 658 kB/s | 49 kB 00:00 2024-08-31T06:33:46.977 INFO:teuthology.orchestra.run.smithi037.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-08-31T06:33:47.044 INFO:teuthology.orchestra.run.smithi037.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-08-31T06:33:47.046 INFO:teuthology.orchestra.run.smithi106.stdout:(34/150): ceph-prometheus-alerts-19.3.0-4560.gd 219 kB/s | 16 kB 00:00 2024-08-31T06:33:47.102 INFO:teuthology.orchestra.run.smithi037.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 812 kB/s | 47 kB 00:00 2024-08-31T06:33:47.147 INFO:teuthology.orchestra.run.smithi106.stdout:(35/150): ceph-volume-19.3.0-4560.gd19e6118.el9 2.8 MB/s | 285 kB 00:00 2024-08-31T06:33:47.169 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T06:33:47.195 INFO:teuthology.orchestra.run.smithi037.stdout:(97/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.0 MB/s | 5.1 MB 00:01 2024-08-31T06:33:47.213 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T06:33:47.247 INFO:teuthology.orchestra.run.smithi106.stdout:(36/150): cephadm-19.3.0-4560.gd19e6118.el9.noa 7.6 MB/s | 781 kB 00:00 2024-08-31T06:33:47.262 INFO:teuthology.orchestra.run.smithi037.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-08-31T06:33:47.287 INFO:teuthology.orchestra.run.smithi037.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 629 kB/s | 58 kB 00:00 2024-08-31T06:33:47.314 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T06:33:47.339 INFO:teuthology.orchestra.run.smithi106.stdout:(37/150): cephfs-top-19.3.0-4560.gd19e6118.el9. 199 kB/s | 18 kB 00:00 2024-08-31T06:33:47.343 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T06:33:47.363 INFO:teuthology.orchestra.run.smithi037.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 849 kB/s | 64 kB 00:00 2024-08-31T06:33:47.388 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T06:33:47.472 INFO:teuthology.orchestra.run.smithi037.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 458 kB/s | 96 kB 00:00 2024-08-31T06:33:47.498 INFO:teuthology.orchestra.run.smithi106.stdout:(38/150): ceph-mgr-dashboard-19.3.0-4560.gd19e6 11 MB/s | 14 MB 00:01 2024-08-31T06:33:47.522 INFO:teuthology.orchestra.run.smithi037.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 282 kB/s | 45 kB 00:00 2024-08-31T06:33:47.547 INFO:teuthology.orchestra.run.smithi037.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 296 kB/s | 22 kB 00:00 2024-08-31T06:33:47.606 INFO:teuthology.orchestra.run.smithi037.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-31T06:33:47.647 INFO:teuthology.orchestra.run.smithi037.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 7.3 MB/s | 309 kB 00:00 2024-08-31T06:33:47.673 INFO:teuthology.orchestra.run.smithi037.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-08-31T06:33:47.723 INFO:teuthology.orchestra.run.smithi037.stdout:(107/150): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-08-31T06:33:47.773 INFO:teuthology.orchestra.run.smithi037.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-08-31T06:33:47.799 INFO:teuthology.orchestra.run.smithi037.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-31T06:33:47.824 INFO:teuthology.orchestra.run.smithi037.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-31T06:33:47.849 INFO:teuthology.orchestra.run.smithi037.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-31T06:33:47.890 INFO:teuthology.orchestra.run.smithi106.stdout:(39/150): ceph-test-19.3.0-4560.gd19e6118.el9.x 13 MB/s | 44 MB 00:03 2024-08-31T06:33:47.913 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T06:33:47.915 INFO:teuthology.orchestra.run.smithi106.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 139 kB/s | 80 kB 00:00 2024-08-31T06:33:47.925 INFO:teuthology.orchestra.run.smithi037.stdout:(112/150): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-08-31T06:33:47.949 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T06:33:47.950 INFO:teuthology.orchestra.run.smithi037.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-08-31T06:33:47.975 INFO:teuthology.orchestra.run.smithi037.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T06:33:48.001 INFO:teuthology.orchestra.run.smithi037.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T06:33:48.021 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T06:33:48.026 INFO:teuthology.orchestra.run.smithi037.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 569 kB/s | 14 kB 00:00 2024-08-31T06:33:48.051 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T06:33:48.051 INFO:teuthology.orchestra.run.smithi037.stdout:(117/150): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-08-31T06:33:48.076 INFO:teuthology.orchestra.run.smithi037.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-31T06:33:48.110 INFO:teuthology.orchestra.run.smithi037.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-31T06:33:48.135 INFO:teuthology.orchestra.run.smithi037.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-31T06:33:48.160 INFO:teuthology.orchestra.run.smithi037.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-31T06:33:48.174 INFO:teuthology.orchestra.run.smithi106.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 981 kB/s | 253 kB 00:00 2024-08-31T06:33:48.186 INFO:teuthology.orchestra.run.smithi037.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-08-31T06:33:48.199 INFO:teuthology.orchestra.run.smithi106.stdout:(42/150): libquadmath-11.5.0-2.el9.x86_64.rpm 619 kB/s | 191 kB 00:00 2024-08-31T06:33:48.203 INFO:teuthology.orchestra.run.smithi037.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-08-31T06:33:48.220 INFO:teuthology.orchestra.run.smithi037.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-08-31T06:33:48.237 INFO:teuthology.orchestra.run.smithi037.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-08-31T06:33:48.241 INFO:teuthology.orchestra.run.smithi106.stdout:(43/150): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-08-31T06:33:48.254 INFO:teuthology.orchestra.run.smithi037.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-08-31T06:33:48.266 INFO:teuthology.orchestra.run.smithi106.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-31T06:33:48.271 INFO:teuthology.orchestra.run.smithi037.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-08-31T06:33:48.292 INFO:teuthology.orchestra.run.smithi106.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-31T06:33:48.325 INFO:teuthology.orchestra.run.smithi106.stdout:(46/150): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-08-31T06:33:48.351 INFO:teuthology.orchestra.run.smithi106.stdout:(47/150): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-08-31T06:33:48.376 INFO:teuthology.orchestra.run.smithi106.stdout:(48/150): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-08-31T06:33:48.440 INFO:teuthology.orchestra.run.smithi037.stdout:(128/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.5 MB/s | 16 MB 00:01 2024-08-31T06:33:48.476 INFO:teuthology.orchestra.run.smithi106.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-08-31T06:33:48.482 INFO:teuthology.orchestra.run.smithi037.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-08-31T06:33:48.502 INFO:teuthology.orchestra.run.smithi106.stdout:(50/150): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-08-31T06:33:48.515 INFO:teuthology.orchestra.run.smithi037.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-31T06:33:48.527 INFO:teuthology.orchestra.run.smithi106.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-08-31T06:33:48.541 INFO:teuthology.orchestra.run.smithi037.stdout:(131/150): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-08-31T06:33:48.566 INFO:teuthology.orchestra.run.smithi037.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-08-31T06:33:48.569 INFO:teuthology.orchestra.run.smithi106.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 787 kB/s | 33 kB 00:00 2024-08-31T06:33:48.594 INFO:teuthology.orchestra.run.smithi106.stdout:(53/150): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-08-31T06:33:48.608 INFO:teuthology.orchestra.run.smithi037.stdout:(133/150): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-08-31T06:33:48.627 INFO:teuthology.orchestra.run.smithi106.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-08-31T06:33:48.633 INFO:teuthology.orchestra.run.smithi037.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-08-31T06:33:48.653 INFO:teuthology.orchestra.run.smithi106.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-08-31T06:33:48.658 INFO:teuthology.orchestra.run.smithi037.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-08-31T06:33:48.678 INFO:teuthology.orchestra.run.smithi106.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-31T06:33:48.684 INFO:teuthology.orchestra.run.smithi037.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-08-31T06:33:48.709 INFO:teuthology.orchestra.run.smithi037.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-08-31T06:33:48.720 INFO:teuthology.orchestra.run.smithi106.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-08-31T06:33:48.734 INFO:teuthology.orchestra.run.smithi037.stdout:(138/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-08-31T06:33:48.745 INFO:teuthology.orchestra.run.smithi106.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-08-31T06:33:48.759 INFO:teuthology.orchestra.run.smithi037.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-31T06:33:48.785 INFO:teuthology.orchestra.run.smithi037.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-08-31T06:33:48.818 INFO:teuthology.orchestra.run.smithi037.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-08-31T06:33:48.829 INFO:teuthology.orchestra.run.smithi106.stdout:(59/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-08-31T06:33:48.844 INFO:teuthology.orchestra.run.smithi037.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 888 kB/s | 74 kB 00:00 2024-08-31T06:33:48.869 INFO:teuthology.orchestra.run.smithi037.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-31T06:33:48.871 INFO:teuthology.orchestra.run.smithi106.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-08-31T06:33:48.894 INFO:teuthology.orchestra.run.smithi037.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-31T06:33:48.896 INFO:teuthology.orchestra.run.smithi106.stdout:(61/150): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-08-31T06:33:48.919 INFO:teuthology.orchestra.run.smithi037.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-08-31T06:33:48.922 INFO:teuthology.orchestra.run.smithi106.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-08-31T06:33:48.945 INFO:teuthology.orchestra.run.smithi037.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T06:33:48.955 INFO:teuthology.orchestra.run.smithi106.stdout:(63/150): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-08-31T06:33:48.970 INFO:teuthology.orchestra.run.smithi037.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-31T06:33:48.980 INFO:teuthology.orchestra.run.smithi106.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-08-31T06:33:49.006 INFO:teuthology.orchestra.run.smithi106.stdout:(65/150): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-08-31T06:33:49.020 INFO:teuthology.orchestra.run.smithi037.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-31T06:33:49.031 INFO:teuthology.orchestra.run.smithi106.stdout:(66/150): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-08-31T06:33:49.140 INFO:teuthology.orchestra.run.smithi106.stdout:(67/150): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-08-31T06:33:49.215 INFO:teuthology.orchestra.run.smithi106.stdout:(68/150): openssl-devel-3.2.2-4.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-08-31T06:33:49.257 INFO:teuthology.orchestra.run.smithi106.stdout:(69/150): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-08-31T06:33:49.282 INFO:teuthology.orchestra.run.smithi106.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-08-31T06:33:49.349 INFO:teuthology.orchestra.run.smithi106.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-08-31T06:33:49.400 INFO:teuthology.orchestra.run.smithi106.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-08-31T06:33:49.441 INFO:teuthology.orchestra.run.smithi106.stdout:(73/150): postgresql-13.16-1.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-08-31T06:33:49.487 INFO:teuthology.orchestra.run.smithi037.stdout:(149/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 6.1 MB/s | 3.1 MB 00:00 2024-08-31T06:33:49.517 INFO:teuthology.orchestra.run.smithi106.stdout:(74/150): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-08-31T06:33:49.542 INFO:teuthology.orchestra.run.smithi106.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 611 kB/s | 61 kB 00:00 2024-08-31T06:33:49.554 INFO:teuthology.orchestra.run.smithi037.stdout:(150/150): librados2-19.3.0-4560.gd19e6118.el9. 5.6 MB/s | 3.4 MB 00:00 2024-08-31T06:33:49.559 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-08-31T06:33:49.559 INFO:teuthology.orchestra.run.smithi037.stdout:Total 22 MB/s | 224 MB 00:10 2024-08-31T06:33:49.567 INFO:teuthology.orchestra.run.smithi106.stdout:(76/150): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-08-31T06:33:49.609 INFO:teuthology.orchestra.run.smithi106.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 616 kB/s | 26 kB 00:00 2024-08-31T06:33:49.693 INFO:teuthology.orchestra.run.smithi106.stdout:(78/150): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-08-31T06:33:49.718 INFO:teuthology.orchestra.run.smithi106.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-08-31T06:33:49.752 INFO:teuthology.orchestra.run.smithi106.stdout:(80/150): python3-jinja2-2.11.3-6.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-08-31T06:33:49.777 INFO:teuthology.orchestra.run.smithi106.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-08-31T06:33:49.802 INFO:teuthology.orchestra.run.smithi106.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-08-31T06:33:49.828 INFO:teuthology.orchestra.run.smithi106.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-08-31T06:33:49.870 INFO:teuthology.orchestra.run.smithi106.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-08-31T06:33:49.895 INFO:teuthology.orchestra.run.smithi106.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-08-31T06:33:49.912 INFO:teuthology.orchestra.run.smithi106.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-31T06:33:49.937 INFO:teuthology.orchestra.run.smithi106.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-08-31T06:33:49.971 INFO:teuthology.orchestra.run.smithi106.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-08-31T06:33:50.013 INFO:teuthology.orchestra.run.smithi106.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-08-31T06:33:50.038 INFO:teuthology.orchestra.run.smithi106.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-08-31T06:33:50.063 INFO:teuthology.orchestra.run.smithi106.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-31T06:33:50.138 INFO:teuthology.orchestra.run.smithi106.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-08-31T06:33:50.164 INFO:teuthology.orchestra.run.smithi106.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 414 kB/s | 42 kB 00:00 2024-08-31T06:33:50.189 INFO:teuthology.orchestra.run.smithi106.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-08-31T06:33:50.215 INFO:teuthology.orchestra.run.smithi106.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-31T06:33:50.241 INFO:teuthology.orchestra.run.smithi106.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 697 kB/s | 36 kB 00:00 2024-08-31T06:33:50.266 INFO:teuthology.orchestra.run.smithi106.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 917 kB/s | 47 kB 00:00 2024-08-31T06:33:50.292 INFO:teuthology.orchestra.run.smithi106.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-31T06:33:50.317 INFO:teuthology.orchestra.run.smithi106.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-31T06:33:50.342 INFO:teuthology.orchestra.run.smithi106.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-31T06:33:50.368 INFO:teuthology.orchestra.run.smithi106.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-31T06:33:50.393 INFO:teuthology.orchestra.run.smithi106.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-08-31T06:33:50.446 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:33:50.480 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:33:50.493 INFO:teuthology.orchestra.run.smithi106.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-08-31T06:33:50.677 INFO:teuthology.orchestra.run.smithi106.stdout:(104/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-08-31T06:33:50.682 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-08-31T06:33:50.721 INFO:teuthology.orchestra.run.smithi106.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 2.4 MB/s | 548 kB 00:00 2024-08-31T06:33:50.746 INFO:teuthology.orchestra.run.smithi106.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 846 kB/s | 19 kB 00:00 2024-08-31T06:33:50.780 INFO:teuthology.orchestra.run.smithi106.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.0 MB/s | 309 kB 00:00 2024-08-31T06:33:50.805 INFO:teuthology.orchestra.run.smithi106.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-08-31T06:33:50.821 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-08-31T06:33:50.821 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-08-31T06:33:50.830 INFO:teuthology.orchestra.run.smithi106.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-08-31T06:33:50.855 INFO:teuthology.orchestra.run.smithi106.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-08-31T06:33:50.872 INFO:teuthology.orchestra.run.smithi106.stdout:(111/150): liboath-2.6.7-2.el9.x86_64.rpm 723 kB/s | 49 kB 00:00 2024-08-31T06:33:50.906 INFO:teuthology.orchestra.run.smithi106.stdout:(112/150): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-08-31T06:33:50.948 INFO:teuthology.orchestra.run.smithi106.stdout:(113/150): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-08-31T06:33:50.973 INFO:teuthology.orchestra.run.smithi106.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-31T06:33:50.998 INFO:teuthology.orchestra.run.smithi106.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-31T06:33:51.024 INFO:teuthology.orchestra.run.smithi106.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-08-31T06:33:51.066 INFO:teuthology.orchestra.run.smithi106.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-08-31T06:33:51.080 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:33:51.091 INFO:teuthology.orchestra.run.smithi106.stdout:(118/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-08-31T06:33:51.124 INFO:teuthology.orchestra.run.smithi106.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-31T06:33:51.125 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T06:33:51.150 INFO:teuthology.orchestra.run.smithi106.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-31T06:33:51.175 INFO:teuthology.orchestra.run.smithi106.stdout:(121/150): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-31T06:33:51.219 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T06:33:51.220 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T06:33:51.220 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T06:33:51.220 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:33:51.233 INFO:teuthology.orchestra.run.smithi106.stdout:(122/150): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-08-31T06:33:51.251 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T06:33:51.259 INFO:teuthology.orchestra.run.smithi106.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-08-31T06:33:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-08-31T06:33:51.310 INFO:teuthology.orchestra.run.smithi106.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-31T06:33:51.335 INFO:teuthology.orchestra.run.smithi106.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-08-31T06:33:51.360 INFO:teuthology.orchestra.run.smithi106.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 389 kB/s | 19 kB 00:00 2024-08-31T06:33:51.385 INFO:teuthology.orchestra.run.smithi106.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-31T06:33:51.410 INFO:teuthology.orchestra.run.smithi106.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-31T06:33:51.444 INFO:teuthology.orchestra.run.smithi106.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-08-31T06:33:51.469 INFO:teuthology.orchestra.run.smithi106.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-31T06:33:51.503 INFO:teuthology.orchestra.run.smithi106.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-08-31T06:33:51.528 INFO:teuthology.orchestra.run.smithi106.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-08-31T06:33:51.554 INFO:teuthology.orchestra.run.smithi106.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-08-31T06:33:51.579 INFO:teuthology.orchestra.run.smithi106.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-08-31T06:33:51.604 INFO:teuthology.orchestra.run.smithi106.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 559 kB/s | 28 kB 00:00 2024-08-31T06:33:51.630 INFO:teuthology.orchestra.run.smithi106.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-08-31T06:33:51.655 INFO:teuthology.orchestra.run.smithi106.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-31T06:33:51.705 INFO:teuthology.orchestra.run.smithi106.stdout:(139/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.7 MB/s | 2.0 MB 00:00 2024-08-31T06:33:51.730 INFO:teuthology.orchestra.run.smithi106.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-08-31T06:33:51.756 INFO:teuthology.orchestra.run.smithi106.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-08-31T06:33:51.781 INFO:teuthology.orchestra.run.smithi106.stdout:(142/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-31T06:33:51.806 INFO:teuthology.orchestra.run.smithi106.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-31T06:33:51.832 INFO:teuthology.orchestra.run.smithi106.stdout:(144/150): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-31T06:33:51.857 INFO:teuthology.orchestra.run.smithi106.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-08-31T06:33:51.882 INFO:teuthology.orchestra.run.smithi106.stdout:(146/150): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-08-31T06:33:51.932 INFO:teuthology.orchestra.run.smithi106.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-08-31T06:33:51.982 INFO:teuthology.orchestra.run.smithi106.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-08-31T06:33:52.125 INFO:teuthology.orchestra.run.smithi106.stdout:(149/150): librados2-19.3.0-4560.gd19e6118.el9. 14 MB/s | 3.4 MB 00:00 2024-08-31T06:33:52.341 INFO:teuthology.orchestra.run.smithi106.stdout:(150/150): librbd1-19.3.0-4560.gd19e6118.el9.x8 7.7 MB/s | 3.1 MB 00:00 2024-08-31T06:33:52.346 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2024-08-31T06:33:52.347 INFO:teuthology.orchestra.run.smithi106.stdout:Total 24 MB/s | 224 MB 00:09 2024-08-31T06:33:52.677 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-08-31T06:33:52.678 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-08-31T06:33:53.406 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2024-08-31T06:33:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2024-08-31T06:33:53.533 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2024-08-31T06:33:55.354 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2024-08-31T06:33:55.355 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2024-08-31T06:33:58.836 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-08-31T06:33:58.924 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T06:33:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T06:33:59.001 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T06:33:59.382 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T06:33:59.499 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T06:33:59.612 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T06:33:59.642 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:33:59.718 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:33:59.760 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T06:33:59.788 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T06:33:59.805 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T06:33:59.960 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T06:34:00.020 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T06:34:00.056 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:34:00.164 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:34:00.190 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T06:34:00.253 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T06:34:00.274 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T06:34:00.299 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T06:34:00.593 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T06:34:00.624 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T06:34:00.735 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T06:34:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T06:34:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T06:34:00.875 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T06:34:00.926 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T06:34:00.966 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T06:34:01.017 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T06:34:01.058 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T06:34:01.094 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T06:34:01.166 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T06:34:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2024-08-31T06:34:01.218 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T06:34:01.255 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T06:34:01.291 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T06:34:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-31T06:34:01.328 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-31T06:34:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-31T06:34:01.371 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T06:34:01.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T06:34:01.445 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T06:34:01.473 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T06:34:01.548 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T06:34:01.596 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T06:34:01.675 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T06:34:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-31T06:34:01.823 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T06:34:01.837 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T06:34:01.884 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T06:34:01.963 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 5/152 2024-08-31T06:34:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:34:02.096 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:34:02.140 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T06:34:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-31T06:34:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-31T06:34:02.348 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-31T06:34:02.398 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-31T06:34:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:34:02.456 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T06:34:02.540 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:34:02.549 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T06:34:02.577 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T06:34:02.590 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T06:34:02.633 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T06:34:02.639 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 13/152 2024-08-31T06:34:02.671 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T06:34:02.687 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T06:34:02.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T06:34:02.713 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-31T06:34:02.801 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T06:34:02.862 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T06:34:02.944 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T06:34:02.981 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T06:34:03.025 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T06:34:03.026 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T06:34:03.053 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-31T06:34:03.082 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T06:34:03.117 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T06:34:03.161 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T06:34:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/152 2024-08-31T06:34:03.201 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-31T06:34:03.203 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2024-08-31T06:34:03.215 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:03.236 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-31T06:34:03.310 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-31T06:34:03.347 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T06:34:03.372 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-31T06:34:03.386 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T06:34:03.406 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T06:34:03.410 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-31T06:34:03.424 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T06:34:03.424 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:03.424 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T06:34:03.424 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:03.428 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T06:34:03.454 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-31T06:34:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-31T06:34:03.531 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-31T06:34:03.536 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T06:34:03.578 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T06:34:03.610 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-31T06:34:03.618 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T06:34:03.643 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T06:34:03.663 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-31T06:34:03.668 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T06:34:03.692 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-31T06:34:03.736 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-31T06:34:03.747 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T06:34:03.814 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-31T06:34:03.847 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 30/152 2024-08-31T06:34:03.877 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T06:34:03.890 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 31/152 2024-08-31T06:34:03.908 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T06:34:03.919 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 32/152 2024-08-31T06:34:03.937 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T06:34:03.971 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T06:34:04.000 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-31T06:34:04.023 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T06:34:04.051 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-31T06:34:04.070 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T06:34:04.109 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T06:34:04.127 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-31T06:34:04.139 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T06:34:04.173 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T06:34:04.206 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T06:34:04.248 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T06:34:04.263 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-31T06:34:04.282 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T06:34:04.321 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-31T06:34:04.374 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T06:34:04.430 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T06:34:04.469 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T06:34:04.579 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T06:34:04.639 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T06:34:04.861 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-31T06:34:04.943 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-31T06:34:04.978 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-31T06:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-31T06:34:05.059 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 42/152 2024-08-31T06:34:05.084 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T06:34:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-31T06:34:05.112 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T06:34:05.112 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:05.112 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T06:34:05.113 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T06:34:05.113 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T06:34:05.113 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:05.194 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-31T06:34:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-31T06:34:05.339 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-31T06:34:05.351 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T06:34:05.376 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T06:34:05.376 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:05.377 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T06:34:05.377 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T06:34:05.377 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T06:34:05.377 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:05.378 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 47/152 2024-08-31T06:34:05.414 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-31T06:34:05.429 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T06:34:05.461 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-31T06:34:05.492 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T06:34:05.496 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-31T06:34:05.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T06:34:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-31T06:34:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-31T06:34:05.648 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T06:34:05.698 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T06:34:05.737 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-31T06:34:05.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T06:34:05.800 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-31T06:34:05.834 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T06:34:05.841 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-31T06:34:05.860 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T06:34:05.877 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T06:34:05.885 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T06:34:05.885 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:05.885 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T06:34:05.885 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T06:34:05.885 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T06:34:05.886 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-31T06:34:05.982 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 57/152 2024-08-31T06:34:06.007 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T06:34:06.023 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-31T06:34:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-31T06:34:06.065 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T06:34:06.068 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T06:34:06.073 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-31T06:34:06.100 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T06:34:06.128 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T06:34:06.157 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-31T06:34:06.179 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T06:34:06.293 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-31T06:34:06.321 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T06:34:06.347 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-31T06:34:06.369 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T06:34:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-31T06:34:06.409 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-31T06:34:06.449 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T06:34:06.538 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T06:34:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-31T06:34:06.592 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-31T06:34:06.632 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-31T06:34:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-31T06:34:06.680 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T06:34:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-31T06:34:06.728 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T06:34:06.762 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-31T06:34:06.767 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T06:34:06.795 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T06:34:06.804 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-31T06:34:06.838 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-31T06:34:06.887 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T06:34:06.927 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-31T06:34:06.977 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-31T06:34:07.004 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T06:34:07.008 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-31T06:34:07.113 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-31T06:34:07.177 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-31T06:34:07.269 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T06:34:07.302 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T06:34:07.334 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T06:34:07.404 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T06:34:07.441 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T06:34:07.925 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-31T06:34:07.977 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-31T06:34:08.015 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-31T06:34:08.116 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-31T06:34:08.170 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 83/152 2024-08-31T06:34:08.224 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-31T06:34:08.312 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-31T06:34:08.339 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T06:34:08.359 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-31T06:34:08.436 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T06:34:08.474 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T06:34:08.506 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T06:34:08.542 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.26-2.el9.x86_64 87/152 2024-08-31T06:34:08.573 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 88/152 2024-08-31T06:34:08.650 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-31T06:34:08.851 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T06:34:08.894 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T06:34:08.986 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T06:34:09.015 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T06:34:09.060 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T06:34:09.308 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-31T06:34:09.432 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-31T06:34:09.593 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T06:34:09.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T06:34:09.718 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T06:34:09.748 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T06:34:10.683 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-31T06:34:10.794 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T06:34:10.796 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T06:34:10.822 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-31T06:34:10.855 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 95/152 2024-08-31T06:34:10.855 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T06:34:11.184 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-31T06:34:11.376 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T06:34:11.467 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 97/152 2024-08-31T06:34:11.505 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 98/152 2024-08-31T06:34:11.541 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-31T06:34:11.868 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T06:34:11.897 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T06:34:12.018 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T06:34:12.126 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:34:12.161 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:34:12.189 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T06:34:12.216 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T06:34:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T06:34:12.242 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:12.242 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T06:34:12.242 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T06:34:12.242 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T06:34:12.242 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:12.267 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-31T06:34:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T06:34:12.295 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T06:34:12.304 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T06:34:12.366 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 101/152 2024-08-31T06:34:12.397 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 102/152 2024-08-31T06:34:12.415 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T06:34:12.466 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T06:34:12.764 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:34:12.805 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T06:34:12.894 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T06:34:12.895 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T06:34:12.895 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T06:34:12.895 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:12.923 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T06:34:13.486 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T06:34:13.519 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T06:34:13.545 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T06:34:13.546 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:13.546 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T06:34:13.546 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T06:34:13.546 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T06:34:13.546 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:13.586 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T06:34:13.611 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T06:34:13.611 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:13.612 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T06:34:13.612 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:13.662 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T06:34:13.687 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T06:34:13.687 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:13.687 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T06:34:13.687 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T06:34:13.687 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T06:34:13.687 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:14.038 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T06:34:14.062 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T06:34:14.063 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:14.063 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T06:34:14.063 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T06:34:14.063 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T06:34:14.063 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:14.634 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:34:14.668 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:34:15.236 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 103/152 2024-08-31T06:34:15.271 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T06:34:15.366 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 104/152 2024-08-31T06:34:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-31T06:34:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-31T06:34:15.366 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:15.397 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T06:34:18.667 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T06:34:18.709 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T06:34:18.749 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T06:34:18.780 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T06:34:18.808 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T06:34:19.010 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T06:34:19.062 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T06:34:19.091 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T06:34:19.719 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:19.756 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:19.778 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:20.685 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T06:34:20.777 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T06:34:20.827 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T06:34:20.920 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T06:34:20.956 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T06:34:20.956 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T06:34:21.039 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T06:34:21.040 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:25.159 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T06:34:25.159 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-08-31T06:34:25.159 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-08-31T06:34:25.159 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-08-31T06:34:25.159 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-08-31T06:34:25.160 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-08-31T06:34:25.160 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-08-31T06:34:25.160 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-08-31T06:34:25.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:25.344 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T06:34:25.361 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T06:34:25.361 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:25.361 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T06:34:25.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:27.005 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T06:34:27.032 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T06:34:27.033 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:27.033 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T06:34:27.033 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T06:34:27.033 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T06:34:27.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 105/152 2024-08-31T06:34:27.100 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2024-08-31T06:34:27.100 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2024-08-31T06:34:27.100 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2024-08-31T06:34:27.100 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2024-08-31T06:34:27.100 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2024-08-31T06:34:27.100 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /root 2024-08-31T06:34:27.101 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2024-08-31T06:34:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T06:34:27.281 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T06:34:27.293 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 106/152 2024-08-31T06:34:27.293 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:27.293 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-31T06:34:27.293 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:27.305 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T06:34:27.305 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:27.305 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T06:34:27.305 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T06:34:27.306 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T06:34:27.306 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:27.541 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:27.541 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T06:34:27.541 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T06:34:27.541 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T06:34:27.541 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T06:34:27.541 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T06:34:27.541 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T06:34:27.542 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T06:34:27.543 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T06:34:27.544 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T06:34:27.544 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T06:34:27.544 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T06:34:27.544 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T06:34:27.556 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T06:34:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T06:34:27.558 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T06:34:27.559 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T06:34:27.560 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T06:34:27.560 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T06:34:27.560 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T06:34:27.560 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T06:34:27.560 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T06:34:27.560 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T06:34:27.561 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T06:34:27.562 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T06:34:27.563 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T06:34:27.564 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T06:34:27.565 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T06:34:27.566 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T06:34:27.566 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T06:34:27.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T06:34:27.823 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T06:34:27.823 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:27.823 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T06:34:27.823 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T06:34:27.823 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T06:34:27.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:27.938 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T06:34:27.997 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T06:34:28.060 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T06:34:28.262 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T06:34:28.308 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T06:34:28.390 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T06:34:28.479 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T06:34:28.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T06:34:28.667 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T06:34:28.699 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T06:34:28.726 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T06:34:28.879 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T06:34:28.906 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 107/152 2024-08-31T06:34:28.906 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:28.906 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-31T06:34:28.906 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T06:34:28.907 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-31T06:34:28.907 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:29.131 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T06:34:29.140 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T06:34:29.160 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T06:34:29.163 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 108/152 2024-08-31T06:34:29.163 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:29.164 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-31T06:34:29.164 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T06:34:29.164 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-31T06:34:29.164 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:29.191 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T06:34:29.259 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T06:34:29.289 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T06:34:29.633 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T06:34:29.655 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 109/152 2024-08-31T06:34:29.656 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:29.656 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-31T06:34:29.656 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T06:34:29.656 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-31T06:34:29.656 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:29.730 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:29.730 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:29.730 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.731 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.732 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T06:34:29.733 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.734 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T06:34:29.735 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T06:34:29.736 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T06:34:29.736 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T06:34:29.736 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T06:34:29.736 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T06:34:29.736 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T06:34:29.736 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T06:34:29.736 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T06:34:29.736 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T06:34:29.737 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T06:34:29.738 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.738 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.738 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.738 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T06:34:29.738 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T06:34:29.738 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T06:34:29.739 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T06:34:29.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T06:34:29.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T06:34:29.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T06:34:29.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T06:34:29.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T06:34:29.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T06:34:29.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T06:34:29.740 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T06:34:29.741 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T06:34:29.742 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T06:34:29.742 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T06:34:29.742 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T06:34:29.742 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.742 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.742 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T06:34:29.742 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T06:34:29.743 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T06:34:29.744 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T06:34:29.745 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T06:34:29.745 INFO:teuthology.orchestra.run.smithi066.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T06:34:29.745 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T06:34:29.745 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T06:34:29.745 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T06:34:29.746 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:34:29.746 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-08-31T06:34:29.763 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-31T06:34:29.819 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-31T06:34:29.883 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-31T06:34:30.067 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-31T06:34:30.076 DEBUG:teuthology.parallel:result is None 2024-08-31T06:34:30.108 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-31T06:34:30.186 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-31T06:34:30.283 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-31T06:34:30.425 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-31T06:34:30.469 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-31T06:34:30.501 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-31T06:34:30.528 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-31T06:34:30.950 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T06:34:30.976 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 121/152 2024-08-31T06:34:31.025 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 122/152 2024-08-31T06:34:31.092 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 123/152 2024-08-31T06:34:31.116 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T06:34:32.667 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T06:34:32.730 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T06:34:33.746 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T06:34:33.780 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T06:34:33.900 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T06:34:34.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T06:34:34.098 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T06:34:34.123 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T06:34:34.123 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:34.123 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T06:34:34.123 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T06:34:34.123 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T06:34:34.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:34.174 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T06:34:34.186 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T06:34:34.289 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T06:34:34.303 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 124/152 2024-08-31T06:34:34.340 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T06:34:34.363 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T06:34:35.317 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 125/152 2024-08-31T06:34:35.339 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T06:34:35.363 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T06:34:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T06:34:35.425 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T06:34:35.425 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:35.425 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T06:34:35.425 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T06:34:35.426 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T06:34:35.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:35.454 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 126/152 2024-08-31T06:34:35.469 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T06:34:35.492 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T06:34:35.492 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:35.492 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T06:34:35.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:35.544 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T06:34:35.568 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T06:34:35.568 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:35.568 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T06:34:35.568 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T06:34:35.568 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T06:34:35.568 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:35.630 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 127/152 2024-08-31T06:34:35.666 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T06:34:35.689 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 128/152 2024-08-31T06:34:35.690 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:35.690 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-31T06:34:35.690 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T06:34:35.690 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-31T06:34:35.690 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:35.742 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T06:34:35.753 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 129/152 2024-08-31T06:34:35.852 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 130/152 2024-08-31T06:34:35.904 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T06:34:35.906 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 131/152 2024-08-31T06:34:35.927 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T06:34:35.927 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:35.927 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T06:34:35.927 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T06:34:35.927 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T06:34:35.927 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:36.858 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-31T06:34:36.894 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T06:34:36.917 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 133/152 2024-08-31T06:34:36.917 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:36.917 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-31T06:34:36.917 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T06:34:36.917 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-31T06:34:36.917 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:36.961 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T06:34:36.983 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 134/152 2024-08-31T06:34:36.983 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:36.983 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-31T06:34:36.983 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:37.037 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T06:34:37.060 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 135/152 2024-08-31T06:34:37.060 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:37.060 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-31T06:34:37.060 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T06:34:37.060 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-31T06:34:37.060 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:37.379 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T06:34:37.402 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 136/152 2024-08-31T06:34:37.402 INFO:teuthology.orchestra.run.smithi106.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-31T06:34:37.402 INFO:teuthology.orchestra.run.smithi106.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-31T06:34:37.402 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T06:34:37.402 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-31T06:34:37.402 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:40.533 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T06:34:40.574 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T06:34:40.615 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T06:34:40.646 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T06:34:40.674 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T06:34:40.870 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T06:34:40.919 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T06:34:40.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T06:34:41.582 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:41.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:41.642 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 137/152 2024-08-31T06:34:41.808 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 138/152 2024-08-31T06:34:41.849 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 139/152 2024-08-31T06:34:41.881 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-31T06:34:41.907 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-31T06:34:42.097 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 142/152 2024-08-31T06:34:42.145 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-31T06:34:42.183 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 144/152 2024-08-31T06:34:42.543 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T06:34:42.634 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T06:34:42.676 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T06:34:42.768 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T06:34:42.805 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T06:34:42.805 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T06:34:42.812 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:42.856 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:42.876 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-31T06:34:42.897 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T06:34:42.897 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:43.705 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 146/152 2024-08-31T06:34:43.785 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openssl-devel-1:3.2.2-4.el9.x86_64 147/152 2024-08-31T06:34:43.826 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-31T06:34:43.906 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-31T06:34:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-31T06:34:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T06:34:44.039 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-31T06:34:44.040 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:49.718 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:49.718 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T06:34:49.718 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T06:34:49.718 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T06:34:49.718 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T06:34:49.718 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T06:34:49.719 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T06:34:49.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T06:34:49.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T06:34:49.722 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T06:34:49.723 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T06:34:49.724 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T06:34:49.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T06:34:49.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T06:34:49.727 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T06:34:49.727 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T06:34:49.727 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T06:34:49.727 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T06:34:49.727 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T06:34:49.728 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T06:34:49.729 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T06:34:49.730 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T06:34:49.731 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T06:34:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 1/152 2024-08-31T06:34:50.743 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 3/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 4/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4560.gd19e6 5/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 6/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 7/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 8/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 9/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 10/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 11/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 12/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 13/152 2024-08-31T06:34:50.744 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 14/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_ 15/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 16/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 17/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_6 18/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86 19/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 20/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el 21/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:19.3.0-4560.gd19e6118.el9. 22/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_6 23/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 24/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 25/152 2024-08-31T06:34:50.745 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 26/152 2024-08-31T06:34:50.746 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 27/152 2024-08-31T06:34:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 28/152 2024-08-31T06:34:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 29/152 2024-08-31T06:34:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118. 30/152 2024-08-31T06:34:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noa 31/152 2024-08-31T06:34:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.n 32/152 2024-08-31T06:34:50.756 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19 33/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el 34/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 35/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.e 36/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 37/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 38/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 39/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-31T06:34:50.757 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-31T06:34:50.758 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-devel-1:3.2.2-4.el9.x86_64 68/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-31T06:34:50.759 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-31T06:34:50.760 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-31T06:34:50.761 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-31T06:34:50.762 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/152 2024-08-31T06:34:50.763 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-31T06:34:50.764 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-31T06:34:50.765 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 149/152 2024-08-31T06:34:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-31T06:34:50.766 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 151/152 2024-08-31T06:34:51.978 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.979 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.980 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T06:34:51.981 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.982 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T06:34:51.983 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T06:34:51.984 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T06:34:51.985 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T06:34:51.986 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T06:34:51.987 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T06:34:51.988 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T06:34:51.989 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T06:34:51.990 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T06:34:51.991 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T06:34:51.991 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:34:51.991 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-08-31T06:34:52.307 DEBUG:teuthology.parallel:result is None 2024-08-31T06:34:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-31T06:34:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:53.051 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2024-08-31T06:34:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.051 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2024-08-31T06:34:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-31T06:34:53.051 INFO:teuthology.orchestra.run.smithi106.stdout: automake-1.16.2-8.el9.noarch 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: bison-3.7.4-5.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.052 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.053 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-shell-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top-2:19.3.0-4560.gd19e6118.el9.noarch 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: flex-2.6.4-9.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-31T06:34:53.054 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-31T06:34:53.055 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: lua-5.4.4-4.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.26-2.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel-1:3.2.2-4.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-13.16-1.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-31T06:34:53.056 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-31T06:34:53.057 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-31T06:34:53.058 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-31T06:34:53.059 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ply-3.11-14.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-31T06:34:53.060 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-31T06:34:53.061 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.8-2.el9.noarch 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:19.3.0-4560.gd19e6118.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: re2-1:20211101-20.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-31T06:34:53.062 INFO:teuthology.orchestra.run.smithi106.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-31T06:34:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-31T06:34:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-31T06:34:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-31T06:34:53.063 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:34:53.063 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2024-08-31T06:34:53.430 DEBUG:teuthology.parallel:result is None 2024-08-31T06:34:53.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:34:53.590 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T06:34:53.611 INFO:teuthology.orchestra.run.smithi037.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T06:34:53.612 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T06:34:53.612 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T06:34:53.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:34:53.749 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T06:34:53.776 INFO:teuthology.orchestra.run.smithi066.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T06:34:53.776 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T06:34:53.776 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T06:34:53.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:34:53.912 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-31T06:34:53.934 INFO:teuthology.orchestra.run.smithi106.stdout:19.3.0-4560.gd19e6118.el9 2024-08-31T06:34:53.934 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4560.gd19e6118.el9 2024-08-31T06:34:53.934 INFO:teuthology.task.install:The correct ceph version 19.3.0-4560.gd19e6118 is installed. 2024-08-31T06:34:53.936 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-31T06:34:53.936 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:34:53.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T06:34:53.964 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:34:53.964 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T06:34:53.997 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:34:53.997 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-31T06:34:54.024 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-31T06:34:54.025 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:34:54.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T06:34:54.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T06:34:54.114 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:34:54.114 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T06:34:54.145 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T06:34:54.215 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:34:54.216 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-08-31T06:34:54.244 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-31T06:34:54.310 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-31T06:34:54.310 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:34:54.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T06:34:54.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T06:34:54.399 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:34:54.399 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T06:34:54.429 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T06:34:54.497 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:34:54.497 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-31T06:34:54.521 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-31T06:34:54.586 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-31T06:34:54.586 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:34:54.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T06:34:54.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T06:34:54.674 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:34:54.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T06:34:54.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T06:34:54.769 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:34:54.769 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-08-31T06:34:54.794 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-31T06:34:54.858 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-31T06:34:54.950 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug cephsqlite': 20, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug'}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-08-31T06:34:54.950 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:34:54.951 INFO:tasks.cephadm:Cluster fsid is 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:34:54.951 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-31T06:34:54.951 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.b': '172.21.15.66', 'mon.c': '172.21.15.106'} 2024-08-31T06:34:54.951 INFO:tasks.cephadm:First mon is mon.a on smithi037 2024-08-31T06:34:54.952 INFO:tasks.cephadm:First mgr is x 2024-08-31T06:34:54.952 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-31T06:34:54.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-08-31T06:34:54.977 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname $(hostname -s) 2024-08-31T06:34:55.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname $(hostname -s) 2024-08-31T06:34:55.028 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-31T06:34:55.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:34:55.176 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd19e6118f7015f0047264006cb0c873528eb3ae6', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82586/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4560-gd19e6118', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4560.gd19e6118'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-28 11:15:32.801765', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-mchangir-testing-20240828.085847-main-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-31T06:34:55.320 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-mchangir-testing-20240828.085847-main-debug, sha1 d19e6118f7015f0047264006cb0c873528eb3ae6 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:34:55.321 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T06:34:55.322 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm 2024-08-31T06:34:55.322 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:55.945 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 06:34 /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:55.946 DEBUG:teuthology.orchestra.run.smithi066:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:56.775 INFO:teuthology.orchestra.run.smithi066.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 06:34 /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:56.776 DEBUG:teuthology.orchestra.run.smithi106:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-mchangir-testing-20240828.085847-main-debug/d19e6118f7015f0047264006cb0c873528eb3ae6/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:57.441 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r--. 1 ubuntu ubuntu 801010 Aug 31 06:34 /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:57.441 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:57.462 DEBUG:teuthology.orchestra.run.smithi066:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:57.482 DEBUG:teuthology.orchestra.run.smithi106:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-31T06:34:57.514 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 on all hosts... 2024-08-31T06:34:57.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T06:34:57.516 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T06:34:57.525 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 pull 2024-08-31T06:34:59.201 INFO:teuthology.orchestra.run.smithi066.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T06:34:59.243 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T06:34:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T06:35:32.418 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-08-31T06:35:32.418 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T06:35:32.418 INFO:teuthology.orchestra.run.smithi066.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T06:35:32.418 INFO:teuthology.orchestra.run.smithi066.stdout: "repo_digests": [ 2024-08-31T06:35:32.419 INFO:teuthology.orchestra.run.smithi066.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T06:35:32.419 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-08-31T06:35:32.419 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-08-31T06:36:07.763 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-31T06:36:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T06:36:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T06:36:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "repo_digests": [ 2024-08-31T06:36:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T06:36:07.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-08-31T06:36:07.764 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-31T06:36:07.968 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:36:07.968 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T06:36:07.968 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0", 2024-08-31T06:36:07.968 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-08-31T06:36:07.968 INFO:teuthology.orchestra.run.smithi037.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61" 2024-08-31T06:36:07.968 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:36:07.968 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:36:07.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-08-31T06:36:08.032 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph 2024-08-31T06:36:08.067 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph 2024-08-31T06:36:08.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-08-31T06:36:08.121 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /etc/ceph 2024-08-31T06:36:08.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /etc/ceph 2024-08-31T06:36:08.179 INFO:tasks.cephadm:Writing seed config... 2024-08-31T06:36:08.180 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-08-31T06:36:08.180 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-08-31T06:36:08.180 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-31T06:36:08.181 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-31T06:36:08.182 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-08-31T06:36:08.183 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:36:08.184 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-31T06:36:08.199 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 22785f22-6763-11ef-bcd4-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-08-31T06:36:08.200 DEBUG:teuthology.orchestra.run.smithi037:mon.a> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.a.service 2024-08-31T06:36:08.243 DEBUG:teuthology.orchestra.run.smithi037:mgr.x> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.x.service 2024-08-31T06:36:08.285 INFO:tasks.cephadm:Bootstrapping... 2024-08-31T06:36:08.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 -v bootstrap --fsid 22785f22-6763-11ef-bcd4-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:36:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-08-31T06:36:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', '-v', 'bootstrap', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.37', '--skip-admin-label'] 2024-08-31T06:36:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-31T06:36:08.494 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying podman|docker is present... 2024-08-31T06:36:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-08-31T06:36:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying lvm2 is present... 2024-08-31T06:36:08.517 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying time synchronization is in place... 2024-08-31T06:36:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T06:36:08.525 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T06:36:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T06:36:08.531 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-31T06:36:08.537 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-08-31T06:36:08.543 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-08-31T06:36:08.544 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-08-31T06:36:08.544 INFO:teuthology.orchestra.run.smithi037.stdout:Repeating the final host check... 2024-08-31T06:36:08.583 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.2 2024-08-31T06:36:08.583 INFO:teuthology.orchestra.run.smithi037.stdout:podman (/bin/podman) version 5.2.2 is present 2024-08-31T06:36:08.583 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl is present 2024-08-31T06:36:08.583 INFO:teuthology.orchestra.run.smithi037.stdout:lvcreate is present 2024-08-31T06:36:08.590 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-31T06:36:08.590 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-31T06:36:08.596 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-31T06:36:08.596 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-31T06:36:08.603 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-08-31T06:36:08.609 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-08-31T06:36:08.609 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-08-31T06:36:08.609 INFO:teuthology.orchestra.run.smithi037.stdout:Host looks OK 2024-08-31T06:36:08.609 INFO:teuthology.orchestra.run.smithi037.stdout:Cluster fsid: 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:08.609 INFO:teuthology.orchestra.run.smithi037.stdout:Acquiring lock 140510892807216 on /run/cephadm/22785f22-6763-11ef-bcd4-c7b262605968.lock 2024-08-31T06:36:08.610 INFO:teuthology.orchestra.run.smithi037.stdout:Lock 140510892807216 acquired on /run/cephadm/22785f22-6763-11ef-bcd4-c7b262605968.lock 2024-08-31T06:36:08.610 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 3300 ... 2024-08-31T06:36:08.610 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 6789 ... 2024-08-31T06:36:08.610 INFO:teuthology.orchestra.run.smithi037.stdout:Base mon IP(s) is [172.21.15.37:3300, 172.21.15.37:6789], mon addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-08-31T06:36:08.613 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.37 metric 100 2024-08-31T06:36:08.613 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 metric 100 2024-08-31T06:36:08.616 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-31T06:36:08.616 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-31T06:36:08.616 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-31T06:36:08.618 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-31T06:36:08.618 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-31T06:36:08.619 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T06:36:08.619 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-31T06:36:08.619 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 fe80::e6b7:ba1:fe98:4c62/64 scope link noprefixroute 2024-08-31T06:36:08.619 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-31T06:36:08.619 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-08-31T06:36:08.619 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-08-31T06:36:08.620 INFO:teuthology.orchestra.run.smithi037.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-31T06:36:08.620 INFO:teuthology.orchestra.run.smithi037.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-31T06:36:08.620 INFO:teuthology.orchestra.run.smithi037.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T06:36:09.019 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T06:36:09.020 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6... 2024-08-31T06:36:09.020 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Getting image source signatures 2024-08-31T06:36:09.020 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-31T06:36:09.020 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:1c7f48e91f1eb9e77df623f13bab8a42aaf12d95954655c07fb62a1a85ca19b2 2024-08-31T06:36:09.020 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying config sha256:79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 2024-08-31T06:36:09.020 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-31T06:36:09.958 INFO:teuthology.orchestra.run.smithi037.stdout:ceph: stdout ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T06:36:09.958 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph version: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev) 2024-08-31T06:36:09.958 INFO:teuthology.orchestra.run.smithi037.stdout:Extracting ceph user uid/gid from container image... 2024-08-31T06:36:10.923 INFO:teuthology.orchestra.run.smithi037.stdout:stat: stdout 167 167 2024-08-31T06:36:10.923 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial keys... 2024-08-31T06:36:11.810 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDbudJmWTr6DxAAguv4sNieikBujn05ZSrLLw== 2024-08-31T06:36:12.749 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDcudJmUClSCBAAprffJDGdUgzc22wZ8vguRA== 2024-08-31T06:36:13.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQDdudJmggq8BBAAjjUrZ6c2h6Gar8gMd+/S/w== 2024-08-31T06:36:13.598 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial monmap... 2024-08-31T06:36:14.527 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool for a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: set fsid to 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:36:14.528 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mon... 2024-08-31T06:36:15.442 INFO:teuthology.orchestra.run.smithi037.stdout:create mon.a on 2024-08-31T06:36:15.650 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-31T06:36:15.808 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-31T06:36:15.982 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-22785f22-6763-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-22785f22-6763-11ef-bcd4-c7b262605968.target. 2024-08-31T06:36:15.982 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-22785f22-6763-11ef-bcd4-c7b262605968.target → /etc/systemd/system/ceph-22785f22-6763-11ef-bcd4-c7b262605968.target. 2024-08-31T06:36:16.239 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.a 2024-08-31T06:36:16.239 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.a.service: Unit ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.a.service not loaded. 2024-08-31T06:36:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-22785f22-6763-11ef-bcd4-c7b262605968.target.wants/ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.a.service → /etc/systemd/system/ceph-22785f22-6763-11ef-bcd4-c7b262605968@.service. 2024-08-31T06:36:16.916 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T06:36:16.916 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-08-31T06:36:16.924 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T06:36:16.924 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-31T06:36:16.924 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-08-31T06:36:16.924 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T06:36:16.924 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon to start... 2024-08-31T06:36:16.924 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon... 2024-08-31T06:36:17.975 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:17 smithi037 ceph-mon[18241]: from='client.? 172.21.15.37:0/4184390918' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-31T06:36:17.979 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout cluster: 2024-08-31T06:36:17.979 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout id: 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:17.979 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout services: 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.578166s) 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout data: 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-31T06:36:17.980 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-31T06:36:17.981 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pgs: 2024-08-31T06:36:17.981 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:17.981 INFO:teuthology.orchestra.run.smithi037.stdout:mon is available 2024-08-31T06:36:17.981 INFO:teuthology.orchestra.run.smithi037.stdout:Assimilating anything we can from ceph.conf... 2024-08-31T06:36:19.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:18 smithi037 ceph-mon[18241]: from='client.? 172.21.15.37:0/2717684348' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T06:36:19.065 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:18 smithi037 ceph-mon[18241]: from='client.? 172.21.15.37:0/2717684348' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T06:36:19.069 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T06:36:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:Generating new minimal ceph.conf... 2024-08-31T06:36:20.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:19 smithi037 ceph-mon[18241]: from='client.? 172.21.15.37:0/864687073' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:36:23.993 INFO:teuthology.orchestra.run.smithi037.stdout:Restarting the monitor... 2024-08-31T06:36:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:24 smithi037 systemd[1]: Stopping Ceph mon.a for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:36:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:24 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a[18237]: 2024-08-31T06:36:24.987+0000 7f6401619640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:36:25.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:24 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a[18237]: 2024-08-31T06:36:24.987+0000 7f6401619640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-31T06:36:25.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:25 smithi037 podman[18485]: 2024-08-31 06:36:25.172869706 +0000 UTC m=+0.996407743 container died 2a76e76f8b16a3cd6e0086814f9c03d2e44d44a39960cb109a55c89a873c00e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-31T06:36:29.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:28 smithi037 podman[18485]: 2024-08-31 06:36:28.814556048 +0000 UTC m=+4.638094087 container cleanup 2a76e76f8b16a3cd6e0086814f9c03d2e44d44a39960cb109a55c89a873c00e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, ceph=True) 2024-08-31T06:36:29.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:28 smithi037 bash[18485]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a 2024-08-31T06:36:30.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:30 smithi037 podman[18497]: 2024-08-31 06:36:30.709890901 +0000 UTC m=+5.534136106 container remove 2a76e76f8b16a3cd6e0086814f9c03d2e44d44a39960cb109a55c89a873c00e8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T06:36:31.291 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:30 smithi037 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-31T06:36:31.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:30 smithi037 systemd[1]: Stopped Ceph mon.a for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:36:31.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:30 smithi037 systemd[1]: Starting Ceph mon.a for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:36:31.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 podman[18593]: 2024-08-31 06:36:31.189200084 +0000 UTC m=+0.101332387 container create e552e968c622837831f3d96ecbdd5d49809b884efeb2d4631c3cf7b62c69d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-31T06:36:31.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 podman[18593]: 2024-08-31 06:36:31.10353141 +0000 UTC m=+0.015663712 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:36:31.471 INFO:teuthology.orchestra.run.smithi037.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 podman[18593]: 2024-08-31 06:36:31.391365411 +0000 UTC m=+0.303497714 container init e552e968c622837831f3d96ecbdd5d49809b884efeb2d4631c3cf7b62c69d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 podman[18593]: 2024-08-31 06:36:31.394442048 +0000 UTC m=+0.306574351 container start e552e968c622837831f3d96ecbdd5d49809b884efeb2d4631c3cf7b62c69d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS) 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: pidfile_write: ignore empty --pid-file 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: load: jerasure load: lrc 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: RocksDB version: 7.9.2 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Git sha 0 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T06:36:31.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: DB SUMMARY 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: DB Session ID: 3KF3S6Y5T73NI0BIJMQZ 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: CURRENT file: CURRENT 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95361 ; 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.error_if_exists: 0 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.create_if_missing: 0 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.paranoid_checks: 1 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.env: 0x55f2d90875a0 2024-08-31T06:36:31.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T06:36:31.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.info_log: 0x55f2df5db4e0 2024-08-31T06:36:31.579 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T06:36:31.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.statistics: (nil) 2024-08-31T06:36:31.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.use_fsync: 0 2024-08-31T06:36:31.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_log_file_size: 0 2024-08-31T06:36:31.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T06:36:31.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T06:36:31.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.allow_fallocate: 1 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.use_direct_reads: 0 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.db_log_dir: 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.wal_dir: 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T06:36:31.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.write_buffer_manager: 0x55f2df5df5e0 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T06:36:31.582 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.unordered_write: 0 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.row_cache: None 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.wal_filter: None 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.two_write_queues: 0 2024-08-31T06:36:31.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.wal_compression: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.atomic_flush: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.log_readahead_size: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T06:36:31.584 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_background_jobs: 2 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_background_compactions: -1 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_subcompactions: 1 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_open_files: -1 2024-08-31T06:36:31.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_background_flushes: -1 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Compression algorithms supported: 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: kZSTD supported: 0 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: kXpressCompression supported: 0 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: kBZip2Compression supported: 0 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: kLZ4Compression supported: 1 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: kZlibCompression supported: 1 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: kSnappyCompression supported: 1 2024-08-31T06:36:31.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.merge_operator: 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_filter: None 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f2df5db100) 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T06:36:31.587 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_type: 0 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_index_type: 0 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_shortening: 1 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: checksum: 4 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: no_block_cache: 0 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache: 0x55f2db59e850 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_options: 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: capacity : 536870912 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_shard_bits : 4 2024-08-31T06:36:31.588 INFO:journalctl@ceph.mon.a.smithi037.stdout: strict_capacity_limit : 0 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_compressed: (nil) 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: persistent_cache: (nil) 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size: 4096 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size_deviation: 10 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_restart_interval: 16 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_block_restart_interval: 1 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: metadata_block_size: 4096 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: partition_filters: 0 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: use_delta_encoding: 1 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: filter_policy: bloomfilter 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: whole_key_filtering: 1 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: verify_compression: 0 2024-08-31T06:36:31.589 INFO:journalctl@ceph.mon.a.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout: format_version: 5 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_index_compression: 1 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_align: 0 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout: max_auto_readahead_size: 262144 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout: prepopulate_block_cache: 0 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout: initial_auto_readahead_size: 8192 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression: NoCompression 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.num_levels: 7 2024-08-31T06:36:31.590 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T06:36:31.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T06:36:31.592 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T06:36:31.593 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T06:36:31.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.inplace_update_support: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.bloom_locality: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.max_successive_merges: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T06:36:31.595 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.ttl: 2592000 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.enable_blob_files: false 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.min_blob_size: 0 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T06:36:31.596 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1500e01f-29ec-4824-a227-387e64d1560c 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086191429384, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086191430490, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91500, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 284, "table_properties": {"data_size": 89541, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11728, "raw_average_key_size": 48, "raw_value_size": 82935, "raw_average_value_size": 341, "num_data_blocks": 12, "num_entries": 243, "num_filter_entries": 243, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725086191, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1500e01f-29ec-4824-a227-387e64d1560c", "db_session_id": "3KF3S6Y5T73NI0BIJMQZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086191430592, "job": 1, "event": "recovery_finished"} 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f2df5fea80 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: DB pointer 0x55f2e03a0000 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T06:36:31.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** DB Stats ** 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T06:36:31.598 INFO:journalctl@ceph.mon.a.smithi037.stdout: L0 2/0 91.22 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: Sum 2/0 91.22 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 127.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 127.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T06:36:31.599 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative compaction: 0.00 GB write, 26.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval compaction: 0.00 GB write, 26.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache BinnedLRUCache@0x55f2db59e850#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a@-1(???) e1 preinit fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a@-1(???).mds e1 new map 2024-08-31T06:36:31.600 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a@-1(???).mds e1 print_map 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout: e1 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout: btime 2024-08-31T06:36:16:871294+0000 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout: legacy client fscid: -1 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout: No filesystems configured 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 bash[18593]: e552e968c622837831f3d96ecbdd5d49809b884efeb2d4631c3cf7b62c69d0ea 2024-08-31T06:36:31.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 systemd[1]: Started Ceph mon.a for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: monmap epoch 1 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: last_changed 2024-08-31T06:36:13.915367+0000 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: created 2024-08-31T06:36:13.915367+0000 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: min_mon_release 19 (squid) 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: election_strategy: 1 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: fsmap 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: osdmap e1: 0 total, 0 up, 0 in 2024-08-31T06:36:31.602 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:31 smithi037 ceph-mon[18612]: mgrmap e1: no daemons active 2024-08-31T06:36:32.568 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-31T06:36:32.590 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:36:32.590 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mgr... 2024-08-31T06:36:32.590 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-31T06:36:32.591 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-31T06:36:32.841 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T06:36:32.841 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.x.service: Unit ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.x.service not loaded. 2024-08-31T06:36:32.992 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-22785f22-6763-11ef-bcd4-c7b262605968.target.wants/ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-22785f22-6763-11ef-bcd4-c7b262605968@.service. 2024-08-31T06:36:33.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:33 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3445168662' entity='client.admin' 2024-08-31T06:36:33.540 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:33 smithi037 podman[18824]: 2024-08-31 06:36:33.439454272 +0000 UTC m=+0.330938104 container start ede2bad6208aefcc46b16f0641a867d187f5c201e8678e1b58477ea0225bc4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:36:33.553 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T06:36:33.553 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-08-31T06:36:33.560 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T06:36:33.560 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-31T06:36:33.560 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-08-31T06:36:33.561 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-08-31T06:36:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T06:36:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-08-31T06:36:33.576 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T06:36:33.576 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-31T06:36:33.576 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-08-31T06:36:33.576 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-31T06:36:33.576 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr to start... 2024-08-31T06:36:33.576 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr... 2024-08-31T06:36:33.830 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:33 smithi037 bash[18824]: ede2bad6208aefcc46b16f0641a867d187f5c201e8678e1b58477ea0225bc4a0 2024-08-31T06:36:33.830 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:33 smithi037 systemd[1]: Started Ceph mgr.x for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:36:34.418 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:34 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2827784081' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T06:36:34.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:34.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-31T06:36:34.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:36:34.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T06:36:34.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T06:36:34.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T06:36:34.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T06:36:34.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:34.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T06:36:34.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:34.737 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T06:36:34.738 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T06:36:16:871294+0000", 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T06:36:34.739 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T06:36:16.872138+0000", 2024-08-31T06:36:34.740 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T06:36:34.741 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:34.741 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T06:36:34.741 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-31T06:36:34.741 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (1/15)... 2024-08-31T06:36:37.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:37 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/402591308' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T06:36:38.289 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:38.289 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-31T06:36:38.289 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:36:38.289 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T06:36:38.289 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T06:36:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T06:36:38.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T06:36:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T06:36:16:871294+0000", 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:38.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T06:36:16.872138+0000", 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-31T06:36:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (2/15)... 2024-08-31T06:36:39.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: Activating manager daemon x 2024-08-31T06:36:39.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: mgrmap e2: x(active, starting, since 0.00359667s) 2024-08-31T06:36:39.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T06:36:39.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T06:36:39.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T06:36:39.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:36:39.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T06:36:39.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: Manager daemon x is now available 2024-08-31T06:36:39.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T06:36:39.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T06:36:39.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' 2024-08-31T06:36:39.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' 2024-08-31T06:36:39.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:38 smithi037 ceph-mon[18612]: from='mgr.14100 172.21.15.37:0/109611819' entity='mgr.x' 2024-08-31T06:36:41.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:40 smithi037 ceph-mon[18612]: mgrmap e3: x(active, since 1.00854s) 2024-08-31T06:36:41.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:41.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-31T06:36:41.651 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:41.652 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-31T06:36:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:41.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-08-31T06:36:16:871294+0000", 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-31T06:36:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-08-31T06:36:16.872138+0000", 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-31T06:36:41.659 INFO:teuthology.orchestra.run.smithi037.stdout:mgr is available 2024-08-31T06:36:41.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:41 smithi037 ceph-mon[18612]: mgrmap e4: x(active, since 2s) 2024-08-31T06:36:41.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:41 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2490912060' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-31T06:36:42.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:42 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2362333598' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-31T06:36:42.896 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:42.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-08-31T06:36:42.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:42.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-31T06:36:42.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-08-31T06:36:42.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-31T06:36:42.899 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-31T06:36:42.900 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling cephadm module... 2024-08-31T06:36:44.074 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:43 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1689789370' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-31T06:36:44.075 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:43 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ignoring --setuser ceph since I am not root 2024-08-31T06:36:44.075 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:43 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ignoring --setgroup ceph since I am not root 2024-08-31T06:36:45.025 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:44 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1689789370' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-31T06:36:45.025 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:44 smithi037 ceph-mon[18612]: mgrmap e5: x(active, since 5s) 2024-08-31T06:36:45.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-31T06:36:45.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-31T06:36:45.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T06:36:45.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T06:36:45.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T06:36:45.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-31T06:36:45.592 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-08-31T06:36:45.593 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 5... 2024-08-31T06:36:45.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:45 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3124686217' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T06:36:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: Active manager daemon x restarted 2024-08-31T06:36:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: Activating manager daemon x 2024-08-31T06:36:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: osdmap e2: 0 total, 0 up, 0 in 2024-08-31T06:36:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: mgrmap e6: x(active, starting, since 0.00373228s) 2024-08-31T06:36:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:36:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T06:36:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T06:36:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T06:36:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T06:36:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:48 smithi037 ceph-mon[18612]: Manager daemon x is now available 2024-08-31T06:36:50.498 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-31T06:36:50.498 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-31T06:36:50.498 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T06:36:50.499 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-31T06:36:50.499 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 5 is available 2024-08-31T06:36:50.499 INFO:teuthology.orchestra.run.smithi037.stdout:Setting orchestrator backend to cephadm... 2024-08-31T06:36:51.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-31T06:36:51.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: mgrmap e7: x(active, since 1.0058s) 2024-08-31T06:36:51.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-31T06:36:51.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:36:51.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:36:51.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:36:51.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:36:51.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:36:51.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:36:51.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T06:36:51.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:50 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T06:36:52.287 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:52 smithi037 ceph-mon[18612]: Found migration_current of "None". Setting to last migration. 2024-08-31T06:36:52.288 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:52 smithi037 ceph-mon[18612]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:52.288 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:52 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:36:52.288 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:52 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:36:52.288 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:52 smithi037 ceph-mon[18612]: mgrmap e8: x(active, since 2s) 2024-08-31T06:36:53.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-31T06:36:53.168 INFO:teuthology.orchestra.run.smithi037.stdout:Generating ssh key... 2024-08-31T06:36:53.400 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-mon[18612]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:54.302 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:54 smithi037 ceph-mon[18612]: [31/Aug/2024:06:36:53] ENGINE Bus STARTING 2024-08-31T06:36:54.302 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:54 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:36:54.302 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:54 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:36:54.303 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:54 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:36:54.303 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: Generating public/private rsa key pair. 2024-08-31T06:36:54.303 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: Your identification has been saved in /tmp/tmpuewr_pvp/key 2024-08-31T06:36:54.303 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: Your public key has been saved in /tmp/tmpuewr_pvp/key.pub 2024-08-31T06:36:54.303 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: The key fingerprint is: 2024-08-31T06:36:54.303 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: SHA256:YvuPM/qWhUa+WFxMLZ6tUk27PQMwsFvu3DBWSoY6hpU ceph-22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: The key's randomart image is: 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: +---[RSA 3072]----+ 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | .. . | 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | . o= o | 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | E o++O.. | 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | o ..**o= | 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | . *+S+*. + | 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | o +B+o+. + | 2024-08-31T06:36:54.304 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | .+ =o . o | 2024-08-31T06:36:54.305 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | ..*. | 2024-08-31T06:36:54.305 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: | .+++. | 2024-08-31T06:36:54.305 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: +----[SHA256]-----+ 2024-08-31T06:36:54.305 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:36:53.908+0000 7f9b627e2640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:06:36:53] ENGINE Error in HTTPServer.serve 2024-08-31T06:36:54.305 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: Traceback (most recent call last): 2024-08-31T06:36:54.305 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T06:36:54.305 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._connections.run(self.expiration_interval) 2024-08-31T06:36:54.305 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T06:36:54.306 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._run(expiration_interval) 2024-08-31T06:36:54.306 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T06:36:54.306 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T06:36:54.306 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T06:36:54.306 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: s = self.context.wrap_socket( 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: return self.sslsocket_class._create( 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self.do_handshake() 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._sslobj.do_handshake() 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T06:36:54.307 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:36:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:55 smithi037 ceph-mon[18612]: [31/Aug/2024:06:36:53] ENGINE Serving on http://172.21.15.37:8765 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:55 smithi037 ceph-mon[18612]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:55 smithi037 ceph-mon[18612]: Generating ssh key... 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:55 smithi037 ceph-mon[18612]: [31/Aug/2024:06:36:53] ENGINE Serving on https://172.21.15.37:7150 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:55 smithi037 ceph-mon[18612]: [31/Aug/2024:06:36:53] ENGINE Bus STARTED 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:55 smithi037 ceph-mon[18612]: [31/Aug/2024:06:36:53] ENGINE Error in HTTPServer.serve 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T06:36:55.403 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-08-31T06:36:55.404 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T06:36:55.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmSn4Rh20I37fstBwrIFB80iAlOabC8U4i+vrAAcikCsZRiqwVzrGVyj6Yyt243lGtg6fuyqasXR8nnlz8cBHcrCCIFrQ0Kp3sPqIp2FiSw94s+PKCjvJ3S3kJtZ24pFg6ObH9qCZHTRJBsb6c5Ur2XAsYtplKMPDgopPS4gXYIXR52W/f8JmHcsabxCiAZnc9IB358q4rr9xmVC+v0o5iAzM/aLoVsnttFsDCsrJuZjKSI9aPKLU1dGzR0Dl99wZJ+iTve3DnhZbXRF7DI9VzZYM0m9q3WD63P0kctAp4H/ZOE1TGMu1cBgb/cCNA/NOfcx9kex1AMBlS558jFkFgnqwYayOvq5lmq37ElRGrI/m+/kTifz4Ks3lp4oBv1iHr/QYir9OpSIs7NeJ+zFHgChhKJPMvij271HMjB+MiJepiC7s28nS2HajuloE2tCljkaQxMmpkBJO0FSR5llVJHQIRA+QAY36YoCt16g8FREOB0VMRug9sdSEwOeI1C4k= ceph-22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:36:55.681 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-31T06:36:55.682 INFO:teuthology.orchestra.run.smithi037.stdout:Adding key to root@localhost authorized_keys... 2024-08-31T06:36:55.682 INFO:teuthology.orchestra.run.smithi037.stdout:Adding host smithi037... 2024-08-31T06:36:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:56 smithi037 ceph-mon[18612]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:57.320 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:57 smithi037 ceph-mon[18612]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:36:58.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:36:58 smithi037 ceph-mon[18612]: Deploying cephadm binary to smithi037 2024-08-31T06:37:00.764 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Added host 'smithi037' with addr '172.21.15.37' 2024-08-31T06:37:00.764 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mon service... 2024-08-31T06:37:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:01 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:37:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:01 smithi037 ceph-mon[18612]: Added host smithi037 2024-08-31T06:37:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:01 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:37:02.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:02 smithi037 ceph-mon[18612]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:02.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:02 smithi037 ceph-mon[18612]: Saving service mon spec with placement count:5 2024-08-31T06:37:02.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:02 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:37:03.220 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-31T06:37:03.220 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mgr service... 2024-08-31T06:37:04.089 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:03 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:37:04.089 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:03 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:37:04.927 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:04 smithi037 ceph-mon[18612]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:04.927 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:04 smithi037 ceph-mon[18612]: Saving service mgr spec with placement count:2 2024-08-31T06:37:04.927 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:04 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-31T06:37:06.471 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:06 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:37:06.471 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:06 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1863868372' entity='client.admin' 2024-08-31T06:37:06.471 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:06 smithi037 ceph-mon[18612]: from='mgr.14118 172.21.15.37:0/1536667860' entity='mgr.x' 2024-08-31T06:37:07.487 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling the dashboard module... 2024-08-31T06:37:08.053 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:07 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2337945791' entity='client.admin' 2024-08-31T06:37:09.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:08 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1440357588' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-31T06:37:09.205 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:08 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ignoring --setuser ceph since I am not root 2024-08-31T06:37:09.205 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:08 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ignoring --setgroup ceph since I am not root 2024-08-31T06:37:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:09 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1440357588' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-31T06:37:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:09 smithi037 ceph-mon[18612]: mgrmap e9: x(active, since 19s) 2024-08-31T06:37:10.897 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-31T06:37:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-31T06:37:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-31T06:37:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-31T06:37:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-31T06:37:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-31T06:37:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-08-31T06:37:10.898 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 9... 2024-08-31T06:37:11.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:10 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1545429496' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-31T06:37:14.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: Active manager daemon x restarted 2024-08-31T06:37:14.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: Activating manager daemon x 2024-08-31T06:37:14.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: osdmap e3: 0 total, 0 up, 0 in 2024-08-31T06:37:14.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: mgrmap e10: x(active, starting, since 0.00427291s) 2024-08-31T06:37:14.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:37:14.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T06:37:14.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T06:37:14.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T06:37:14.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T06:37:14.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:14 smithi037 ceph-mon[18612]: Manager daemon x is now available 2024-08-31T06:37:15.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:15 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:37:15.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:15 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T06:37:15.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:15 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T06:37:15.434 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:15 smithi037 ceph-mon[18612]: mgrmap e11: x(active, since 1.00772s) 2024-08-31T06:37:15.720 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-31T06:37:15.720 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-31T06:37:15.720 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-31T06:37:15.721 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-31T06:37:15.721 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 9 is available 2024-08-31T06:37:15.721 INFO:teuthology.orchestra.run.smithi037.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-31T06:37:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-mon[18612]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-31T06:37:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-mon[18612]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:37:16.431+0000 7f8b079a3640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:06:37:16] ENGINE Error in HTTPServer.serve 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: Traceback (most recent call last): 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._connections.run(self.expiration_interval) 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._run(expiration_interval) 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T06:37:16.856 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: s = self.context.wrap_socket( 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: return self.sslsocket_class._create( 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self.do_handshake() 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._sslobj.do_handshake() 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T06:37:16.857 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:37:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:37:17.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:17 smithi037 ceph-mon[18612]: mgrmap e12: x(active, since 2s) 2024-08-31T06:37:17.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:17 smithi037 ceph-mon[18612]: [31/Aug/2024:06:37:16] ENGINE Bus STARTING 2024-08-31T06:37:17.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:17 smithi037 ceph-mon[18612]: [31/Aug/2024:06:37:16] ENGINE Serving on http://172.21.15.37:8765 2024-08-31T06:37:17.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:17 smithi037 ceph-mon[18612]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:17.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:17 smithi037 ceph-mon[18612]: [31/Aug/2024:06:37:16] ENGINE Serving on https://172.21.15.37:7150 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:17 smithi037 ceph-mon[18612]: [31/Aug/2024:06:37:16] ENGINE Bus STARTED 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:17 smithi037 ceph-mon[18612]: [31/Aug/2024:06:37:16] ENGINE Error in HTTPServer.serve 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T06:37:17.606 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T06:37:17.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:17 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:18.206 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIULMltCusKGo7evLQ9AgFU2sijZOIwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgzMTA2MzcxN1oXDTM0\nMDkwMTA2MzcxN1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjM3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAlm3uYLgt6T7I1XRacTkuORvJUeQn1b+W1v/c\nEAfLQOUaHzg6Yxq0P197gFflyBP8S7QU5mrpYJu5fhY2hkaiUqQnIiNB9hyPO/Ly\njlIZIZFsFH9X9cXLyfsryRNbP5Wz/8knDyUOMup8WRg6wDCXao3ssN5RqB/PoAu2\nQ8jzW+rRUDmBut75Uyq1iFUsWSFWL+PItMk+Ix0B546K0cSCKQmPWjLhvEMNNGbo\nT026QvLNlYvQjeHMN+CVfXrhHerkB7b2Qzb/D5TJhAotnZLJp/ELc7kNgSF3VqNw\nTpR7DGww8Z2T3jrcV/RaeRJyVOP9B+LrteuuWNoX9ZRcejxzhRk5oY/GCK3IeylD\nUvcvvQ8rVqhfQuAHT+1GkLfv85rZdPGm/um8VTgm1hWXU/It1O6bQYzYJ0DBH6x/\n3uykoIrxMn4+iDJJ6mP3mHVLXday8s3JmvAy9xPKJUdNqiigJx6LOVIutXdjzbmk\ngU37lpHJGj27qN4PFr2KhudAVTEgpj8vZ/4Y8Xy0HCnr82j+dXhVcHNz6ELrJjOK\nbYTIp7KMGpoRxgjB9ITsIKT9yKngl7i9SwwYXAw1qXMwZ+33TO60Ti5efc6dmNi+\nkFmKm2Ju+ySgk317Glcx8tP037Qpi9Mm9Ql2TM1QAiP2E+lpnIzOvtmt+WohxL3W\nK7JQ+AMCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDM3ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPJTAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAt\nzTJi5rVps68PWVEUutjL3K3KfIM5HPQISBl769EFkkTdb5khLMM1TLkUH0ynOm5c\nUx9f2mG4jTI50ejjFzWYUJfHY6JTZB+517WerAOwX4NJ3a+E2BOkGRzMIXzwommo\nk0HBfnpuvEnRfXqv6+DewmOK/JaxOToPWq8wlLiIlHu9wvpLun5iMGueX7pNY6wB\nRPZ4IYujaozqwSwu5EgycqJWfvUEWzpALdczB36z1sgehR7nSPvkMO1rWqTsnMF+\nn8HUZNGRUcVGtl/0weOZHksa+lYO+ZnbhO2U9LIEcdpniMVdF9loKRpDY2Zv9E7l\nkOCZaxZO2oVmAru8EbKQ7uGusilBvZPwToBSqfqfeB64BMXd7mHkPpBxj4rimf27\n8SuO1kZa10J+VB4YP+Ynlp+QXyilWlMS3IsYXn1epNI2S0n91XnMdo5pS/sAzJL6\nQg/zZNbdsAh3CjVewRpjpTmDe8X9UPo4xCGttdTeSKmDogyYqAl8l6g4lxQ2Nncj\nVLx8tFrK9YpQt/GKMRs9c2fZakMYaOnWRLy72DfX1yhuPejIbsoAFCLCtn3KxWqE\nqL9tH/UFEDAaWKBbUrVwKGv7T6nG3/oYhVRGL1+ne1TPFjerCYkBoHAKOARR3JZ2\nghHF+2+bFeZodWlGnSF3GgVrSj6EHcznWOCcxbGMkQ==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEAlm3uYLgt6T7I1XRacTkuORvJUeQn1b+W1v/cEAfLQOUaHzg6\nYxq0P197gFflyBP8S7QU5mrpYJu5fhY2hkaiUqQnIiNB9hyPO/LyjlIZIZFsFH9X\n9cXLyfsryRNbP5Wz/8knDyUOMup8WRg6wDCXao3ssN5RqB/PoAu2Q8jzW+rRUDmB\nut75Uyq1iFUsWSFWL+PItMk+Ix0B546K0cSCKQmPWjLhvEMNNGboT026QvLNlYvQ\njeHMN+CVfXrhHerkB7b2Qzb/D5TJhAotnZLJp/ELc7kNgSF3VqNwTpR7DGww8Z2T\n3jrcV/RaeRJyVOP9B+LrteuuWNoX9ZRcejxzhRk5oY/GCK3IeylDUvcvvQ8rVqhf\nQuAHT+1GkLfv85rZdPGm/um8VTgm1hWXU/It1O6bQYzYJ0DBH6x/3uykoIrxMn4+\niDJJ6mP3mHVLXday8s3JmvAy9xPKJUdNqiigJx6LOVIutXdjzbmkgU37lpHJGj27\nqN4PFr2KhudAVTEgpj8vZ/4Y8Xy0HCnr82j+dXhVcHNz6ELrJjOKbYTIp7KMGpoR\nxgjB9ITsIKT9yKngl7i9SwwYXAw1qXMwZ+33TO60Ti5efc6dmNi+kFmKm2Ju+ySg\nk317Glcx8tP037Qpi9Mm9Ql2TM1QAiP2E+lpnIzOvtmt+WohxL3WK7JQ+AMCAwEA\nAQKCAgAYHIG3Zf4R4zrcn9w5RrGGfNItepT5+U4LoxIaTa2B9tbThzcwmGCowbyx\nayVNBwsK9U/eSOekUQGP2K6foiW1elM9cQpLEPPSZ5QCRN17WGxK8shd//i0pLo1\nbhFTpUKnLo5Aqq9WcOhCfZQ5JvC2Jw53oQLUoFiurgHmZoi/RGmNYtJM6h1re66C\nLijAFoxSe7+5XoJDrYwXGe1dRxKX0kz0Z7Bv9Q1iR1ZYE7zVq0ZRgIoKm9UYZbqA\nVNhNa89l/ykEyAVk8XPFYr5CAfupnAS6ZUBpYLxYmjTPm5QHfzXvHFNNrQCRZnyz\n6EWEHtD5WSFv1Nlqq3ZoqgGSpCrdvS56hV1rQnn1FBg7mQhFCalHm5mcYS8eg3Q6\nVBmVkG1MliS4JyP1fY/TTliVx/5GcVQsE+9YofzOZpwbooEf5FESRF9jMT7u0w0q\n5Xr8CZnNAD6980V35ujK4nbdOWIruBmbcnjA9jp8R/3GF6n5bvJbq2TpAkY7CbFJ\ndjnp9vb6rQsV7jHsE+x63eBQYt1ht7UCvaEhQioWnB+udz7pkjzgy/lJiALoZ0Cg\nMa267lN9Q321CYthmCNgDF4ZRdgrVca9kAf3Tzv/jxGtS3hiUJw51asGNaSwL859\n8uM9ITB4Q3fwLVjuPsUwh/MRA1vtB6o6uBaV5iBndpdVKQnO3QKCAQEAxg2egjrf\nDQievYtUkTBnQIjndVPiVlayMxvvaTOVAFoVbuhpcooRUUsKuQCC87VkfZfiG3p8\ng3nTyV0itug0LmGnjecQq05vj55bNjt+zca0z38tq5r9VnoUpLW/I2H3JexCODN6\nSjG7+kb4XSOZrlGH4eM1aB+iYslmwFE94tzriYcFEF2e6PDzUnEwR1LveqEAwDYZ\nvUlNQ6VxpTnvC0/jWQVGPMlnKLA6JMrUYAa15dXpzSwgZIk6P3fnNb6XuIxlpZCd\n7wg665qbwyR+wvFg5KOiQozLCBomkh+sM9IUcbZtz5B1W7PsznGhR7hNPyHZb1a4\n1JboCa/mleZxtwKCAQEAwnE+XMLrVubKpCc6bcAdyxGU6mo9Y22hA/Rcvs5EA9en\nqTfR5UyxHiKnpHwaa6MEHK0dnZBLhyDzwNu86fY4cQ6lI3R9l5/VMholMGTTjeRq\nsA4z2ceafYfH7oBiPCb404iE04V2WTwABL8ynBsW9Gjfm20dDPD+kt8rsPJ5UI6H\n+1ndhIQBzg4g2gi2y7JO/y+U71R/l0e7E/rnKP0i568rsaN2UlCXvPv0F5QLLuY2\nHzVmv1U9/ntol3pRavfqG+tQo3od8K8ej7XaUAAT5gSUduwwyM5ptutNpKNyx/bT\ng8wMUZhzZeB75/g1ZwvlzSB2w/r2I6bTOUQkX1N8FQKCAQAyLKMahQWbDLMCe/jZ\nq3SNAeH5dF3j16Tfk9UsRrgZ1biWV2TXcqj+ek9mHP4P9cVWmBLdOUOwHz4LRoAT\n7HHDylOjfIVZkM5siQa8j4gJY6zM4IBWeDZ0IQt3yt94fEobnmYMTOZPQ5hGyJIF\nLo6xfdA55tDR5ynBcxqH4E0YWzWEquMaiU1H4DsUiL5dY2JuI7nH+Cy/KoHbgF9x\nJ2Mq73s+QzrPDYsH4NVqGsSA61JLvsyzgNlX/vf1uk+l6voO8+qQbjnEo8YhiBKr\n9mPyySnt4pKp33dUPyPEYyfCHRe20yuwqP1CVSvKBTmBrOxM8StfrI24td5lDd4R\n3cazAoIBAB6+/2h1nfcI2YQpe9C87zkcF5sVn41oWWyhqES3owOkhyt32yXSAbPN\nMQsOYLMifNT3/tXaakb8y+50EKRCPdyKv0wi8HUYXgLlJXpIhzdJpiEerc5DBMfS\nv6eT/3SZiQER9kboNLWZijs17I/IrNGK/8i48T4JoYeh6Gu7e7lkQFZbeG6q3Qoz\nK7iuZhFBqcIqSPerOd23Bvr60rCljm5qQZN+UIhlnAjTIl7UFwycdHRs4klg9kOW\nSgyh19v9RbSSehbPiYp0dnWtAM9jo8HceYlwgapPEWJOROHCwrSh8AJIMq54V88F\nNzKQCgm4VOchugX1WhR7Ha1RfBrivZ0CggEAVTVcJx2Lv9ybUYI4mESMxPjZMsMS\nftwd8eU2XqMxVDBFzG26vl87qYhW5o9fDnAtp1rwV7SwW7fOHT1N8H9tVJNAO6AB\nEImF9LsTkrMAGvgX/kzfvOjUWZAnZeyyos5XkP7KKwXOT3uQhC8QDQFCyhUO89ji\ndVQ6TF4vj5UNv9maK3eWSVPCHFunxAP8zNFzc6oyNVQ6CFC5HXTKXJN7Ge+yvvvv\nNEAelO5Dx13xb5g021MMNJEfXgmuxYW5NfYtI53jMCrp/4F9W9bctNYJg4wwiccX\nWHRc5SSuQIpP3TTfD1vmEU3EhikXbyNLR5ZKgxWyfAwUMUstmpDinYh0YQ==\n-----END RSA PRIVATE KEY-----\n"} 2024-08-31T06:37:18.784 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:18 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:19.489 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-31T06:37:20.058 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:19 smithi037 ceph-mon[18612]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:20.058 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:19 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:21.389 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:21 smithi037 ceph-mon[18612]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:21.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:21 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:21.393 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-31T06:37:21.393 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial admin user... 2024-08-31T06:37:22.882 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$zYuiZIwApRcxw3QH8nYCleFj.jJk1JGUSVOnKMeE4FZJF2tMXZFN6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725086242, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-31T06:37:22.882 INFO:teuthology.orchestra.run.smithi037.stdout:Fetching dashboard port number... 2024-08-31T06:37:23.528 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:23 smithi037 ceph-mon[18612]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:23.528 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:23 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:24.104 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 8443 2024-08-31T06:37:24.115 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-31T06:37:24.115 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-08-31T06:37:24.123 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-31T06:37:24.123 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-31T06:37:24.123 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-08-31T06:37:24.123 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-31T06:37:24.125 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph Dashboard is now available at: 2024-08-31T06:37:24.125 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:24.125 INFO:teuthology.orchestra.run.smithi037.stdout: URL: https://smithi037:8443/ 2024-08-31T06:37:24.125 INFO:teuthology.orchestra.run.smithi037.stdout: User: admin 2024-08-31T06:37:24.125 INFO:teuthology.orchestra.run.smithi037.stdout: Password: yhqqyjoh0z 2024-08-31T06:37:24.125 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:24.125 INFO:teuthology.orchestra.run.smithi037.stdout:Saving cluster configuration to /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config directory 2024-08-31T06:37:24.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:24 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1305612352' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout:Or, if you are only running a single cluster on this host: 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:25.428 INFO:teuthology.orchestra.run.smithi037.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-31T06:37:25.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:25.429 INFO:teuthology.orchestra.run.smithi037.stdout: ceph telemetry on 2024-08-31T06:37:25.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:25.429 INFO:teuthology.orchestra.run.smithi037.stdout:For more information see: 2024-08-31T06:37:25.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:25.429 INFO:teuthology.orchestra.run.smithi037.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-31T06:37:25.429 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:25.429 INFO:teuthology.orchestra.run.smithi037.stdout:Bootstrap complete. 2024-08-31T06:37:25.468 INFO:tasks.cephadm:Fetching config... 2024-08-31T06:37:25.468 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:37:25.468 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-31T06:37:25.483 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-31T06:37:25.483 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:37:25.484 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-31T06:37:25.538 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-31T06:37:25.538 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:37:25.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-31T06:37:25.602 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-31T06:37:25.602 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:37:25.602 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-31T06:37:25.657 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-31T06:37:25.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmSn4Rh20I37fstBwrIFB80iAlOabC8U4i+vrAAcikCsZRiqwVzrGVyj6Yyt243lGtg6fuyqasXR8nnlz8cBHcrCCIFrQ0Kp3sPqIp2FiSw94s+PKCjvJ3S3kJtZ24pFg6ObH9qCZHTRJBsb6c5Ur2XAsYtplKMPDgopPS4gXYIXR52W/f8JmHcsabxCiAZnc9IB358q4rr9xmVC+v0o5iAzM/aLoVsnttFsDCsrJuZjKSI9aPKLU1dGzR0Dl99wZJ+iTve3DnhZbXRF7DI9VzZYM0m9q3WD63P0kctAp4H/ZOE1TGMu1cBgb/cCNA/NOfcx9kex1AMBlS558jFkFgnqwYayOvq5lmq37ElRGrI/m+/kTifz4Ks3lp4oBv1iHr/QYir9OpSIs7NeJ+zFHgChhKJPMvij271HMjB+MiJepiC7s28nS2HajuloE2tCljkaQxMmpkBJO0FSR5llVJHQIRA+QAY36YoCt16g8FREOB0VMRug9sdSEwOeI1C4k= ceph-22785f22-6763-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T06:37:25.732 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmSn4Rh20I37fstBwrIFB80iAlOabC8U4i+vrAAcikCsZRiqwVzrGVyj6Yyt243lGtg6fuyqasXR8nnlz8cBHcrCCIFrQ0Kp3sPqIp2FiSw94s+PKCjvJ3S3kJtZ24pFg6ObH9qCZHTRJBsb6c5Ur2XAsYtplKMPDgopPS4gXYIXR52W/f8JmHcsabxCiAZnc9IB358q4rr9xmVC+v0o5iAzM/aLoVsnttFsDCsrJuZjKSI9aPKLU1dGzR0Dl99wZJ+iTve3DnhZbXRF7DI9VzZYM0m9q3WD63P0kctAp4H/ZOE1TGMu1cBgb/cCNA/NOfcx9kex1AMBlS558jFkFgnqwYayOvq5lmq37ElRGrI/m+/kTifz4Ks3lp4oBv1iHr/QYir9OpSIs7NeJ+zFHgChhKJPMvij271HMjB+MiJepiC7s28nS2HajuloE2tCljkaQxMmpkBJO0FSR5llVJHQIRA+QAY36YoCt16g8FREOB0VMRug9sdSEwOeI1C4k= ceph-22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:37:25.753 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmSn4Rh20I37fstBwrIFB80iAlOabC8U4i+vrAAcikCsZRiqwVzrGVyj6Yyt243lGtg6fuyqasXR8nnlz8cBHcrCCIFrQ0Kp3sPqIp2FiSw94s+PKCjvJ3S3kJtZ24pFg6ObH9qCZHTRJBsb6c5Ur2XAsYtplKMPDgopPS4gXYIXR52W/f8JmHcsabxCiAZnc9IB358q4rr9xmVC+v0o5iAzM/aLoVsnttFsDCsrJuZjKSI9aPKLU1dGzR0Dl99wZJ+iTve3DnhZbXRF7DI9VzZYM0m9q3WD63P0kctAp4H/ZOE1TGMu1cBgb/cCNA/NOfcx9kex1AMBlS558jFkFgnqwYayOvq5lmq37ElRGrI/m+/kTifz4Ks3lp4oBv1iHr/QYir9OpSIs7NeJ+zFHgChhKJPMvij271HMjB+MiJepiC7s28nS2HajuloE2tCljkaQxMmpkBJO0FSR5llVJHQIRA+QAY36YoCt16g8FREOB0VMRug9sdSEwOeI1C4k= ceph-22785f22-6763-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T06:37:25.798 INFO:teuthology.orchestra.run.smithi066.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmSn4Rh20I37fstBwrIFB80iAlOabC8U4i+vrAAcikCsZRiqwVzrGVyj6Yyt243lGtg6fuyqasXR8nnlz8cBHcrCCIFrQ0Kp3sPqIp2FiSw94s+PKCjvJ3S3kJtZ24pFg6ObH9qCZHTRJBsb6c5Ur2XAsYtplKMPDgopPS4gXYIXR52W/f8JmHcsabxCiAZnc9IB358q4rr9xmVC+v0o5iAzM/aLoVsnttFsDCsrJuZjKSI9aPKLU1dGzR0Dl99wZJ+iTve3DnhZbXRF7DI9VzZYM0m9q3WD63P0kctAp4H/ZOE1TGMu1cBgb/cCNA/NOfcx9kex1AMBlS558jFkFgnqwYayOvq5lmq37ElRGrI/m+/kTifz4Ks3lp4oBv1iHr/QYir9OpSIs7NeJ+zFHgChhKJPMvij271HMjB+MiJepiC7s28nS2HajuloE2tCljkaQxMmpkBJO0FSR5llVJHQIRA+QAY36YoCt16g8FREOB0VMRug9sdSEwOeI1C4k= ceph-22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:37:25.811 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmSn4Rh20I37fstBwrIFB80iAlOabC8U4i+vrAAcikCsZRiqwVzrGVyj6Yyt243lGtg6fuyqasXR8nnlz8cBHcrCCIFrQ0Kp3sPqIp2FiSw94s+PKCjvJ3S3kJtZ24pFg6ObH9qCZHTRJBsb6c5Ur2XAsYtplKMPDgopPS4gXYIXR52W/f8JmHcsabxCiAZnc9IB358q4rr9xmVC+v0o5iAzM/aLoVsnttFsDCsrJuZjKSI9aPKLU1dGzR0Dl99wZJ+iTve3DnhZbXRF7DI9VzZYM0m9q3WD63P0kctAp4H/ZOE1TGMu1cBgb/cCNA/NOfcx9kex1AMBlS558jFkFgnqwYayOvq5lmq37ElRGrI/m+/kTifz4Ks3lp4oBv1iHr/QYir9OpSIs7NeJ+zFHgChhKJPMvij271HMjB+MiJepiC7s28nS2HajuloE2tCljkaQxMmpkBJO0FSR5llVJHQIRA+QAY36YoCt16g8FREOB0VMRug9sdSEwOeI1C4k= ceph-22785f22-6763-11ef-bcd4-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-31T06:37:25.852 INFO:teuthology.orchestra.run.smithi106.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmSn4Rh20I37fstBwrIFB80iAlOabC8U4i+vrAAcikCsZRiqwVzrGVyj6Yyt243lGtg6fuyqasXR8nnlz8cBHcrCCIFrQ0Kp3sPqIp2FiSw94s+PKCjvJ3S3kJtZ24pFg6ObH9qCZHTRJBsb6c5Ur2XAsYtplKMPDgopPS4gXYIXR52W/f8JmHcsabxCiAZnc9IB358q4rr9xmVC+v0o5iAzM/aLoVsnttFsDCsrJuZjKSI9aPKLU1dGzR0Dl99wZJ+iTve3DnhZbXRF7DI9VzZYM0m9q3WD63P0kctAp4H/ZOE1TGMu1cBgb/cCNA/NOfcx9kex1AMBlS558jFkFgnqwYayOvq5lmq37ElRGrI/m+/kTifz4Ks3lp4oBv1iHr/QYir9OpSIs7NeJ+zFHgChhKJPMvij271HMjB+MiJepiC7s28nS2HajuloE2tCljkaQxMmpkBJO0FSR5llVJHQIRA+QAY36YoCt16g8FREOB0VMRug9sdSEwOeI1C4k= ceph-22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:37:25.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-31T06:37:25.980 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:25 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1380029470' entity='client.admin' 2024-08-31T06:37:26.113 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:37:27.650 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-31T06:37:27.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-31T06:37:27.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:27 smithi037 ceph-mon[18612]: mgrmap e13: x(active, since 12s) 2024-08-31T06:37:28.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:27 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1313067487' entity='client.admin' 2024-08-31T06:37:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:37:30.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:30 smithi037 ceph-mon[18612]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:30.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:30 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:30.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:30 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:30.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:30 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:30.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:30 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"} : dispatch 2024-08-31T06:37:30.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:30 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:30.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:30 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:37:30.512 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi066 2024-08-31T06:37:30.512 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:37:30.512 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/etc/ceph/ceph.conf 2024-08-31T06:37:30.532 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:37:30.532 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:37:30.590 INFO:tasks.cephadm:Adding host smithi066 to orchestrator... 2024-08-31T06:37:30.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch host add smithi066 2024-08-31T06:37:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:37:32.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-31T06:37:32.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:37:32.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:37:32.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:37:32.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:32.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:32.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:32.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:37:32.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:32.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:37:32.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:31 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:33.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:32 smithi037 ceph-mon[18612]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:34.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:33 smithi037 ceph-mon[18612]: Deploying cephadm binary to smithi066 2024-08-31T06:37:35.466 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi066' with addr '172.21.15.66' 2024-08-31T06:37:35.466 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:35 smithi037 ceph-mon[18612]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:36.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T06:37:36.342 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:37:36.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:36 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:36.759 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:36 smithi037 ceph-mon[18612]: Added host smithi066 2024-08-31T06:37:36.759 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:36 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:37:36.759 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:36 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:36.759 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:36 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:36.977 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}] 2024-08-31T06:37:37.623 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi106 2024-08-31T06:37:37.623 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:37:37.624 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/etc/ceph/ceph.conf 2024-08-31T06:37:37.643 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:37:37.644 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:37:37.702 INFO:tasks.cephadm:Adding host smithi106 to orchestrator... 2024-08-31T06:37:37.702 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch host add smithi106 2024-08-31T06:37:37.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:37 smithi037 ceph-mon[18612]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:37.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:37 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:37.952 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:37:39.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:38 smithi037 ceph-mon[18612]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:37:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:40.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:40.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-08-31T06:37:40.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:40.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:39 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:37:41.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:40 smithi037 ceph-mon[18612]: Deploying cephadm binary to smithi106 2024-08-31T06:37:41.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:40 smithi037 ceph-mon[18612]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:37:41.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:40 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:41.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:40 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:41.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:40 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:42.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:41 smithi037 ceph-mon[18612]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:37:42.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:41 smithi037 ceph-mon[18612]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:42.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:41 smithi037 ceph-mon[18612]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:37:42.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:41 smithi037 ceph-mon[18612]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:37:42.560 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi106' with addr '172.21.15.106' 2024-08-31T06:37:43.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch host ls --format=json 2024-08-31T06:37:43.423 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:37:43.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:43 smithi037 ceph-mon[18612]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:43.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:43 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:43.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:43 smithi037 ceph-mon[18612]: Added host smithi106 2024-08-31T06:37:43.795 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:43 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:37:43.795 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:43 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:43.795 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:43 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:44.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:37:44.098 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}, {"addr": "172.21.15.106", "hostname": "smithi106", "labels": [], "status": ""}] 2024-08-31T06:37:44.682 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-31T06:37:44.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd crush tunables default 2024-08-31T06:37:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:37:45.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:44 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:45.911 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-08-31T06:37:46.234 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:45 smithi037 ceph-mon[18612]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:37:46.234 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:45 smithi037 ceph-mon[18612]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:46.234 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:45 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3453700102' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T06:37:46.568 INFO:tasks.cephadm:Adding mon.a on smithi037 2024-08-31T06:37:46.568 INFO:tasks.cephadm:Adding mon.b on smithi066 2024-08-31T06:37:46.568 INFO:tasks.cephadm:Adding mon.c on smithi106 2024-08-31T06:37:46.568 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch apply mon '3;smithi037:172.21.15.37=a;smithi066:172.21.15.66=b;smithi106:172.21.15.106=c' 2024-08-31T06:37:46.810 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T06:37:46.854 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-31T06:37:47.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3453700102' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T06:37:47.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:37:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"} : dispatch 2024-08-31T06:37:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:46 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:37:47.640 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled mon update... 2024-08-31T06:37:48.209 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:48.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:37:48.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:37:48.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:47 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:48.215 DEBUG:teuthology.orchestra.run.smithi066:mon.b> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.b.service 2024-08-31T06:37:48.218 DEBUG:teuthology.orchestra.run.smithi106:mon.c> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.c.service 2024-08-31T06:37:48.221 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T06:37:48.221 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T06:37:48.488 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:37:49.167 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:37:49.167 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","modified":"2024-08-31T06:36:13.915367Z","created":"2024-08-31T06:36:13.915367Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T06:37:49.167 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-08-31T06:37:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:48 smithi037 ceph-mon[18612]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:37:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:48 smithi037 ceph-mon[18612]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:37:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:48 smithi037 ceph-mon[18612]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:37:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:48 smithi037 ceph-mon[18612]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi066:172.21.15.66=b;smithi106:172.21.15.106=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:48 smithi037 ceph-mon[18612]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi066:172.21.15.66=b;smithi106:172.21.15.106=c;count:3 2024-08-31T06:37:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:48 smithi037 ceph-mon[18612]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T06:37:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:48 smithi037 ceph-mon[18612]: Reconfiguring daemon mon.a on smithi037 2024-08-31T06:37:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:37:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:50.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:37:50.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:50.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:37:50.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:50.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:49 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/1803571484' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:37:50.775 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T06:37:50.775 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T06:37:51.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:50 smithi037 ceph-mon[18612]: Deploying daemon mon.c on smithi106 2024-08-31T06:37:51.760 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:37:52.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:51 smithi037 ceph-mon[18612]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:52.661 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:37:52.661 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":1,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","modified":"2024-08-31T06:36:13.915367Z","created":"2024-08-31T06:36:13.915367Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-31T06:37:52.662 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 1 2024-08-31T06:37:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:52 smithi106 systemd[1]: Starting Ceph mon.c for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:37:53.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:52 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/3882159992' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:37:53.672 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 podman[22115]: 2024-08-31 06:37:53.658216891 +0000 UTC m=+0.099451353 container create 2a0cc1389358f708254561dab03d0d7d3905310fc1fa1d76f389cc98fe1325eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-c, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:37:53.672 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 podman[22115]: 2024-08-31 06:37:53.573988144 +0000 UTC m=+0.015222616 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:37:53.923 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 podman[22115]: 2024-08-31 06:37:53.885614472 +0000 UTC m=+0.326848934 container init 2a0cc1389358f708254561dab03d0d7d3905310fc1fa1d76f389cc98fe1325eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-31T06:37:53.923 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 podman[22115]: 2024-08-31 06:37:53.889942886 +0000 UTC m=+0.331177351 container start 2a0cc1389358f708254561dab03d0d7d3905310fc1fa1d76f389cc98fe1325eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T06:37:53.923 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: set uid:gid to 167:167 (ceph:ceph) 2024-08-31T06:37:53.923 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev), process ceph-mon, pid 2 2024-08-31T06:37:53.923 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pidfile_write: ignore empty --pid-file 2024-08-31T06:37:54.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: load: jerasure load: lrc 2024-08-31T06:37:54.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: RocksDB version: 7.9.2 2024-08-31T06:37:54.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Git sha 0 2024-08-31T06:37:54.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: DB SUMMARY 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: DB Session ID: 73Q7972E1EOK7WWL8ZZT 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: CURRENT file: CURRENT 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.error_if_exists: 0 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.create_if_missing: 0 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.paranoid_checks: 1 2024-08-31T06:37:54.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.env: 0x56157ffeb5a0 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.info_log: 0x5615867294e0 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.statistics: (nil) 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.use_fsync: 0 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_log_file_size: 0 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T06:37:54.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.allow_fallocate: 1 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.use_direct_reads: 0 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.db_log_dir: 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.wal_dir: 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T06:37:54.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T06:37:54.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T06:37:54.321 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.write_buffer_manager: 0x56158672d5e0 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T06:37:54.322 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.unordered_write: 0 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.row_cache: None 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.wal_filter: None 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.two_write_queues: 0 2024-08-31T06:37:54.323 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.wal_compression: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.atomic_flush: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.log_readahead_size: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T06:37:54.324 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_background_jobs: 2 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_background_compactions: -1 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_subcompactions: 1 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_open_files: -1 2024-08-31T06:37:54.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_background_flushes: -1 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Compression algorithms supported: 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: kZSTD supported: 0 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: kXpressCompression supported: 0 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: kBZip2Compression supported: 0 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: kLZ4Compression supported: 1 2024-08-31T06:37:54.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: kZlibCompression supported: 1 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: kSnappyCompression supported: 1 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.merge_operator: 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_filter: None 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T06:37:54.327 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561586729100) 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: cache_index_and_filter_blocks: 1 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: pin_top_level_index_and_filter: 1 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: index_type: 0 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: data_block_index_type: 0 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: index_shortening: 1 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: checksum: 4 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: no_block_cache: 0 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: block_cache: 0x5615826ec850 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: block_cache_name: BinnedLRUCache 2024-08-31T06:37:54.328 INFO:journalctl@ceph.mon.c.smithi106.stdout: block_cache_options: 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: capacity : 536870912 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: num_shard_bits : 4 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: strict_capacity_limit : 0 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: high_pri_pool_ratio: 0.000 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: block_cache_compressed: (nil) 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: persistent_cache: (nil) 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: block_size: 4096 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: block_size_deviation: 10 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: block_restart_interval: 16 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: index_block_restart_interval: 1 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: metadata_block_size: 4096 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: partition_filters: 0 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: use_delta_encoding: 1 2024-08-31T06:37:54.329 INFO:journalctl@ceph.mon.c.smithi106.stdout: filter_policy: bloomfilter 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: whole_key_filtering: 1 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: verify_compression: 0 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: read_amp_bytes_per_bit: 0 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: format_version: 5 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: enable_index_compression: 1 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: block_align: 0 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: max_auto_readahead_size: 262144 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: prepopulate_block_cache: 0 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: initial_auto_readahead_size: 8192 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression: NoCompression 2024-08-31T06:37:54.330 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.num_levels: 7 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T06:37:54.331 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T06:37:54.332 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T06:37:54.333 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T06:37:54.334 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.inplace_update_support: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.bloom_locality: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.max_successive_merges: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.ttl: 2592000 2024-08-31T06:37:54.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.enable_blob_files: false 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.min_blob_size: 0 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T06:37:54.336 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b1532f3e-12f4-4152-8f66-c572522503b8 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086273927319, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086273927740, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725086273, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b1532f3e-12f4-4152-8f66-c572522503b8", "db_session_id": "73Q7972E1EOK7WWL8ZZT", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086273927837, "job": 1, "event": "recovery_finished"} 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56158674ca80 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: DB pointer 0x5615874ee000 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout: ** DB Stats ** 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T06:37:54.337 INFO:journalctl@ceph.mon.c.smithi106.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: ** Compaction Stats [default] ** 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T06:37:54.338 INFO:journalctl@ceph.mon.c.smithi106.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: ** Compaction Stats [default] ** 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T06:37:54.339 INFO:journalctl@ceph.mon.c.smithi106.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: Block cache BinnedLRUCache@0x5615826ec850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-31T06:37:54.340 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: using public_addr v2:172.21.15.106:0/0 -> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: starting mon.c rank -1 at public addrs [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] at bind addrs [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(???) e0 preinit fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).mds e1 new map 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout: e1 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout: btime 2024-08-31T06:36:16:871294+0000 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout: legacy client fscid: -1 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout: 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout: No filesystems configured 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T06:37:54.341 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:37:54.342 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:37:54.343 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Deploying cephadm binary to smithi106 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.344 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Added host smithi106 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3453700102' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3453700102' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.345 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"} : dispatch 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.346 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi066:172.21.15.66=b;smithi106:172.21.15.106=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi066:172.21.15.66=b;smithi106:172.21.15.106=c;count:3 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Reconfiguring daemon mon.a on smithi037 2024-08-31T06:37:54.347 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/1803571484' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: Deploying daemon mon.c on smithi106 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/3882159992' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:37:54.348 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.349 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 ceph-mon[22134]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T06:37:54.349 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 bash[22115]: 2a0cc1389358f708254561dab03d0d7d3905310fc1fa1d76f389cc98fe1325eb 2024-08-31T06:37:54.349 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:53 smithi106 systemd[1]: Started Ceph mon.c for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:37:54.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:53 smithi037 ceph-mon[18612]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:54.419 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T06:37:54.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T06:37:54.671 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:37:59.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:37:59.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: mon.a calling monitor election 2024-08-31T06:37:59.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:59.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: mon.c calling monitor election 2024-08-31T06:37:59.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:59.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:59.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T06:37:59.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: monmap epoch 2 2024-08-31T06:37:59.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:37:59.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: last_changed 2024-08-31T06:37:53.955169+0000 2024-08-31T06:37:59.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: created 2024-08-31T06:36:13.915367+0000 2024-08-31T06:37:59.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: min_mon_release 19 (squid) 2024-08-31T06:37:59.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: election_strategy: 1 2024-08-31T06:37:59.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-31T06:37:59.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.c 2024-08-31T06:37:59.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: fsmap 2024-08-31T06:37:59.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:37:59.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: mgrmap e13: x(active, since 44s) 2024-08-31T06:37:59.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: overall HEALTH_OK 2024-08-31T06:37:59.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:59.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:59.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:59.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:37:59.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:37:59 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:59.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:37:59.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: mon.a calling monitor election 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: mon.c calling monitor election 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T06:37:59.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: monmap epoch 2 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: last_changed 2024-08-31T06:37:53.955169+0000 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: created 2024-08-31T06:36:13.915367+0000 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: min_mon_release 19 (squid) 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: election_strategy: 1 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.c 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: fsmap 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: mgrmap e13: x(active, since 44s) 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: overall HEALTH_OK 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:59.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:59.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:37:59.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:37:59.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:37:59 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:37:59.786 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:37:59.786 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":2,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","modified":"2024-08-31T06:37:53.955169Z","created":"2024-08-31T06:36:13.915367Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T06:37:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 2 2024-08-31T06:38:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:00 smithi106 ceph-mon[22134]: Deploying daemon mon.b on smithi066 2024-08-31T06:38:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:00 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/872816615' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:38:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:00 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:00.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:00 smithi037 ceph-mon[18612]: Deploying daemon mon.b on smithi066 2024-08-31T06:38:00.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:00 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/872816615' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:38:00.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:00 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:01.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:01 smithi106 ceph-mon[22134]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:01 smithi037 ceph-mon[18612]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:01.386 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T06:38:01.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T06:38:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:38:02.351 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:38:02.351 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":2,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","modified":"2024-08-31T06:37:53.955169Z","created":"2024-08-31T06:36:13.915367Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-31T06:38:02.351 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 2 2024-08-31T06:38:02.766 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: load: jerasure load: lrc 2024-08-31T06:38:03.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: RocksDB version: 7.9.2 2024-08-31T06:38:03.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Git sha 0 2024-08-31T06:38:03.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Compile date 2024-08-28 10:19:06 2024-08-31T06:38:03.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: DB SUMMARY 2024-08-31T06:38:03.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: DB Session ID: A7ZOH79082RB49UVGINN 2024-08-31T06:38:03.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: CURRENT file: CURRENT 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: IDENTITY file: IDENTITY 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.error_if_exists: 0 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.create_if_missing: 0 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.paranoid_checks: 1 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.env: 0x56295e8325a0 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.fs: PosixFileSystem 2024-08-31T06:38:03.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.info_log: 0x5629638b34e0 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_file_opening_threads: 16 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.statistics: (nil) 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.use_fsync: 0 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_log_file_size: 0 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.keep_log_file_num: 1000 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.recycle_log_file_num: 0 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.allow_fallocate: 1 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.allow_mmap_reads: 0 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.allow_mmap_writes: 0 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.use_direct_reads: 0 2024-08-31T06:38:03.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-31T06:38:03.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.create_missing_column_families: 0 2024-08-31T06:38:03.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.db_log_dir: 2024-08-31T06:38:03.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.wal_dir: 2024-08-31T06:38:03.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-31T06:38:03.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-31T06:38:03.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-31T06:38:03.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.advise_random_on_open: 1 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.db_write_buffer_size: 0 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.write_buffer_manager: 0x5629638b75e0 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.rate_limiter: (nil) 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.wal_recovery_mode: 2 2024-08-31T06:38:03.143 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.enable_thread_tracking: 0 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.enable_pipelined_write: 0 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.unordered_write: 0 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.row_cache: None 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.wal_filter: None 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-31T06:38:03.144 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.allow_ingest_behind: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.two_write_queues: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.manual_wal_flush: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.wal_compression: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.atomic_flush: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.log_readahead_size: 0 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-31T06:38:03.145 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.best_efforts_recovery: 0 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.allow_data_in_errors: 0 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.db_host_id: __hostname__ 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_background_jobs: 2 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_background_compactions: -1 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_subcompactions: 1 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_total_wal_size: 0 2024-08-31T06:38:03.146 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_open_files: -1 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bytes_per_sync: 0 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_readahead_size: 0 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_background_flushes: -1 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Compression algorithms supported: 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: kZSTD supported: 0 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: kXpressCompression supported: 0 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: kBZip2Compression supported: 0 2024-08-31T06:38:03.147 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: kLZ4Compression supported: 1 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: kZlibCompression supported: 1 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: kLZ4HCCompression supported: 1 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: kSnappyCompression supported: 1 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.merge_operator: 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_filter: None 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_filter_factory: None 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.sst_partitioner_factory: None 2024-08-31T06:38:03.148 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5629638b3100) 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: cache_index_and_filter_blocks: 1 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: pin_top_level_index_and_filter: 1 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: index_type: 0 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: data_block_index_type: 0 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: index_shortening: 1 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: checksum: 4 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: no_block_cache: 0 2024-08-31T06:38:03.149 INFO:journalctl@ceph.mon.b.smithi066.stdout: block_cache: 0x56295f876850 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: block_cache_name: BinnedLRUCache 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: block_cache_options: 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: capacity : 536870912 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: num_shard_bits : 4 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: strict_capacity_limit : 0 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: high_pri_pool_ratio: 0.000 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: block_cache_compressed: (nil) 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: persistent_cache: (nil) 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: block_size: 4096 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: block_size_deviation: 10 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: block_restart_interval: 16 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: index_block_restart_interval: 1 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: metadata_block_size: 4096 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: partition_filters: 0 2024-08-31T06:38:03.150 INFO:journalctl@ceph.mon.b.smithi066.stdout: use_delta_encoding: 1 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: filter_policy: bloomfilter 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: whole_key_filtering: 1 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: verify_compression: 0 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: read_amp_bytes_per_bit: 0 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: format_version: 5 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: enable_index_compression: 1 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: block_align: 0 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: max_auto_readahead_size: 262144 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: prepopulate_block_cache: 0 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: initial_auto_readahead_size: 8192 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout: num_file_reads_for_auto_readahead: 2 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.write_buffer_size: 33554432 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_write_buffer_number: 2 2024-08-31T06:38:03.151 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression: NoCompression 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression: Disabled 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.prefix_extractor: nullptr 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.num_levels: 7 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-31T06:38:03.152 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.level: 32767 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.strategy: 0 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.enabled: false 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-31T06:38:03.153 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.target_file_size_base: 67108864 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-31T06:38:03.154 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.arena_block_size: 1048576 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.disable_auto_compactions: 0 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-31T06:38:03.156 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.inplace_update_support: 0 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-31T06:38:03.157 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.bloom_locality: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.max_successive_merges: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.paranoid_file_checks: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.force_consistency_checks: 1 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.report_bg_io_stats: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.ttl: 2592000 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.enable_blob_files: false 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.min_blob_size: 0 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.blob_file_size: 268435456 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-31T06:38:03.158 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.blob_file_starting_level: 0 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2beb6cbc-ba44-4bf3-b98a-b6ef13c6e6cb 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086282767925, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086282768349, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725086282, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2beb6cbc-ba44-4bf3-b98a-b6ef13c6e6cb", "db_session_id": "A7ZOH79082RB49UVGINN", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725086282768447, "job": 1, "event": "recovery_finished"} 2024-08-31T06:38:03.159 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5629638d6a80 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: DB pointer 0x562964678000 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: ** DB Stats ** 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-31T06:38:03.160 INFO:journalctl@ceph.mon.b.smithi066.stdout: 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: ** Compaction Stats [default] ** 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: ** Compaction Stats [default] ** 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: 2024-08-31T06:38:03.161 INFO:journalctl@ceph.mon.b.smithi066.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: Block cache BinnedLRUCache@0x56295f876850#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-31T06:38:03.162 INFO:journalctl@ceph.mon.b.smithi066.stdout: 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: using public_addr v2:172.21.15.66:0/0 -> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: starting mon.b rank -1 at public addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] at bind addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(???) e0 preinit fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).mds e1 new map 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout: e1 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout: btime 2024-08-31T06:36:16:871294+0000 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout: legacy client fscid: -1 2024-08-31T06:38:03.163 INFO:journalctl@ceph.mon.b.smithi066.stdout: 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout: No filesystems configured 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.164 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi106", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Deploying cephadm binary to smithi106 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.165 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Added host smithi106 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.166 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3453700102' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3453700102' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.167 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi066:172.21.15.66=b;smithi106:172.21.15.106=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:03.168 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi066:172.21.15.66=b;smithi106:172.21.15.106=c;count:3 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Reconfiguring mon.a (unknown last config time)... 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Reconfiguring daemon mon.a on smithi037 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/1803571484' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Deploying daemon mon.c on smithi106 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.169 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/3882159992' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.a calling monitor election 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.c calling monitor election 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:03.170 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: monmap epoch 2 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: last_changed 2024-08-31T06:37:53.955169+0000 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: created 2024-08-31T06:36:13.915367+0000 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: min_mon_release 19 (squid) 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: election_strategy: 1 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.c 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: fsmap 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mgrmap e13: x(active, since 44s) 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: overall HEALTH_OK 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: Deploying daemon mon.b on smithi066 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/872816615' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 ceph-mon[22244]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 bash[22225]: 2e7cea2798aafed1a7f4cfc253ff5629a6e6e6932850a09bfeba9c80cf39423a 2024-08-31T06:38:03.172 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:02 smithi066 systemd[1]: Started Ceph mon.b for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:38:03.927 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-31T06:38:03.928 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph mon dump -f json 2024-08-31T06:38:04.195 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: mon.a calling monitor election 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: mon.c calling monitor election 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: mon.b calling monitor election 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: monmap epoch 3 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: last_changed 2024-08-31T06:38:02.796694+0000 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: created 2024-08-31T06:36:13.915367+0000 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: min_mon_release 19 (squid) 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: election_strategy: 1 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.c 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: fsmap 2024-08-31T06:38:08.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:38:08.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: mgrmap e13: x(active, since 53s) 2024-08-31T06:38:08.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: overall HEALTH_OK 2024-08-31T06:38:08.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:07 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:38:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: mon.a calling monitor election 2024-08-31T06:38:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: mon.c calling monitor election 2024-08-31T06:38:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: mon.b calling monitor election 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T06:38:08.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: monmap epoch 3 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: last_changed 2024-08-31T06:38:02.796694+0000 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: created 2024-08-31T06:36:13.915367+0000 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: min_mon_release 19 (squid) 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: election_strategy: 1 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.c 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: fsmap 2024-08-31T06:38:08.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:38:08.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: mgrmap e13: x(active, since 53s) 2024-08-31T06:38:08.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: overall HEALTH_OK 2024-08-31T06:38:08.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:07 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: mon.a calling monitor election 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: mon.c calling monitor election 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: mon.b calling monitor election 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: monmap epoch 3 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: last_changed 2024-08-31T06:38:02.796694+0000 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: created 2024-08-31T06:36:13.915367+0000 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: min_mon_release 19 (squid) 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: election_strategy: 1 2024-08-31T06:38:08.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: 1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.c 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: 2: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: fsmap 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: osdmap e4: 0 total, 0 up, 0 in 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: mgrmap e13: x(active, since 53s) 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: overall HEALTH_OK 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:07 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:08.472 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:38:08.473 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":3,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","modified":"2024-08-31T06:38:02.796694Z","created":"2024-08-31T06:36:13.915367Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:3300","nonce":0},{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-31T06:38:08.473 INFO:teuthology.orchestra.run.smithi106.stderr:dumped monmap epoch 3 2024-08-31T06:38:09.039 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:08 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:09.039 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:08 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/1281272188' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:38:09.039 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:08 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:09.065 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-31T06:38:09.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config generate-minimal-conf 2024-08-31T06:38:09.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:08 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:09.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:08 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/1281272188' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:38:09.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:08 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:09.328 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:09.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:08 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:09.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:08 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/1281272188' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-31T06:38:09.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:08 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:09.990 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:38:09.990 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-08-31T06:38:09.990 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:38:09.990 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] 2024-08-31T06:38:09.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:09 smithi037 ceph-mon[18612]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:09.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:09 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:09.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:09 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:09.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:09 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:09.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:09 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:09.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:09 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:09.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:09 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:09.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:09 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:10.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:09 smithi106 ceph-mon[22134]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:10.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:09 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:09 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:09 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:09 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:09 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:09 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:09 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:10.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:09 smithi066 ceph-mon[22244]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:09 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:09 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:09 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:09 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:09 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:09 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:09 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:10.693 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-31T06:38:10.693 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:38:10.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T06:38:10.724 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:38:10.724 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:10.789 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:38:10.789 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T06:38:10.818 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:38:10.818 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:10.885 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:38:10.886 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.conf 2024-08-31T06:38:10.916 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:38:10.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:10.982 INFO:tasks.cephadm:enabling module snap_schedule 2024-08-31T06:38:10.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/789515920' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:11.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:11.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:10 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/789515920' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:11.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:11.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:10 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:11.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-31T06:38:11.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:38:11.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:38:11.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/789515920' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:11.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:11.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:10 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:12.075 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:12.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: Reconfiguring mon.a (monmap changed)... 2024-08-31T06:38:12.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: Reconfiguring daemon mon.a on smithi037 2024-08-31T06:38:12.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:12.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:12.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:12.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:12.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:11 smithi037 ceph-mon[18612]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:12.202 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: Reconfiguring mon.a (monmap changed)... 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: Reconfiguring daemon mon.a on smithi037 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:12.203 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:11 smithi066 ceph-mon[22244]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:12.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:12.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:12.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: Reconfiguring mon.a (monmap changed)... 2024-08-31T06:38:12.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: Reconfiguring daemon mon.a on smithi037 2024-08-31T06:38:12.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:12.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' 2024-08-31T06:38:12.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:12.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:12.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:11 smithi106 ceph-mon[22134]: from='mgr.14150 172.21.15.37:0/2704541152' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:13.205 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:12 smithi066 ceph-mon[22244]: Reconfiguring mon.b (monmap changed)... 2024-08-31T06:38:13.296 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:12 smithi066 ceph-mon[22244]: Reconfiguring daemon mon.b on smithi066 2024-08-31T06:38:13.296 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:12 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1483818363' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T06:38:13.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:12 smithi106 ceph-mon[22134]: Reconfiguring mon.b (monmap changed)... 2024-08-31T06:38:13.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:12 smithi106 ceph-mon[22134]: Reconfiguring daemon mon.b on smithi066 2024-08-31T06:38:13.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:12 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1483818363' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T06:38:13.343 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:13 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ignoring --setuser ceph since I am not root 2024-08-31T06:38:13.344 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:13 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ignoring --setgroup ceph since I am not root 2024-08-31T06:38:13.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:12 smithi037 ceph-mon[18612]: Reconfiguring mon.b (monmap changed)... 2024-08-31T06:38:13.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:12 smithi037 ceph-mon[18612]: Reconfiguring daemon mon.b on smithi066 2024-08-31T06:38:13.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:12 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1483818363' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-08-31T06:38:13.647 INFO:tasks.cephadm:Adding mgr.x on smithi037 2024-08-31T06:38:13.648 INFO:tasks.cephadm:Adding mgr.y on smithi066 2024-08-31T06:38:13.648 INFO:tasks.cephadm:Adding mgr.z on smithi106 2024-08-31T06:38:13.648 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch apply mgr '3;smithi037=x;smithi066=y;smithi106=z' 2024-08-31T06:38:13.898 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:38:14.271 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:13 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1483818363' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T06:38:14.271 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:13 smithi106 ceph-mon[22134]: mgrmap e14: x(active, since 58s) 2024-08-31T06:38:14.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:13 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1483818363' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T06:38:14.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:13 smithi037 ceph-mon[18612]: mgrmap e14: x(active, since 58s) 2024-08-31T06:38:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:13 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1483818363' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-31T06:38:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:13 smithi066 ceph-mon[22244]: mgrmap e14: x(active, since 58s) 2024-08-31T06:38:18.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: Active manager daemon x restarted 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: Activating manager daemon x 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: mgrmap e15: x(active, starting, since 0.00499364s) 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T06:38:18.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:18 smithi106 ceph-mon[22134]: Manager daemon x is now available 2024-08-31T06:38:18.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: Active manager daemon x restarted 2024-08-31T06:38:18.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: Activating manager daemon x 2024-08-31T06:38:18.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: mgrmap e15: x(active, starting, since 0.00499364s) 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T06:38:18.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:18 smithi037 ceph-mon[18612]: Manager daemon x is now available 2024-08-31T06:38:18.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: Active manager daemon x restarted 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: Activating manager daemon x 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: osdmap e5: 0 total, 0 up, 0 in 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: mgrmap e15: x(active, starting, since 0.00499364s) 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-31T06:38:18.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:18 smithi066 ceph-mon[22244]: Manager daemon x is now available 2024-08-31T06:38:19.211 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled mgr update... 2024-08-31T06:38:19.462 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:19.462 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T06:38:19.462 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T06:38:19.462 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:19 smithi066 ceph-mon[22244]: mgrmap e16: x(active, since 1.01107s) 2024-08-31T06:38:19.462 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:19.508 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:19.508 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T06:38:19.508 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T06:38:19.508 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:19 smithi106 ceph-mon[22134]: mgrmap e16: x(active, since 1.01107s) 2024-08-31T06:38:19.508 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:19.539 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:19.539 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-31T06:38:19.539 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-31T06:38:19.540 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:19 smithi037 ceph-mon[18612]: mgrmap e16: x(active, since 1.01107s) 2024-08-31T06:38:19.540 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:19.819 DEBUG:teuthology.orchestra.run.smithi066:mgr.y> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.y.service 2024-08-31T06:38:19.822 DEBUG:teuthology.orchestra.run.smithi106:mgr.z> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.z.service 2024-08-31T06:38:19.824 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-31T06:38:19.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-31T06:38:19.826 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-31T06:38:19.827 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set client debug_client 20 2024-08-31T06:38:19.869 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-31T06:38:19.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set client debug_ms 1 2024-08-31T06:38:19.912 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-31T06:38:19.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-31T06:38:19.955 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-31T06:38:19.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-31T06:38:19.998 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-31T06:38:19.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-31T06:38:20.041 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-31T06:38:20.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-31T06:38:20.091 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-31T06:38:20.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-31T06:38:20.156 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-31T06:38:20.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-31T06:38:20.157 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:20.217 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-31T06:38:20.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-31T06:38:20.266 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-31T06:38:20.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-31T06:38:20.311 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-31T06:38:20.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-31T06:38:20.355 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-31T06:38:20.356 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-31T06:38:20.410 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-31T06:38:20.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-31T06:38:20.465 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-31T06:38:20.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-31T06:38:20.519 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-31T06:38:20.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-31T06:38:20.520 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:20.586 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-31T06:38:20.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-31T06:38:20.643 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-31T06:38:20.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-31T06:38:20.688 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-31T06:38:20.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-31T06:38:20.731 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-08-31T06:38:20.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mgr debug_cephsqlite 20 2024-08-31T06:38:20.793 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-08-31T06:38:20.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-08-31T06:38:20.843 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-08-31T06:38:20.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-08-31T06:38:20.910 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-08-31T06:38:20.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-08-31T06:38:20.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: Saving service mgr spec with placement smithi037=x;smithi066=y;smithi106=z;count:3 2024-08-31T06:38:20.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:20.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:20.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:20.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:20.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:20.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:20.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:20.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:20.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:20.940 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-31T06:38:20.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-31T06:38:20.998 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-31T06:38:20.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-31T06:38:21.064 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-31T06:38:21.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-31T06:38:21.112 DEBUG:tasks.cephadm:set 26 configs 2024-08-31T06:38:21.112 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi037') 2024-08-31T06:38:21.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: Saving service mgr spec with placement smithi037=x;smithi066=y;smithi106=z;count:3 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:21.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.196 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:21.196 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:21.309 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:21.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: Saving service mgr spec with placement smithi037=x;smithi066=y;smithi106=z;count:3 2024-08-31T06:38:21.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:21.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:21.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 -- 172.21.15.37:0/1315081055 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0a003f2d0 msgr2=0x7ff0a00417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 --2- 172.21.15.37:0/1315081055 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0a003f2d0 0x7ff0a00417e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8005d90 tx=0x7ff0a8004d30 comp rx=0 tx=0).stop 2024-08-31T06:38:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 -- 172.21.15.37:0/1315081055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b8104420 msgr2=0x7ff0b819c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 --2- 172.21.15.37:0/1315081055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b8104420 0x7ff0b819c200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b560 tx=0x7ff0ac00ba20 comp rx=0 tx=0).stop 2024-08-31T06:38:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 -- 172.21.15.37:0/1315081055 shutdown_connections 2024-08-31T06:38:22.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 --2- 172.21.15.37:0/1315081055 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0a003f2d0 0x7ff0a00417e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 --2- 172.21.15.37:0/1315081055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b8104420 0x7ff0b819c200 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 --2- 172.21.15.37:0/1315081055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0b810b470 0x7ff0b819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 --2- 172.21.15.37:0/1315081055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0b81019a0 0x7ff0b819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 -- 172.21.15.37:0/1315081055 >> 172.21.15.37:0/1315081055 conn(0x7ff0b80fd510 msgr2=0x7ff0b8102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 -- 172.21.15.37:0/1315081055 shutdown_connections 2024-08-31T06:38:22.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:22.116+0000 7ff0be190640 1 -- 172.21.15.37:0/1315081055 wait complete. 2024-08-31T06:38:22.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:22 smithi066 ceph-mon[22244]: mgrmap e17: x(active, since 2s) 2024-08-31T06:38:22.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:22 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:22.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:22 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:22.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:22 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:22.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:22 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2808029547' entity='client.admin' 2024-08-31T06:38:22.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:22 smithi066 ceph-mon[22244]: [31/Aug/2024:06:38:22] ENGINE Bus STARTING 2024-08-31T06:38:22.551 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-mon[18612]: mgrmap e17: x(active, since 2s) 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2808029547' entity='client.admin' 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-mon[18612]: [31/Aug/2024:06:38:22] ENGINE Bus STARTING 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:38:22.228+0000 7ff8e2c7f640 -1 log_channel(cephadm) log [ERR] : [31/Aug/2024:06:38:22] ENGINE Error in HTTPServer.serve 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: Traceback (most recent call last): 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T06:38:22.552 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._connections.run(self.expiration_interval) 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._run(expiration_interval) 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: s = self.context.wrap_socket( 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: return self.sslsocket_class._create( 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self.do_handshake() 2024-08-31T06:38:22.553 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T06:38:22.554 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: self._sslobj.do_handshake() 2024-08-31T06:38:22.554 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T06:38:22.554 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:38:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:38:22.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:22 smithi106 ceph-mon[22134]: mgrmap e17: x(active, since 2s) 2024-08-31T06:38:22.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:22 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:22.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:22 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:22.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:22 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi106", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:22.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:22 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2808029547' entity='client.admin' 2024-08-31T06:38:22.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:22 smithi106 ceph-mon[22134]: [31/Aug/2024:06:38:22] ENGINE Bus STARTING 2024-08-31T06:38:22.604 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi037') 2024-08-31T06:38:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:22.643 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:22.643 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:23.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: [31/Aug/2024:06:38:22] ENGINE Serving on http://172.21.15.37:8765 2024-08-31T06:38:23.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1315081055' entity='client.admin' 2024-08-31T06:38:23.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:23.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: [31/Aug/2024:06:38:22] ENGINE Serving on https://172.21.15.37:7150 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: [31/Aug/2024:06:38:22] ENGINE Bus STARTED 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: [31/Aug/2024:06:38:22] ENGINE Error in HTTPServer.serve 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-08-31T06:38:23.193 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-08-31T06:38:23.194 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.376 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:23.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: [31/Aug/2024:06:38:22] ENGINE Serving on http://172.21.15.37:8765 2024-08-31T06:38:23.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1315081055' entity='client.admin' 2024-08-31T06:38:23.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:23.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:23.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:23.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: [31/Aug/2024:06:38:22] ENGINE Serving on https://172.21.15.37:7150 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: [31/Aug/2024:06:38:22] ENGINE Bus STARTED 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: [31/Aug/2024:06:38:22] ENGINE Error in HTTPServer.serve 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout: Traceback (most recent call last): 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T06:38:23.389 INFO:journalctl@ceph.mon.b.smithi066.stdout: self._run(expiration_interval) 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: s = self.context.wrap_socket( 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: return self.sslsocket_class._create( 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: self.do_handshake() 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: self._sslobj.do_handshake() 2024-08-31T06:38:23.390 INFO:journalctl@ceph.mon.b.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.391 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.556 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: [31/Aug/2024:06:38:22] ENGINE Serving on http://172.21.15.37:8765 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1315081055' entity='client.admin' 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"} : dispatch 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi066:/etc/ceph/ceph.conf 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi106:/etc/ceph/ceph.conf 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: [31/Aug/2024:06:38:22] ENGINE Serving on https://172.21.15.37:7150 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: [31/Aug/2024:06:38:22] ENGINE Bus STARTED 2024-08-31T06:38:23.557 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: [31/Aug/2024:06:38:22] ENGINE Error in HTTPServer.serve 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: Traceback (most recent call last): 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: self._connections.run(self.expiration_interval) 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: self._run(expiration_interval) 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: s = self.context.wrap_socket( 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: return self.sslsocket_class._create( 2024-08-31T06:38:23.558 INFO:journalctl@ceph.mon.c.smithi106.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout: self.do_handshake() 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout: self._sslobj.do_handshake() 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.conf 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi106:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: Updating smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/config/ceph.client.admin.keyring 2024-08-31T06:38:23.559 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.560 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.565+0000 7f8d5fc64640 1 -- 172.21.15.37:0/3544728998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58105880 msgr2=0x7f8d5810f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.565+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/3544728998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58105880 0x7f8d5810f2d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009be0 tx=0x7f8d5002a6c0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.565+0000 7f8d5fc64640 1 -- 172.21.15.37:0/3544728998 shutdown_connections 2024-08-31T06:38:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.565+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/3544728998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58105880 0x7f8d5810f2d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.565+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/3544728998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d58104f30 0x7f8d58105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.565+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/3544728998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d58102f60 0x7f8d58103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.565+0000 7f8d5fc64640 1 -- 172.21.15.37:0/3544728998 >> 172.21.15.37:0/3544728998 conn(0x7f8d58077a00 msgr2=0x7f8d58077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.566+0000 7f8d5fc64640 1 -- 172.21.15.37:0/3544728998 shutdown_connections 2024-08-31T06:38:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.566+0000 7f8d5fc64640 1 -- 172.21.15.37:0/3544728998 wait complete. 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.566+0000 7f8d5fc64640 1 Processor -- start 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.566+0000 7f8d5fc64640 1 -- start start 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5fc64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d58102f60 0x7f8d58199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5fc64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58104f30 0x7f8d5819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5fc64640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d58105880 0x7f8d5819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5fc64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58112280 con 0x7f8d58104f30 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5fc64640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58112100 con 0x7f8d58102f60 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5fc64640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8d58112400 con 0x7f8d58105880 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58104f30 0x7f8d5819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:23.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58104f30 0x7f8d5819a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49412/0 (socket says 172.21.15.37:49412) 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 -- 172.21.15.37:0/679053129 learned_addr learned my addr 172.21.15.37:0/679053129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5e201640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d58105880 0x7f8d5819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5da00640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d58102f60 0x7f8d58199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 -- 172.21.15.37:0/679053129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d58105880 msgr2=0x7f8d5819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d58105880 0x7f8d5819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 -- 172.21.15.37:0/679053129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d58102f60 msgr2=0x7f8d58199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d58102f60 0x7f8d58199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 -- 172.21.15.37:0/679053129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5819fdb0 con 0x7f8d58104f30 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5e201640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d58105880 0x7f8d5819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d5d1ff640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58104f30 0x7f8d5819a3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e9f0 tx=0x7f8d5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d4effd640 1 -- 172.21.15.37:0/679053129 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5400ccc0 con 0x7f8d58104f30 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.567+0000 7f8d4effd640 1 -- 172.21.15.37:0/679053129 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(22 keys) ==== 976+0+0 (secure 0 0 0) 0x7f8d54010860 con 0x7f8d58104f30 2024-08-31T06:38:23.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.568+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d581a00a0 con 0x7f8d58104f30 2024-08-31T06:38:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.568+0000 7f8d4effd640 1 -- 172.21.15.37:0/679053129 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54018680 con 0x7f8d58104f30 2024-08-31T06:38:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.568+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d581a6800 con 0x7f8d58104f30 2024-08-31T06:38:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.569+0000 7f8d4effd640 1 -- 172.21.15.37:0/679053129 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f8d54018820 con 0x7f8d58104f30 2024-08-31T06:38:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.568+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d58103370 con 0x7f8d58104f30 2024-08-31T06:38:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.569+0000 7f8d4effd640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d4403f2d0 0x7f8d440417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.569+0000 7f8d4effd640 1 -- 172.21.15.37:0/679053129 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8d54053de0 con 0x7f8d58104f30 2024-08-31T06:38:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.569+0000 7f8d5da00640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d4403f2d0 0x7f8d440417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:23.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.569+0000 7f8d5da00640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d4403f2d0 0x7f8d440417e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009b60 tx=0x7f8d48005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.574+0000 7f8d4effd640 1 -- 172.21.15.37:0/679053129 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d540071c0 con 0x7f8d58104f30 2024-08-31T06:38:23.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.762+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f8d5810b8a0 con 0x7f8d58104f30 2024-08-31T06:38:23.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.766+0000 7f8d4effd640 1 -- 172.21.15.37:0/679053129 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f8d54025da0 con 0x7f8d58104f30 2024-08-31T06:38:23.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.767+0000 7f8d4effd640 1 -- 172.21.15.37:0/679053129 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(23 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f8d54010a10 con 0x7f8d58104f30 2024-08-31T06:38:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d4403f2d0 msgr2=0x7f8d440417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d4403f2d0 0x7f8d440417e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d48009b60 tx=0x7f8d48005f90 comp rx=0 tx=0).stop 2024-08-31T06:38:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58104f30 msgr2=0x7f8d5819a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58104f30 0x7f8d5819a3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400e9f0 tx=0x7f8d5400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 shutdown_connections 2024-08-31T06:38:23.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d4403f2d0 0x7f8d440417e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d58104f30 0x7f8d5819a3e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d58105880 0x7f8d5819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 --2- 172.21.15.37:0/679053129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d58102f60 0x7f8d58199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:23.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 >> 172.21.15.37:0/679053129 conn(0x7f8d58077a00 msgr2=0x7f8d58106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:23.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 shutdown_connections 2024-08-31T06:38:23.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:23.769+0000 7f8d5fc64640 1 -- 172.21.15.37:0/679053129 wait complete. 2024-08-31T06:38:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: Deploying daemon mgr.z on smithi106 2024-08-31T06:38:24.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:24 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/679053129' entity='client.admin' 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: Deploying daemon mgr.z on smithi106 2024-08-31T06:38:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:24 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/679053129' entity='client.admin' 2024-08-31T06:38:24.529 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.529 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.529 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.529 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.529 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:24.529 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:24.529 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T06:38:24.530 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:24.530 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:24.530 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: Deploying daemon mgr.z on smithi106 2024-08-31T06:38:24.530 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:24 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/679053129' entity='client.admin' 2024-08-31T06:38:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 -- 172.21.15.37:0/3816145069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108ad0 msgr2=0x7fad7810f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 --2- 172.21.15.37:0/3816145069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108ad0 0x7fad7810f300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad70009ca0 tx=0x7fad7002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 -- 172.21.15.37:0/3816145069 shutdown_connections 2024-08-31T06:38:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 --2- 172.21.15.37:0/3816145069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108ad0 0x7fad7810f300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 --2- 172.21.15.37:0/3816145069 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad78108180 0x7fad78108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 --2- 172.21.15.37:0/3816145069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad78102840 0x7fad78102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 -- 172.21.15.37:0/3816145069 >> 172.21.15.37:0/3816145069 conn(0x7fad78079580 msgr2=0x7fad78079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 -- 172.21.15.37:0/3816145069 shutdown_connections 2024-08-31T06:38:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.626+0000 7fad7db16640 1 -- 172.21.15.37:0/3816145069 wait complete. 2024-08-31T06:38:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad7db16640 1 Processor -- start 2024-08-31T06:38:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad7db16640 1 -- start start 2024-08-31T06:38:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad7db16640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad78102840 0x7fad78199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad7db16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108180 0x7fad7819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad7db16640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad78108ad0 0x7fad7819f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad7db16640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad78112440 con 0x7fad78108180 2024-08-31T06:38:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad7db16640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad781122c0 con 0x7fad78108ad0 2024-08-31T06:38:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad7db16640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad781125c0 con 0x7fad78102840 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108180 0x7fad7819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108180 0x7fad7819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54724/0 (socket says 172.21.15.37:54724) 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad76ffd640 1 -- 172.21.15.37:0/968356417 learned_addr learned my addr 172.21.15.37:0/968356417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.627+0000 7fad777fe640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad78102840 0x7fad78199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad77fff640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad78108ad0 0x7fad7819f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad76ffd640 1 -- 172.21.15.37:0/968356417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad78102840 msgr2=0x7fad78199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad76ffd640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad78102840 0x7fad78199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad76ffd640 1 -- 172.21.15.37:0/968356417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad78108ad0 msgr2=0x7fad7819f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad76ffd640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad78108ad0 0x7fad7819f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad76ffd640 1 -- 172.21.15.37:0/968356417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad7819fe90 con 0x7fad78108180 2024-08-31T06:38:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad76ffd640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108180 0x7fad7819a580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e9f0 tx=0x7fad6c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad74ff9640 1 -- 172.21.15.37:0/968356417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00ccc0 con 0x7fad78108180 2024-08-31T06:38:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad74ff9640 1 -- 172.21.15.37:0/968356417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(23 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fad6c005470 con 0x7fad78108180 2024-08-31T06:38:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad781a0180 con 0x7fad78108180 2024-08-31T06:38:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.628+0000 7fad74ff9640 1 -- 172.21.15.37:0/968356417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c010430 con 0x7fad78108180 2024-08-31T06:38:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.629+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad78104da0 con 0x7fad78108180 2024-08-31T06:38:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.630+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad78103ac0 con 0x7fad78108180 2024-08-31T06:38:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.630+0000 7fad74ff9640 1 -- 172.21.15.37:0/968356417 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7fad6c0105d0 con 0x7fad78108180 2024-08-31T06:38:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.630+0000 7fad74ff9640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad6003f300 0x7fad60041810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.630+0000 7fad74ff9640 1 -- 172.21.15.37:0/968356417 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fad6c053e20 con 0x7fad78108180 2024-08-31T06:38:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.631+0000 7fad777fe640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad6003f300 0x7fad60041810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.631+0000 7fad777fe640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad6003f300 0x7fad60041810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fad6800ac30 tx=0x7fad6800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:24.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.639+0000 7fad74ff9640 1 -- 172.21.15.37:0/968356417 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fad6c057030 con 0x7fad78108180 2024-08-31T06:38:24.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.834+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fad7819b1f0 con 0x7fad78108180 2024-08-31T06:38:24.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.838+0000 7fad74ff9640 1 -- 172.21.15.37:0/968356417 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v13)=0 v13) ==== 114+0+0 (secure 0 0 0) 0x7fad6c016330 con 0x7fad78108180 2024-08-31T06:38:24.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.840+0000 7fad74ff9640 1 -- 172.21.15.37:0/968356417 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fad6c01f6e0 con 0x7fad78108180 2024-08-31T06:38:24.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad6003f300 msgr2=0x7fad60041810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad6003f300 0x7fad60041810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fad6800ac30 tx=0x7fad6800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108180 msgr2=0x7fad7819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108180 0x7fad7819a580 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e9f0 tx=0x7fad6c00edf0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 shutdown_connections 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad6003f300 0x7fad60041810 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78108180 0x7fad7819a580 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad78108ad0 0x7fad7819f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 --2- 172.21.15.37:0/968356417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad78102840 0x7fad78199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 >> 172.21.15.37:0/968356417 conn(0x7fad78079580 msgr2=0x7fad7806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 shutdown_connections 2024-08-31T06:38:24.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:24.842+0000 7fad7db16640 1 -- 172.21.15.37:0/968356417 wait complete. 2024-08-31T06:38:25.239 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:38:25 smithi106 systemd[1]: Starting Ceph mgr.z for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:38:25.503 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:38:25 smithi106 podman[24753]: 2024-08-31 06:38:25.140944455 +0000 UTC m=+0.015682007 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:38:25.503 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:38:25 smithi106 podman[24753]: 2024-08-31 06:38:25.265904301 +0000 UTC m=+0.140641852 container create d3a287e49e10309a4ff8048b83b2e2ca6fe867b0761e4a79258a2b4a13096d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:38:25.504 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:38:25 smithi106 podman[24753]: 2024-08-31 06:38:25.465816806 +0000 UTC m=+0.340554353 container init d3a287e49e10309a4ff8048b83b2e2ca6fe867b0761e4a79258a2b4a13096d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-z, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T06:38:25.504 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:38:25 smithi106 podman[24753]: 2024-08-31 06:38:25.468537648 +0000 UTC m=+0.343275188 container start d3a287e49e10309a4ff8048b83b2e2ca6fe867b0761e4a79258a2b4a13096d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-08-31T06:38:25.504 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mgr[24773]: -- 172.21.15.106:0/3750550323 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564d87b7d0e0 con 0x564d87b9ba80 2024-08-31T06:38:25.815 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:38:25 smithi106 bash[24753]: d3a287e49e10309a4ff8048b83b2e2ca6fe867b0761e4a79258a2b4a13096d61 2024-08-31T06:38:25.815 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:38:25 smithi106 systemd[1]: Started Ceph mgr.z for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:38:25.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:25 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/968356417' entity='client.admin' 2024-08-31T06:38:25.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:25.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:25.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:25.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:25.849 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T06:38:25.849 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:25.849 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:25.852 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:25.890 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi037') 2024-08-31T06:38:25.890 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-08-31T06:38:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2520086025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0109b90 msgr2=0x7f8bd01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2520086025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0109b90 0x7f8bd01103c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009ca0 tx=0x7f8bc802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2520086025 shutdown_connections 2024-08-31T06:38:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2520086025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0109b90 0x7f8bd01103c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2520086025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bd0109240 0x7f8bd0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2520086025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd0103900 0x7f8bd0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2520086025 >> 172.21.15.37:0/2520086025 conn(0x7f8bd007b5f0 msgr2=0x7f8bd007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2520086025 shutdown_connections 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.050+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2520086025 wait complete. 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd85ed640 1 Processor -- start 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd85ed640 1 -- start start 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd85ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0103900 0x7f8bd019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd85ed640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bd0109240 0x7f8bd019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd85ed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd0109b90 0x7f8bd019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd85ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd01135e0 con 0x7f8bd0103900 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd85ed640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd0113460 con 0x7f8bd0109b90 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd85ed640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd0113760 con 0x7f8bd0109240 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd6389640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0103900 0x7f8bd019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd6389640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0103900 0x7f8bd019a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54744/0 (socket says 172.21.15.37:54744) 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd5b88640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bd0109240 0x7f8bd019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd6389640 1 -- 172.21.15.37:0/2841705723 learned_addr learned my addr 172.21.15.37:0/2841705723 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.051+0000 7f8bd6b8a640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd0109b90 0x7f8bd019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bd6389640 1 -- 172.21.15.37:0/2841705723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bd0109240 msgr2=0x7f8bd019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bd6389640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bd0109240 0x7f8bd019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bd6389640 1 -- 172.21.15.37:0/2841705723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd0109b90 msgr2=0x7f8bd019f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bd6389640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd0109b90 0x7f8bd019f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bd6389640 1 -- 172.21.15.37:0/2841705723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd019ff80 con 0x7f8bd0103900 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bd6389640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0103900 0x7f8bd019a010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00d950 tx=0x7f8bcc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bc77fe640 1 -- 172.21.15.37:0/2841705723 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc017070 con 0x7f8bd0103900 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bc77fe640 1 -- 172.21.15.37:0/2841705723 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8bcc009c30 con 0x7f8bd0103900 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bc77fe640 1 -- 172.21.15.37:0/2841705723 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00f620 con 0x7f8bd0103900 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd01a0270 con 0x7f8bd0103900 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.052+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd01a69d0 con 0x7f8bd0103900 2024-08-31T06:38:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.053+0000 7f8bc77fe640 1 -- 172.21.15.37:0/2841705723 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f8bcc00f7c0 con 0x7f8bd0103900 2024-08-31T06:38:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.053+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd0103d10 con 0x7f8bd0103900 2024-08-31T06:38:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.053+0000 7f8bc77fe640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8bbc03f2d0 0x7f8bbc0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.053+0000 7f8bc77fe640 1 -- 172.21.15.37:0/2841705723 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8bcc053840 con 0x7f8bd0103900 2024-08-31T06:38:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.053+0000 7f8bd5b88640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8bbc03f2d0 0x7f8bbc0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.054+0000 7f8bd5b88640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8bbc03f2d0 0x7f8bbc0417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8bd01062d0 tx=0x7f8bc000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.058+0000 7f8bc77fe640 1 -- 172.21.15.37:0/2841705723 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8bcc010e10 con 0x7f8bd0103900 2024-08-31T06:38:26.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:25 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/968356417' entity='client.admin' 2024-08-31T06:38:26.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:26.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:26.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:26.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:26.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T06:38:26.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:26.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:26.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.250+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f8bd002e430 con 0x7f8bd0103900 2024-08-31T06:38:26.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.253+0000 7f8bc77fe640 1 -- 172.21.15.37:0/2841705723 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v14)=0 v14) ==== 127+0+0 (secure 0 0 0) 0x7f8bcc019c10 con 0x7f8bd0103900 2024-08-31T06:38:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8bbc03f2d0 msgr2=0x7f8bbc0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8bbc03f2d0 0x7f8bbc0417e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8bd01062d0 tx=0x7f8bc000b390 comp rx=0 tx=0).stop 2024-08-31T06:38:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0103900 msgr2=0x7f8bd019a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:26.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0103900 0x7f8bd019a010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00d950 tx=0x7f8bcc00de10 comp rx=0 tx=0).stop 2024-08-31T06:38:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 shutdown_connections 2024-08-31T06:38:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8bbc03f2d0 0x7f8bbc0417e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bd0109b90 0x7f8bd019f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8bd0109240 0x7f8bd019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 --2- 172.21.15.37:0/2841705723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bd0103900 0x7f8bd019a010 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 >> 172.21.15.37:0/2841705723 conn(0x7f8bd007b5f0 msgr2=0x7f8bd0107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 shutdown_connections 2024-08-31T06:38:26.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:26.256+0000 7f8bd85ed640 1 -- 172.21.15.37:0/2841705723 wait complete. 2024-08-31T06:38:26.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/968356417' entity='client.admin' 2024-08-31T06:38:26.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:26.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:26.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:26.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:26.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-31T06:38:26.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:26.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:26.931 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:26 smithi037 ceph-mon[18612]: Deploying daemon mgr.y on smithi066 2024-08-31T06:38:26.931 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:26 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2841705723' entity='client.admin' 2024-08-31T06:38:27.010 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:26 smithi066 ceph-mon[22244]: Deploying daemon mgr.y on smithi066 2024-08-31T06:38:27.010 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:26 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2841705723' entity='client.admin' 2024-08-31T06:38:27.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 -- 172.21.15.37:0/408582230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4102810 msgr2=0x7f28e4102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:27.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 --2- 172.21.15.37:0/408582230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4102810 0x7f28e4102c20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009900 tx=0x7f28d402a410 comp rx=0 tx=0).stop 2024-08-31T06:38:27.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 -- 172.21.15.37:0/408582230 shutdown_connections 2024-08-31T06:38:27.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 --2- 172.21.15.37:0/408582230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4108aa0 0x7f28e410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 --2- 172.21.15.37:0/408582230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e4108150 0x7f28e4108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 --2- 172.21.15.37:0/408582230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4102810 0x7f28e4102c20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 -- 172.21.15.37:0/408582230 >> 172.21.15.37:0/408582230 conn(0x7f28e40794b0 msgr2=0x7f28e40798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 -- 172.21.15.37:0/408582230 shutdown_connections 2024-08-31T06:38:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.134+0000 7f28e9004640 1 -- 172.21.15.37:0/408582230 wait complete. 2024-08-31T06:38:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.135+0000 7f28e9004640 1 Processor -- start 2024-08-31T06:38:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.135+0000 7f28e9004640 1 -- start start 2024-08-31T06:38:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e9004640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4102810 0x7f28e419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e9004640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4108150 0x7f28e419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e9004640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e4108aa0 0x7f28e419f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e9004640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28e4113640 con 0x7f28e4108150 2024-08-31T06:38:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e9004640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41134c0 con 0x7f28e4102810 2024-08-31T06:38:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e9004640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f28e41137c0 con 0x7f28e4108aa0 2024-08-31T06:38:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4108150 0x7f28e419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4108150 0x7f28e419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54766/0 (socket says 172.21.15.37:54766) 2024-08-31T06:38:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e259c640 1 -- 172.21.15.37:0/3836930184 learned_addr learned my addr 172.21.15.37:0/3836930184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e359e640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e4108aa0 0x7f28e419f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e2d9d640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4102810 0x7f28e419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e359e640 1 -- 172.21.15.37:0/3836930184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4102810 msgr2=0x7f28e419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e359e640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4102810 0x7f28e419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e359e640 1 -- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4108150 msgr2=0x7f28e419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e359e640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4108150 0x7f28e419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e359e640 1 -- 172.21.15.37:0/3836930184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e41a0080 con 0x7f28e4108aa0 2024-08-31T06:38:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e259c640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4108150 0x7f28e419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:38:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.136+0000 7f28e359e640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e4108aa0 0x7f28e419f950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009fd0 tx=0x7f28dc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.137+0000 7f28cbfff640 1 -- 172.21.15.37:0/3836930184 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00ce20 con 0x7f28e4108aa0 2024-08-31T06:38:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.137+0000 7f28cbfff640 1 -- 172.21.15.37:0/3836930184 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f28dc005020 con 0x7f28e4108aa0 2024-08-31T06:38:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.137+0000 7f28cbfff640 1 -- 172.21.15.37:0/3836930184 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc010690 con 0x7f28e4108aa0 2024-08-31T06:38:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.137+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e41a0370 con 0x7f28e4108aa0 2024-08-31T06:38:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.137+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e41a6ad0 con 0x7f28e4108aa0 2024-08-31T06:38:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.138+0000 7f28cbfff640 1 -- 172.21.15.37:0/3836930184 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f28dc010830 con 0x7f28e4108aa0 2024-08-31T06:38:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.138+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e4103a90 con 0x7f28e4108aa0 2024-08-31T06:38:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.138+0000 7f28cbfff640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f28cc03f2d0 0x7f28cc0417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.138+0000 7f28cbfff640 1 -- 172.21.15.37:0/3836930184 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f28dc0541b0 con 0x7f28e4108aa0 2024-08-31T06:38:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.138+0000 7f28e2d9d640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f28cc03f2d0 0x7f28cc0417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.138+0000 7f28e2d9d640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f28cc03f2d0 0x7f28cc0417e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28d4006010 tx=0x7f28d4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:27.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.143+0000 7f28cbfff640 1 -- 172.21.15.37:0/3836930184 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f28dc0051d0 con 0x7f28e4108aa0 2024-08-31T06:38:27.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:26 smithi106 ceph-mon[22134]: Deploying daemon mgr.y on smithi066 2024-08-31T06:38:27.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:26 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2841705723' entity='client.admin' 2024-08-31T06:38:27.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.334+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f28e402e430 con 0x7f28e4108aa0 2024-08-31T06:38:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.339+0000 7f28cbfff640 1 -- 172.21.15.37:0/3836930184 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v15)=0 v15) ==== 116+0+0 (secure 0 0 0) 0x7f28dc0152d0 con 0x7f28e4108aa0 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f28cc03f2d0 msgr2=0x7f28cc0417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f28cc03f2d0 0x7f28cc0417e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f28d4006010 tx=0x7f28d4000bc0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e4108aa0 msgr2=0x7f28e419f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e4108aa0 0x7f28e419f950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009fd0 tx=0x7f28dc00ef10 comp rx=0 tx=0).stop 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 shutdown_connections 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f28cc03f2d0 0x7f28cc0417e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e4108150 0x7f28e419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e4108aa0 0x7f28e419f950 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 --2- 172.21.15.37:0/3836930184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28e4102810 0x7f28e419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 >> 172.21.15.37:0/3836930184 conn(0x7f28e40794b0 msgr2=0x7f28e4106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 shutdown_connections 2024-08-31T06:38:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:27.343+0000 7f28e9004640 1 -- 172.21.15.37:0/3836930184 wait complete. 2024-08-31T06:38:27.638 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:38:27 smithi066 systemd[1]: Starting Ceph mgr.y for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:38:27.673 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-08-31T06:38:28.014 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:38:27 smithi066 podman[24552]: 2024-08-31 06:38:27.736117502 +0000 UTC m=+0.107513910 container create a99c2b7d2d8696ab0c9e43de79ba07db832653fe61b108bcbb2d79da707b632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:38:28.014 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:38:27 smithi066 podman[24552]: 2024-08-31 06:38:27.644802806 +0000 UTC m=+0.016199186 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:38:28.014 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:38:27 smithi066 podman[24552]: 2024-08-31 06:38:27.929986166 +0000 UTC m=+0.301382535 container init a99c2b7d2d8696ab0c9e43de79ba07db832653fe61b108bcbb2d79da707b632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1) 2024-08-31T06:38:28.014 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:38:27 smithi066 podman[24552]: 2024-08-31 06:38:27.932922538 +0000 UTC m=+0.304318907 container start a99c2b7d2d8696ab0c9e43de79ba07db832653fe61b108bcbb2d79da707b632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:38:28.014 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:38:27 smithi066 ceph-mgr[24571]: -- 172.21.15.66:0/2320234933 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55871dbd90e0 con 0x558722978000 2024-08-31T06:38:28.015 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:38:28 smithi066 bash[24552]: a99c2b7d2d8696ab0c9e43de79ba07db832653fe61b108bcbb2d79da707b632a 2024-08-31T06:38:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 -- 172.21.15.37:0/301443783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6641050a0 msgr2=0x7fe66410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 --2- 172.21.15.37:0/301443783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6641050a0 0x7fe66410d5f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe660009900 tx=0x7fe66002a410 comp rx=0 tx=0).stop 2024-08-31T06:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 -- 172.21.15.37:0/301443783 shutdown_connections 2024-08-31T06:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 --2- 172.21.15.37:0/301443783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6641050a0 0x7fe66410d5f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 --2- 172.21.15.37:0/301443783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe66410dbb0 0x7fe6641100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 --2- 172.21.15.37:0/301443783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe664104750 0x7fe664104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 -- 172.21.15.37:0/301443783 >> 172.21.15.37:0/301443783 conn(0x7fe6640794d0 msgr2=0x7fe6640798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 -- 172.21.15.37:0/301443783 shutdown_connections 2024-08-31T06:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.125+0000 7fe66b295640 1 -- 172.21.15.37:0/301443783 wait complete. 2024-08-31T06:38:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe66b295640 1 Processor -- start 2024-08-31T06:38:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe66b295640 1 -- start start 2024-08-31T06:38:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe66b295640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe664104750 0x7fe664102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe66b295640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6641050a0 0x7fe6641029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe66b295640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe66410dbb0 0x7fe664102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe669031640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe664104750 0x7fe664102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe66b295640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe664113560 con 0x7fe664104750 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe669031640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe664104750 0x7fe664102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54786/0 (socket says 172.21.15.37:54786) 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe669031640 1 -- 172.21.15.37:0/4233154528 learned_addr learned my addr 172.21.15.37:0/4233154528 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe668830640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6641050a0 0x7fe6641029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.126+0000 7fe669832640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe66410dbb0 0x7fe664102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641133e0 con 0x7fe66410dbb0 2024-08-31T06:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641136e0 con 0x7fe6641050a0 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe669031640 1 -- 172.21.15.37:0/4233154528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6641050a0 msgr2=0x7fe6641029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe669031640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6641050a0 0x7fe6641029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe669031640 1 -- 172.21.15.37:0/4233154528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe66410dbb0 msgr2=0x7fe664102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe669031640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe66410dbb0 0x7fe664102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe669031640 1 -- 172.21.15.37:0/4233154528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6641a8410 con 0x7fe664104750 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe669832640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe66410dbb0 0x7fe664102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe669031640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe664104750 0x7fe664102490 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe65400d950 tx=0x7fe65400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.127+0000 7fe65a7fc640 1 -- 172.21.15.37:0/4233154528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654017070 con 0x7fe664104750 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.128+0000 7fe65a7fc640 1 -- 172.21.15.37:0/4233154528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fe654009c30 con 0x7fe664104750 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.128+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6641a8700 con 0x7fe664104750 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.128+0000 7fe65a7fc640 1 -- 172.21.15.37:0/4233154528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65400f3c0 con 0x7fe664104750 2024-08-31T06:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.128+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6641a8c10 con 0x7fe664104750 2024-08-31T06:38:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.129+0000 7fe65a7fc640 1 -- 172.21.15.37:0/4233154528 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7fe65401a070 con 0x7fe664104750 2024-08-31T06:38:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.129+0000 7fe65a7fc640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe65003f2d0 0x7fe6500417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.129+0000 7fe65a7fc640 1 -- 172.21.15.37:0/4233154528 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe654058730 con 0x7fe664104750 2024-08-31T06:38:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.129+0000 7fe668830640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe65003f2d0 0x7fe6500417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.129+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe664104b60 con 0x7fe664104750 2024-08-31T06:38:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.130+0000 7fe668830640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe65003f2d0 0x7fe6500417e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe660005940 tx=0x7fe6600058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.135+0000 7fe65a7fc640 1 -- 172.21.15.37:0/4233154528 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe654009de0 con 0x7fe664104750 2024-08-31T06:38:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.306+0000 7f083b2b2640 1 -- 172.21.15.37:0/1079668127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 msgr2=0x7f0834102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.306+0000 7f083b2b2640 1 --2- 172.21.15.37:0/1079668127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 0x7f0834102c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0830009900 tx=0x7f083002a410 comp rx=0 tx=0).stop 2024-08-31T06:38:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.306+0000 7f083b2b2640 1 -- 172.21.15.37:0/1079668127 shutdown_connections 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.306+0000 7f083b2b2640 1 --2- 172.21.15.37:0/1079668127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0834108a90 0x7f083410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.306+0000 7f083b2b2640 1 --2- 172.21.15.37:0/1079668127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0834108140 0x7f0834108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.306+0000 7f083b2b2640 1 --2- 172.21.15.37:0/1079668127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 0x7f0834102c10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.306+0000 7f083b2b2640 1 -- 172.21.15.37:0/1079668127 >> 172.21.15.37:0/1079668127 conn(0x7f08340794d0 msgr2=0x7f08340798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.306+0000 7f083b2b2640 1 -- 172.21.15.37:0/1079668127 shutdown_connections 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.307+0000 7f083b2b2640 1 -- 172.21.15.37:0/1079668127 wait complete. 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.307+0000 7f083b2b2640 1 Processor -- start 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.307+0000 7f083b2b2640 1 -- start start 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083b2b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 0x7f083419ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083b2b2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0834108140 0x7f083419b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083b2b2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0834108a90 0x7f083419b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083b2b2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f08341124b0 con 0x7f0834102800 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083b2b2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0834112330 con 0x7f0834108a90 2024-08-31T06:38:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083b2b2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0834112630 con 0x7f0834108140 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 0x7f083419ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 0x7f083419ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54794/0 (socket says 172.21.15.37:54794) 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 -- 172.21.15.37:0/3075005717 learned_addr learned my addr 172.21.15.37:0/3075005717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083884d640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0834108140 0x7f083419b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083984f640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0834108a90 0x7f083419b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 -- 172.21.15.37:0/3075005717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0834108140 msgr2=0x7f083419b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0834108140 0x7f083419b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 -- 172.21.15.37:0/3075005717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0834108a90 msgr2=0x7f083419b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0834108a90 0x7f083419b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 -- 172.21.15.37:0/3075005717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08341a6110 con 0x7f0834102800 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.308+0000 7f083904e640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 0x7f083419ae80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f083002aa00 tx=0x7f0830003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.309+0000 7f082a7fc640 1 -- 172.21.15.37:0/3075005717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083003f070 con 0x7f0834102800 2024-08-31T06:38:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.309+0000 7f082a7fc640 1 -- 172.21.15.37:0/3075005717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(24 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f083003bce0 con 0x7f0834102800 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.309+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08341a63a0 con 0x7f0834102800 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.309+0000 7f082a7fc640 1 -- 172.21.15.37:0/3075005717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830035030 con 0x7f0834102800 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.309+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08341a6880 con 0x7f0834102800 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.310+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0834102c10 con 0x7f0834102800 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.310+0000 7f082a7fc640 1 -- 172.21.15.37:0/3075005717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f0830042070 con 0x7f0834102800 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.310+0000 7f082a7fc640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f082003f300 0x7f0820041810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.310+0000 7f082a7fc640 1 -- 172.21.15.37:0/3075005717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0830074240 con 0x7f0834102800 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.311+0000 7f083884d640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f082003f300 0x7f0820041810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.311+0000 7f083884d640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f082003f300 0x7f0820041810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0834100910 tx=0x7f0824005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.320+0000 7f082a7fc640 1 -- 172.21.15.37:0/3075005717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0830036df0 con 0x7f0834102800 2024-08-31T06:38:28.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.331+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe66402e430 con 0x7fe664104750 2024-08-31T06:38:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.334+0000 7fe65a7fc640 1 -- 172.21.15.37:0/4233154528 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7fe6540194f0 con 0x7fe664104750 2024-08-31T06:38:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.335+0000 7fe65a7fc640 1 -- 172.21.15.37:0/4233154528 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe654018cf0 con 0x7fe664104750 2024-08-31T06:38:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.335+0000 7f082a7fc640 1 -- 172.21.15.37:0/3075005717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0830042920 con 0x7f0834102800 2024-08-31T06:38:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe65003f2d0 msgr2=0x7fe6500417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe65003f2d0 0x7fe6500417e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe660005940 tx=0x7fe6600058d0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe664104750 msgr2=0x7fe664102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe664104750 0x7fe664102490 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe65400d950 tx=0x7fe65400de10 comp rx=0 tx=0).stop 2024-08-31T06:38:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 shutdown_connections 2024-08-31T06:38:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe65003f2d0 0x7fe6500417e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe66410dbb0 0x7fe664102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6641050a0 0x7fe6641029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 --2- 172.21.15.37:0/4233154528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe664104750 0x7fe664102490 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 >> 172.21.15.37:0/4233154528 conn(0x7fe6640794d0 msgr2=0x7fe6640ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 shutdown_connections 2024-08-31T06:38:28.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.337+0000 7fe66b295640 1 -- 172.21.15.37:0/4233154528 wait complete. 2024-08-31T06:38:28.342 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:38:28 smithi066 systemd[1]: Started Ceph mgr.y for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:38:28.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.509+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f083402e430 con 0x7f0834102800 2024-08-31T06:38:28.511 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:28 smithi037 ceph-mon[18612]: from='client.? ' entity='client.admin' 2024-08-31T06:38:28.512 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:28 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.512 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:28 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.512 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:28 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.512 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:28 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.512 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:28 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:28.512 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:28 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4233154528' entity='client.admin' 2024-08-31T06:38:28.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.513+0000 7f082a7fc640 1 -- 172.21.15.37:0/3075005717 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v17)=0 v17) ==== 117+0+0 (secure 0 0 0) 0x7f0830031400 con 0x7f0834102800 2024-08-31T06:38:28.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.515+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f082003f300 msgr2=0x7f0820041810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.515+0000 7f083b2b2640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f082003f300 0x7f0820041810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0834100910 tx=0x7f0824005f90 comp rx=0 tx=0).stop 2024-08-31T06:38:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.515+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 msgr2=0x7f083419ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.515+0000 7f083b2b2640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 0x7f083419ae80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f083002aa00 tx=0x7f0830003c80 comp rx=0 tx=0).stop 2024-08-31T06:38:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.516+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 shutdown_connections 2024-08-31T06:38:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.516+0000 7f083b2b2640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f082003f300 0x7f0820041810 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.516+0000 7f083b2b2640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0834108a90 0x7f083419b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.516+0000 7f083b2b2640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0834108140 0x7f083419b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.516+0000 7f083b2b2640 1 --2- 172.21.15.37:0/3075005717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0834102800 0x7f083419ae80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.516+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 >> 172.21.15.37:0/3075005717 conn(0x7f08340794d0 msgr2=0x7f08341012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.516+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 shutdown_connections 2024-08-31T06:38:28.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:28.516+0000 7f083b2b2640 1 -- 172.21.15.37:0/3075005717 wait complete. 2024-08-31T06:38:28.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:28 smithi066 ceph-mon[22244]: from='client.? ' entity='client.admin' 2024-08-31T06:38:28.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:28 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:28 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:28 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:28 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:28 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:28.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:28 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4233154528' entity='client.admin' 2024-08-31T06:38:28.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:28 smithi106 ceph-mon[22134]: from='client.? ' entity='client.admin' 2024-08-31T06:38:28.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:28 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:28 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:28 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:28 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:28.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:28 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:28.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:28 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4233154528' entity='client.admin' 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3075005717' entity='client.admin' 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.673 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:29.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:29.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.683+0000 7f470d9aa640 1 -- 172.21.15.37:0/3279535396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4708104750 msgr2=0x7f4708104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.683+0000 7f470d9aa640 1 --2- 172.21.15.37:0/3279535396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4708104750 0x7f4708104b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009900 tx=0x7f46f802a410 comp rx=0 tx=0).stop 2024-08-31T06:38:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.684+0000 7f470d9aa640 1 -- 172.21.15.37:0/3279535396 shutdown_connections 2024-08-31T06:38:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.684+0000 7f470d9aa640 1 --2- 172.21.15.37:0/3279535396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f470810dbb0 0x7f47081100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.684+0000 7f470d9aa640 1 --2- 172.21.15.37:0/3279535396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47081050a0 0x7f470810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.684+0000 7f470d9aa640 1 --2- 172.21.15.37:0/3279535396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4708104750 0x7f4708104b60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.684+0000 7f470d9aa640 1 -- 172.21.15.37:0/3279535396 >> 172.21.15.37:0/3279535396 conn(0x7f47080794d0 msgr2=0x7f47080798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.684+0000 7f470d9aa640 1 -- 172.21.15.37:0/3279535396 shutdown_connections 2024-08-31T06:38:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.684+0000 7f470d9aa640 1 -- 172.21.15.37:0/3279535396 wait complete. 2024-08-31T06:38:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.686+0000 7f470d9aa640 1 Processor -- start 2024-08-31T06:38:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.686+0000 7f470d9aa640 1 -- start start 2024-08-31T06:38:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.686+0000 7f470d9aa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708104750 0x7f470819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.686+0000 7f470d9aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47081050a0 0x7f470819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.686+0000 7f470d9aa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f470810dbb0 0x7f470819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.686+0000 7f470d9aa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47081136c0 con 0x7f47081050a0 2024-08-31T06:38:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.686+0000 7f470d9aa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4708113540 con 0x7f470810dbb0 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.686+0000 7f470d9aa640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4708113840 con 0x7f4708104750 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47067fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47081050a0 0x7f470819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47067fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47081050a0 0x7f470819a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54824/0 (socket says 172.21.15.37:54824) 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47067fc640 1 -- 172.21.15.37:0/4222213508 learned_addr learned my addr 172.21.15.37:0/4222213508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47077fe640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f470810dbb0 0x7f470819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47067fc640 1 -- 172.21.15.37:0/4222213508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708104750 msgr2=0x7f470819a1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47067fc640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708104750 0x7f470819a1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47067fc640 1 -- 172.21.15.37:0/4222213508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f470810dbb0 msgr2=0x7f470819f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47067fc640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f470810dbb0 0x7f470819f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.687+0000 7f47067fc640 1 -- 172.21.15.37:0/4222213508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47081a0120 con 0x7f47081050a0 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.688+0000 7f47067fc640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47081050a0 0x7f470819a750 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00d9a0 tx=0x7f46fc00de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.688+0000 7f470c9a8640 1 -- 172.21.15.37:0/4222213508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc017070 con 0x7f47081050a0 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.688+0000 7f470c9a8640 1 -- 172.21.15.37:0/4222213508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46fc010460 con 0x7f47081050a0 2024-08-31T06:38:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.688+0000 7f470c9a8640 1 -- 172.21.15.37:0/4222213508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc00f620 con 0x7f47081050a0 2024-08-31T06:38:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.688+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47081a0410 con 0x7f47081050a0 2024-08-31T06:38:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.688+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4708102370 con 0x7f47081050a0 2024-08-31T06:38:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.690+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470806b300 con 0x7f47081050a0 2024-08-31T06:38:29.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.691+0000 7f470c9a8640 1 -- 172.21.15.37:0/4222213508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f46fc01a070 con 0x7f47081050a0 2024-08-31T06:38:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.692+0000 7f470c9a8640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f46f003f2d0 0x7f46f00417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.692+0000 7f470c9a8640 1 -- 172.21.15.37:0/4222213508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f46fc053a30 con 0x7f47081050a0 2024-08-31T06:38:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.692+0000 7f4706ffd640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f46f003f2d0 0x7f46f00417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.693+0000 7f4706ffd640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f46f003f2d0 0x7f46f00417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f46f802a930 tx=0x7f46f8005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:29.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.696+0000 7f470c9a8640 1 -- 172.21.15.37:0/4222213508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f46fc021070 con 0x7f47081050a0 2024-08-31T06:38:29.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3075005717' entity='client.admin' 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:29.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:29.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:29.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3075005717' entity='client.admin' 2024-08-31T06:38:29.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:29.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:29.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:29.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-31T06:38:29.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-31T06:38:29.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:29.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.899+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f4708104b60 con 0x7f47081050a0 2024-08-31T06:38:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.905+0000 7f470c9a8640 1 -- 172.21.15.37:0/4222213508 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v19)=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f4708104b60 con 0x7f47081050a0 2024-08-31T06:38:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f46f003f2d0 msgr2=0x7f46f00417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f46f003f2d0 0x7f46f00417e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f46f802a930 tx=0x7f46f8005fd0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47081050a0 msgr2=0x7f470819a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47081050a0 0x7f470819a750 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00d9a0 tx=0x7f46fc00de60 comp rx=0 tx=0).stop 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 shutdown_connections 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f46f003f2d0 0x7f46f00417e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47081050a0 0x7f470819a750 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f470810dbb0 0x7f470819f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 --2- 172.21.15.37:0/4222213508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4708104750 0x7f470819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 >> 172.21.15.37:0/4222213508 conn(0x7f47080794d0 msgr2=0x7f4708100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 shutdown_connections 2024-08-31T06:38:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.908+0000 7f470d9aa640 1 -- 172.21.15.37:0/4222213508 wait complete. 2024-08-31T06:38:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:30.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 -- 172.21.15.37:0/2320731164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c108170 msgr2=0x7f963c108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:30.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 --2- 172.21.15.37:0/2320731164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c108170 0x7f963c108580 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9624009900 tx=0x7f962402a410 comp rx=0 tx=0).stop 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 -- 172.21.15.37:0/2320731164 shutdown_connections 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 --2- 172.21.15.37:0/2320731164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c108170 0x7f963c108580 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 --2- 172.21.15.37:0/2320731164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f963c108ac0 0x7f963c10f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 --2- 172.21.15.37:0/2320731164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f963c102880 0x7f963c102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 -- 172.21.15.37:0/2320731164 >> 172.21.15.37:0/2320731164 conn(0x7f963c079500 msgr2=0x7f963c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 -- 172.21.15.37:0/2320731164 shutdown_connections 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.587+0000 7f9641fbc640 1 -- 172.21.15.37:0/2320731164 wait complete. 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.588+0000 7f9641fbc640 1 Processor -- start 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.588+0000 7f9641fbc640 1 -- start start 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.588+0000 7f9641fbc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c102880 0x7f963c19c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:30.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.588+0000 7f9641fbc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f963c108170 0x7f963c19c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.588+0000 7f9641fbc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f963c108ac0 0x7f963c1a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.588+0000 7f9641fbc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f963c113700 con 0x7f963c102880 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.588+0000 7f9641fbc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f963c113580 con 0x7f963c108ac0 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.588+0000 7f9641fbc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f963c113880 con 0x7f963c108170 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f963b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c102880 0x7f963c19c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f9632ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f963c108170 0x7f963c19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f963b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c102880 0x7f963c19c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54812/0 (socket says 172.21.15.37:54812) 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f963b7fe640 1 -- 172.21.15.37:0/3367672398 learned_addr learned my addr 172.21.15.37:0/3367672398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:30.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f963bfff640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f963c108ac0 0x7f963c1a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f9632ffd640 1 -- 172.21.15.37:0/3367672398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f963c108ac0 msgr2=0x7f963c1a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f9632ffd640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f963c108ac0 0x7f963c1a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f9632ffd640 1 -- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c102880 msgr2=0x7f963c19c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f9632ffd640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c102880 0x7f963c19c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f9632ffd640 1 -- 172.21.15.37:0/3367672398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963c1a2340 con 0x7f963c108170 2024-08-31T06:38:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f9632ffd640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f963c108170 0x7f963c19c970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9624009230 tx=0x7f9624005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f96397fa640 1 -- 172.21.15.37:0/3367672398 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962403f070 con 0x7f963c108170 2024-08-31T06:38:30.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f96397fa640 1 -- 172.21.15.37:0/3367672398 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9624003a80 con 0x7f963c108170 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963c1a25d0 con 0x7f963c108170 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.589+0000 7f96397fa640 1 -- 172.21.15.37:0/3367672398 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9624035070 con 0x7f963c108170 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.590+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963c1a8d90 con 0x7f963c108170 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.591+0000 7f96397fa640 1 -- 172.21.15.37:0/3367672398 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 17) ==== 51270+0+0 (secure 0 0 0) 0x7f9624043400 con 0x7f963c108170 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.591+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963c103ab0 con 0x7f963c108170 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.591+0000 7f96397fa640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f962803f2d0 0x7f96280417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.591+0000 7f96397fa640 1 -- 172.21.15.37:0/3367672398 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9624073ce0 con 0x7f963c108170 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.591+0000 7f963b7fe640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f962803f2d0 0x7f96280417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.592+0000 7f963b7fe640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f962803f2d0 0x7f96280417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f962c009c90 tx=0x7f962c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:30.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.596+0000 7f96397fa640 1 -- 172.21.15.37:0/3367672398 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f962404a2f0 con 0x7f963c108170 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.827+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f963c1a8f60 con 0x7f963c108170 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.834+0000 7f96397fa640 1 -- 172.21.15.37:0/3367672398 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v18)=0 v18) ==== 108+0+0 (secure 0 0 0) 0x7f962402edc0 con 0x7f963c108170 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f962803f2d0 msgr2=0x7f96280417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f962803f2d0 0x7f96280417e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f962c009c90 tx=0x7f962c005f90 comp rx=0 tx=0).stop 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f963c108170 msgr2=0x7f963c19c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f963c108170 0x7f963c19c970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9624009230 tx=0x7f9624005e10 comp rx=0 tx=0).stop 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 shutdown_connections 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f962803f2d0 0x7f96280417e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f963c108ac0 0x7f963c1a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f963c108170 0x7f963c19c970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 --2- 172.21.15.37:0/3367672398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f963c102880 0x7f963c19c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:30.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 >> 172.21.15.37:0/3367672398 conn(0x7f963c079500 msgr2=0x7f963c10fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:30.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 shutdown_connections 2024-08-31T06:38:30.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:29.836+0000 7f9641fbc640 1 -- 172.21.15.37:0/3367672398 wait complete. 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: Reconfiguring daemon mgr.x on smithi037 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: from='client.? ' entity='client.admin' 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4222213508' entity='client.admin' 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: Standby manager daemon z started 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T06:38:31.057 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:30 smithi037 ceph-mon[18612]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T06:38:31.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T06:38:31.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: Reconfiguring daemon mgr.x on smithi037 2024-08-31T06:38:31.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: from='client.? ' entity='client.admin' 2024-08-31T06:38:31.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4222213508' entity='client.admin' 2024-08-31T06:38:31.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: Standby manager daemon z started 2024-08-31T06:38:31.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T06:38:31.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T06:38:31.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T06:38:31.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:30 smithi066 ceph-mon[22244]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T06:38:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: Reconfiguring mgr.x (unknown last config time)... 2024-08-31T06:38:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: Reconfiguring daemon mgr.x on smithi037 2024-08-31T06:38:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: from='client.? ' entity='client.admin' 2024-08-31T06:38:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4222213508' entity='client.admin' 2024-08-31T06:38:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: Standby manager daemon z started 2024-08-31T06:38:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-31T06:38:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T06:38:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-31T06:38:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:30 smithi106 ceph-mon[22134]: from='mgr.? 172.21.15.106:0/4192500069' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T06:38:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.587+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/1788042085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b98109310 msgr2=0x7f3b98109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.587+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/1788042085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b98109310 0x7f3b98109720 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009900 tx=0x7f3b8002a410 comp rx=0 tx=0).stop 2024-08-31T06:38:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.587+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/1788042085 shutdown_connections 2024-08-31T06:38:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.587+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/1788042085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b98109310 0x7f3b98109720 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.587+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/1788042085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b98109c60 0x7f3b98110490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.587+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/1788042085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b981039d0 0x7f3b98103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.587+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/1788042085 >> 172.21.15.37:0/1788042085 conn(0x7f3b9807b670 msgr2=0x7f3b9807ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.587+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/1788042085 shutdown_connections 2024-08-31T06:38:31.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.588+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/1788042085 wait complete. 2024-08-31T06:38:31.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.588+0000 7f3b9cbc1640 1 Processor -- start 2024-08-31T06:38:31.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9cbc1640 1 -- start start 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9cbc1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b981039d0 0x7f3b980754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9cbc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b98109310 0x7f3b980759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9cbc1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b98109c60 0x7f3b98075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9cbc1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b98113730 con 0x7f3b981039d0 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9cbc1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3b981135b0 con 0x7f3b98109310 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9cbc1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3b981138b0 con 0x7f3b98109c60 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b981039d0 0x7f3b980754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b981039d0 0x7f3b980754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54854/0 (socket says 172.21.15.37:54854) 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9659c640 1 -- 172.21.15.37:0/3055966823 learned_addr learned my addr 172.21.15.37:0/3055966823 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b8dd9b640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b98109310 0x7f3b980759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b96d9d640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b98109c60 0x7f3b98075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:31.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9659c640 1 -- 172.21.15.37:0/3055966823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b98109c60 msgr2=0x7f3b98075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9659c640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b98109c60 0x7f3b98075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9659c640 1 -- 172.21.15.37:0/3055966823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b98109310 msgr2=0x7f3b980759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9659c640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b98109310 0x7f3b980759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.589+0000 7f3b9659c640 1 -- 172.21.15.37:0/3055966823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b981a8460 con 0x7f3b981039d0 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.590+0000 7f3b9659c640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b981039d0 0x7f3b980754b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800e9f0 tx=0x7f3b8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.590+0000 7f3b8ffff640 1 -- 172.21.15.37:0/3055966823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8800cd80 con 0x7f3b981039d0 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.590+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b981a8750 con 0x7f3b981039d0 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.590+0000 7f3b8ffff640 1 -- 172.21.15.37:0/3055966823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b880108c0 con 0x7f3b981039d0 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.590+0000 7f3b8ffff640 1 -- 172.21.15.37:0/3055966823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b880187c0 con 0x7f3b981039d0 2024-08-31T06:38:31.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.590+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b981a8cb0 con 0x7f3b981039d0 2024-08-31T06:38:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.591+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b98103de0 con 0x7f3b981039d0 2024-08-31T06:38:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.592+0000 7f3b8ffff640 1 -- 172.21.15.37:0/3055966823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 101904+0+0 (secure 0 0 0) 0x7f3b88010430 con 0x7f3b981039d0 2024-08-31T06:38:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.592+0000 7f3b8ffff640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b84079ee0 0x7f3b8407c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.593+0000 7f3b8dd9b640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b84079ee0 0x7f3b8407c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.593+0000 7f3b8ffff640 1 -- 172.21.15.37:0/3055966823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3b8809baf0 con 0x7f3b981039d0 2024-08-31T06:38:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.593+0000 7f3b8dd9b640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b84079ee0 0x7f3b8407c3f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3b80005940 tx=0x7f3b800058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:31.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.597+0000 7f3b8ffff640 1 -- 172.21.15.37:0/3055966823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3b88064430 con 0x7f3b981039d0 2024-08-31T06:38:31.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.786+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3b980767b0 con 0x7f3b981039d0 2024-08-31T06:38:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.790+0000 7f3b8ffff640 1 -- 172.21.15.37:0/3055966823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v20)=0 v20) ==== 106+0+0 (secure 0 0 0) 0x7f3b88068bf0 con 0x7f3b981039d0 2024-08-31T06:38:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b84079ee0 msgr2=0x7f3b8407c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b84079ee0 0x7f3b8407c3f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3b80005940 tx=0x7f3b800058d0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b981039d0 msgr2=0x7f3b980754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b981039d0 0x7f3b980754b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800e9f0 tx=0x7f3b8800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 shutdown_connections 2024-08-31T06:38:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b84079ee0 0x7f3b8407c3f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b98109c60 0x7f3b98075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b98109310 0x7f3b980759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 --2- 172.21.15.37:0/3055966823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b981039d0 0x7f3b980754b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 >> 172.21.15.37:0/3055966823 conn(0x7f3b9807b670 msgr2=0x7f3b981053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 shutdown_connections 2024-08-31T06:38:31.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:31.792+0000 7f3b9cbc1640 1 -- 172.21.15.37:0/3055966823 wait complete. 2024-08-31T06:38:32.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:31 smithi037 ceph-mon[18612]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T06:38:32.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T06:38:32.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:31 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3055966823' entity='client.admin' 2024-08-31T06:38:32.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:31 smithi106 ceph-mon[22134]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T06:38:32.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T06:38:32.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:31 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3055966823' entity='client.admin' 2024-08-31T06:38:32.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:31 smithi066 ceph-mon[22244]: mgrmap e18: x(active, since 12s), standbys: z 2024-08-31T06:38:32.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-31T06:38:32.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:31 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3055966823' entity='client.admin' 2024-08-31T06:38:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.794+0000 7f6db05d6640 1 -- 172.21.15.37:0/1869156349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da810dc10 msgr2=0x7f6da81100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.794+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1869156349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da810dc10 0x7f6da81100e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009ca0 tx=0x7f6da002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.794+0000 7f6db05d6640 1 -- 172.21.15.37:0/1869156349 shutdown_connections 2024-08-31T06:38:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.794+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1869156349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da810dc10 0x7f6da81100e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:32.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.794+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1869156349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da8105090 0x7f6da810d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.794+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1869156349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da8104660 0x7f6da8104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.794+0000 7f6db05d6640 1 -- 172.21.15.37:0/1869156349 >> 172.21.15.37:0/1869156349 conn(0x7f6da8079580 msgr2=0x7f6da8079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.794+0000 7f6db05d6640 1 -- 172.21.15.37:0/1869156349 shutdown_connections 2024-08-31T06:38:32.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.795+0000 7f6db05d6640 1 -- 172.21.15.37:0/1869156349 wait complete. 2024-08-31T06:38:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.795+0000 7f6db05d6640 1 Processor -- start 2024-08-31T06:38:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.795+0000 7f6db05d6640 1 -- start start 2024-08-31T06:38:32.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6db05d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da8104660 0x7f6da819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6db05d6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da8105090 0x7f6da819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6db05d6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da810dc10 0x7f6da819f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6db05d6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6da8113750 con 0x7f6da8104660 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6db05d6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81135d0 con 0x7f6da810dc10 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6db05d6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6da81138d0 con 0x7f6da8105090 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da8104660 0x7f6da819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da8104660 0x7f6da819a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54874/0 (socket says 172.21.15.37:54874) 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 -- 172.21.15.37:0/1590345791 learned_addr learned my addr 172.21.15.37:0/1590345791 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6daeb73640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da810dc10 0x7f6da819f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dadb71640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da8105090 0x7f6da819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 -- 172.21.15.37:0/1590345791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da8105090 msgr2=0x7f6da819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:32.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da8105090 0x7f6da819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 -- 172.21.15.37:0/1590345791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da810dc10 msgr2=0x7f6da819f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da810dc10 0x7f6da819f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 -- 172.21.15.37:0/1590345791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da81a00b0 con 0x7f6da8104660 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dadb71640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da8105090 0x7f6da819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.796+0000 7f6dae372640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da8104660 0x7f6da819a140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6da400e9c0 tx=0x7f6da400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.797+0000 7f6d9f7fe640 1 -- 172.21.15.37:0/1590345791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da400cd80 con 0x7f6da8104660 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.797+0000 7f6d9f7fe640 1 -- 172.21.15.37:0/1590345791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6da40044b0 con 0x7f6da8104660 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.797+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da81a03a0 con 0x7f6da8104660 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.797+0000 7f6d9f7fe640 1 -- 172.21.15.37:0/1590345791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da4010430 con 0x7f6da8104660 2024-08-31T06:38:32.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.797+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da81a6b00 con 0x7f6da8104660 2024-08-31T06:38:32.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.798+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da8104a70 con 0x7f6da8104660 2024-08-31T06:38:32.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.799+0000 7f6d9f7fe640 1 -- 172.21.15.37:0/1590345791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 101904+0+0 (secure 0 0 0) 0x7f6da4003f00 con 0x7f6da8104660 2024-08-31T06:38:32.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.799+0000 7f6d9f7fe640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d94079ee0 0x7f6d9407c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:32.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.799+0000 7f6dadb71640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d94079ee0 0x7f6d9407c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:32.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.799+0000 7f6d9f7fe640 1 -- 172.21.15.37:0/1590345791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6da409bbd0 con 0x7f6da8104660 2024-08-31T06:38:32.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.800+0000 7f6dadb71640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d94079ee0 0x7f6d9407c3f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6da810f950 tx=0x7f6d98005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.804+0000 7f6d9f7fe640 1 -- 172.21.15.37:0/1590345791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6da4064a20 con 0x7f6da8104660 2024-08-31T06:38:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.992+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f6da81a6e00 con 0x7f6da8104660 2024-08-31T06:38:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.996+0000 7f6d9f7fe640 1 -- 172.21.15.37:0/1590345791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v21)=0 v21) ==== 116+0+0 (secure 0 0 0) 0x7f6da4064320 con 0x7f6da8104660 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d94079ee0 msgr2=0x7f6d9407c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d94079ee0 0x7f6d9407c3f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6da810f950 tx=0x7f6d98005f90 comp rx=0 tx=0).stop 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da8104660 msgr2=0x7f6da819a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da8104660 0x7f6da819a140 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6da400e9c0 tx=0x7f6da400ee80 comp rx=0 tx=0).stop 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 shutdown_connections 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d94079ee0 0x7f6d9407c3f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da810dc10 0x7f6da819f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da8105090 0x7f6da819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 --2- 172.21.15.37:0/1590345791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da8104660 0x7f6da819a140 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 >> 172.21.15.37:0/1590345791 conn(0x7f6da8079580 msgr2=0x7f6da81066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.998+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 shutdown_connections 2024-08-31T06:38:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:32.999+0000 7f6db05d6640 1 -- 172.21.15.37:0/1590345791 wait complete. 2024-08-31T06:38:33.211 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi037') 2024-08-31T06:38:33.212 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi037') 2024-08-31T06:38:33.212 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi037') 2024-08-31T06:38:33.212 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi037') 2024-08-31T06:38:33.212 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi037') 2024-08-31T06:38:33.212 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi037') 2024-08-31T06:38:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:34.068 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:34 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1590345791' entity='client.admin' 2024-08-31T06:38:34.068 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:34 smithi037 ceph-mon[18612]: Standby manager daemon y started 2024-08-31T06:38:34.068 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:34 smithi037 ceph-mon[18612]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T06:38:34.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:34 smithi037 ceph-mon[18612]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T06:38:34.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:34 smithi037 ceph-mon[18612]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T06:38:34.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:34 smithi037 ceph-mon[18612]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T06:38:34.093 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:34 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1590345791' entity='client.admin' 2024-08-31T06:38:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:34 smithi106 ceph-mon[22134]: Standby manager daemon y started 2024-08-31T06:38:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:34 smithi106 ceph-mon[22134]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T06:38:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:34 smithi106 ceph-mon[22134]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T06:38:34.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:34 smithi106 ceph-mon[22134]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T06:38:34.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:34 smithi106 ceph-mon[22134]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T06:38:34.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:34 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1590345791' entity='client.admin' 2024-08-31T06:38:34.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:34 smithi066 ceph-mon[22244]: Standby manager daemon y started 2024-08-31T06:38:34.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:34 smithi066 ceph-mon[22244]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-31T06:38:34.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:34 smithi066 ceph-mon[22244]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-31T06:38:34.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:34 smithi066 ceph-mon[22244]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-31T06:38:34.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:34 smithi066 ceph-mon[22244]: from='mgr.? 172.21.15.66:0/3305324854' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-31T06:38:35.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1953962330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 msgr2=0x7fc4bc10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1953962330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 0x7fc4bc10d5f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009900 tx=0x7fc4ac02a410 comp rx=0 tx=0).stop 2024-08-31T06:38:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1953962330 shutdown_connections 2024-08-31T06:38:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1953962330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 0x7fc4bc10d5f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1953962330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4bc10dbb0 0x7fc4bc1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1953962330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4bc104750 0x7fc4bc104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1953962330 >> 172.21.15.37:0/1953962330 conn(0x7fc4bc0794d0 msgr2=0x7fc4bc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1953962330 shutdown_connections 2024-08-31T06:38:35.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.234+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1953962330 wait complete. 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c34e5640 1 Processor -- start 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c34e5640 1 -- start start 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c34e5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4bc104750 0x7fc4bc102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c34e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 0x7fc4bc1029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c34e5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4bc10dbb0 0x7fc4bc102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c34e5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc1136a0 con 0x7fc4bc1050a0 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c34e5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc113520 con 0x7fc4bc104750 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c34e5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc113820 con 0x7fc4bc10dbb0 2024-08-31T06:38:35.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c0a80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 0x7fc4bc1029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c0a80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 0x7fc4bc1029d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35720/0 (socket says 172.21.15.37:35720) 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c0a80640 1 -- 172.21.15.37:0/1250969373 learned_addr learned my addr 172.21.15.37:0/1250969373 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c1281640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4bc104750 0x7fc4bc102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c1a82640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4bc10dbb0 0x7fc4bc102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c0a80640 1 -- 172.21.15.37:0/1250969373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4bc10dbb0 msgr2=0x7fc4bc102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c0a80640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4bc10dbb0 0x7fc4bc102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c0a80640 1 -- 172.21.15.37:0/1250969373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4bc104750 msgr2=0x7fc4bc102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c0a80640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4bc104750 0x7fc4bc102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c0a80640 1 -- 172.21.15.37:0/1250969373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc1a8380 con 0x7fc4bc1050a0 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.235+0000 7fc4c1281640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4bc104750 0x7fc4bc102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.236+0000 7fc4c0a80640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 0x7fc4bc1029d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac005940 tx=0x7fc4ac0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.236+0000 7fc4b27fc640 1 -- 172.21.15.37:0/1250969373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac03f030 con 0x7fc4bc1050a0 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.236+0000 7fc4b27fc640 1 -- 172.21.15.37:0/1250969373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4ac003a80 con 0x7fc4bc1050a0 2024-08-31T06:38:35.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.236+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc1a8610 con 0x7fc4bc1050a0 2024-08-31T06:38:35.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.236+0000 7fc4b27fc640 1 -- 172.21.15.37:0/1250969373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac035070 con 0x7fc4bc1050a0 2024-08-31T06:38:35.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.236+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc1a8b40 con 0x7fc4bc1050a0 2024-08-31T06:38:35.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.237+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4bc104b60 con 0x7fc4bc1050a0 2024-08-31T06:38:35.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.239+0000 7fc4b27fc640 1 -- 172.21.15.37:0/1250969373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fc4ac042030 con 0x7fc4bc1050a0 2024-08-31T06:38:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.239+0000 7fc4b27fc640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4a80b4b70 0x7fc4a80b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.240+0000 7fc4c1281640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4a80b4b70 0x7fc4a80b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.240+0000 7fc4b27fc640 1 -- 172.21.15.37:0/1250969373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc4ac103ee0 con 0x7fc4bc1050a0 2024-08-31T06:38:35.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.240+0000 7fc4c1281640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4a80b4b70 0x7fc4a80b7080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8005fd0 tx=0x7fc4b8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:35.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.243+0000 7fc4b27fc640 1 -- 172.21.15.37:0/1250969373 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc4ac0ccc10 con 0x7fc4bc1050a0 2024-08-31T06:38:35.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:35 smithi106 ceph-mon[22134]: mgrmap e19: x(active, since 15s), standbys: z, y 2024-08-31T06:38:35.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T06:38:35.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:35 smithi037 ceph-mon[18612]: mgrmap e19: x(active, since 15s), standbys: z, y 2024-08-31T06:38:35.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T06:38:35.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:35 smithi066 ceph-mon[22244]: mgrmap e19: x(active, since 15s), standbys: z, y 2024-08-31T06:38:35.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 -- 172.21.15.37:0/432323701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b4108220 msgr2=0x7fd2b410ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 --2- 172.21.15.37:0/432323701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b4108220 0x7fd2b410ea50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac009ca0 tx=0x7fd2ac02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 -- 172.21.15.37:0/432323701 shutdown_connections 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 --2- 172.21.15.37:0/432323701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b4108220 0x7fd2b410ea50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 --2- 172.21.15.37:0/432323701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b41078d0 0x7fd2b4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 --2- 172.21.15.37:0/432323701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2b4101f90 0x7fd2b41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 -- 172.21.15.37:0/432323701 >> 172.21.15.37:0/432323701 conn(0x7fd2b4077a30 msgr2=0x7fd2b4077e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 -- 172.21.15.37:0/432323701 shutdown_connections 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.420+0000 7fd2ba214640 1 -- 172.21.15.37:0/432323701 wait complete. 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2ba214640 1 Processor -- start 2024-08-31T06:38:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2ba214640 1 -- start start 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2ba214640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b4101f90 0x7fd2b4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2ba214640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b41078d0 0x7fd2b4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2ba214640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2b4108220 0x7fd2b41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2ba214640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b4112660 con 0x7fd2b41078d0 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2ba214640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b41124e0 con 0x7fd2b4101f90 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2ba214640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b41127e0 con 0x7fd2b4108220 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b41078d0 0x7fd2b4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b41078d0 0x7fd2b4199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35738/0 (socket says 172.21.15.37:35738) 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2abfff640 1 -- 172.21.15.37:0/3454501464 learned_addr learned my addr 172.21.15.37:0/3454501464 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2b37fe640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b4101f90 0x7fd2b4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.421+0000 7fd2b3fff640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2b4108220 0x7fd2b41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2abfff640 1 -- 172.21.15.37:0/3454501464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2b4108220 msgr2=0x7fd2b41997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2abfff640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2b4108220 0x7fd2b41997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2abfff640 1 -- 172.21.15.37:0/3454501464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b4101f90 msgr2=0x7fd2b4198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2abfff640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b4101f90 0x7fd2b4198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2abfff640 1 -- 172.21.15.37:0/3454501464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b41a83d0 con 0x7fd2b41078d0 2024-08-31T06:38:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2abfff640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b41078d0 0x7fd2b4199260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00e9f0 tx=0x7fd29c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2b17fa640 1 -- 172.21.15.37:0/3454501464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00ccc0 con 0x7fd2b41078d0 2024-08-31T06:38:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b41a86c0 con 0x7fd2b41078d0 2024-08-31T06:38:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2b17fa640 1 -- 172.21.15.37:0/3454501464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd29c0108c0 con 0x7fd2b41078d0 2024-08-31T06:38:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2b17fa640 1 -- 172.21.15.37:0/3454501464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c018660 con 0x7fd2b41078d0 2024-08-31T06:38:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.422+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b41a8c50 con 0x7fd2b41078d0 2024-08-31T06:38:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.424+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b41023a0 con 0x7fd2b41078d0 2024-08-31T06:38:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.425+0000 7fd2b17fa640 1 -- 172.21.15.37:0/3454501464 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fd29c010430 con 0x7fd2b41078d0 2024-08-31T06:38:35.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.426+0000 7fd2b17fa640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd2a00b4af0 0x7fd2a00b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:35.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.426+0000 7fd2b17fa640 1 -- 172.21.15.37:0/3454501464 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd29c0e3e20 con 0x7fd2b41078d0 2024-08-31T06:38:35.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.426+0000 7fd2b37fe640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd2a00b4af0 0x7fd2a00b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.427+0000 7fd2b37fe640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd2a00b4af0 0x7fd2a00b7000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4104890 tx=0x7fd2a400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.430+0000 7fd2b17fa640 1 -- 172.21.15.37:0/3454501464 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd29c0acb50 con 0x7fd2b41078d0 2024-08-31T06:38:35.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.436+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fc4bc103790 con 0x7fc4bc1050a0 2024-08-31T06:38:35.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.441+0000 7fc4b27fc640 1 -- 172.21.15.37:0/1250969373 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v22)=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7fc4bc103790 con 0x7fc4bc1050a0 2024-08-31T06:38:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4a80b4b70 msgr2=0x7fc4a80b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4a80b4b70 0x7fc4a80b7080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8005fd0 tx=0x7fc4b8005850 comp rx=0 tx=0).stop 2024-08-31T06:38:35.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 msgr2=0x7fc4bc1029d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 0x7fc4bc1029d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac005940 tx=0x7fc4ac0040e0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 shutdown_connections 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4a80b4b70 0x7fc4a80b7080 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc1050a0 0x7fc4bc1029d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4bc10dbb0 0x7fc4bc102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 --2- 172.21.15.37:0/1250969373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4bc104750 0x7fc4bc102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 >> 172.21.15.37:0/1250969373 conn(0x7fc4bc0794d0 msgr2=0x7fc4bc100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 shutdown_connections 2024-08-31T06:38:35.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.443+0000 7fc4c34e5640 1 -- 172.21.15.37:0/1250969373 wait complete. 2024-08-31T06:38:35.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.620+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fd2b410f820 con 0x7fd2b41078d0 2024-08-31T06:38:35.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.624+0000 7fd2b17fa640 1 -- 172.21.15.37:0/3454501464 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v23)=0 v23) ==== 122+0+0 (secure 0 0 0) 0x7fd29c0b5090 con 0x7fd2b41078d0 2024-08-31T06:38:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd2a00b4af0 msgr2=0x7fd2a00b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd2a00b4af0 0x7fd2a00b7000 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd2b4104890 tx=0x7fd2a400b410 comp rx=0 tx=0).stop 2024-08-31T06:38:35.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b41078d0 msgr2=0x7fd2b4199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b41078d0 0x7fd2b4199260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00e9f0 tx=0x7fd29c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 shutdown_connections 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd2a00b4af0 0x7fd2a00b7000 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b41078d0 0x7fd2b4199260 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2b4108220 0x7fd2b41997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 --2- 172.21.15.37:0/3454501464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2b4101f90 0x7fd2b4198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 >> 172.21.15.37:0/3454501464 conn(0x7fd2b4077a30 msgr2=0x7fd2b4105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 shutdown_connections 2024-08-31T06:38:35.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:35.627+0000 7fd2ba214640 1 -- 172.21.15.37:0/3454501464 wait complete. 2024-08-31T06:38:36.753 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:36 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1250969373' entity='client.admin' 2024-08-31T06:38:36.754 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:36 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3454501464' entity='client.admin' 2024-08-31T06:38:36.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:36 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1250969373' entity='client.admin' 2024-08-31T06:38:36.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:36 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3454501464' entity='client.admin' 2024-08-31T06:38:36.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.233+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1466135790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a410dc50 msgr2=0x7f10a4110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:36.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.233+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1466135790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a410dc50 0x7f10a4110120 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f109c009ca0 tx=0x7f109c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1466135790 shutdown_connections 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1466135790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a410dc50 0x7f10a4110120 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1466135790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10a41050d0 0x7f10a410d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1466135790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10a41046a0 0x7f10a4104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1466135790 >> 172.21.15.37:0/1466135790 conn(0x7f10a4079510 msgr2=0x7f10a4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1466135790 shutdown_connections 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1466135790 wait complete. 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 Processor -- start 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.234+0000 7f10aa7ad640 1 -- start start 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10aa7ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a41046a0 0x7f10a419a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10aa7ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10a41050d0 0x7f10a419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10aa7ad640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10a410dc50 0x7f10a419f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:36.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10aa7ad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10a4113790 con 0x7f10a41046a0 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10aa7ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f10a4113610 con 0x7f10a41050d0 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10aa7ad640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f10a4113910 con 0x7f10a410dc50 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a41046a0 0x7f10a419a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a41046a0 0x7f10a419a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35758/0 (socket says 172.21.15.37:35758) 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 -- 172.21.15.37:0/1541471516 learned_addr learned my addr 172.21.15.37:0/1541471516 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f109bfff640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10a41050d0 0x7f10a419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a8d4a640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10a410dc50 0x7f10a419f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 -- 172.21.15.37:0/1541471516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10a410dc50 msgr2=0x7f10a419f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10a410dc50 0x7f10a419f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 -- 172.21.15.37:0/1541471516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10a41050d0 msgr2=0x7f10a419a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10a41050d0 0x7f10a419a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 -- 172.21.15.37:0/1541471516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a41a00f0 con 0x7f10a41046a0 2024-08-31T06:38:36.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a3fff640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a41046a0 0x7f10a419a180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f109400d950 tx=0x7f109400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a1ffb640 1 -- 172.21.15.37:0/1541471516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094017070 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a1ffb640 1 -- 172.21.15.37:0/1541471516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1094009c30 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10a1ffb640 1 -- 172.21.15.37:0/1541471516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109400f620 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a41a03e0 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.235+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a41a6b40 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.237+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a406bf60 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.238+0000 7f10a1ffb640 1 -- 172.21.15.37:0/1541471516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f1094010460 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.239+0000 7f10a1ffb640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10900b4af0 0x7f10900b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.239+0000 7f109bfff640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10900b4af0 0x7f10900b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.239+0000 7f10a1ffb640 1 -- 172.21.15.37:0/1541471516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f10940e31a0 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.239+0000 7f109bfff640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10900b4af0 0x7f10900b7000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10a410f7f0 tx=0x7f108c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.243+0000 7f10a1ffb640 1 -- 172.21.15.37:0/1541471516 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f10940abed0 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.441+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f10a41a6eb0 con 0x7f10a41046a0 2024-08-31T06:38:36.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.447+0000 7f10a1ffb640 1 -- 172.21.15.37:0/1541471516 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f1094009de0 con 0x7f10a41046a0 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10900b4af0 msgr2=0x7f10900b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10900b4af0 0x7f10900b7000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f10a410f7f0 tx=0x7f108c00b390 comp rx=0 tx=0).stop 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a41046a0 msgr2=0x7f10a419a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a41046a0 0x7f10a419a180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f109400d950 tx=0x7f109400de10 comp rx=0 tx=0).stop 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 shutdown_connections 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10900b4af0 0x7f10900b7000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10a410dc50 0x7f10a419f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10a41050d0 0x7f10a419a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 --2- 172.21.15.37:0/1541471516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a41046a0 0x7f10a419a180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 >> 172.21.15.37:0/1541471516 conn(0x7f10a4079510 msgr2=0x7f10a4107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 shutdown_connections 2024-08-31T06:38:36.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:36.450+0000 7f10aa7ad640 1 -- 172.21.15.37:0/1541471516 wait complete. 2024-08-31T06:38:36.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:36 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1250969373' entity='client.admin' 2024-08-31T06:38:36.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:36 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3454501464' entity='client.admin' 2024-08-31T06:38:37.511 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:37 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1541471516' entity='client.admin' 2024-08-31T06:38:37.512 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:37.512 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:37.512 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:37 smithi066 ceph-mon[22244]: Reconfiguring mon.b (monmap changed)... 2024-08-31T06:38:37.512 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:37.512 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:37.512 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:37.512 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:37 smithi066 ceph-mon[22244]: Reconfiguring daemon mon.b on smithi066 2024-08-31T06:38:37.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:37 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1541471516' entity='client.admin' 2024-08-31T06:38:37.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:37.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:37.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:37 smithi037 ceph-mon[18612]: Reconfiguring mon.b (monmap changed)... 2024-08-31T06:38:37.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:37.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:37.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:37.642 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:37 smithi037 ceph-mon[18612]: Reconfiguring daemon mon.b on smithi066 2024-08-31T06:38:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:37 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1541471516' entity='client.admin' 2024-08-31T06:38:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:37 smithi106 ceph-mon[22134]: Reconfiguring mon.b (monmap changed)... 2024-08-31T06:38:37.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:37.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:37.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:37.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:37 smithi106 ceph-mon[22134]: Reconfiguring daemon mon.b on smithi066 2024-08-31T06:38:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 -- 172.21.15.37:0/4252672180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8109b90 msgr2=0x7f6ae81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 --2- 172.21.15.37:0/4252672180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8109b90 0x7f6ae81103c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6ae0009ca0 tx=0x7f6ae002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 -- 172.21.15.37:0/4252672180 shutdown_connections 2024-08-31T06:38:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 --2- 172.21.15.37:0/4252672180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8109b90 0x7f6ae81103c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 --2- 172.21.15.37:0/4252672180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ae8109240 0x7f6ae8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:37.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 --2- 172.21.15.37:0/4252672180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae8103900 0x7f6ae8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 -- 172.21.15.37:0/4252672180 >> 172.21.15.37:0/4252672180 conn(0x7f6ae807b5f0 msgr2=0x7f6ae807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 -- 172.21.15.37:0/4252672180 shutdown_connections 2024-08-31T06:38:37.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.994+0000 7f6aef27e640 1 -- 172.21.15.37:0/4252672180 wait complete. 2024-08-31T06:38:37.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.995+0000 7f6aef27e640 1 Processor -- start 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.995+0000 7f6aef27e640 1 -- start start 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.995+0000 7f6aef27e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8103900 0x7f6ae819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.995+0000 7f6aef27e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae8109240 0x7f6ae819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.995+0000 7f6aef27e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ae8109b90 0x7f6ae819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.995+0000 7f6aef27e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8113750 con 0x7f6ae8103900 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.995+0000 7f6aef27e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81135d0 con 0x7f6ae8109240 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.995+0000 7f6aef27e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81138d0 con 0x7f6ae8109b90 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8103900 0x7f6ae819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8103900 0x7f6ae819a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35784/0 (socket says 172.21.15.37:35784) 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 -- 172.21.15.37:0/3360769807 learned_addr learned my addr 172.21.15.37:0/3360769807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed81b640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ae8109b90 0x7f6ae819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:37.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aec819640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae8109240 0x7f6ae819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 -- 172.21.15.37:0/3360769807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ae8109b90 msgr2=0x7f6ae819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ae8109b90 0x7f6ae819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 -- 172.21.15.37:0/3360769807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae8109240 msgr2=0x7f6ae819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae8109240 0x7f6ae819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 -- 172.21.15.37:0/3360769807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae81a0110 con 0x7f6ae8103900 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aed01a640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8103900 0x7f6ae819a260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c920 tx=0x7f6ae400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6ade7fc640 1 -- 172.21.15.37:0/3360769807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4007c70 con 0x7f6ae8103900 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6ade7fc640 1 -- 172.21.15.37:0/3360769807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ae4007e10 con 0x7f6ae8103900 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae81a0400 con 0x7f6ae8103900 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6ade7fc640 1 -- 172.21.15.37:0/3360769807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4018710 con 0x7f6ae8103900 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.996+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae81a6c20 con 0x7f6ae8103900 2024-08-31T06:38:38.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.997+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae8103d10 con 0x7f6ae8103900 2024-08-31T06:38:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:37.999+0000 7f6ade7fc640 1 -- 172.21.15.37:0/3360769807 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f6ae400f450 con 0x7f6ae8103900 2024-08-31T06:38:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.000+0000 7f6ade7fc640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6ad40b4b20 0x7f6ad40b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.000+0000 7f6aec819640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6ad40b4b20 0x7f6ad40b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:38.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.000+0000 7f6ade7fc640 1 -- 172.21.15.37:0/3360769807 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6ae40e38b0 con 0x7f6ae8103900 2024-08-31T06:38:38.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.001+0000 7f6aec819640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6ad40b4b20 0x7f6ad40b7030 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8108fc0 tx=0x7f6ad800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:38.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.003+0000 7f6ade7fc640 1 -- 172.21.15.37:0/3360769807 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6ae4014030 con 0x7f6ae8103900 2024-08-31T06:38:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.202+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f6ae819b390 con 0x7f6ae8103900 2024-08-31T06:38:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.206+0000 7f6ade7fc640 1 -- 172.21.15.37:0/3360769807 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f6ae819b390 con 0x7f6ae8103900 2024-08-31T06:38:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.208+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6ad40b4b20 msgr2=0x7f6ad40b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.208+0000 7f6aef27e640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6ad40b4b20 0x7f6ad40b7030 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8108fc0 tx=0x7f6ad800b390 comp rx=0 tx=0).stop 2024-08-31T06:38:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.208+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8103900 msgr2=0x7f6ae819a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.208+0000 7f6aef27e640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8103900 0x7f6ae819a260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400c920 tx=0x7f6ae400cde0 comp rx=0 tx=0).stop 2024-08-31T06:38:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.209+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 shutdown_connections 2024-08-31T06:38:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.209+0000 7f6aef27e640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6ad40b4b20 0x7f6ad40b7030 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.209+0000 7f6aef27e640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ae8109b90 0x7f6ae819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.209+0000 7f6aef27e640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ae8109240 0x7f6ae819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.209+0000 7f6aef27e640 1 --2- 172.21.15.37:0/3360769807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae8103900 0x7f6ae819a260 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.209+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 >> 172.21.15.37:0/3360769807 conn(0x7f6ae807b5f0 msgr2=0x7f6ae8107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.209+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 shutdown_connections 2024-08-31T06:38:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:38.209+0000 7f6aef27e640 1 -- 172.21.15.37:0/3360769807 wait complete. 2024-08-31T06:38:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 -- 172.21.15.37:0/1896706502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 msgr2=0x7fa4641103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 --2- 172.21.15.37:0/1896706502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 0x7fa4641103d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009ca0 tx=0x7fa45c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 -- 172.21.15.37:0/1896706502 shutdown_connections 2024-08-31T06:38:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 --2- 172.21.15.37:0/1896706502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 0x7fa4641103d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 --2- 172.21.15.37:0/1896706502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa464109250 0x7fa464109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 --2- 172.21.15.37:0/1896706502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa464103960 0x7fa464103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 -- 172.21.15.37:0/1896706502 >> 172.21.15.37:0/1896706502 conn(0x7fa46407b6b0 msgr2=0x7fa46407bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 -- 172.21.15.37:0/1896706502 shutdown_connections 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.004+0000 7fa46a321640 1 -- 172.21.15.37:0/1896706502 wait complete. 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.005+0000 7fa46a321640 1 Processor -- start 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.005+0000 7fa46a321640 1 -- start start 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.005+0000 7fa46a321640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa464103960 0x7fa46419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.005+0000 7fa46a321640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa464109250 0x7fa46419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.005+0000 7fa46a321640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 0x7fa46419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.005+0000 7fa46a321640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa464113760 con 0x7fa464109ba0 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.005+0000 7fa46a321640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa4641135e0 con 0x7fa464109250 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.005+0000 7fa46a321640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa4641138e0 con 0x7fa464103960 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 0x7fa46419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa463fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa464103960 0x7fa46419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 0x7fa46419f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35802/0 (socket says 172.21.15.37:35802) 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 -- 172.21.15.37:0/4240528431 learned_addr learned my addr 172.21.15.37:0/4240528431 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa463fff640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa464103960 0x7fa46419a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:50104/0 (socket says 172.21.15.37:50104) 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4637fe640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa464109250 0x7fa46419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 -- 172.21.15.37:0/4240528431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa464103960 msgr2=0x7fa46419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa464103960 0x7fa46419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 -- 172.21.15.37:0/4240528431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa464109250 msgr2=0x7fa46419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa464109250 0x7fa46419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 -- 172.21.15.37:0/4240528431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4641a0060 con 0x7fa464109ba0 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa463fff640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa464103960 0x7fa46419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4688be640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 0x7fa46419f930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005e30 tx=0x7fa45c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4617fa640 1 -- 172.21.15.37:0/4240528431 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c032d10 con 0x7fa464109ba0 2024-08-31T06:38:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa4617fa640 1 -- 172.21.15.37:0/4240528431 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa45c032eb0 con 0x7fa464109ba0 2024-08-31T06:38:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.006+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4641a02f0 con 0x7fa464109ba0 2024-08-31T06:38:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.007+0000 7fa4617fa640 1 -- 172.21.15.37:0/4240528431 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c030b20 con 0x7fa464109ba0 2024-08-31T06:38:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.007+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4641a6ab0 con 0x7fa464109ba0 2024-08-31T06:38:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.008+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa464103d70 con 0x7fa464109ba0 2024-08-31T06:38:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.009+0000 7fa4617fa640 1 -- 172.21.15.37:0/4240528431 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fa45c030cc0 con 0x7fa464109ba0 2024-08-31T06:38:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.010+0000 7fa4617fa640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa44c0b4b70 0x7fa44c0b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.010+0000 7fa463fff640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa44c0b4b70 0x7fa44c0b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.010+0000 7fa4617fa640 1 -- 172.21.15.37:0/4240528431 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa45c104900 con 0x7fa464109ba0 2024-08-31T06:38:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.011+0000 7fa463fff640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa44c0b4b70 0x7fa44c0b7080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa454005d00 tx=0x7fa45400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:39.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.013+0000 7fa4617fa640 1 -- 172.21.15.37:0/4240528431 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa45c0cd590 con 0x7fa464109ba0 2024-08-31T06:38:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.202+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fa46410b990 con 0x7fa464109ba0 2024-08-31T06:38:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.207+0000 7fa4617fa640 1 -- 172.21.15.37:0/4240528431 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7fa45c0cce90 con 0x7fa464109ba0 2024-08-31T06:38:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa44c0b4b70 msgr2=0x7fa44c0b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa44c0b4b70 0x7fa44c0b7080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa454005d00 tx=0x7fa45400b410 comp rx=0 tx=0).stop 2024-08-31T06:38:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 msgr2=0x7fa46419f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 0x7fa46419f930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa45c005e30 tx=0x7fa45c0093d0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 shutdown_connections 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa44c0b4b70 0x7fa44c0b7080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa464109ba0 0x7fa46419f930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa464109250 0x7fa46419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 --2- 172.21.15.37:0/4240528431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa464103960 0x7fa46419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 >> 172.21.15.37:0/4240528431 conn(0x7fa46407b6b0 msgr2=0x7fa4641072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 shutdown_connections 2024-08-31T06:38:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.209+0000 7fa46a321640 1 -- 172.21.15.37:0/4240528431 wait complete. 2024-08-31T06:38:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: Reconfiguring mon.c (monmap changed)... 2024-08-31T06:38:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: Reconfiguring daemon mon.c on smithi106 2024-08-31T06:38:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:39.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:39 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3360769807' entity='client.admin' 2024-08-31T06:38:39.384 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:39.384 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:39.384 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: Reconfiguring mon.c (monmap changed)... 2024-08-31T06:38:39.385 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:39.385 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:39.385 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:39.385 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: Reconfiguring daemon mon.c on smithi106 2024-08-31T06:38:39.385 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:39.385 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:39 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3360769807' entity='client.admin' 2024-08-31T06:38:39.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: Reconfiguring mon.c (monmap changed)... 2024-08-31T06:38:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-31T06:38:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-31T06:38:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: Reconfiguring daemon mon.c on smithi106 2024-08-31T06:38:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:39 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3360769807' entity='client.admin' 2024-08-31T06:38:39.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 -- 172.21.15.37:0/2252285609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 msgr2=0x7f2c6c10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 --2- 172.21.15.37:0/2252285609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 0x7f2c6c10f2e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009ca0 tx=0x7f2c6402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 -- 172.21.15.37:0/2252285609 shutdown_connections 2024-08-31T06:38:39.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 --2- 172.21.15.37:0/2252285609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 0x7f2c6c10f2e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 --2- 172.21.15.37:0/2252285609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c6c108160 0x7f2c6c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 --2- 172.21.15.37:0/2252285609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c6c102820 0x7f2c6c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 -- 172.21.15.37:0/2252285609 >> 172.21.15.37:0/2252285609 conn(0x7f2c6c0794e0 msgr2=0x7f2c6c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:39.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 -- 172.21.15.37:0/2252285609 shutdown_connections 2024-08-31T06:38:39.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.666+0000 7f2c7085b640 1 -- 172.21.15.37:0/2252285609 wait complete. 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c7085b640 1 Processor -- start 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c7085b640 1 -- start start 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c7085b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c6c102820 0x7f2c6c19af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c7085b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c6c108160 0x7f2c6c19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c7085b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 0x7f2c6c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c7085b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1126a0 con 0x7f2c6c108ab0 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c7085b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c112520 con 0x7f2c6c108160 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c7085b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c112820 con 0x7f2c6c102820 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c6a59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c6c102820 0x7f2c6c19af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c6ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 0x7f2c6c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:39.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c6a59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c6c102820 0x7f2c6c19af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:50132/0 (socket says 172.21.15.37:50132) 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c6a59c640 1 -- 172.21.15.37:0/4240087011 learned_addr learned my addr 172.21.15.37:0/4240087011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.667+0000 7f2c69d9b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c6c108160 0x7f2c6c19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c6a59c640 1 -- 172.21.15.37:0/4240087011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c6c108160 msgr2=0x7f2c6c19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c6a59c640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c6c108160 0x7f2c6c19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c6a59c640 1 -- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 msgr2=0x7f2c6c19b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c6a59c640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 0x7f2c6c19b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c6a59c640 1 -- 172.21.15.37:0/4240087011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c1a6260 con 0x7f2c6c102820 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c6ad9d640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 0x7f2c6c19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c6a59c640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c6c102820 0x7f2c6c19af50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00d770 tx=0x7f2c5c00db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c5b7fe640 1 -- 172.21.15.37:0/4240087011 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c017070 con 0x7f2c6c102820 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c5b7fe640 1 -- 172.21.15.37:0/4240087011 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c5c009820 con 0x7f2c6c102820 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c198da0 con 0x7f2c6c102820 2024-08-31T06:38:39.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c5b7fe640 1 -- 172.21.15.37:0/4240087011 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c004b20 con 0x7f2c6c102820 2024-08-31T06:38:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.668+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c199290 con 0x7f2c6c102820 2024-08-31T06:38:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.669+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c103aa0 con 0x7f2c6c102820 2024-08-31T06:38:39.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.671+0000 7f2c5b7fe640 1 -- 172.21.15.37:0/4240087011 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f2c5c0099d0 con 0x7f2c6c102820 2024-08-31T06:38:39.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.672+0000 7f2c5b7fe640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2c540b4af0 0x7f2c540b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:39.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.672+0000 7f2c69d9b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2c540b4af0 0x7f2c540b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:39.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.672+0000 7f2c5b7fe640 1 -- 172.21.15.37:0/4240087011 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2c5c0e2fa0 con 0x7f2c6c102820 2024-08-31T06:38:39.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.672+0000 7f2c69d9b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2c540b4af0 0x7f2c540b7000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c079a70 tx=0x7f2c60009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:39.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.675+0000 7f2c5b7fe640 1 -- 172.21.15.37:0/4240087011 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2c5c0abc30 con 0x7f2c6c102820 2024-08-31T06:38:39.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.866+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f2c6c06bd50 con 0x7f2c6c102820 2024-08-31T06:38:39.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.872+0000 7f2c5b7fe640 1 -- 172.21.15.37:0/4240087011 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f2c5c0ab530 con 0x7f2c6c102820 2024-08-31T06:38:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.874+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2c540b4af0 msgr2=0x7f2c540b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2c540b4af0 0x7f2c540b7000 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c079a70 tx=0x7f2c60009110 comp rx=0 tx=0).stop 2024-08-31T06:38:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c6c102820 msgr2=0x7f2c6c19af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c6c102820 0x7f2c6c19af50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00d770 tx=0x7f2c5c00db70 comp rx=0 tx=0).stop 2024-08-31T06:38:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 shutdown_connections 2024-08-31T06:38:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2c540b4af0 0x7f2c540b7000 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c6c108ab0 0x7f2c6c19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c6c108160 0x7f2c6c19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 --2- 172.21.15.37:0/4240087011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c6c102820 0x7f2c6c19af50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 >> 172.21.15.37:0/4240087011 conn(0x7f2c6c0794e0 msgr2=0x7f2c6c105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 shutdown_connections 2024-08-31T06:38:39.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:39.875+0000 7f2c7085b640 1 -- 172.21.15.37:0/4240087011 wait complete. 2024-08-31T06:38:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:40 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4240528431' entity='client.admin' 2024-08-31T06:38:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:40 smithi037 ceph-mon[18612]: from='client.? ' entity='client.admin' 2024-08-31T06:38:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:40 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4240528431' entity='client.admin' 2024-08-31T06:38:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:40 smithi066 ceph-mon[22244]: from='client.? ' entity='client.admin' 2024-08-31T06:38:40.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:40 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4240528431' entity='client.admin' 2024-08-31T06:38:40.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:40 smithi106 ceph-mon[22134]: from='client.? ' entity='client.admin' 2024-08-31T06:38:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.898+0000 7f602ae8f640 1 -- 172.21.15.37:0/4118616180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 msgr2=0x7f602410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.898+0000 7f602ae8f640 1 --2- 172.21.15.37:0/4118616180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 0x7f602410f2e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f601c009ca0 tx=0x7f601c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.898+0000 7f602ae8f640 1 -- 172.21.15.37:0/4118616180 shutdown_connections 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.898+0000 7f602ae8f640 1 --2- 172.21.15.37:0/4118616180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 0x7f602410f2e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.898+0000 7f602ae8f640 1 --2- 172.21.15.37:0/4118616180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6024108160 0x7f6024108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.898+0000 7f602ae8f640 1 --2- 172.21.15.37:0/4118616180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6024102820 0x7f6024102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.899+0000 7f602ae8f640 1 -- 172.21.15.37:0/4118616180 >> 172.21.15.37:0/4118616180 conn(0x7f60240794e0 msgr2=0x7f60240798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.899+0000 7f602ae8f640 1 -- 172.21.15.37:0/4118616180 shutdown_connections 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.899+0000 7f602ae8f640 1 -- 172.21.15.37:0/4118616180 wait complete. 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.899+0000 7f602ae8f640 1 Processor -- start 2024-08-31T06:38:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.899+0000 7f602ae8f640 1 -- start start 2024-08-31T06:38:40.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602ae8f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6024102820 0x7f60240ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:40.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602ae8f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6024108160 0x7f60240ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:40.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602ae8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 0x7f60240ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:40.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602ae8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6024112630 con 0x7f6024108ab0 2024-08-31T06:38:40.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602ae8f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f60241124b0 con 0x7f6024102820 2024-08-31T06:38:40.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602ae8f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f60241127b0 con 0x7f6024108160 2024-08-31T06:38:40.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 0x7f60240ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:40.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 0x7f60240ffeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35822/0 (socket says 172.21.15.37:35822) 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 -- 172.21.15.37:0/1281815406 learned_addr learned my addr 172.21.15.37:0/1281815406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f6023fff640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6024108160 0x7f60240ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f6028c2b640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6024102820 0x7f60240ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 -- 172.21.15.37:0/1281815406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6024108160 msgr2=0x7f60240ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6024108160 0x7f60240ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 -- 172.21.15.37:0/1281815406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6024102820 msgr2=0x7f60240ff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6024102820 0x7f60240ff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 -- 172.21.15.37:0/1281815406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60241a8380 con 0x7f6024108ab0 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f6028c2b640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6024102820 0x7f60240ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.900+0000 7f602942c640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 0x7f60240ffeb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f601c031040 tx=0x7f601c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.901+0000 7f6021ffb640 1 -- 172.21.15.37:0/1281815406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c004040 con 0x7f6024108ab0 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.901+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60241a8610 con 0x7f6024108ab0 2024-08-31T06:38:40.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.901+0000 7f6021ffb640 1 -- 172.21.15.37:0/1281815406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f601c004670 con 0x7f6024108ab0 2024-08-31T06:38:40.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.901+0000 7f6021ffb640 1 -- 172.21.15.37:0/1281815406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601c030bb0 con 0x7f6024108ab0 2024-08-31T06:38:40.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.901+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60241a8b50 con 0x7f6024108ab0 2024-08-31T06:38:40.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.902+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6024103aa0 con 0x7f6024108ab0 2024-08-31T06:38:40.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.903+0000 7f6021ffb640 1 -- 172.21.15.37:0/1281815406 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f601c0041e0 con 0x7f6024108ab0 2024-08-31T06:38:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.904+0000 7f6021ffb640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f60140b4b70 0x7f60140b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.905+0000 7f6028c2b640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f60140b4b70 0x7f60140b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.905+0000 7f6021ffb640 1 -- 172.21.15.37:0/1281815406 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f601c104850 con 0x7f6024108ab0 2024-08-31T06:38:40.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.905+0000 7f6028c2b640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f60140b4b70 0x7f60140b7080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6018005fd0 tx=0x7f6018005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:40.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:40.909+0000 7f6021ffb640 1 -- 172.21.15.37:0/1281815406 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f601c0cd4e0 con 0x7f6024108ab0 2024-08-31T06:38:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.099+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f6024100730 con 0x7f6024108ab0 2024-08-31T06:38:41.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.104+0000 7f6021ffb640 1 -- 172.21.15.37:0/1281815406 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v28)=0 v28) ==== 133+0+0 (secure 0 0 0) 0x7f6024100730 con 0x7f6024108ab0 2024-08-31T06:38:41.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f60140b4b70 msgr2=0x7f60140b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f60140b4b70 0x7f60140b7080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6018005fd0 tx=0x7f6018005850 comp rx=0 tx=0).stop 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 msgr2=0x7f60240ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 0x7f60240ffeb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f601c031040 tx=0x7f601c032bc0 comp rx=0 tx=0).stop 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 shutdown_connections 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f60140b4b70 0x7f60140b7080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6024108ab0 0x7f60240ffeb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6024108160 0x7f60240ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 --2- 172.21.15.37:0/1281815406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6024102820 0x7f60240ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 >> 172.21.15.37:0/1281815406 conn(0x7f60240794e0 msgr2=0x7f602406bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 shutdown_connections 2024-08-31T06:38:41.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:41.107+0000 7f602ae8f640 1 -- 172.21.15.37:0/1281815406 wait complete. 2024-08-31T06:38:41.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi037') 2024-08-31T06:38:41.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi037') 2024-08-31T06:38:41.956 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi037') 2024-08-31T06:38:42.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:41 smithi037 ceph-mon[18612]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:42.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:41 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1281815406' entity='client.admin' 2024-08-31T06:38:42.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:42.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:42.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:42.031 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:42.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:41 smithi066 ceph-mon[22244]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:42.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:41 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1281815406' entity='client.admin' 2024-08-31T06:38:42.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:42.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:42.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:42.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:41 smithi106 ceph-mon[22134]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:41 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1281815406' entity='client.admin' 2024-08-31T06:38:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:42.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:42.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:42.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 -- 172.21.15.37:0/3202779900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 msgr2=0x7fec6010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 --2- 172.21.15.37:0/3202779900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 0x7fec6010f2e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fec58009ca0 tx=0x7fec5802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 -- 172.21.15.37:0/3202779900 shutdown_connections 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 --2- 172.21.15.37:0/3202779900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 0x7fec6010f2e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 --2- 172.21.15.37:0/3202779900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec60108160 0x7fec60108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 --2- 172.21.15.37:0/3202779900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60102820 0x7fec60102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 -- 172.21.15.37:0/3202779900 >> 172.21.15.37:0/3202779900 conn(0x7fec600794e0 msgr2=0x7fec600798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 -- 172.21.15.37:0/3202779900 shutdown_connections 2024-08-31T06:38:42.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.494+0000 7fec66fb4640 1 -- 172.21.15.37:0/3202779900 wait complete. 2024-08-31T06:38:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.495+0000 7fec66fb4640 1 Processor -- start 2024-08-31T06:38:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.495+0000 7fec66fb4640 1 -- start start 2024-08-31T06:38:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.495+0000 7fec66fb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60102820 0x7fec60104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.495+0000 7fec66fb4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec60108160 0x7fec601053e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.495+0000 7fec66fb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 0x7fec60105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.495+0000 7fec66fb4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec60112630 con 0x7fec60108ab0 2024-08-31T06:38:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.495+0000 7fec66fb4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fec601124b0 con 0x7fec60102820 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.495+0000 7fec66fb4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fec601127b0 con 0x7fec60108160 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 0x7fec60105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 0x7fec60105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35832/0 (socket says 172.21.15.37:35832) 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 -- 172.21.15.37:0/4134327940 learned_addr learned my addr 172.21.15.37:0/4134327940 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec5ffff640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec60108160 0x7fec601053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec64d50640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60102820 0x7fec60104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 -- 172.21.15.37:0/4134327940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec60108160 msgr2=0x7fec601053e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec60108160 0x7fec601053e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 -- 172.21.15.37:0/4134327940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60102820 msgr2=0x7fec60104ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60102820 0x7fec60104ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 -- 172.21.15.37:0/4134327940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec601a8440 con 0x7fec60108ab0 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec65551640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 0x7fec60105920 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fec58005cc0 tx=0x7fec58003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec5dffb640 1 -- 172.21.15.37:0/4134327940 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58032c10 con 0x7fec60108ab0 2024-08-31T06:38:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec601a86d0 con 0x7fec60108ab0 2024-08-31T06:38:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec5dffb640 1 -- 172.21.15.37:0/4134327940 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec58032db0 con 0x7fec60108ab0 2024-08-31T06:38:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.496+0000 7fec5dffb640 1 -- 172.21.15.37:0/4134327940 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58030a60 con 0x7fec60108ab0 2024-08-31T06:38:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.497+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec601a8c10 con 0x7fec60108ab0 2024-08-31T06:38:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.498+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec60103aa0 con 0x7fec60108ab0 2024-08-31T06:38:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.499+0000 7fec5dffb640 1 -- 172.21.15.37:0/4134327940 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7fec58030c00 con 0x7fec60108ab0 2024-08-31T06:38:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.500+0000 7fec5dffb640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fec500b4b70 0x7fec500b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.500+0000 7fec64d50640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fec500b4b70 0x7fec500b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.500+0000 7fec5dffb640 1 -- 172.21.15.37:0/4134327940 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fec581046c0 con 0x7fec60108ab0 2024-08-31T06:38:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.500+0000 7fec64d50640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fec500b4b70 0x7fec500b7080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec601068f0 tx=0x7fec54005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.504+0000 7fec5dffb640 1 -- 172.21.15.37:0/4134327940 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fec580cd350 con 0x7fec60108ab0 2024-08-31T06:38:42.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.695+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fec601061a0 con 0x7fec60108ab0 2024-08-31T06:38:42.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.699+0000 7fec5dffb640 1 -- 172.21.15.37:0/4134327940 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v29)=0 v29) ==== 120+0+0 (secure 0 0 0) 0x7fec601061a0 con 0x7fec60108ab0 2024-08-31T06:38:42.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 -- 172.21.15.37:0/4210639821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 msgr2=0x7ff744104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/4210639821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 0x7ff744104b60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff738009900 tx=0x7ff73802a410 comp rx=0 tx=0).stop 2024-08-31T06:38:42.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 -- 172.21.15.37:0/4210639821 shutdown_connections 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/4210639821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff74410dbb0 0x7ff7441100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/4210639821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7441050a0 0x7ff74410d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/4210639821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 0x7ff744104b60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 -- 172.21.15.37:0/4210639821 >> 172.21.15.37:0/4210639821 conn(0x7ff7440794d0 msgr2=0x7ff7440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 -- 172.21.15.37:0/4210639821 shutdown_connections 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.684+0000 7ff74ad7f640 1 -- 172.21.15.37:0/4210639821 wait complete. 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74ad7f640 1 Processor -- start 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74ad7f640 1 -- start start 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74ad7f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 0x7ff74419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74ad7f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7441050a0 0x7ff74419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74ad7f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff74410dbb0 0x7ff74419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74ad7f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7441136e0 con 0x7ff744104750 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74ad7f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff744113560 con 0x7ff74410dbb0 2024-08-31T06:38:42.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74ad7f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff744113860 con 0x7ff7441050a0 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff748b1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 0x7ff74419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff748b1b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 0x7ff74419a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35850/0 (socket says 172.21.15.37:35850) 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff748b1b640 1 -- 172.21.15.37:0/2753682837 learned_addr learned my addr 172.21.15.37:0/2753682837 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff743fff640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7441050a0 0x7ff74419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74931c640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff74410dbb0 0x7ff74419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff748b1b640 1 -- 172.21.15.37:0/2753682837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7441050a0 msgr2=0x7ff74419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff748b1b640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7441050a0 0x7ff74419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff748b1b640 1 -- 172.21.15.37:0/2753682837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff74410dbb0 msgr2=0x7ff74419f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff748b1b640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff74410dbb0 0x7ff74419f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff748b1b640 1 -- 172.21.15.37:0/2753682837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7441a0100 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.685+0000 7ff74931c640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff74410dbb0 0x7ff74419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.686+0000 7ff748b1b640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 0x7ff74419a190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff738005940 tx=0x7ff7380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.686+0000 7ff741ffb640 1 -- 172.21.15.37:0/2753682837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73803f030 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.686+0000 7ff741ffb640 1 -- 172.21.15.37:0/2753682837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff738003c90 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.686+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7441a0390 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.686+0000 7ff741ffb640 1 -- 172.21.15.37:0/2753682837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738035070 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.686+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7441a6b50 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.687+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff744104b60 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.689+0000 7ff741ffb640 1 -- 172.21.15.37:0/2753682837 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7ff738042030 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.690+0000 7ff741ffb640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff7340b4b70 0x7ff7340b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.690+0000 7ff743fff640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff7340b4b70 0x7ff7340b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.690+0000 7ff741ffb640 1 -- 172.21.15.37:0/2753682837 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff738103e20 con 0x7ff744104750 2024-08-31T06:38:42.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.690+0000 7ff743fff640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff7340b4b70 0x7ff7340b7080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7441021e0 tx=0x7ff73000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:42.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.693+0000 7ff741ffb640 1 -- 172.21.15.37:0/2753682837 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff7380ccb50 con 0x7ff744104750 2024-08-31T06:38:42.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fec500b4b70 msgr2=0x7fec500b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fec500b4b70 0x7fec500b7080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec601068f0 tx=0x7fec54005f90 comp rx=0 tx=0).stop 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 msgr2=0x7fec60105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 0x7fec60105920 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fec58005cc0 tx=0x7fec58003f90 comp rx=0 tx=0).stop 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 shutdown_connections 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fec500b4b70 0x7fec500b7080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec60108ab0 0x7fec60105920 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec60108160 0x7fec601053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 --2- 172.21.15.37:0/4134327940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60102820 0x7fec60104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.702+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 >> 172.21.15.37:0/4134327940 conn(0x7fec600794e0 msgr2=0x7fec60100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.703+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 shutdown_connections 2024-08-31T06:38:42.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.703+0000 7fec66fb4640 1 -- 172.21.15.37:0/4134327940 wait complete. 2024-08-31T06:38:42.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.884+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7ff74419b2c0 con 0x7ff744104750 2024-08-31T06:38:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.888+0000 7ff741ffb640 1 -- 172.21.15.37:0/2753682837 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7ff74419b2c0 con 0x7ff744104750 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff7340b4b70 msgr2=0x7ff7340b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff7340b4b70 0x7ff7340b7080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7441021e0 tx=0x7ff73000b410 comp rx=0 tx=0).stop 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 msgr2=0x7ff74419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 0x7ff74419a190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff738005940 tx=0x7ff7380042f0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 shutdown_connections 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff7340b4b70 0x7ff7340b7080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff74410dbb0 0x7ff74419f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7441050a0 0x7ff74419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 --2- 172.21.15.37:0/2753682837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff744104750 0x7ff74419a190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 >> 172.21.15.37:0/2753682837 conn(0x7ff7440794d0 msgr2=0x7ff744100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 shutdown_connections 2024-08-31T06:38:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:42.890+0000 7ff74ad7f640 1 -- 172.21.15.37:0/2753682837 wait complete. 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 -- 172.21.15.37:0/2581171374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08105930 msgr2=0x7f7a0810f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 --2- 172.21.15.37:0/2581171374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08105930 0x7f7a0810f380 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009ca0 tx=0x7f7a0002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 -- 172.21.15.37:0/2581171374 shutdown_connections 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 --2- 172.21.15.37:0/2581171374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08105930 0x7f7a0810f380 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 --2- 172.21.15.37:0/2581171374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a08104fe0 0x7f7a081053f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 --2- 172.21.15.37:0/2581171374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08103010 0x7f7a08103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 -- 172.21.15.37:0/2581171374 >> 172.21.15.37:0/2581171374 conn(0x7f7a08079c60 msgr2=0x7f7a0807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 -- 172.21.15.37:0/2581171374 shutdown_connections 2024-08-31T06:38:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.154+0000 7f7a101b8640 1 -- 172.21.15.37:0/2581171374 wait complete. 2024-08-31T06:38:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a101b8640 1 Processor -- start 2024-08-31T06:38:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a101b8640 1 -- start start 2024-08-31T06:38:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a101b8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08103010 0x7f7a0819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a101b8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08104fe0 0x7f7a0819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a101b8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a08105930 0x7f7a0819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a101b8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a081126c0 con 0x7f7a08103010 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a101b8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a08112540 con 0x7f7a08105930 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a101b8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7a08112840 con 0x7f7a08104fe0 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a0df54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08103010 0x7f7a0819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a0df54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08103010 0x7f7a0819af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35870/0 (socket says 172.21.15.37:35870) 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a0df54640 1 -- 172.21.15.37:0/864639960 learned_addr learned my addr 172.21.15.37:0/864639960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.155+0000 7f7a0d753640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08104fe0 0x7f7a0819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a0e755640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a08105930 0x7f7a0819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a0df54640 1 -- 172.21.15.37:0/864639960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08104fe0 msgr2=0x7f7a0819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a0df54640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08104fe0 0x7f7a0819b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a0df54640 1 -- 172.21.15.37:0/864639960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a08105930 msgr2=0x7f7a0819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a0df54640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a08105930 0x7f7a0819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a0df54640 1 -- 172.21.15.37:0/864639960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a081a6170 con 0x7f7a08103010 2024-08-31T06:38:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a0e755640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a08105930 0x7f7a0819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:38:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a0df54640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08103010 0x7f7a0819af70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400c920 tx=0x7f7a0400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f79feffd640 1 -- 172.21.15.37:0/864639960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04007c70 con 0x7f7a08103010 2024-08-31T06:38:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f79feffd640 1 -- 172.21.15.37:0/864639960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a04007e10 con 0x7f7a08103010 2024-08-31T06:38:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f79feffd640 1 -- 172.21.15.37:0/864639960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a04018710 con 0x7f7a08103010 2024-08-31T06:38:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a081a6460 con 0x7f7a08103010 2024-08-31T06:38:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.156+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a081a6950 con 0x7f7a08103010 2024-08-31T06:38:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.157+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a08103420 con 0x7f7a08103010 2024-08-31T06:38:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.159+0000 7f79feffd640 1 -- 172.21.15.37:0/864639960 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f7a0400f450 con 0x7f7a08103010 2024-08-31T06:38:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.159+0000 7f79feffd640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79f40b4ba0 0x7f79f40b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.159+0000 7f7a0d753640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79f40b4ba0 0x7f79f40b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.160+0000 7f79feffd640 1 -- 172.21.15.37:0/864639960 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7a040e3900 con 0x7f7a08103010 2024-08-31T06:38:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.160+0000 7f7a0d753640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79f40b4ba0 0x7f79f40b70b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a08107cd0 tx=0x7f79f800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.162+0000 7f79feffd640 1 -- 172.21.15.37:0/864639960 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7a04014030 con 0x7f7a08103010 2024-08-31T06:38:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.348+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f7a08102080 con 0x7f7a08103010 2024-08-31T06:38:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.353+0000 7f79feffd640 1 -- 172.21.15.37:0/864639960 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v31)=0 v31) ==== 125+0+0 (secure 0 0 0) 0x7f7a040ac740 con 0x7f7a08103010 2024-08-31T06:38:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.355+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79f40b4ba0 msgr2=0x7f79f40b70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.355+0000 7f7a101b8640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79f40b4ba0 0x7f79f40b70b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7a08107cd0 tx=0x7f79f800b390 comp rx=0 tx=0).stop 2024-08-31T06:38:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.355+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08103010 msgr2=0x7f7a0819af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.355+0000 7f7a101b8640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08103010 0x7f7a0819af70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400c920 tx=0x7f7a0400cde0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.356+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 shutdown_connections 2024-08-31T06:38:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.356+0000 7f7a101b8640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79f40b4ba0 0x7f79f40b70b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.356+0000 7f7a101b8640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a08105930 0x7f7a0819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.356+0000 7f7a101b8640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a08104fe0 0x7f7a0819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.356+0000 7f7a101b8640 1 --2- 172.21.15.37:0/864639960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a08103010 0x7f7a0819af70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.356+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 >> 172.21.15.37:0/864639960 conn(0x7f7a08079c60 msgr2=0x7f7a08106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.356+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 shutdown_connections 2024-08-31T06:38:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:43.356+0000 7f7a101b8640 1 -- 172.21.15.37:0/864639960 wait complete. 2024-08-31T06:38:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:43.813 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:43 smithi037 ceph-mon[18612]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:43.813 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:43 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4134327940' entity='client.admin' 2024-08-31T06:38:43.813 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:43 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2753682837' entity='client.admin' 2024-08-31T06:38:43.813 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:43 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/864639960' entity='client.admin' 2024-08-31T06:38:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:43 smithi106 ceph-mon[22134]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:44.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:43 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4134327940' entity='client.admin' 2024-08-31T06:38:44.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:43 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2753682837' entity='client.admin' 2024-08-31T06:38:44.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:43 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/864639960' entity='client.admin' 2024-08-31T06:38:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:43 smithi066 ceph-mon[22244]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:44.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:43 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4134327940' entity='client.admin' 2024-08-31T06:38:44.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:43 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2753682837' entity='client.admin' 2024-08-31T06:38:44.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:43 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/864639960' entity='client.admin' 2024-08-31T06:38:45.148 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:45.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 -- 172.21.15.37:0/718152385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109b90 msgr2=0x7effbc1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 --2- 172.21.15.37:0/718152385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109b90 0x7effbc1103c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7effb4009ca0 tx=0x7effb402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 -- 172.21.15.37:0/718152385 shutdown_connections 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 --2- 172.21.15.37:0/718152385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109b90 0x7effbc1103c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 --2- 172.21.15.37:0/718152385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effbc109240 0x7effbc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 --2- 172.21.15.37:0/718152385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effbc103900 0x7effbc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 -- 172.21.15.37:0/718152385 >> 172.21.15.37:0/718152385 conn(0x7effbc07b5f0 msgr2=0x7effbc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 -- 172.21.15.37:0/718152385 shutdown_connections 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 -- 172.21.15.37:0/718152385 wait complete. 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.756+0000 7effc1759640 1 Processor -- start 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effc1759640 1 -- start start 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effc1759640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effbc103900 0x7effbc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:45.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effc1759640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109240 0x7effbc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effc1759640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effbc109b90 0x7effbc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effc1759640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7effbc113750 con 0x7effbc109240 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effc1759640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7effbc1135d0 con 0x7effbc103900 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effc1759640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7effbc1138d0 con 0x7effbc109b90 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effba7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109240 0x7effbc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effba7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109240 0x7effbc0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42606/0 (socket says 172.21.15.37:42606) 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effba7fc640 1 -- 172.21.15.37:0/3740585599 learned_addr learned my addr 172.21.15.37:0/3740585599 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effbaffd640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effbc103900 0x7effbc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effbb7fe640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effbc109b90 0x7effbc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effba7fc640 1 -- 172.21.15.37:0/3740585599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effbc109b90 msgr2=0x7effbc075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effba7fc640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effbc109b90 0x7effbc075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effba7fc640 1 -- 172.21.15.37:0/3740585599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effbc103900 msgr2=0x7effbc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:45.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effba7fc640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effbc103900 0x7effbc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.757+0000 7effba7fc640 1 -- 172.21.15.37:0/3740585599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effbc1a8400 con 0x7effbc109240 2024-08-31T06:38:45.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.758+0000 7effba7fc640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109240 0x7effbc0759f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effb000d950 tx=0x7effb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:45.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.758+0000 7effa3fff640 1 -- 172.21.15.37:0/3740585599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb0017070 con 0x7effbc109240 2024-08-31T06:38:45.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.758+0000 7effa3fff640 1 -- 172.21.15.37:0/3740585599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effb0009c30 con 0x7effbc109240 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.758+0000 7effa3fff640 1 -- 172.21.15.37:0/3740585599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb00047a0 con 0x7effbc109240 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.758+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effbc1a86f0 con 0x7effbc109240 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.758+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effbc1a8c30 con 0x7effbc109240 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.759+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effbc103d10 con 0x7effbc109240 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.761+0000 7effa3fff640 1 -- 172.21.15.37:0/3740585599 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7effb0004020 con 0x7effbc109240 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.761+0000 7effa3fff640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7effa40b4af0 0x7effa40b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.761+0000 7effbaffd640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7effa40b4af0 0x7effa40b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.761+0000 7effa3fff640 1 -- 172.21.15.37:0/3740585599 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7effb00e35f0 con 0x7effbc109240 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.762+0000 7effbaffd640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7effa40b4af0 0x7effa40b7000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effbc076f00 tx=0x7effac005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:45.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.764+0000 7effa3fff640 1 -- 172.21.15.37:0/3740585599 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7effb0020020 con 0x7effbc109240 2024-08-31T06:38:45.841 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:45 smithi037 ceph-mon[18612]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.953+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7effbc02e430 con 0x7effbc109240 2024-08-31T06:38:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.957+0000 7effa3fff640 1 -- 172.21.15.37:0/3740585599 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v32)=0 v32) ==== 129+0+0 (secure 0 0 0) 0x7effb00ac320 con 0x7effbc109240 2024-08-31T06:38:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7effa40b4af0 msgr2=0x7effa40b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7effa40b4af0 0x7effa40b7000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7effbc076f00 tx=0x7effac005f90 comp rx=0 tx=0).stop 2024-08-31T06:38:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109240 msgr2=0x7effbc0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109240 0x7effbc0759f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effb000d950 tx=0x7effb000de10 comp rx=0 tx=0).stop 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 shutdown_connections 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7effa40b4af0 0x7effa40b7000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effbc109240 0x7effbc0759f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7effbc109b90 0x7effbc075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 --2- 172.21.15.37:0/3740585599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effbc103900 0x7effbc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 >> 172.21.15.37:0/3740585599 conn(0x7effbc07b5f0 msgr2=0x7effbc105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 shutdown_connections 2024-08-31T06:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:45.960+0000 7effc1759640 1 -- 172.21.15.37:0/3740585599 wait complete. 2024-08-31T06:38:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:45 smithi106 ceph-mon[22134]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:46.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:45 smithi066 ceph-mon[22244]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:46.764 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:46.799 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-08-31T06:38:46.799 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi037') 2024-08-31T06:38:46.799 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-08-31T06:38:46.799 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-08-31T06:38:47.156 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:46 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3740585599' entity='client.admin' 2024-08-31T06:38:47.157 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:47.157 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:47.157 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:47.157 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:47.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:46 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3740585599' entity='client.admin' 2024-08-31T06:38:47.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:47.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:47.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:47.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:47.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:46 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3740585599' entity='client.admin' 2024-08-31T06:38:47.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:47.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:47.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:47.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 -- 172.21.15.37:0/2281835320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 msgr2=0x7f15d010d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/2281835320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 0x7f15d010d630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009900 tx=0x7f15c402a410 comp rx=0 tx=0).stop 2024-08-31T06:38:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 -- 172.21.15.37:0/2281835320 shutdown_connections 2024-08-31T06:38:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/2281835320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 0x7f15d010d630 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/2281835320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d010dbf0 0x7f15d01100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/2281835320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0104790 0x7f15d0104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 -- 172.21.15.37:0/2281835320 >> 172.21.15.37:0/2281835320 conn(0x7f15d0079580 msgr2=0x7f15d0079990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 -- 172.21.15.37:0/2281835320 shutdown_connections 2024-08-31T06:38:47.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.579+0000 7f15d5a7b640 1 -- 172.21.15.37:0/2281835320 wait complete. 2024-08-31T06:38:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.580+0000 7f15d5a7b640 1 Processor -- start 2024-08-31T06:38:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.580+0000 7f15d5a7b640 1 -- start start 2024-08-31T06:38:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15d5a7b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0104790 0x7f15d019a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15d5a7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 0x7f15d019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15d5a7b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d010dbf0 0x7f15d019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15d5a7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0113700 con 0x7f15d01050e0 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15d5a7b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0113580 con 0x7f15d0104790 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15d5a7b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0113880 con 0x7f15d010dbf0 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 0x7f15d019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 0x7f15d019a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42642/0 (socket says 172.21.15.37:42642) 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 -- 172.21.15.37:0/1355008095 learned_addr learned my addr 172.21.15.37:0/1355008095 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0104790 0x7f15d019a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15cffff640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d010dbf0 0x7f15d019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 -- 172.21.15.37:0/1355008095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d010dbf0 msgr2=0x7f15d019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d010dbf0 0x7f15d019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 -- 172.21.15.37:0/1355008095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0104790 msgr2=0x7f15d019a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0104790 0x7f15d019a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 -- 172.21.15.37:0/1355008095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d01a00c0 con 0x7f15d01050e0 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0104790 0x7f15d019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.581+0000 7f15ceffd640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 0x7f15d019a6f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f15c4005940 tx=0x7f15c4005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.582+0000 7f15ccff9640 1 -- 172.21.15.37:0/1355008095 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c403f030 con 0x7f15d01050e0 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.582+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d01a0350 con 0x7f15d01050e0 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.582+0000 7f15ccff9640 1 -- 172.21.15.37:0/1355008095 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c40043d0 con 0x7f15d01050e0 2024-08-31T06:38:47.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.582+0000 7f15ccff9640 1 -- 172.21.15.37:0/1355008095 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4035070 con 0x7f15d01050e0 2024-08-31T06:38:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.582+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d01a6b10 con 0x7f15d01050e0 2024-08-31T06:38:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.583+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d0104ba0 con 0x7f15d01050e0 2024-08-31T06:38:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.584+0000 7f15ccff9640 1 -- 172.21.15.37:0/1355008095 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f15c4042030 con 0x7f15d01050e0 2024-08-31T06:38:47.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.585+0000 7f15ccff9640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4af0 0x7f15b80b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:47.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.585+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4af0 0x7f15b80b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:47.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.585+0000 7f15ccff9640 1 -- 172.21.15.37:0/1355008095 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f15c4103dc0 con 0x7f15d01050e0 2024-08-31T06:38:47.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.586+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4af0 0x7f15b80b7000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15d006c3c0 tx=0x7f15c0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:47.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.588+0000 7f15ccff9640 1 -- 172.21.15.37:0/1355008095 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f15c40ccaf0 con 0x7f15d01050e0 2024-08-31T06:38:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 -- 172.21.15.37:0/1828473075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4105050 msgr2=0x7f42b410d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/1828473075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4105050 0x7f42b410d690 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009900 tx=0x7f42a802a410 comp rx=0 tx=0).stop 2024-08-31T06:38:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 -- 172.21.15.37:0/1828473075 shutdown_connections 2024-08-31T06:38:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/1828473075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4105050 0x7f42b410d690 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/1828473075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b410dbd0 0x7f42b41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/1828473075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b4104620 0x7f42b4104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 -- 172.21.15.37:0/1828473075 >> 172.21.15.37:0/1828473075 conn(0x7f42b40794d0 msgr2=0x7f42b40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 -- 172.21.15.37:0/1828473075 shutdown_connections 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.466+0000 7f42bb0a9640 1 -- 172.21.15.37:0/1828473075 wait complete. 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42bb0a9640 1 Processor -- start 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42bb0a9640 1 -- start start 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42bb0a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4104620 0x7f42b419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42bb0a9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b4105050 0x7f42b419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42bb0a9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b410dbd0 0x7f42b419f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42bb0a9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41136a0 con 0x7f42b4104620 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42bb0a9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4113520 con 0x7f42b4105050 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42bb0a9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4113820 con 0x7f42b410dbd0 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42b8e45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4104620 0x7f42b419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42b8e45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4104620 0x7f42b419a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42638/0 (socket says 172.21.15.37:42638) 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42b8e45640 1 -- 172.21.15.37:0/3540469567 learned_addr learned my addr 172.21.15.37:0/3540469567 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42b3fff640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b4105050 0x7f42b419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42b9646640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b410dbd0 0x7f42b419f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.467+0000 7f42b8e45640 1 -- 172.21.15.37:0/3540469567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b410dbd0 msgr2=0x7f42b419f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b8e45640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b410dbd0 0x7f42b419f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b8e45640 1 -- 172.21.15.37:0/3540469567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b4105050 msgr2=0x7f42b419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b8e45640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b4105050 0x7f42b419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b8e45640 1 -- 172.21.15.37:0/3540469567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b41a0000 con 0x7f42b4104620 2024-08-31T06:38:47.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b3fff640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b4105050 0x7f42b419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b8e45640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4104620 0x7f42b419a150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f42a400eaa0 tx=0x7f42a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b1ffb640 1 -- 172.21.15.37:0/3540469567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4016070 con 0x7f42b4104620 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b1ffb640 1 -- 172.21.15.37:0/3540469567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a400ce10 con 0x7f42b4104620 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42b1ffb640 1 -- 172.21.15.37:0/3540469567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4011470 con 0x7f42b4104620 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b41a02f0 con 0x7f42b4104620 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.468+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b41a07b0 con 0x7f42b4104620 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.469+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b4104a30 con 0x7f42b4104620 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.470+0000 7f42b1ffb640 1 -- 172.21.15.37:0/3540469567 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f42a4019070 con 0x7f42b4104620 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.471+0000 7f42b1ffb640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f429c0b4b20 0x7f429c0b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.472+0000 7f42b3fff640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f429c0b4b20 0x7f429c0b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.472+0000 7f42b1ffb640 1 -- 172.21.15.37:0/3540469567 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f42a40e3600 con 0x7f42b4104620 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.472+0000 7f42b3fff640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f429c0b4b20 0x7f429c0b7030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f42a8006010 tx=0x7f42a8005de0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:47.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.476+0000 7f42b1ffb640 1 -- 172.21.15.37:0/3540469567 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f42a40ac330 con 0x7f42b4104620 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.667+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f42b402e430 con 0x7f42b4104620 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.671+0000 7f42b1ffb640 1 -- 172.21.15.37:0/3540469567 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v33)=0 v33) ==== 115+0+0 (secure 0 0 0) 0x7f42a40abc30 con 0x7f42b4104620 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f429c0b4b20 msgr2=0x7f429c0b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f429c0b4b20 0x7f429c0b7030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f42a8006010 tx=0x7f42a8005de0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4104620 msgr2=0x7f42b419a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4104620 0x7f42b419a150 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f42a400eaa0 tx=0x7f42a400ef60 comp rx=0 tx=0).stop 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 shutdown_connections 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f429c0b4b20 0x7f429c0b7030 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b410dbd0 0x7f42b419f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b4105050 0x7f42b419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 --2- 172.21.15.37:0/3540469567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b4104620 0x7f42b419a150 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 >> 172.21.15.37:0/3540469567 conn(0x7f42b40794d0 msgr2=0x7f42b4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.673+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 shutdown_connections 2024-08-31T06:38:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.674+0000 7f42bb0a9640 1 -- 172.21.15.37:0/3540469567 wait complete. 2024-08-31T06:38:47.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.784+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f15d0108d50 con 0x7f15d01050e0 2024-08-31T06:38:47.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.788+0000 7f15ccff9640 1 -- 172.21.15.37:0/1355008095 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v34)=0 v34) ==== 138+0+0 (secure 0 0 0) 0x7f15c40cc3f0 con 0x7f15d01050e0 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4af0 msgr2=0x7f15b80b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4af0 0x7f15b80b7000 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f15d006c3c0 tx=0x7f15c0005f90 comp rx=0 tx=0).stop 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 msgr2=0x7f15d019a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 0x7f15d019a6f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f15c4005940 tx=0x7f15c4005e10 comp rx=0 tx=0).stop 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 shutdown_connections 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4af0 0x7f15b80b7000 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d01050e0 0x7f15d019a6f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d010dbf0 0x7f15d019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 --2- 172.21.15.37:0/1355008095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0104790 0x7f15d019a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 >> 172.21.15.37:0/1355008095 conn(0x7f15d0079580 msgr2=0x7f15d0100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 shutdown_connections 2024-08-31T06:38:47.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:47.791+0000 7f15d5a7b640 1 -- 172.21.15.37:0/1355008095 wait complete. 2024-08-31T06:38:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3540469567' entity='client.admin' 2024-08-31T06:38:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1355008095' entity='client.admin' 2024-08-31T06:38:48.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:48.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:48.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:48.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:48.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3540469567' entity='client.admin' 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1355008095' entity='client.admin' 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:48.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:48.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3540469567' entity='client.admin' 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1355008095' entity='client.admin' 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:38:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:38:49.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 -- 172.21.15.37:0/2611751034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c105050 msgr2=0x7f7a4c10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/2611751034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c105050 0x7f7a4c10d690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009900 tx=0x7f7a3402a410 comp rx=0 tx=0).stop 2024-08-31T06:38:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 -- 172.21.15.37:0/2611751034 shutdown_connections 2024-08-31T06:38:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/2611751034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c105050 0x7f7a4c10d690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/2611751034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c10dbd0 0x7f7a4c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/2611751034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a4c104620 0x7f7a4c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 -- 172.21.15.37:0/2611751034 >> 172.21.15.37:0/2611751034 conn(0x7f7a4c0794d0 msgr2=0x7f7a4c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 -- 172.21.15.37:0/2611751034 shutdown_connections 2024-08-31T06:38:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.368+0000 7f7a51e4c640 1 -- 172.21.15.37:0/2611751034 wait complete. 2024-08-31T06:38:49.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.369+0000 7f7a51e4c640 1 Processor -- start 2024-08-31T06:38:49.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.369+0000 7f7a51e4c640 1 -- start start 2024-08-31T06:38:49.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a51e4c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a4c104620 0x7f7a4c102530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:49.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a51e4c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c105050 0x7f7a4c102a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:49.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a51e4c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c10dbd0 0x7f7a4c102fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a51e4c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c113680 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a51e4c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c113500 con 0x7f7a4c105050 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a51e4c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c113800 con 0x7f7a4c104620 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c10dbd0 0x7f7a4c102fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c10dbd0 0x7f7a4c102fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42664/0 (socket says 172.21.15.37:42664) 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 -- 172.21.15.37:0/3111910033 learned_addr learned my addr 172.21.15.37:0/3111910033 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a42ffd640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c105050 0x7f7a4c102a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4b7fe640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a4c104620 0x7f7a4c102530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 -- 172.21.15.37:0/3111910033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a4c104620 msgr2=0x7f7a4c102530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a4c104620 0x7f7a4c102530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 -- 172.21.15.37:0/3111910033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c105050 msgr2=0x7f7a4c102a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c105050 0x7f7a4c102a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 -- 172.21.15.37:0/3111910033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c1a8410 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.370+0000 7f7a4bfff640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c10dbd0 0x7f7a4c102fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400eb10 tx=0x7f7a4400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.371+0000 7f7a497fa640 1 -- 172.21.15.37:0/3111910033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44004b20 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.371+0000 7f7a497fa640 1 -- 172.21.15.37:0/3111910033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a44004cc0 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.371+0000 7f7a497fa640 1 -- 172.21.15.37:0/3111910033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44010690 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.371+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c1a8700 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.371+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c1a8bb0 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.372+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c104a30 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.374+0000 7f7a497fa640 1 -- 172.21.15.37:0/3111910033 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f7a44005020 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.374+0000 7f7a497fa640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a380b4af0 0x7f7a380b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:49.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.374+0000 7f7a4b7fe640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a380b4af0 0x7f7a380b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:49.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.374+0000 7f7a497fa640 1 -- 172.21.15.37:0/3111910033 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7a440e3b00 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.375+0000 7f7a4b7fe640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a380b4af0 0x7f7a380b7000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c103f80 tx=0x7f7a3c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:49.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.379+0000 7f7a497fa640 1 -- 172.21.15.37:0/3111910033 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7a440ac790 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.566+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7a4c02e430 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.571+0000 7f7a497fa640 1 -- 172.21.15.37:0/3111910033 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v35)=0 v35) ==== 120+0+0 (secure 0 0 0) 0x7f7a440ac090 con 0x7f7a4c10dbd0 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a380b4af0 msgr2=0x7f7a380b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a380b4af0 0x7f7a380b7000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c103f80 tx=0x7f7a3c00b410 comp rx=0 tx=0).stop 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c10dbd0 msgr2=0x7f7a4c102fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c10dbd0 0x7f7a4c102fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400eb10 tx=0x7f7a4400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 shutdown_connections 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a380b4af0 0x7f7a380b7000 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c10dbd0 0x7f7a4c102fb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a4c105050 0x7f7a4c102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 --2- 172.21.15.37:0/3111910033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a4c104620 0x7f7a4c102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:49.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 >> 172.21.15.37:0/3111910033 conn(0x7f7a4c0794d0 msgr2=0x7f7a4c100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:49.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 shutdown_connections 2024-08-31T06:38:49.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:49.574+0000 7f7a51e4c640 1 -- 172.21.15.37:0/3111910033 wait complete. 2024-08-31T06:38:50.271 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:49 smithi037 ceph-mon[18612]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:50.271 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:49 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3111910033' entity='client.admin' 2024-08-31T06:38:50.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:49 smithi106 ceph-mon[22134]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:50.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:49 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3111910033' entity='client.admin' 2024-08-31T06:38:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:49 smithi066 ceph-mon[22244]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:49 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3111910033' entity='client.admin' 2024-08-31T06:38:50.535 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-08-31T06:38:50.535 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi037') 2024-08-31T06:38:50.536 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi037') 2024-08-31T06:38:50.536 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi037') 2024-08-31T06:38:50.536 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi037') 2024-08-31T06:38:50.536 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi037') 2024-08-31T06:38:50.536 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi037') 2024-08-31T06:38:50.536 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '22785f22-6763-11ef-bcd4-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-08-31T06:38:50.536 INFO:tasks.cephadm:Deploying OSDs... 2024-08-31T06:38:50.537 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:38:50.537 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T06:38:50.556 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T06:38:50.556 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-08-31T06:38:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T06:38:50.613 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:50.614 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-31T06:38:50.614 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:50.614 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:50.614 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-31 06:37:29.076278487 +0000 2024-08-31T06:38:50.614 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-31 06:32:34.096903177 +0000 2024-08-31T06:38:50.614 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-31 06:32:34.096903177 +0000 2024-08-31T06:38:50.614 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-08-31 06:32:34.096903177 +0000 2024-08-31T06:38:50.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T06:38:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-08-31T06:38:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-08-31T06:38:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000213044 s, 2.4 MB/s 2024-08-31T06:38:50.684 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T06:38:50.744 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-08-31T06:38:50.801 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T06:38:50.802 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:50.802 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-31T06:38:50.802 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:50.802 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:50.802 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-31 06:37:29.112277989 +0000 2024-08-31T06:38:50.802 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-31 06:32:34.429898732 +0000 2024-08-31T06:38:50.802 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-31 06:32:34.429898732 +0000 2024-08-31T06:38:50.802 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-08-31 06:32:34.429898732 +0000 2024-08-31T06:38:50.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T06:38:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-08-31T06:38:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-08-31T06:38:50.868 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000229214 s, 2.2 MB/s 2024-08-31T06:38:50.870 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T06:38:50.928 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-08-31T06:38:50.985 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T06:38:50.985 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:50.985 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-31T06:38:50.985 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:50.985 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:50.985 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-31 06:37:29.151277451 +0000 2024-08-31T06:38:50.986 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-31 06:32:34.754894394 +0000 2024-08-31T06:38:50.986 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-31 06:32:34.754894394 +0000 2024-08-31T06:38:50.986 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-08-31 06:32:34.754894394 +0000 2024-08-31T06:38:50.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T06:38:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-08-31T06:38:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-08-31T06:38:51.050 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000218726 s, 2.3 MB/s 2024-08-31T06:38:51.052 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T06:38:51.109 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-08-31T06:38:51.166 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T06:38:51.166 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:51.167 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-31T06:38:51.167 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:51.167 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:51.167 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-31 06:37:29.186276968 +0000 2024-08-31T06:38:51.167 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-31 06:32:35.090889909 +0000 2024-08-31T06:38:51.167 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-31 06:32:35.090889909 +0000 2024-08-31T06:38:51.167 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-08-31 06:32:35.090889909 +0000 2024-08-31T06:38:51.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T06:38:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-08-31T06:38:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-08-31T06:38:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000242287 s, 2.1 MB/s 2024-08-31T06:38:51.233 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T06:38:51.290 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-08-31T06:38:51.290 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T06:38:51.311 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T06:38:51.311 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-08-31T06:38:51.371 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T06:38:51.372 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:51.372 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-08-31T06:38:51.372 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:51.372 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:51.372 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-08-31 06:38:27.471010938 +0000 2024-08-31T06:38:51.373 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-08-31 06:32:34.992065386 +0000 2024-08-31T06:38:51.373 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-08-31 06:32:34.992065386 +0000 2024-08-31T06:38:51.373 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-08-31 06:32:34.992065386 +0000 2024-08-31T06:38:51.373 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T06:38:51.443 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-08-31T06:38:51.443 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-08-31T06:38:51.443 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000290903 s, 1.8 MB/s 2024-08-31T06:38:51.444 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T06:38:51.504 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-08-31T06:38:51.561 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T06:38:51.562 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:51.562 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-08-31T06:38:51.562 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:51.562 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:51.562 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-08-31 06:38:27.471010938 +0000 2024-08-31T06:38:51.562 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-08-31 06:32:35.330064741 +0000 2024-08-31T06:38:51.562 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-08-31 06:32:35.330064741 +0000 2024-08-31T06:38:51.562 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-08-31 06:32:35.330064741 +0000 2024-08-31T06:38:51.562 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T06:38:51.629 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-08-31T06:38:51.629 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-08-31T06:38:51.629 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000230088 s, 2.2 MB/s 2024-08-31T06:38:51.633 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T06:38:51.692 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-08-31T06:38:51.749 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T06:38:51.749 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:51.750 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-31T06:38:51.750 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:51.750 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:51.750 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-08-31 06:38:27.472010930 +0000 2024-08-31T06:38:51.750 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-08-31 06:32:35.643064144 +0000 2024-08-31T06:38:51.750 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-08-31 06:32:35.643064144 +0000 2024-08-31T06:38:51.750 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-08-31 06:32:35.643064144 +0000 2024-08-31T06:38:51.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T06:38:51.815 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-08-31T06:38:51.816 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-08-31T06:38:51.816 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.00021863 s, 2.3 MB/s 2024-08-31T06:38:51.817 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T06:38:51.876 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-08-31T06:38:51.932 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T06:38:51.932 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:51.932 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-31T06:38:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-08-31 06:38:27.472010930 +0000 2024-08-31T06:38:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-08-31 06:32:35.967063526 +0000 2024-08-31T06:38:51.933 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-08-31 06:32:35.967063526 +0000 2024-08-31T06:38:51.933 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-08-31 06:32:35.967063526 +0000 2024-08-31T06:38:51.933 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T06:38:51.998 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-08-31T06:38:51.998 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-08-31T06:38:51.998 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000227178 s, 2.3 MB/s 2024-08-31T06:38:52.000 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T06:38:52.057 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-08-31T06:38:52.057 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-08-31T06:38:52.077 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-31T06:38:52.077 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-08-31 06:38:24.971250325 +0000 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-08-31 06:32:34.092382436 +0000 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-08-31 06:32:34.092382436 +0000 2024-08-31T06:38:52.137 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-08-31 06:32:34.092382436 +0000 2024-08-31T06:38:52.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-31T06:38:52.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:51 smithi066 ceph-mon[22244]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:52.206 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-08-31T06:38:52.207 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-08-31T06:38:52.207 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000212136 s, 2.4 MB/s 2024-08-31T06:38:52.208 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-31T06:38:52.268 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-08-31T06:38:52.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:51 smithi106 ceph-mon[22134]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:52.324 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-31T06:38:52.325 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:52.325 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-08-31T06:38:52.325 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:52.325 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:52.325 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-08-31 06:38:24.972250301 +0000 2024-08-31T06:38:52.325 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-08-31 06:32:34.414373276 +0000 2024-08-31T06:38:52.325 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-08-31 06:32:34.414373276 +0000 2024-08-31T06:38:52.325 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-08-31 06:32:34.414373276 +0000 2024-08-31T06:38:52.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-31T06:38:52.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:51 smithi037 ceph-mon[18612]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:52.390 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-08-31T06:38:52.390 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-08-31T06:38:52.390 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.0002043 s, 2.5 MB/s 2024-08-31T06:38:52.391 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-31T06:38:52.450 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-08-31 06:38:24.972250301 +0000 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-08-31 06:32:34.738364059 +0000 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-08-31 06:32:34.738364059 +0000 2024-08-31T06:38:52.507 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-08-31 06:32:34.738364059 +0000 2024-08-31T06:38:52.508 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-31T06:38:52.572 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-08-31T06:38:52.572 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-08-31T06:38:52.572 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000218875 s, 2.3 MB/s 2024-08-31T06:38:52.573 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-31T06:38:52.631 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-08-31T06:38:52.687 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-31T06:38:52.687 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-31T06:38:52.688 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-08-31T06:38:52.688 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:38:52.688 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2024-08-31T06:38:52.688 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-08-31 06:38:24.973250277 +0000 2024-08-31T06:38:52.688 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-08-31 06:32:35.070354615 +0000 2024-08-31T06:38:52.688 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-08-31 06:32:35.070354615 +0000 2024-08-31T06:38:52.688 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-08-31 06:32:35.070354615 +0000 2024-08-31T06:38:52.688 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-31T06:38:52.752 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-08-31T06:38:52.752 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-08-31T06:38:52.752 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000200199 s, 2.6 MB/s 2024-08-31T06:38:52.753 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-31T06:38:52.810 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2024-08-31T06:38:52.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T06:38:53.067 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:54.166 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:53 smithi037 ceph-mon[18612]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:54.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:53 smithi106 ceph-mon[22134]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:54.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:53 smithi066 ceph-mon[22244]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:38:55.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-08-31T06:38:55.808 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:38:56.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:55 smithi037 ceph-mon[18612]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:56.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 -- 172.21.15.37:0/2903737240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109240 msgr2=0x7f9274109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:56.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 --2- 172.21.15.37:0/2903737240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109240 0x7f9274109650 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9264009900 tx=0x7f926402a410 comp rx=0 tx=0).stop 2024-08-31T06:38:56.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 -- 172.21.15.37:0/2903737240 shutdown_connections 2024-08-31T06:38:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 --2- 172.21.15.37:0/2903737240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109240 0x7f9274109650 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 --2- 172.21.15.37:0/2903737240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9274109b90 0x7f92741103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 --2- 172.21.15.37:0/2903737240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9274103900 0x7f9274103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 -- 172.21.15.37:0/2903737240 >> 172.21.15.37:0/2903737240 conn(0x7f927407b5f0 msgr2=0x7f927407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:38:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 -- 172.21.15.37:0/2903737240 shutdown_connections 2024-08-31T06:38:56.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 -- 172.21.15.37:0/2903737240 wait complete. 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.286+0000 7f927b6d7640 1 Processor -- start 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f927b6d7640 1 -- start start 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f927b6d7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9274103900 0x7f927419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f927b6d7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9274109240 0x7f927419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f927b6d7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109b90 0x7f927419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f927b6d7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9274113700 con 0x7f9274109b90 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f927b6d7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9274113580 con 0x7f9274109240 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f927b6d7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9274113880 con 0x7f9274103900 2024-08-31T06:38:56.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279c74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109b90 0x7f927419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279c74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109b90 0x7f927419f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42608/0 (socket says 172.21.15.37:42608) 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279c74640 1 -- 172.21.15.37:0/3196009682 learned_addr learned my addr 172.21.15.37:0/3196009682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9278c72640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9274109240 0x7f927419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279473640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9274103900 0x7f927419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279c74640 1 -- 172.21.15.37:0/3196009682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9274103900 msgr2=0x7f927419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279c74640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9274103900 0x7f927419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279c74640 1 -- 172.21.15.37:0/3196009682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9274109240 msgr2=0x7f927419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279c74640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9274109240 0x7f927419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.287+0000 7f9279c74640 1 -- 172.21.15.37:0/3196009682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92741a0060 con 0x7f9274109b90 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.288+0000 7f9279c74640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109b90 0x7f927419f9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f926c00cce0 tx=0x7f926c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.288+0000 7f926a7fc640 1 -- 172.21.15.37:0/3196009682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c00f450 con 0x7f9274109b90 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.288+0000 7f926a7fc640 1 -- 172.21.15.37:0/3196009682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f926c00fa80 con 0x7f9274109b90 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.288+0000 7f926a7fc640 1 -- 172.21.15.37:0/3196009682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c018ad0 con 0x7f9274109b90 2024-08-31T06:38:56.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.288+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92741a0350 con 0x7f9274109b90 2024-08-31T06:38:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.288+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92741a0810 con 0x7f9274109b90 2024-08-31T06:38:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.289+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9274103d10 con 0x7f9274109b90 2024-08-31T06:38:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.290+0000 7f926a7fc640 1 -- 172.21.15.37:0/3196009682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f926c00f5f0 con 0x7f9274109b90 2024-08-31T06:38:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.291+0000 7f926a7fc640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92600b4b20 0x7f92600b7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:38:56.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.291+0000 7f9279473640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92600b4b20 0x7f92600b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:38:56.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.291+0000 7f926a7fc640 1 -- 172.21.15.37:0/3196009682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f926c0e3dd0 con 0x7f9274109b90 2024-08-31T06:38:56.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.292+0000 7f9279473640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92600b4b20 0x7f92600b7030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9270005fd0 tx=0x7f9270005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:38:56.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.294+0000 7f926a7fc640 1 -- 172.21.15.37:0/3196009682 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f926c014030 con 0x7f9274109b90 2024-08-31T06:38:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:55 smithi106 ceph-mon[22134]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:56.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:55 smithi066 ceph-mon[22244]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:56.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:38:56.488+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f92740635a0 con 0x7f92600b4b20 2024-08-31T06:38:57.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:38:57.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:38:57.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:38:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:38:57.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:57.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:38:57.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:38:57.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:38:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:57 smithi037 ceph-mon[18612]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:57 smithi037 ceph-mon[18612]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:57 smithi106 ceph-mon[22134]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:57 smithi106 ceph-mon[22134]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:57 smithi066 ceph-mon[22244]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:38:58.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:57 smithi066 ceph-mon[22244]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:38:59.289 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:59 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2634500280' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded8d651-8305-4924-9bde-2e31cc2d088b"} : dispatch 2024-08-31T06:38:59.289 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:59 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2634500280' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded8d651-8305-4924-9bde-2e31cc2d088b"}]': finished 2024-08-31T06:38:59.289 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:59 smithi066 ceph-mon[22244]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T06:38:59.289 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:38:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:38:59.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:59 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2634500280' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded8d651-8305-4924-9bde-2e31cc2d088b"} : dispatch 2024-08-31T06:38:59.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:59 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2634500280' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded8d651-8305-4924-9bde-2e31cc2d088b"}]': finished 2024-08-31T06:38:59.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:59 smithi106 ceph-mon[22134]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T06:38:59.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:38:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:38:59.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:59 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2634500280' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ded8d651-8305-4924-9bde-2e31cc2d088b"} : dispatch 2024-08-31T06:38:59.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:59 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2634500280' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ded8d651-8305-4924-9bde-2e31cc2d088b"}]': finished 2024-08-31T06:38:59.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:59 smithi037 ceph-mon[18612]: osdmap e6: 1 total, 0 up, 1 in 2024-08-31T06:38:59.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:38:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:00.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:00 smithi106 ceph-mon[22134]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:00.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:00 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1964948688' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:00.365 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:00 smithi037 ceph-mon[18612]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:00.366 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:00 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1964948688' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:00.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:00 smithi066 ceph-mon[22244]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:00.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:00 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1964948688' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:01.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:01 smithi066 ceph-mon[22244]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:01.437 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:01 smithi106 ceph-mon[22134]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:01.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:01 smithi037 ceph-mon[18612]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:03.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:03 smithi106 ceph-mon[22134]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:03.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:03 smithi037 ceph-mon[18612]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:03.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:03 smithi066 ceph-mon[22244]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:05.478 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:05 smithi037 ceph-mon[18612]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:05.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:05 smithi106 ceph-mon[22134]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:05.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:05 smithi066 ceph-mon[22244]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:07.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:07 smithi037 ceph-mon[18612]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:07.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:07 smithi106 ceph-mon[22134]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:07.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:07 smithi066 ceph-mon[22244]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T06:39:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:08 smithi037 ceph-mon[18612]: Deploying daemon osd.0 on smithi037 2024-08-31T06:39:08.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T06:39:08.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:08.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:08 smithi106 ceph-mon[22134]: Deploying daemon osd.0 on smithi037 2024-08-31T06:39:08.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-31T06:39:08.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:08.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:08 smithi066 ceph-mon[22244]: Deploying daemon osd.0 on smithi037 2024-08-31T06:39:09.303 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:09 smithi037 ceph-mon[18612]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:09.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:09 smithi106 ceph-mon[22134]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:09.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:09 smithi066 ceph-mon[22244]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:11.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:11 smithi037 ceph-mon[18612]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:11.508 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:11 smithi106 ceph-mon[22134]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:11.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:11 smithi066 ceph-mon[22244]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:13.449 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:13 smithi037 ceph-mon[18612]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:13.449 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:13.449 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:13.449 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:13.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:13 smithi106 ceph-mon[22134]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:13.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:13.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:13.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:13.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:13 smithi066 ceph-mon[22244]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:13.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:13.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:13.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:15.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:15 smithi106 ceph-mon[22134]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:15.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:15 smithi037 ceph-mon[18612]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:15.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:15 smithi066 ceph-mon[22244]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:16.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:16.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:16.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:16.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:16.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:16.762 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:16.762 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:16.762 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:16.762 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:16.762 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:16.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:16.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:16.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:16.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:16.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:17.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.072+0000 7f926a7fc640 1 -- 172.21.15.37:0/3196009682 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f92740635a0 con 0x7f92600b4b20 2024-08-31T06:39:17.074 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2024-08-31T06:39:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92600b4b20 msgr2=0x7f92600b7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92600b4b20 0x7f92600b7030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9270005fd0 tx=0x7f9270005850 comp rx=0 tx=0).stop 2024-08-31T06:39:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109b90 msgr2=0x7f927419f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109b90 0x7f927419f9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f926c00cce0 tx=0x7f926c00a620 comp rx=0 tx=0).stop 2024-08-31T06:39:17.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 shutdown_connections 2024-08-31T06:39:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92600b4b20 0x7f92600b7030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9274109b90 0x7f927419f9f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9274109240 0x7f927419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 --2- 172.21.15.37:0/3196009682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9274103900 0x7f927419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 >> 172.21.15.37:0/3196009682 conn(0x7f927407b5f0 msgr2=0x7f9274105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:39:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 shutdown_connections 2024-08-31T06:39:17.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:39:17.075+0000 7f927b6d7640 1 -- 172.21.15.37:0/3196009682 wait complete. 2024-08-31T06:39:17.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:17 smithi037 ceph-mon[18612]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:17.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:17 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:17.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:17 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:17.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:17 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:17.783 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.0.service 2024-08-31T06:39:17.785 INFO:tasks.cephadm:Deploying osd.1 on smithi066 with /dev/vg_nvme/lv_4... 2024-08-31T06:39:17.786 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T06:39:17.813 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:17 smithi066 ceph-mon[22244]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:17.814 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:17 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:17.814 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:17 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:17.814 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:17 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:17.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:17 smithi106 ceph-mon[22134]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:17.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:17 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:17.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:17 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:17.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:17 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:18.061 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:39:18.855 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:39:18 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0[37063]: 2024-08-31T06:39:18.558+0000 7f0842879640 -1 osd.0 0 log_to_monitors true 2024-08-31T06:39:19.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:19 smithi037 ceph-mon[18612]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:19.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:19 smithi037 ceph-mon[18612]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T06:39:19.627 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:19 smithi066 ceph-mon[22244]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:19.627 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:19 smithi066 ceph-mon[22244]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T06:39:19.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:19 smithi106 ceph-mon[22134]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:19.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:19 smithi106 ceph-mon[22134]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-31T06:39:20.319 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:39:20.347 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_4 2024-08-31T06:39:20.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:20 smithi037 ceph-mon[18612]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T06:39:20.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:20 smithi037 ceph-mon[18612]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T06:39:20.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:20 smithi037 ceph-mon[18612]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:39:20.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:20.627 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:20 smithi066 ceph-mon[22244]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T06:39:20.627 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:20 smithi066 ceph-mon[22244]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T06:39:20.627 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:20 smithi066 ceph-mon[22244]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:39:20.627 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:20.645 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:39:20.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:20 smithi106 ceph-mon[22134]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-31T06:39:20.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:20 smithi106 ceph-mon[22134]: osdmap e7: 1 total, 0 up, 1 in 2024-08-31T06:39:20.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:20 smithi106 ceph-mon[22134]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:39:20.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.165+0000 7f13a01ba640 1 -- 172.21.15.66:0/3412012453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108140 msgr2=0x7f1398108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:21.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.165+0000 7f13a01ba640 1 --2- 172.21.15.66:0/3412012453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108140 0x7f1398108550 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1388009900 tx=0x7f138802a410 comp rx=0 tx=0).stop 2024-08-31T06:39:21.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.165+0000 7f13a01ba640 1 -- 172.21.15.66:0/3412012453 shutdown_connections 2024-08-31T06:39:21.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.165+0000 7f13a01ba640 1 --2- 172.21.15.66:0/3412012453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1398108a90 0x7f139810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:21.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.165+0000 7f13a01ba640 1 --2- 172.21.15.66:0/3412012453 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108140 0x7f1398108550 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:21.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.165+0000 7f13a01ba640 1 --2- 172.21.15.66:0/3412012453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398102800 0x7f1398102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:21.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.165+0000 7f13a01ba640 1 -- 172.21.15.66:0/3412012453 >> 172.21.15.66:0/3412012453 conn(0x7f13980794d0 msgr2=0x7f13980798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.166+0000 7f13a01ba640 1 -- 172.21.15.66:0/3412012453 shutdown_connections 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.166+0000 7f13a01ba640 1 -- 172.21.15.66:0/3412012453 wait complete. 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.166+0000 7f13a01ba640 1 Processor -- start 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.166+0000 7f13a01ba640 1 -- start start 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f13a01ba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1398102800 0x7f13981990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f13a01ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398108140 0x7f1398199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f13a01ba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108a90 0x7f139819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f13a01ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f13981125f0 con 0x7f1398108140 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f13a01ba640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1398112470 con 0x7f1398108a90 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f13a01ba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1398112770 con 0x7f1398102800 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139d755640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398108140 0x7f1398199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139e757640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108a90 0x7f139819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:39:21.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139d755640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398108140 0x7f1398199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.66:39494/0 (socket says 172.21.15.66:39494) 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139d755640 1 -- 172.21.15.66:0/1177789209 learned_addr learned my addr 172.21.15.66:0/1177789209 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139df56640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1398102800 0x7f13981990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139e757640 1 -- 172.21.15.66:0/1177789209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1398102800 msgr2=0x7f13981990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139e757640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1398102800 0x7f13981990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139e757640 1 -- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398108140 msgr2=0x7f1398199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139e757640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398108140 0x7f1398199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139e757640 1 -- 172.21.15.66:0/1177789209 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139819f050 con 0x7f1398108a90 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.167+0000 7f139d755640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398108140 0x7f1398199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.168+0000 7f139e757640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108a90 0x7f139819e920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f139000be20 tx=0x7f139000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.168+0000 7f138effd640 1 -- 172.21.15.66:0/1177789209 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1390019070 con 0x7f1398108a90 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.168+0000 7f138effd640 1 -- 172.21.15.66:0/1177789209 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13900148d0 con 0x7f1398108a90 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.168+0000 7f138effd640 1 -- 172.21.15.66:0/1177789209 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13900127e0 con 0x7f1398108a90 2024-08-31T06:39:21.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.168+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139819f340 con 0x7f1398108a90 2024-08-31T06:39:21.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.168+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13981a5aa0 con 0x7f1398108a90 2024-08-31T06:39:21.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.169+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1398102c10 con 0x7f1398108a90 2024-08-31T06:39:21.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.172+0000 7f138effd640 1 -- 172.21.15.66:0/1177789209 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f139001c070 con 0x7f1398108a90 2024-08-31T06:39:21.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.173+0000 7f138effd640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f13840b4b70 0x7f13840b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:39:21.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.173+0000 7f139df56640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f13840b4b70 0x7f13840b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:39:21.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.173+0000 7f138effd640 1 -- 172.21.15.66:0/1177789209 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f13900e3240 con 0x7f1398108a90 2024-08-31T06:39:21.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.173+0000 7f139df56640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f13840b4b70 0x7f13840b7080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1394005d00 tx=0x7f139400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:39:21.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.176+0000 7f138effd640 1 -- 172.21.15.66:0/1177789209 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f13900ab7d0 con 0x7f1398108a90 2024-08-31T06:39:21.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:21.377+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f13980635a0 con 0x7f13840b4b70 2024-08-31T06:39:21.605 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0[37063]: 2024-08-31T06:39:21.325+0000 7f083e7fb640 -1 osd.0 0 waiting for initial osdmap 2024-08-31T06:39:21.605 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0[37063]: 2024-08-31T06:39:21.498+0000 7f08365f1640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:39:21.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:21.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi037 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi037 to 17092M 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' 2024-08-31T06:39:21.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:39:21.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:39:21.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:21.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:21.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:39:21.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T06:39:21.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi037 2024-08-31T06:39:21.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:39:21.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi037 to 17092M 2024-08-31T06:39:21.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:21.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:21.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' 2024-08-31T06:39:21.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:39:21.640 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:39:21.640 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:21.640 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:21.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: osdmap e8: 1 total, 0 up, 1 in 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi037 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi037 to 17092M 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:21.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550]' entity='osd.0' 2024-08-31T06:39:21.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:39:21.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:39:21.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:21.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:22.784 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:22 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:39:22.785 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:22 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:39:22.785 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:22 smithi066 ceph-mon[22244]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:22.785 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:22 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:22.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:22 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:39:22.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:22 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:39:22.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:22 smithi106 ceph-mon[22134]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:22.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:22 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:22.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:22 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:39:22.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:22 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:39:22.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:22 smithi037 ceph-mon[18612]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:22.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:22 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:23.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:23 smithi106 ceph-mon[22134]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:23.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:23 smithi106 ceph-mon[22134]: osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] boot 2024-08-31T06:39:23.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:23 smithi106 ceph-mon[22134]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T06:39:23.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:23 smithi037 ceph-mon[18612]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:23 smithi037 ceph-mon[18612]: osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] boot 2024-08-31T06:39:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:23 smithi037 ceph-mon[18612]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T06:39:23.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:23.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:23 smithi066 ceph-mon[22244]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-31T06:39:23.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:23 smithi066 ceph-mon[22244]: osd.0 [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] boot 2024-08-31T06:39:23.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:23 smithi066 ceph-mon[22244]: osdmap e9: 1 total, 1 up, 1 in 2024-08-31T06:39:23.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-31T06:39:24.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:24 smithi106 ceph-mon[22134]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T06:39:24.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:24 smithi106 ceph-mon[22134]: from='client.? 172.21.15.66:0/3856414707' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"} : dispatch 2024-08-31T06:39:24.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:24 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"} : dispatch 2024-08-31T06:39:24.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:24 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"}]': finished 2024-08-31T06:39:24.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:24 smithi106 ceph-mon[22134]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T06:39:24.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:24.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:24 smithi106 ceph-mon[22134]: from='client.? 172.21.15.66:0/1767756074' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:24.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:24 smithi037 ceph-mon[18612]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T06:39:24.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:24 smithi037 ceph-mon[18612]: from='client.? 172.21.15.66:0/3856414707' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"} : dispatch 2024-08-31T06:39:24.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:24 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"} : dispatch 2024-08-31T06:39:24.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:24 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"}]': finished 2024-08-31T06:39:24.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:24 smithi037 ceph-mon[18612]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T06:39:24.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:24.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:24 smithi037 ceph-mon[18612]: from='client.? 172.21.15.66:0/1767756074' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:24.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:24 smithi066 ceph-mon[22244]: osdmap e10: 1 total, 1 up, 1 in 2024-08-31T06:39:24.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:24 smithi066 ceph-mon[22244]: from='client.? 172.21.15.66:0/3856414707' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"} : dispatch 2024-08-31T06:39:24.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:24 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"} : dispatch 2024-08-31T06:39:24.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:24 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b0189860-11da-4ba3-8356-3fddf0991b0c"}]': finished 2024-08-31T06:39:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:24 smithi066 ceph-mon[22244]: osdmap e11: 2 total, 1 up, 2 in 2024-08-31T06:39:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:24 smithi066 ceph-mon[22244]: from='client.? 172.21.15.66:0/1767756074' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:26.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:25 smithi066 ceph-mon[22244]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:26.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:25 smithi106 ceph-mon[22134]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:25 smithi037 ceph-mon[18612]: pgmap v32: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:28.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:27 smithi066 ceph-mon[22244]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:27 smithi106 ceph-mon[22134]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:28.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:27 smithi037 ceph-mon[18612]: pgmap v33: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:30.118 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:29 smithi106 ceph-mon[22134]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:29 smithi066 ceph-mon[22244]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:30.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:29 smithi037 ceph-mon[18612]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:32.020 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:31 smithi066 ceph-mon[22244]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:32.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:31 smithi106 ceph-mon[22134]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:32.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:31 smithi037 ceph-mon[18612]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:33.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:32 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T06:39:33.074 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:32 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:33.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:32 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T06:39:33.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:32 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:33.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:32 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-31T06:39:33.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:32 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:33.960 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:33 smithi066 ceph-mon[22244]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:33.960 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:33 smithi066 ceph-mon[22244]: Deploying daemon osd.1 on smithi066 2024-08-31T06:39:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:33 smithi106 ceph-mon[22134]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:33 smithi106 ceph-mon[22134]: Deploying daemon osd.1 on smithi066 2024-08-31T06:39:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:33 smithi037 ceph-mon[18612]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:33 smithi037 ceph-mon[18612]: Deploying daemon osd.1 on smithi066 2024-08-31T06:39:35.987 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:35 smithi066 ceph-mon[22244]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:36.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:35 smithi106 ceph-mon[22134]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:36.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:35 smithi037 ceph-mon[18612]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:38.157 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:37 smithi037 ceph-mon[18612]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:38.158 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:38.158 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:38.158 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:38.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:37 smithi066 ceph-mon[22244]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:38.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:38.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:38.171 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:37 smithi106 ceph-mon[22134]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:38.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:40.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:39 smithi106 ceph-mon[22134]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:39 smithi037 ceph-mon[18612]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:39 smithi066 ceph-mon[22244]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:41.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:41 smithi106 ceph-mon[22134]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:41.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:41.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:41.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:41 smithi066 ceph-mon[22244]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:41.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:41.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:41.576 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:41 smithi037 ceph-mon[18612]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:41.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:41.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:41.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.851+0000 7f138effd640 1 -- 172.21.15.66:0/1177789209 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f13980635a0 con 0x7f13840b4b70 2024-08-31T06:39:41.852 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 1 on host 'smithi066' 2024-08-31T06:39:41.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f13840b4b70 msgr2=0x7f13840b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:41.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f13840b4b70 0x7f13840b7080 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1394005d00 tx=0x7f139400b410 comp rx=0 tx=0).stop 2024-08-31T06:39:41.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108a90 msgr2=0x7f139819e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108a90 0x7f139819e920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f139000be20 tx=0x7f139000bf10 comp rx=0 tx=0).stop 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 shutdown_connections 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f13840b4b70 0x7f13840b7080 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1398108140 0x7f1398199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1398108a90 0x7f139819e920 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 --2- 172.21.15.66:0/1177789209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1398102800 0x7f13981990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.853+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 >> 172.21.15.66:0/1177789209 conn(0x7f13980794d0 msgr2=0x7f13981050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.854+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 shutdown_connections 2024-08-31T06:39:41.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:39:41.854+0000 7f13a01ba640 1 -- 172.21.15.66:0/1177789209 wait complete. 2024-08-31T06:39:42.438 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:42 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:42.438 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:42 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:42.438 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:42 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:42.465 DEBUG:teuthology.orchestra.run.smithi066:osd.1> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.1.service 2024-08-31T06:39:42.467 INFO:tasks.cephadm:Deploying osd.2 on smithi106 with /dev/vg_nvme/lv_4... 2024-08-31T06:39:42.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-31T06:39:42.494 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:42 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:42.494 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:42 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:42.494 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:42 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:42.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:42 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:39:42.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:42 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:42.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:42 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:42.718 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:39:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:43 smithi066 ceph-mon[22244]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:43.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:43 smithi066 ceph-mon[22244]: from='osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T06:39:43.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:43 smithi066 ceph-mon[22244]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T06:39:43.888 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:39:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1[28023]: 2024-08-31T06:39:43.624+0000 7f6c829d9640 -1 osd.1 0 log_to_monitors true 2024-08-31T06:39:43.890 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:43 smithi106 ceph-mon[22134]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:43.890 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:43 smithi106 ceph-mon[22134]: from='osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T06:39:43.890 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:43 smithi106 ceph-mon[22134]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T06:39:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:43 smithi037 ceph-mon[18612]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:43 smithi037 ceph-mon[18612]: from='osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T06:39:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:43 smithi037 ceph-mon[18612]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-31T06:39:44.897 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:39:44.923 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_4 2024-08-31T06:39:44.974 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:44 smithi066 ceph-mon[22244]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T06:39:44.975 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:44 smithi066 ceph-mon[22244]: from='osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:39:44.975 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:44 smithi066 ceph-mon[22244]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T06:39:44.975 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:44 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:44.975 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:44 smithi066 ceph-mon[22244]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:39:44.975 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:44 smithi066 ceph-mon[22244]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:39:44.975 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:44 smithi066 ceph-mon[22244]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T06:39:44.975 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:44 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:45.203 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:39:45.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:44 smithi106 ceph-mon[22134]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T06:39:45.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:44 smithi106 ceph-mon[22134]: from='osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:39:45.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:44 smithi106 ceph-mon[22134]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T06:39:45.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:44 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:45.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:44 smithi106 ceph-mon[22134]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:39:45.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:44 smithi106 ceph-mon[22134]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:39:45.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:44 smithi106 ceph-mon[22134]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T06:39:45.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:44 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:44 smithi037 ceph-mon[18612]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-31T06:39:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:44 smithi037 ceph-mon[18612]: from='osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:39:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:44 smithi037 ceph-mon[18612]: osdmap e12: 2 total, 1 up, 2 in 2024-08-31T06:39:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:44 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:44 smithi037 ceph-mon[18612]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:39:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:44 smithi037 ceph-mon[18612]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:39:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:44 smithi037 ceph-mon[18612]: osdmap e13: 2 total, 1 up, 2 in 2024-08-31T06:39:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:44 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:45.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 -- 172.21.15.106:0/2788407387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 msgr2=0x7f4d0c1103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:45.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 --2- 172.21.15.106:0/2788407387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 0x7f4d0c1103e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009ca0 tx=0x7f4d0402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:39:45.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 -- 172.21.15.106:0/2788407387 shutdown_connections 2024-08-31T06:39:45.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 --2- 172.21.15.106:0/2788407387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d0c106020 0x7f4d0c106430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:45.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 --2- 172.21.15.106:0/2788407387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 0x7f4d0c1103e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:45.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 --2- 172.21.15.106:0/2788407387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d0c101d40 0x7f4d0c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:45.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 -- 172.21.15.106:0/2788407387 >> 172.21.15.106:0/2788407387 conn(0x7f4d0c077a40 msgr2=0x7f4d0c077e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:39:45.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 -- 172.21.15.106:0/2788407387 shutdown_connections 2024-08-31T06:39:45.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.658+0000 7f4d1384e640 1 -- 172.21.15.106:0/2788407387 wait complete. 2024-08-31T06:39:45.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d1384e640 1 Processor -- start 2024-08-31T06:39:45.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d1384e640 1 -- start start 2024-08-31T06:39:45.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d1384e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d0c101d40 0x7f4d0c19a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:39:45.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d1384e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d0c106020 0x7f4d0c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:39:45.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d1384e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 0x7f4d0c19f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:39:45.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d1384e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c113770 con 0x7f4d0c101d40 2024-08-31T06:39:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d1384e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c1135f0 con 0x7f4d0c106020 2024-08-31T06:39:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d1384e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c1138f0 con 0x7f4d0c106970 2024-08-31T06:39:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d11deb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 0x7f4d0c19f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:39:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d11deb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 0x7f4d0c19f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33836/0 (socket says 172.21.15.106:33836) 2024-08-31T06:39:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d11deb640 1 -- 172.21.15.106:0/3192602095 learned_addr learned my addr 172.21.15.106:0/3192602095 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-31T06:39:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d10de9640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d0c106020 0x7f4d0c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:39:45.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.659+0000 7f4d115ea640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d0c101d40 0x7f4d0c19a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:39:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d11deb640 1 -- 172.21.15.106:0/3192602095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d0c106020 msgr2=0x7f4d0c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d11deb640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d0c106020 0x7f4d0c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d11deb640 1 -- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d0c101d40 msgr2=0x7f4d0c19a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:39:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d11deb640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d0c101d40 0x7f4d0c19a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:39:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d11deb640 1 -- 172.21.15.106:0/3192602095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c1a0030 con 0x7f4d0c106970 2024-08-31T06:39:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d11deb640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 0x7f4d0c19f900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d04005cc0 tx=0x7f4d04032a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:39:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d027fc640 1 -- 172.21.15.106:0/3192602095 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04032e00 con 0x7f4d0c106970 2024-08-31T06:39:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d027fc640 1 -- 172.21.15.106:0/3192602095 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d040044d0 con 0x7f4d0c106970 2024-08-31T06:39:45.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c1a02c0 con 0x7f4d0c106970 2024-08-31T06:39:45.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d027fc640 1 -- 172.21.15.106:0/3192602095 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04030b70 con 0x7f4d0c106970 2024-08-31T06:39:45.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.660+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c102bc0 con 0x7f4d0c106970 2024-08-31T06:39:45.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.661+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c06b710 con 0x7f4d0c106970 2024-08-31T06:39:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.663+0000 7f4d027fc640 1 -- 172.21.15.106:0/3192602095 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f4d04030d10 con 0x7f4d0c106970 2024-08-31T06:39:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.664+0000 7f4d027fc640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4cf80b4af0 0x7f4cf80b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:39:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.664+0000 7f4d027fc640 1 -- 172.21.15.106:0/3192602095 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7f4d04104d60 con 0x7f4d0c106970 2024-08-31T06:39:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.664+0000 7f4d115ea640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4cf80b4af0 0x7f4cf80b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:39:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.665+0000 7f4d115ea640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4cf80b4af0 0x7f4cf80b7000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d08005fd0 tx=0x7f4d08005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:39:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.667+0000 7f4d027fc640 1 -- 172.21.15.106:0/3192602095 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4d040cd720 con 0x7f4d0c106970 2024-08-31T06:39:45.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:39:45.861+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4d0c0635a0 con 0x7f4cf80b4af0 2024-08-31T06:39:45.906 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:45.906 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:45.906 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:45.907 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:45.907 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:39:45.907 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:45.907 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:45.907 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:45.907 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:45.908 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:45 smithi106 ceph-mon[22134]: from='osd.1 ' entity='osd.1' 2024-08-31T06:39:46.137 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1[28023]: 2024-08-31T06:39:45.778+0000 7f6c7e95b640 -1 osd.1 0 waiting for initial osdmap 2024-08-31T06:39:46.138 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1[28023]: 2024-08-31T06:39:45.875+0000 7f6c76751640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:46.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:46.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:45 smithi066 ceph-mon[22244]: from='osd.1 ' entity='osd.1' 2024-08-31T06:39:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:39:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:46.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:46.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:39:46.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:39:46.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:45 smithi037 ceph-mon[18612]: from='osd.1 ' entity='osd.1' 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi066 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi066 to 17088M 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:47.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:47.195 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi066 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi066 to 17088M 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:47.196 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:47.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:39:47.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:39:47.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi066 2024-08-31T06:39:47.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi066 to 17088M 2024-08-31T06:39:47.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:39:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:39:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:39:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:47.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:47 smithi106 ceph-mon[22134]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:47 smithi106 ceph-mon[22134]: osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] boot 2024-08-31T06:39:48.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:47 smithi106 ceph-mon[22134]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T06:39:48.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:47 smithi066 ceph-mon[22244]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:47 smithi066 ceph-mon[22244]: osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] boot 2024-08-31T06:39:48.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:47 smithi066 ceph-mon[22244]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T06:39:48.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:48.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:47 smithi037 ceph-mon[18612]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-31T06:39:48.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:47 smithi037 ceph-mon[18612]: osd.1 [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] boot 2024-08-31T06:39:48.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:47 smithi037 ceph-mon[18612]: osdmap e14: 2 total, 2 up, 2 in 2024-08-31T06:39:48.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-31T06:39:49.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:48 smithi106 ceph-mon[22134]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T06:39:49.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:48 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/1555571166' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"} : dispatch 2024-08-31T06:39:49.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:48 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"} : dispatch 2024-08-31T06:39:49.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:48 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"}]': finished 2024-08-31T06:39:49.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:48 smithi106 ceph-mon[22134]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T06:39:49.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:48 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:39:49.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:48 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/1045034568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:49.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:48 smithi066 ceph-mon[22244]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T06:39:49.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:48 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/1555571166' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"} : dispatch 2024-08-31T06:39:49.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:48 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"} : dispatch 2024-08-31T06:39:49.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:48 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"}]': finished 2024-08-31T06:39:49.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:48 smithi066 ceph-mon[22244]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T06:39:49.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:48 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:39:49.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:48 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/1045034568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:48 smithi037 ceph-mon[18612]: osdmap e15: 2 total, 2 up, 2 in 2024-08-31T06:39:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:48 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/1555571166' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"} : dispatch 2024-08-31T06:39:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:48 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"} : dispatch 2024-08-31T06:39:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:48 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "62bc8710-4647-4a53-8009-cc6ceb86e34a"}]': finished 2024-08-31T06:39:49.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:48 smithi037 ceph-mon[18612]: osdmap e16: 3 total, 2 up, 3 in 2024-08-31T06:39:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:48 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:39:49.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:48 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/1045034568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:39:50.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:49 smithi066 ceph-mon[22244]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:50.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:49 smithi106 ceph-mon[22134]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:49 smithi037 ceph-mon[18612]: pgmap v49: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:52.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:51 smithi106 ceph-mon[22134]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:52.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:51 smithi037 ceph-mon[18612]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:52.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:51 smithi066 ceph-mon[22244]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:54.187 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:53 smithi106 ceph-mon[22134]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:54.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:53 smithi037 ceph-mon[18612]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:54.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:53 smithi066 ceph-mon[22244]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:56.172 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:55 smithi106 ceph-mon[22134]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:55 smithi037 ceph-mon[18612]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:56.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:55 smithi066 ceph-mon[22244]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:57.244 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T06:39:57.244 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:57.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T06:39:57.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:57.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-31T06:39:57.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:39:58.192 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:57 smithi106 ceph-mon[22134]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:58.192 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:57 smithi106 ceph-mon[22134]: Deploying daemon osd.2 on smithi106 2024-08-31T06:39:58.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:57 smithi037 ceph-mon[18612]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:58.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:57 smithi037 ceph-mon[18612]: Deploying daemon osd.2 on smithi106 2024-08-31T06:39:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:57 smithi066 ceph-mon[22244]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:39:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:57 smithi066 ceph-mon[22244]: Deploying daemon osd.2 on smithi106 2024-08-31T06:40:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:39:59 smithi106 ceph-mon[22134]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:00.190 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:39:59 smithi066 ceph-mon[22244]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:00.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:39:59 smithi037 ceph-mon[18612]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:01.179 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:00 smithi106 ceph-mon[22134]: overall HEALTH_OK 2024-08-31T06:40:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:00 smithi037 ceph-mon[18612]: overall HEALTH_OK 2024-08-31T06:40:01.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:00 smithi066 ceph-mon[22244]: overall HEALTH_OK 2024-08-31T06:40:02.184 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:01 smithi106 ceph-mon[22134]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:02.185 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:02.185 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:02.185 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:01 smithi037 ceph-mon[18612]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:02.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:01 smithi066 ceph-mon[22244]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:02.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:02.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:02.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:04.170 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:03 smithi106 ceph-mon[22134]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:04.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:03 smithi037 ceph-mon[18612]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:04.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:03 smithi066 ceph-mon[22244]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:05.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:05 smithi106 ceph-mon[22134]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:05.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:05.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:05.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:05 smithi037 ceph-mon[18612]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:05.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:05.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:05.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:05 smithi066 ceph-mon[22244]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:05.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:05.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:05.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.915+0000 7f4d027fc640 1 -- 172.21.15.106:0/3192602095 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4d0c0635a0 con 0x7f4cf80b4af0 2024-08-31T06:40:05.918 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 2 on host 'smithi106' 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4cf80b4af0 msgr2=0x7f4cf80b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4cf80b4af0 0x7f4cf80b7000 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d08005fd0 tx=0x7f4d08005850 comp rx=0 tx=0).stop 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 msgr2=0x7f4d0c19f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 0x7f4d0c19f900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d04005cc0 tx=0x7f4d04032a10 comp rx=0 tx=0).stop 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 shutdown_connections 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4cf80b4af0 0x7f4cf80b7000 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d0c106970 0x7f4d0c19f900 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d0c106020 0x7f4d0c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 --2- 172.21.15.106:0/3192602095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d0c101d40 0x7f4d0c19a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.918+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 >> 172.21.15.106:0/3192602095 conn(0x7f4d0c077a40 msgr2=0x7f4d0c107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:40:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.919+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 shutdown_connections 2024-08-31T06:40:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:40:05.919+0000 7f4d1384e640 1 -- 172.21.15.106:0/3192602095 wait complete. 2024-08-31T06:40:06.496 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:06 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:06.496 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:06 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:06.496 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:06 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:06.523 DEBUG:teuthology.orchestra.run.smithi106:osd.2> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.2.service 2024-08-31T06:40:06.526 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_3... 2024-08-31T06:40:06.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T06:40:06.554 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:06 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:06.554 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:06 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:06.554 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:06 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:06.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:06 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:06.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:06 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:06.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:06 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:06.790 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:40:07.904 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:07 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2[28410]: 2024-08-31T06:40:07.564+0000 7f75abe9f640 -1 osd.2 0 log_to_monitors true 2024-08-31T06:40:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:07 smithi106 ceph-mon[22134]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:07 smithi106 ceph-mon[22134]: from='osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T06:40:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:07 smithi106 ceph-mon[22134]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T06:40:08.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:07 smithi037 ceph-mon[18612]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:08.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:07 smithi037 ceph-mon[18612]: from='osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T06:40:08.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:07 smithi037 ceph-mon[18612]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T06:40:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:07 smithi066 ceph-mon[22244]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:08.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:07 smithi066 ceph-mon[22244]: from='osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T06:40:08.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:07 smithi066 ceph-mon[22244]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-31T06:40:09.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:08 smithi037 ceph-mon[18612]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T06:40:09.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:08 smithi037 ceph-mon[18612]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T06:40:09.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:09.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:08 smithi037 ceph-mon[18612]: from='osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:40:09.219 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:08 smithi037 ceph-mon[18612]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:40:09.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:08 smithi106 ceph-mon[22134]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T06:40:09.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:08 smithi106 ceph-mon[22134]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T06:40:09.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:09.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:08 smithi106 ceph-mon[22134]: from='osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:40:09.234 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:08 smithi106 ceph-mon[22134]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:40:09.235 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:08 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2[28410]: 2024-08-31T06:40:08.950+0000 7f75a7e21640 -1 osd.2 0 waiting for initial osdmap 2024-08-31T06:40:09.235 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:08 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2[28410]: 2024-08-31T06:40:08.955+0000 7f75a3c1f640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:40:09.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:08 smithi066 ceph-mon[22244]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-31T06:40:09.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:08 smithi066 ceph-mon[22244]: osdmap e17: 3 total, 2 up, 3 in 2024-08-31T06:40:09.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:09.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:08 smithi066 ceph-mon[22244]: from='osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:40:09.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:08 smithi066 ceph-mon[22244]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:40:09.514 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:40:09.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-08-31T06:40:09.832 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:40:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:40:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T06:40:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:10.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:10.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:10.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:10.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:10.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: osdmap e18: 3 total, 2 up, 3 in 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:10.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:10.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 -- 172.21.15.37:0/3365372252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734108140 msgr2=0x7f0734108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 --2- 172.21.15.37:0/3365372252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734108140 0x7f0734108550 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0730009900 tx=0x7f073002a410 comp rx=0 tx=0).stop 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 -- 172.21.15.37:0/3365372252 shutdown_connections 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 --2- 172.21.15.37:0/3365372252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734108140 0x7f0734108550 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 --2- 172.21.15.37:0/3365372252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0734108a90 0x7f073410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 --2- 172.21.15.37:0/3365372252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734102800 0x7f0734102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 -- 172.21.15.37:0/3365372252 >> 172.21.15.37:0/3365372252 conn(0x7f07340794d0 msgr2=0x7f07340798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 -- 172.21.15.37:0/3365372252 shutdown_connections 2024-08-31T06:40:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.458+0000 7f073c269640 1 -- 172.21.15.37:0/3365372252 wait complete. 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073c269640 1 Processor -- start 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073c269640 1 -- start start 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073c269640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734102800 0x7f0734104e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073c269640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734108140 0x7f07341053c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073c269640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0734108a90 0x7f0734105900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073c269640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f07341125e0 con 0x7f0734102800 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073c269640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0734112460 con 0x7f0734108a90 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073c269640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0734112760 con 0x7f0734108140 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.459+0000 7f073a005640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734102800 0x7f0734104e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a005640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734102800 0x7f0734104e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54280/0 (socket says 172.21.15.37:54280) 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a005640 1 -- 172.21.15.37:0/1224284769 learned_addr learned my addr 172.21.15.37:0/1224284769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f0739804640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734108140 0x7f07341053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:40:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a806640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0734108a90 0x7f0734105900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a005640 1 -- 172.21.15.37:0/1224284769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734108140 msgr2=0x7f07341053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a005640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734108140 0x7f07341053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a005640 1 -- 172.21.15.37:0/1224284769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0734108a90 msgr2=0x7f0734105900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a005640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0734108a90 0x7f0734105900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a005640 1 -- 172.21.15.37:0/1224284769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07341a83d0 con 0x7f0734102800 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073a005640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734102800 0x7f0734104e80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f072800e9f0 tx=0x7f072800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f07277fe640 1 -- 172.21.15.37:0/1224284769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072800cd80 con 0x7f0734102800 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07341a86c0 con 0x7f0734102800 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f07277fe640 1 -- 172.21.15.37:0/1224284769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07280054b0 con 0x7f0734102800 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.460+0000 7f07277fe640 1 -- 172.21.15.37:0/1224284769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0728010430 con 0x7f0734102800 2024-08-31T06:40:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.461+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07341a8bd0 con 0x7f0734102800 2024-08-31T06:40:10.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.462+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0734102c10 con 0x7f0734102800 2024-08-31T06:40:10.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.463+0000 7f07277fe640 1 -- 172.21.15.37:0/1224284769 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) ==== 152538+0+0 (secure 0 0 0) 0x7f07280046c0 con 0x7f0734102800 2024-08-31T06:40:10.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.464+0000 7f07277fe640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f07200b4af0 0x7f07200b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:40:10.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.464+0000 7f0739804640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f07200b4af0 0x7f07200b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:40:10.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.464+0000 7f07277fe640 1 -- 172.21.15.37:0/1224284769 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3066+0+0 (secure 0 0 0) 0x7f07280e3f70 con 0x7f0734102800 2024-08-31T06:40:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.464+0000 7f0739804640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f07200b4af0 0x7f07200b7000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f07300057c0 tx=0x7f0730000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:40:10.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.469+0000 7f07277fe640 1 -- 172.21.15.37:0/1224284769 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f07280ac600 con 0x7f0734102800 2024-08-31T06:40:10.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:10.678+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f07340ff670 con 0x7f07200b4af0 2024-08-31T06:40:11.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:40:11.223 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi106 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi106 to 17088M 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] boot 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:40:11.224 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:10 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:11.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:40:11.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi106 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi106 to 17088M 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] boot 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:40:11.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:10 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:11.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi106 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi106 to 17088M 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: osd.2 [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] boot 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: osdmap e19: 3 total, 3 up, 3 in 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:40:11.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:10 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:12.171 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:11 smithi037 ceph-mon[18612]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:12.171 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:11 smithi037 ceph-mon[18612]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:12.171 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:11 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T06:40:12.171 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:11 smithi037 ceph-mon[18612]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T06:40:12.171 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:11 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:40:12.171 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41543]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T06:40:12.171 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41543]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.172 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.172 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41543]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.172 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41546]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T06:40:12.172 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41546]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.172 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.172 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41546]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.292 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32472]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T06:40:12.292 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32472]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.292 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.292 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32472]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.293 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32475]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T06:40:12.293 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32475]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.293 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.293 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32475]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.293 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:11 smithi106 ceph-mon[22134]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:12.293 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:11 smithi106 ceph-mon[22134]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:12.293 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:11 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T06:40:12.293 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:11 smithi106 ceph-mon[22134]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T06:40:12.293 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:11 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:40:12.332 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:11 smithi066 ceph-mon[22244]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:12.332 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:11 smithi066 ceph-mon[22244]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:12.332 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:11 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-31T06:40:12.332 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:11 smithi066 ceph-mon[22244]: osdmap e20: 3 total, 3 up, 3 in 2024-08-31T06:40:12.332 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:11 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:40:12.333 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31815]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T06:40:12.333 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31815]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.333 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.333 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31815]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.333 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31818]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T06:40:12.333 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31818]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.333 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.333 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31818]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.493 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41570]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T06:40:12.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41570]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41570]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41573]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T06:40:12.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41573]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 sudo[41573]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32478]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T06:40:12.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32478]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32478]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32481]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T06:40:12.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32481]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 sudo[32481]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31821]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-31T06:40:12.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31821]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31821]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31824]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-31T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31824]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-31T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-31T06:40:12.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 sudo[31824]: pam_unix(sudo:session): session closed for user root 2024-08-31T06:40:13.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:13.178+0000 7f07277fe640 1 -- 172.21.15.37:0/1224284769 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f07280a8190 con 0x7f0734102800 2024-08-31T06:40:13.179 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.180 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:13.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.181 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:12 smithi037 ceph-mon[18612]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:13.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:13.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:12 smithi106 ceph-mon[22134]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:13.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:40:13.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: osdmap e21: 3 total, 3 up, 3 in 2024-08-31T06:40:13.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:13.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-31T06:40:13.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:12 smithi066 ceph-mon[22244]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-31T06:40:14.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:13 smithi037 ceph-mon[18612]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:14.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:13 smithi037 ceph-mon[18612]: osdmap e22: 3 total, 3 up, 3 in 2024-08-31T06:40:14.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:13 smithi037 ceph-mon[18612]: mgrmap e20: x(active, since 115s), standbys: z, y 2024-08-31T06:40:14.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:13 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1016513151' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ed7aadd-17fe-413c-a360-6d43f4697865"} : dispatch 2024-08-31T06:40:14.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:13 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1016513151' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ed7aadd-17fe-413c-a360-6d43f4697865"}]': finished 2024-08-31T06:40:14.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:13 smithi037 ceph-mon[18612]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T06:40:14.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:14.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:13 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/295000418' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:40:14.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:13 smithi106 ceph-mon[22134]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:14.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:13 smithi106 ceph-mon[22134]: osdmap e22: 3 total, 3 up, 3 in 2024-08-31T06:40:14.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:13 smithi106 ceph-mon[22134]: mgrmap e20: x(active, since 115s), standbys: z, y 2024-08-31T06:40:14.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:13 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1016513151' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ed7aadd-17fe-413c-a360-6d43f4697865"} : dispatch 2024-08-31T06:40:14.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:13 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1016513151' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ed7aadd-17fe-413c-a360-6d43f4697865"}]': finished 2024-08-31T06:40:14.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:13 smithi106 ceph-mon[22134]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T06:40:14.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:14.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:13 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/295000418' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:40:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:13 smithi066 ceph-mon[22244]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:14.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:13 smithi066 ceph-mon[22244]: osdmap e22: 3 total, 3 up, 3 in 2024-08-31T06:40:14.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:13 smithi066 ceph-mon[22244]: mgrmap e20: x(active, since 115s), standbys: z, y 2024-08-31T06:40:14.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:13 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1016513151' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1ed7aadd-17fe-413c-a360-6d43f4697865"} : dispatch 2024-08-31T06:40:14.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:13 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1016513151' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ed7aadd-17fe-413c-a360-6d43f4697865"}]': finished 2024-08-31T06:40:14.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:13 smithi066 ceph-mon[22244]: osdmap e23: 4 total, 3 up, 4 in 2024-08-31T06:40:14.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:14.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:13 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/295000418' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:40:16.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:15 smithi106 ceph-mon[22134]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:15 smithi037 ceph-mon[18612]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:15 smithi066 ceph-mon[22244]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 89 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:18.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:17 smithi106 ceph-mon[22134]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:18.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:17 smithi037 ceph-mon[18612]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:18.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:17 smithi066 ceph-mon[22244]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:20.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:19 smithi037 ceph-mon[18612]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:20.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:19 smithi106 ceph-mon[22134]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:20.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:19 smithi066 ceph-mon[22244]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:22.102 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:21 smithi037 ceph-mon[18612]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:22.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:21 smithi106 ceph-mon[22134]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:22.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:21 smithi066 ceph-mon[22244]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:23.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T06:40:23.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:23 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:23.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T06:40:23.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:23 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:23.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-31T06:40:23.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:23 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:24.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:24 smithi037 ceph-mon[18612]: Deploying daemon osd.3 on smithi037 2024-08-31T06:40:24.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:24 smithi037 ceph-mon[18612]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:24 smithi106 ceph-mon[22134]: Deploying daemon osd.3 on smithi037 2024-08-31T06:40:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:24 smithi106 ceph-mon[22134]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:24 smithi066 ceph-mon[22244]: Deploying daemon osd.3 on smithi037 2024-08-31T06:40:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:24 smithi066 ceph-mon[22244]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:26.310 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:26 smithi037 ceph-mon[18612]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:26.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:26 smithi106 ceph-mon[22134]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:26 smithi066 ceph-mon[22244]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:28.287 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:28 smithi037 ceph-mon[18612]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:28.287 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:28 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:28.287 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:28 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:28.287 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:28 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:28 smithi106 ceph-mon[22134]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:28 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:28 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:28 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:28 smithi066 ceph-mon[22244]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:28 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:28 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:28.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:28 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:30.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:30 smithi106 ceph-mon[22134]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:30.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:30 smithi037 ceph-mon[18612]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:30.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:30 smithi066 ceph-mon[22244]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:31.464 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:31 smithi066 ceph-mon[22244]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:31.464 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:31.464 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:31.464 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:31.464 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:31.464 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:31.509 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:31 smithi037 ceph-mon[18612]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:31.509 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:31.509 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:31.509 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:31.509 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:31.509 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:31.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.549+0000 7f07277fe640 1 -- 172.21.15.37:0/1224284769 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f07340ff670 con 0x7f07200b4af0 2024-08-31T06:40:31.551 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2024-08-31T06:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.551+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f07200b4af0 msgr2=0x7f07200b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.551+0000 7f073c269640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f07200b4af0 0x7f07200b7000 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f07300057c0 tx=0x7f0730000bc0 comp rx=0 tx=0).stop 2024-08-31T06:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.551+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734102800 msgr2=0x7f0734104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.551+0000 7f073c269640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734102800 0x7f0734104e80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f072800e9f0 tx=0x7f072800edf0 comp rx=0 tx=0).stop 2024-08-31T06:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.552+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 shutdown_connections 2024-08-31T06:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.552+0000 7f073c269640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f07200b4af0 0x7f07200b7000 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.552+0000 7f073c269640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0734108a90 0x7f0734105900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:31.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.552+0000 7f073c269640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734108140 0x7f07341053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.552+0000 7f073c269640 1 --2- 172.21.15.37:0/1224284769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0734102800 0x7f0734104e80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.552+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 >> 172.21.15.37:0/1224284769 conn(0x7f07340794d0 msgr2=0x7f0734100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.552+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 shutdown_connections 2024-08-31T06:40:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:40:31.552+0000 7f073c269640 1 -- 172.21.15.37:0/1224284769 wait complete. 2024-08-31T06:40:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:31 smithi106 ceph-mon[22134]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:31.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:32.147 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.3.service 2024-08-31T06:40:32.149 INFO:tasks.cephadm:Deploying osd.4 on smithi066 with /dev/vg_nvme/lv_3... 2024-08-31T06:40:32.149 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T06:40:32.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:32 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:32.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:32 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:32.387 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:32 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:32.419 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:40:32.540 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:32 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:32.540 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:32 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:32.540 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:32 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:32.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:32 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:32.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:32 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:32.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:32 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:33.697 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:33 smithi037 ceph-mon[18612]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:33.697 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:40:33 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3[43633]: 2024-08-31T06:40:33.622+0000 7ff74b409640 -1 osd.3 0 log_to_monitors true 2024-08-31T06:40:33.809 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:33 smithi066 ceph-mon[22244]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:33.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:33 smithi106 ceph-mon[22134]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:34.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:34 smithi066 ceph-mon[22244]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T06:40:34.750 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:34 smithi037 ceph-mon[18612]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T06:40:34.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:34 smithi106 ceph-mon[22134]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-31T06:40:35.081 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:40:35.109 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_3 2024-08-31T06:40:35.362 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:40:35.811 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:35.811 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:35.812 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:35.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 -- 172.21.15.66:0/25735321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 msgr2=0x7fcd5c10d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:35.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 --2- 172.21.15.66:0/25735321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 0x7fcd5c10d670 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009900 tx=0x7fcd5002a410 comp rx=0 tx=0).stop 2024-08-31T06:40:35.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 -- 172.21.15.66:0/25735321 shutdown_connections 2024-08-31T06:40:35.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 --2- 172.21.15.66:0/25735321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd5c10dc00 0x7fcd5c1100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:35.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 --2- 172.21.15.66:0/25735321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 0x7fcd5c10d670 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:35.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 --2- 172.21.15.66:0/25735321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5c1047d0 0x7fcd5c104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:35.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 -- 172.21.15.66:0/25735321 >> 172.21.15.66:0/25735321 conn(0x7fcd5c079500 msgr2=0x7fcd5c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:40:35.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 -- 172.21.15.66:0/25735321 shutdown_connections 2024-08-31T06:40:35.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.809+0000 7fcd6084c640 1 -- 172.21.15.66:0/25735321 wait complete. 2024-08-31T06:40:35.840 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd6084c640 1 Processor -- start 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd6084c640 1 -- start start 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd6084c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd5c1047d0 0x7fcd5c103f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd6084c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 0x7fcd5c102510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd6084c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5c10dc00 0x7fcd5c102a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd6084c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c1136f0 con 0x7fcd5c10dc00 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd6084c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c113570 con 0x7fcd5c105120 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd6084c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c113870 con 0x7fcd5c1047d0 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd59d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 0x7fcd5c102510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.810+0000 7fcd59d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 0x7fcd5c102510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53464/0 (socket says 172.21.15.66:53464) 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd59d9b640 1 -- 172.21.15.66:0/4208948518 learned_addr learned my addr 172.21.15.66:0/4208948518 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-08-31T06:40:35.841 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd5ad9d640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5c10dc00 0x7fcd5c102a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd5a59c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd5c1047d0 0x7fcd5c103f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd59d9b640 1 -- 172.21.15.66:0/4208948518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd5c1047d0 msgr2=0x7fcd5c103f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd59d9b640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd5c1047d0 0x7fcd5c103f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd59d9b640 1 -- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5c10dc00 msgr2=0x7fcd5c102a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd59d9b640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5c10dc00 0x7fcd5c102a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd59d9b640 1 -- 172.21.15.66:0/4208948518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5c103270 con 0x7fcd5c105120 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd59d9b640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 0x7fcd5c102510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd50004770 tx=0x7fcd50004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd4b7fe640 1 -- 172.21.15.66:0/4208948518 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5003f030 con 0x7fcd5c105120 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd4b7fe640 1 -- 172.21.15.66:0/4208948518 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd50004440 con 0x7fcd5c105120 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5c1acb60 con 0x7fcd5c105120 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd4b7fe640 1 -- 172.21.15.66:0/4208948518 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd50035070 con 0x7fcd5c105120 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.811+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5c1ad040 con 0x7fcd5c105120 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.813+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd5c06bf90 con 0x7fcd5c105120 2024-08-31T06:40:35.842 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.814+0000 7fcd4b7fe640 1 -- 172.21.15.66:0/4208948518 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fcd50042030 con 0x7fcd5c105120 2024-08-31T06:40:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.815+0000 7fcd4b7fe640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd440b4b80 0x7fcd440b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:40:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.816+0000 7fcd5a59c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd440b4b80 0x7fcd440b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:40:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.816+0000 7fcd4b7fe640 1 -- 172.21.15.66:0/4208948518 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3604+0+0 (secure 0 0 0) 0x7fcd50104770 con 0x7fcd5c105120 2024-08-31T06:40:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.816+0000 7fcd5a59c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd440b4b80 0x7fcd440b7090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c19e0d0 tx=0x7fcd4c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:40:35.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:35.819+0000 7fcd4b7fe640 1 -- 172.21.15.66:0/4208948518 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcd500ccb00 con 0x7fcd5c105120 2024-08-31T06:40:35.855 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3[43633]: 2024-08-31T06:40:35.567+0000 7ff74738b640 -1 osd.3 0 waiting for initial osdmap 2024-08-31T06:40:35.855 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3[43633]: 2024-08-31T06:40:35.575+0000 7ff743189640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:40:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T06:40:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T06:40:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:40:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:35.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:35.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:35.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:35.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:35.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:35.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:36.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:36.020+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fcd5c0635a0 con 0x7fcd440b4b80 2024-08-31T06:40:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: osdmap e24: 4 total, 3 up, 4 in 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:40:36.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:36.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:36.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:36.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:36.717 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi037 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi037 to 8546M 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: osdmap e25: 4 total, 3 up, 4 in 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] boot 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T06:40:36.718 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:36 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi037 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi037 to 8546M 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: osdmap e25: 4 total, 3 up, 4 in 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:40:36.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:36.858 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] boot 2024-08-31T06:40:36.858 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T06:40:36.858 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:36 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:37.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi037 2024-08-31T06:40:37.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi037 to 8546M 2024-08-31T06:40:37.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: from='osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:40:37.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: osdmap e25: 4 total, 3 up, 4 in 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: osd.3 [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] boot 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: osdmap e26: 4 total, 4 up, 4 in 2024-08-31T06:40:37.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:36 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-31T06:40:37.799 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:37 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:40:37.799 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:37 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:40:37.799 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:37 smithi066 ceph-mon[22244]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:37.800 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:37 smithi066 ceph-mon[22244]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T06:40:37.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:37 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:40:37.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:37 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:40:37.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:37 smithi037 ceph-mon[18612]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:37.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:37 smithi037 ceph-mon[18612]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T06:40:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:37 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:40:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:37 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:40:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:37 smithi106 ceph-mon[22134]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-31T06:40:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:37 smithi106 ceph-mon[22134]: osdmap e27: 4 total, 4 up, 4 in 2024-08-31T06:40:38.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:38 smithi037 ceph-mon[18612]: from='client.? 172.21.15.66:0/181315790' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"} : dispatch 2024-08-31T06:40:38.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:38 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"} : dispatch 2024-08-31T06:40:38.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:38 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"}]': finished 2024-08-31T06:40:38.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:38 smithi037 ceph-mon[18612]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T06:40:38.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:38 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:40:38.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:38 smithi066 ceph-mon[22244]: from='client.? 172.21.15.66:0/181315790' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"} : dispatch 2024-08-31T06:40:38.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:38 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"} : dispatch 2024-08-31T06:40:38.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:38 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"}]': finished 2024-08-31T06:40:38.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:38 smithi066 ceph-mon[22244]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T06:40:38.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:38 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:40:39.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:38 smithi106 ceph-mon[22134]: from='client.? 172.21.15.66:0/181315790' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"} : dispatch 2024-08-31T06:40:39.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:38 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"} : dispatch 2024-08-31T06:40:39.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:38 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "31f6e880-6ba2-491b-ace7-c98e9eab42b8"}]': finished 2024-08-31T06:40:39.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:38 smithi106 ceph-mon[22134]: osdmap e28: 5 total, 4 up, 5 in 2024-08-31T06:40:39.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:38 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:40:39.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:39 smithi066 ceph-mon[22244]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:39.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:39 smithi066 ceph-mon[22244]: from='client.? 172.21.15.66:0/496586777' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:40:40.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:39 smithi037 ceph-mon[18612]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:40.028 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:39 smithi037 ceph-mon[18612]: from='client.? 172.21.15.66:0/496586777' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:40:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:39 smithi106 ceph-mon[22134]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:39 smithi106 ceph-mon[22134]: from='client.? 172.21.15.66:0/496586777' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:40:41.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:41 smithi106 ceph-mon[22134]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:41.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:41 smithi066 ceph-mon[22244]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:42.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:41 smithi037 ceph-mon[18612]: pgmap v87: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:43 smithi066 ceph-mon[22244]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:43 smithi106 ceph-mon[22134]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:44.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:43 smithi037 ceph-mon[18612]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 117 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:45.801 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:45 smithi066 ceph-mon[22244]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T06:40:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:45 smithi106 ceph-mon[22134]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T06:40:46.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:45 smithi037 ceph-mon[18612]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-31T06:40:47.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:47 smithi066 ceph-mon[22244]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-08-31T06:40:47.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T06:40:47.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:47 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:47.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:47 smithi066 ceph-mon[22244]: Deploying daemon osd.4 on smithi066 2024-08-31T06:40:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:47 smithi106 ceph-mon[22134]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-08-31T06:40:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T06:40:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:47 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:47 smithi106 ceph-mon[22134]: Deploying daemon osd.4 on smithi066 2024-08-31T06:40:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:47 smithi037 ceph-mon[18612]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-08-31T06:40:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-31T06:40:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:47 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:48.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:47 smithi037 ceph-mon[18612]: Deploying daemon osd.4 on smithi066 2024-08-31T06:40:49.790 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:49 smithi066 ceph-mon[22244]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:40:49.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:49 smithi037 ceph-mon[18612]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:40:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:49 smithi106 ceph-mon[22134]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:40:51.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:51 smithi066 ceph-mon[22244]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T06:40:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:51 smithi106 ceph-mon[22134]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T06:40:52.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:51 smithi037 ceph-mon[18612]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-08-31T06:40:52.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:52.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:52.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:53.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:53.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:53.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:53.779 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:53 smithi066 ceph-mon[22244]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:40:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:53 smithi106 ceph-mon[22134]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:40:54.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:53 smithi037 ceph-mon[18612]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:40:56.063 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:55 smithi066 ceph-mon[22244]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:40:56.063 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.064 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.064 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:56.064 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:56.064 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:55 smithi106 ceph-mon[22134]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:40:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:56.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:56.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:55 smithi037 ceph-mon[18612]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:40:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:40:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:40:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:56.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.364+0000 7fcd4b7fe640 1 -- 172.21.15.66:0/4208948518 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcd5c0635a0 con 0x7fcd440b4b80 2024-08-31T06:40:56.366 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 4 on host 'smithi066' 2024-08-31T06:40:56.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd440b4b80 msgr2=0x7fcd440b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:56.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd440b4b80 0x7fcd440b7090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c19e0d0 tx=0x7fcd4c005f90 comp rx=0 tx=0).stop 2024-08-31T06:40:56.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 msgr2=0x7fcd5c102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:40:56.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 0x7fcd5c102510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcd50004770 tx=0x7fcd50004040 comp rx=0 tx=0).stop 2024-08-31T06:40:56.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 shutdown_connections 2024-08-31T06:40:56.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd440b4b80 0x7fcd440b7090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:56.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd5c10dc00 0x7fcd5c102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:56.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd5c105120 0x7fcd5c102510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:56.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 --2- 172.21.15.66:0/4208948518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd5c1047d0 0x7fcd5c103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:40:56.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 >> 172.21.15.66:0/4208948518 conn(0x7fcd5c079500 msgr2=0x7fcd5c1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:40:56.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 shutdown_connections 2024-08-31T06:40:56.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:40:56.367+0000 7fcd6084c640 1 -- 172.21.15.66:0/4208948518 wait complete. 2024-08-31T06:40:56.973 DEBUG:teuthology.orchestra.run.smithi066:osd.4> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.4.service 2024-08-31T06:40:56.975 INFO:tasks.cephadm:Deploying osd.5 on smithi106 with /dev/vg_nvme/lv_3... 2024-08-31T06:40:56.975 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-31T06:40:57.214 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:57.214 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:57.214 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:57.228 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:40:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:57.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:40:57.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:57.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:40:58.230 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:57 smithi106 ceph-mon[22134]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:58.245 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:57 smithi066 ceph-mon[22244]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:58.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:57 smithi037 ceph-mon[18612]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:40:58.888 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:40:58 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4[34470]: 2024-08-31T06:40:58.535+0000 7f245b317640 -1 osd.4 0 log_to_monitors true 2024-08-31T06:40:59.267 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:58 smithi106 ceph-mon[22134]: from='osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T06:40:59.267 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:58 smithi106 ceph-mon[22134]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T06:40:59.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:58 smithi037 ceph-mon[18612]: from='osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T06:40:59.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:58 smithi037 ceph-mon[18612]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T06:40:59.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:58 smithi066 ceph-mon[22244]: from='osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T06:40:59.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:58 smithi066 ceph-mon[22244]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-31T06:40:59.599 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:40:59.625 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_3 2024-08-31T06:40:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:41:00.138 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4[34470]: 2024-08-31T06:40:59.982+0000 7f2457299640 -1 osd.4 0 waiting for initial osdmap 2024-08-31T06:41:00.138 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4[34470]: 2024-08-31T06:40:59.988+0000 7f2453097640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:41:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:41:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T06:41:00.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:41:00.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T06:41:00.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:00.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:41:00.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:00.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:00.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:00.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:00.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:40:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:00.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:00.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:00.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:00.229 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:40:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 -- 172.21.15.106:0/1183208080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 msgr2=0x7ff4c0108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:00.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 --2- 172.21.15.106:0/1183208080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 0x7ff4c0108570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009900 tx=0x7ff4b402a410 comp rx=0 tx=0).stop 2024-08-31T06:41:00.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 -- 172.21.15.106:0/1183208080 shutdown_connections 2024-08-31T06:41:00.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 --2- 172.21.15.106:0/1183208080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c0108ab0 0x7ff4c010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:00.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 --2- 172.21.15.106:0/1183208080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 0x7ff4c0108570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:00.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 --2- 172.21.15.106:0/1183208080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c0102820 0x7ff4c0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:00.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 -- 172.21.15.106:0/1183208080 >> 172.21.15.106:0/1183208080 conn(0x7ff4c00794e0 msgr2=0x7ff4c00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:41:00.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 -- 172.21.15.106:0/1183208080 shutdown_connections 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.318+0000 7ff4c7969640 1 -- 172.21.15.106:0/1183208080 wait complete. 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c7969640 1 Processor -- start 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c7969640 1 -- start start 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c7969640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c0102820 0x7ff4c01990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c7969640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 0x7ff4c0199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c7969640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c0108ab0 0x7ff4c019e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c7969640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01125b0 con 0x7ff4c0108ab0 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c7969640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0112430 con 0x7ff4c0102820 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c7969640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0112730 con 0x7ff4c0108160 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c4f04640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 0x7ff4c0199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c4f04640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 0x7ff4c0199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57118/0 (socket says 172.21.15.106:57118) 2024-08-31T06:41:00.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c4f04640 1 -- 172.21.15.106:0/4248870966 learned_addr learned my addr 172.21.15.106:0/4248870966 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c5705640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c0102820 0x7ff4c01990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c5f06640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c0108ab0 0x7ff4c019e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c4f04640 1 -- 172.21.15.106:0/4248870966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c0102820 msgr2=0x7ff4c01990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c4f04640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c0102820 0x7ff4c01990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c4f04640 1 -- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c0108ab0 msgr2=0x7ff4c019e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c4f04640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c0108ab0 0x7ff4c019e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.319+0000 7ff4c4f04640 1 -- 172.21.15.106:0/4248870966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c019f030 con 0x7ff4c0108160 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.320+0000 7ff4c4f04640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 0x7ff4c0199660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4005940 tx=0x7ff4b40319a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.320+0000 7ff4be7fc640 1 -- 172.21.15.106:0/4248870966 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4046070 con 0x7ff4c0108160 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.320+0000 7ff4be7fc640 1 -- 172.21.15.106:0/4248870966 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4b4004350 con 0x7ff4c0108160 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.320+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c019f2c0 con 0x7ff4c0108160 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.320+0000 7ff4be7fc640 1 -- 172.21.15.106:0/4248870966 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4035050 con 0x7ff4c0108160 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.320+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c006b5c0 con 0x7ff4c0108160 2024-08-31T06:41:00.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.321+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c0103aa0 con 0x7ff4c0108160 2024-08-31T06:41:00.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.323+0000 7ff4be7fc640 1 -- 172.21.15.106:0/4248870966 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7ff4b4049070 con 0x7ff4c0108160 2024-08-31T06:41:00.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.324+0000 7ff4be7fc640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4a80b4b80 0x7ff4a80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:00.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.324+0000 7ff4be7fc640 1 -- 172.21.15.106:0/4248870966 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7ff4b4105e90 con 0x7ff4c0108160 2024-08-31T06:41:00.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.324+0000 7ff4c5705640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4a80b4b80 0x7ff4a80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:00.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.325+0000 7ff4c5705640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4a80b4b80 0x7ff4a80b7090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009bd0 tx=0x7ff4b8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:41:00.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.327+0000 7ff4be7fc640 1 -- 172.21.15.106:0/4248870966 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff4b4050020 con 0x7ff4c0108160 2024-08-31T06:41:00.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:41:00.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-31T06:41:00.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:41:00.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: osdmap e29: 5 total, 4 up, 5 in 2024-08-31T06:41:00.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:00.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:41:00.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:00.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:00.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:00.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:00.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:40:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:00.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:00.513+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff4c010a3a0 con 0x7ff4a80b4b80 2024-08-31T06:41:01.235 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi066 2024-08-31T06:41:01.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi066 to 8544M 2024-08-31T06:41:01.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:41:01.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T06:41:01.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:01.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:01.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:01.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:01.236 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi066 2024-08-31T06:41:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi066 to 8544M 2024-08-31T06:41:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:41:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T06:41:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:01.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:01.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:01.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:01.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:01.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi066 2024-08-31T06:41:01.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi066 to 8544M 2024-08-31T06:41:01.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:41:01.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: osdmap e30: 5 total, 4 up, 5 in 2024-08-31T06:41:01.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:01.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:01.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:01.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:01.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:01 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:41:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:01 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:41:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:01 smithi106 ceph-mon[22134]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:41:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:01 smithi106 ceph-mon[22134]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:02.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:01 smithi106 ceph-mon[22134]: osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] boot 2024-08-31T06:41:02.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:01 smithi106 ceph-mon[22134]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T06:41:02.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:01 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:41:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:01 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:41:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:01 smithi037 ceph-mon[18612]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:41:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:01 smithi037 ceph-mon[18612]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:01 smithi037 ceph-mon[18612]: osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] boot 2024-08-31T06:41:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:01 smithi037 ceph-mon[18612]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T06:41:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:02.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:01 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:41:02.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:01 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:41:02.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:01 smithi066 ceph-mon[22244]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-31T06:41:02.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:01 smithi066 ceph-mon[22244]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:02.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:01 smithi066 ceph-mon[22244]: osd.4 [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] boot 2024-08-31T06:41:02.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:01 smithi066 ceph-mon[22244]: osdmap e31: 5 total, 5 up, 5 in 2024-08-31T06:41:02.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-31T06:41:03.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:02 smithi106 ceph-mon[22134]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T06:41:03.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:02 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/3408302446' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"} : dispatch 2024-08-31T06:41:03.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:02 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"} : dispatch 2024-08-31T06:41:03.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:02 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"}]': finished 2024-08-31T06:41:03.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:02 smithi106 ceph-mon[22134]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T06:41:03.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:02 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:03.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:02 smithi037 ceph-mon[18612]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T06:41:03.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:02 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/3408302446' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"} : dispatch 2024-08-31T06:41:03.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:02 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"} : dispatch 2024-08-31T06:41:03.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:02 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"}]': finished 2024-08-31T06:41:03.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:02 smithi037 ceph-mon[18612]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T06:41:03.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:02 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:03.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:02 smithi066 ceph-mon[22244]: osdmap e32: 5 total, 5 up, 5 in 2024-08-31T06:41:03.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:02 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/3408302446' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"} : dispatch 2024-08-31T06:41:03.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:02 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"} : dispatch 2024-08-31T06:41:03.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:02 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "673f5b17-3d81-4124-a3c0-cde3e717639e"}]': finished 2024-08-31T06:41:03.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:02 smithi066 ceph-mon[22244]: osdmap e33: 6 total, 5 up, 6 in 2024-08-31T06:41:03.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:02 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:04.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:04 smithi106 ceph-mon[22134]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:04 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/3238534678' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:04.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:04 smithi037 ceph-mon[18612]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:04.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:04 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/3238534678' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:04.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:04 smithi066 ceph-mon[22244]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:04.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:04 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/3238534678' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:06 smithi106 ceph-mon[22134]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:06 smithi037 ceph-mon[18612]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:06.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:06 smithi066 ceph-mon[22244]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:08.306 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:08 smithi106 ceph-mon[22134]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:08 smithi037 ceph-mon[18612]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:08 smithi066 ceph-mon[22244]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:10.287 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:10 smithi106 ceph-mon[22134]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:10.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:10 smithi037 ceph-mon[18612]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:10.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:10 smithi066 ceph-mon[22244]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:12.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:12 smithi106 ceph-mon[22134]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:12.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T06:41:12.201 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:12.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:12 smithi037 ceph-mon[18612]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:12.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T06:41:12.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:12.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:12 smithi066 ceph-mon[22244]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:12.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-31T06:41:12.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:13.291 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:13 smithi106 ceph-mon[22134]: Deploying daemon osd.5 on smithi106 2024-08-31T06:41:13.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:13 smithi037 ceph-mon[18612]: Deploying daemon osd.5 on smithi106 2024-08-31T06:41:13.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:13 smithi066 ceph-mon[22244]: Deploying daemon osd.5 on smithi106 2024-08-31T06:41:14.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:14 smithi106 ceph-mon[22134]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:14.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:14 smithi037 ceph-mon[18612]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:14 smithi066 ceph-mon[22244]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:16.260 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:16 smithi106 ceph-mon[22134]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:16 smithi037 ceph-mon[18612]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:16 smithi066 ceph-mon[22244]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:17.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:17 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:17.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:17 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:17.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:17 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:17 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:17 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:17 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:17.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:17 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:17.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:17 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:17.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:17 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:18.182 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:18 smithi106 ceph-mon[22134]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:18.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:18 smithi037 ceph-mon[18612]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:18.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:18 smithi066 ceph-mon[22244]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:19.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.836+0000 7ff4be7fc640 1 -- 172.21.15.106:0/4248870966 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff4c010a3a0 con 0x7ff4a80b4b80 2024-08-31T06:41:19.838 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 5 on host 'smithi106' 2024-08-31T06:41:19.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4a80b4b80 msgr2=0x7ff4a80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:19.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4a80b4b80 0x7ff4a80b7090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009bd0 tx=0x7ff4b8005f90 comp rx=0 tx=0).stop 2024-08-31T06:41:19.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 msgr2=0x7ff4c0199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:19.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 0x7ff4c0199660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4005940 tx=0x7ff4b40319a0 comp rx=0 tx=0).stop 2024-08-31T06:41:19.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 shutdown_connections 2024-08-31T06:41:19.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4a80b4b80 0x7ff4a80b7090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:19.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c0108ab0 0x7ff4c019e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:19.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c0108160 0x7ff4c0199660 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:19.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 --2- 172.21.15.106:0/4248870966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c0102820 0x7ff4c01990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:19.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 >> 172.21.15.106:0/4248870966 conn(0x7ff4c00794e0 msgr2=0x7ff4c0105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:41:19.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 shutdown_connections 2024-08-31T06:41:19.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:41:19.838+0000 7ff4c7969640 1 -- 172.21.15.106:0/4248870966 wait complete. 2024-08-31T06:41:20.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:20.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:20.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:20.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:20.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:20 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:20.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:20.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:20.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:20.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:20 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:20 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:20.442 DEBUG:teuthology.orchestra.run.smithi106:osd.5> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.5.service 2024-08-31T06:41:20.445 INFO:tasks.cephadm:Deploying osd.6 on smithi037 with /dev/vg_nvme/lv_2... 2024-08-31T06:41:20.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T06:41:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:41:22.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:22 smithi037 ceph-mon[18612]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:22.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:22 smithi106 ceph-mon[22134]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:22.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:22 smithi066 ceph-mon[22244]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:22.927 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:41:22 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:41:22.726+0000 7f792ce90640 -1 osd.5 0 log_to_monitors true 2024-08-31T06:41:23.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:23 smithi106 ceph-mon[22134]: from='osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T06:41:23.228 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:23 smithi106 ceph-mon[22134]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T06:41:23.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:23 smithi037 ceph-mon[18612]: from='osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T06:41:23.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:23 smithi037 ceph-mon[18612]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T06:41:23.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:41:23.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-08-31T06:41:23.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:23 smithi066 ceph-mon[22244]: from='osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T06:41:23.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:23 smithi066 ceph-mon[22244]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-31T06:41:23.631 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:41:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.086+0000 7fb90e129640 1 -- 172.21.15.37:0/2401398241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908108170 msgr2=0x7fb908108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.086+0000 7fb90e129640 1 --2- 172.21.15.37:0/2401398241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908108170 0x7fb908108580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009900 tx=0x7fb8f002a410 comp rx=0 tx=0).stop 2024-08-31T06:41:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.086+0000 7fb90e129640 1 -- 172.21.15.37:0/2401398241 shutdown_connections 2024-08-31T06:41:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.086+0000 7fb90e129640 1 --2- 172.21.15.37:0/2401398241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908108170 0x7fb908108580 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:24.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.086+0000 7fb90e129640 1 --2- 172.21.15.37:0/2401398241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb908108ac0 0x7fb90810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.086+0000 7fb90e129640 1 --2- 172.21.15.37:0/2401398241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb908102880 0x7fb908102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.087+0000 7fb90e129640 1 -- 172.21.15.37:0/2401398241 >> 172.21.15.37:0/2401398241 conn(0x7fb908079500 msgr2=0x7fb908079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.087+0000 7fb90e129640 1 -- 172.21.15.37:0/2401398241 shutdown_connections 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.087+0000 7fb90e129640 1 -- 172.21.15.37:0/2401398241 wait complete. 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.087+0000 7fb90e129640 1 Processor -- start 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.087+0000 7fb90e129640 1 -- start start 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb90e129640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908102880 0x7fb90819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb90e129640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb908108170 0x7fb90819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb90e129640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb908108ac0 0x7fb9081a1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb90e129640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9081125a0 con 0x7fb908102880 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb90e129640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb908112420 con 0x7fb908108170 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb90e129640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb908112720 con 0x7fb908108ac0 2024-08-31T06:41:24.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908102880 0x7fb90819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908102880 0x7fb90819c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45334/0 (socket says 172.21.15.37:45334) 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 -- 172.21.15.37:0/2213876413 learned_addr learned my addr 172.21.15.37:0/2213876413 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb907fff640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb908108ac0 0x7fb9081a1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb8feffd640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb908108170 0x7fb90819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 -- 172.21.15.37:0/2213876413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb908108ac0 msgr2=0x7fb9081a1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb908108ac0 0x7fb9081a1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 -- 172.21.15.37:0/2213876413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb908108170 msgr2=0x7fb90819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb908108170 0x7fb90819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:24.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 -- 172.21.15.37:0/2213876413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9081a22e0 con 0x7fb908102880 2024-08-31T06:41:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb8feffd640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb908108170 0x7fb90819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:41:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9077fe640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908102880 0x7fb90819c370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800d950 tx=0x7fb8f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:41:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.088+0000 7fb9057fa640 1 -- 172.21.15.37:0/2213876413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8017070 con 0x7fb908102880 2024-08-31T06:41:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.089+0000 7fb9057fa640 1 -- 172.21.15.37:0/2213876413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8f8009c30 con 0x7fb908102880 2024-08-31T06:41:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.089+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9081a25d0 con 0x7fb908102880 2024-08-31T06:41:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.089+0000 7fb9057fa640 1 -- 172.21.15.37:0/2213876413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800f620 con 0x7fb908102880 2024-08-31T06:41:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.089+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9081a8d30 con 0x7fb908102880 2024-08-31T06:41:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.090+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb908103ab0 con 0x7fb908102880 2024-08-31T06:41:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.092+0000 7fb9057fa640 1 -- 172.21.15.37:0/2213876413 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fb8f8005030 con 0x7fb908102880 2024-08-31T06:41:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.093+0000 7fb9057fa640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb8f40b4c00 0x7fb8f40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.093+0000 7fb8feffd640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb8f40b4c00 0x7fb8f40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.093+0000 7fb9057fa640 1 -- 172.21.15.37:0/2213876413 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4468+0+0 (secure 0 0 0) 0x7fb8f80e3ec0 con 0x7fb908102880 2024-08-31T06:41:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.094+0000 7fb8feffd640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb8f40b4c00 0x7fb8f40b7110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0006010 tx=0x7fb8f0005de0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:41:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.096+0000 7fb9057fa640 1 -- 172.21.15.37:0/2213876413 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb8f80abed0 con 0x7fb908102880 2024-08-31T06:41:24.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:24.291+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb9080635a0 con 0x7fb8f40b4c00 2024-08-31T06:41:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T06:41:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:41:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T06:41:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:41:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:24.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:24.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:24.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:24.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:24.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:24.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:24.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-31T06:41:24.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:41:24.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: osdmap e34: 6 total, 5 up, 6 in 2024-08-31T06:41:24.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:24.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:25.315 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:41:24 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:41:24.979+0000 7f7928e12640 -1 osd.5 0 waiting for initial osdmap 2024-08-31T06:41:25.316 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:41:25.137+0000 7f7920c08640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi106 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi106 to 8544M 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:25.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:25.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:25 smithi106 ceph-mon[22134]: from='osd.5 ' entity='osd.5' 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi106 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi106 to 8544M 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:25.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:25 smithi037 ceph-mon[18612]: from='osd.5 ' entity='osd.5' 2024-08-31T06:41:25.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi106 2024-08-31T06:41:25.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi106 to 8544M 2024-08-31T06:41:25.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:41:25.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: osdmap e35: 6 total, 5 up, 6 in 2024-08-31T06:41:25.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:25.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:25.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:25.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:25.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:25.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:25 smithi066 ceph-mon[22244]: from='osd.5 ' entity='osd.5' 2024-08-31T06:41:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:26 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:41:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:26 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:41:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:26 smithi037 ceph-mon[18612]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:26 smithi037 ceph-mon[18612]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:26 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:26 smithi037 ceph-mon[18612]: osdmap e36: 6 total, 5 up, 6 in 2024-08-31T06:41:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:26 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:26 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:26 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:41:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:26 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:41:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:26 smithi066 ceph-mon[22244]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:26.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:26 smithi066 ceph-mon[22244]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:26.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:26 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:26.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:26 smithi066 ceph-mon[22244]: osdmap e36: 6 total, 5 up, 6 in 2024-08-31T06:41:26.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:26 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:26.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:26 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:26.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:26 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:41:26.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:26 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:41:26.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:26 smithi106 ceph-mon[22134]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:26.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:26 smithi106 ceph-mon[22134]: from='client.14571 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:26.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:26 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:26.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:26 smithi106 ceph-mon[22134]: osdmap e36: 6 total, 5 up, 6 in 2024-08-31T06:41:26.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:26 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:26.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:26 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] boot 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1509958354' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25"} : dispatch 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1509958354' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25"}]': finished 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T06:41:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:27.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] boot 2024-08-31T06:41:27.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T06:41:27.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:27.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:27.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T06:41:27.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1509958354' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25"} : dispatch 2024-08-31T06:41:27.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1509958354' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25"}]': finished 2024-08-31T06:41:27.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T06:41:27.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:27.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: osd.5 [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] boot 2024-08-31T06:41:27.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: osdmap e37: 6 total, 6 up, 6 in 2024-08-31T06:41:27.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-31T06:41:27.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-31T06:41:27.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: osdmap e38: 6 total, 6 up, 6 in 2024-08-31T06:41:27.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1509958354' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25"} : dispatch 2024-08-31T06:41:27.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1509958354' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25"}]': finished 2024-08-31T06:41:27.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: osdmap e39: 7 total, 6 up, 7 in 2024-08-31T06:41:27.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:28 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/783404598' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:28.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:28 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/783404598' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:28.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:28 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/783404598' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:29.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:29 smithi066 ceph-mon[22244]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T06:41:29.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:29 smithi106 ceph-mon[22134]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T06:41:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:29 smithi037 ceph-mon[18612]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-31T06:41:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:31 smithi106 ceph-mon[22134]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-08-31T06:41:31.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:31 smithi037 ceph-mon[18612]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-08-31T06:41:31.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:31 smithi066 ceph-mon[22244]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 113 KiB/s, 0 objects/s recovering 2024-08-31T06:41:33.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:33 smithi037 ceph-mon[18612]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T06:41:33.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:33 smithi106 ceph-mon[22134]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T06:41:33.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:33 smithi066 ceph-mon[22244]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-08-31T06:41:35.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:35 smithi037 ceph-mon[18612]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:41:35.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:35 smithi106 ceph-mon[22134]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:41:35.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:35 smithi066 ceph-mon[22244]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:41:36.542 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:36 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T06:41:36.542 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:36 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:36.542 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:36 smithi037 ceph-mon[18612]: Deploying daemon osd.6 on smithi037 2024-08-31T06:41:36.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:36 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T06:41:36.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:36 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:36.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:36 smithi106 ceph-mon[22134]: Deploying daemon osd.6 on smithi037 2024-08-31T06:41:36.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:36 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-31T06:41:36.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:36 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:36.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:36 smithi066 ceph-mon[22244]: Deploying daemon osd.6 on smithi037 2024-08-31T06:41:37.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:37 smithi106 ceph-mon[22134]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T06:41:37.570 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:37 smithi037 ceph-mon[18612]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T06:41:37.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:37 smithi066 ceph-mon[22244]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-08-31T06:41:39.539 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:39 smithi037 ceph-mon[18612]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T06:41:39.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:39 smithi106 ceph-mon[22134]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T06:41:39.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:39 smithi066 ceph-mon[22244]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-31T06:41:41.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:41 smithi106 ceph-mon[22134]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:41 smithi037 ceph-mon[18612]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:41.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:41 smithi066 ceph-mon[22244]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:42.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:42 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:42.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:42 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:42.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:42 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:42.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:42 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:42.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:42 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:42.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:42 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:42.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:42 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:42.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:42 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:42.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:42 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:43.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:43 smithi037 ceph-mon[18612]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:43.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:43 smithi106 ceph-mon[22134]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:43 smithi066 ceph-mon[22244]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:45.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.095+0000 7fb9057fa640 1 -- 172.21.15.37:0/2213876413 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb9080635a0 con 0x7fb8f40b4c00 2024-08-31T06:41:45.097 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 6 on host 'smithi037' 2024-08-31T06:41:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb8f40b4c00 msgr2=0x7fb8f40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb8f40b4c00 0x7fb8f40b7110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0006010 tx=0x7fb8f0005de0 comp rx=0 tx=0).stop 2024-08-31T06:41:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908102880 msgr2=0x7fb90819c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908102880 0x7fb90819c370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800d950 tx=0x7fb8f800de10 comp rx=0 tx=0).stop 2024-08-31T06:41:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 shutdown_connections 2024-08-31T06:41:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb8f40b4c00 0x7fb8f40b7110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:45.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb908108ac0 0x7fb9081a1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb908108170 0x7fb90819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 --2- 172.21.15.37:0/2213876413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb908102880 0x7fb90819c370 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 >> 172.21.15.37:0/2213876413 conn(0x7fb908079500 msgr2=0x7fb9081051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:41:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 shutdown_connections 2024-08-31T06:41:45.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:41:45.098+0000 7fb90e129640 1 -- 172.21.15.37:0/2213876413 wait complete. 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:45 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:45.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:45.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:45.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:45.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:45 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:45.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:45.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:45.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:41:45.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:45 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:45.878 DEBUG:teuthology.orchestra.run.smithi037:osd.6> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.6.service 2024-08-31T06:41:45.881 INFO:tasks.cephadm:Deploying osd.7 on smithi066 with /dev/vg_nvme/lv_2... 2024-08-31T06:41:45.881 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T06:41:46.149 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:41:47.291 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:41:47 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:41:47.033+0000 7ff44fa1d640 -1 osd.6 0 log_to_monitors true 2024-08-31T06:41:47.516 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:47 smithi066 ceph-mon[22244]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:47.517 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:47 smithi066 ceph-mon[22244]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T06:41:47.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:47 smithi106 ceph-mon[22134]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:47.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:47 smithi106 ceph-mon[22134]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T06:41:47.572 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:47 smithi037 ceph-mon[18612]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:47.573 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:47 smithi037 ceph-mon[18612]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-31T06:41:48.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:48 smithi106 ceph-mon[22134]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T06:41:48.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:48 smithi106 ceph-mon[22134]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T06:41:48.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:48 smithi106 ceph-mon[22134]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:41:48.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:48 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:48.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:48 smithi037 ceph-mon[18612]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T06:41:48.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:48 smithi037 ceph-mon[18612]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T06:41:48.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:48 smithi037 ceph-mon[18612]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:41:48.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:48 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:48.605 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:41:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:41:48.306+0000 7ff44b99f640 -1 osd.6 0 waiting for initial osdmap 2024-08-31T06:41:48.605 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:41:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:41:48.315+0000 7ff44779d640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:41:48.615 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:48 smithi066 ceph-mon[22244]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-31T06:41:48.615 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:48 smithi066 ceph-mon[22244]: osdmap e40: 7 total, 6 up, 7 in 2024-08-31T06:41:48.615 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:48 smithi066 ceph-mon[22244]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:41:48.615 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:48 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:48.618 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:41:48.645 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_2 2024-08-31T06:41:48.910 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:41:49.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 -- 172.21.15.66:0/1202596997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc102800 msgr2=0x7fc3cc102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:49.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/1202596997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc102800 0x7fc3cc102c10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009900 tx=0x7fc3bc02a410 comp rx=0 tx=0).stop 2024-08-31T06:41:49.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 -- 172.21.15.66:0/1202596997 shutdown_connections 2024-08-31T06:41:49.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/1202596997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3cc108a90 0x7fc3cc10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:49.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/1202596997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3cc108140 0x7fc3cc108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:49.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/1202596997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc102800 0x7fc3cc102c10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:49.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 -- 172.21.15.66:0/1202596997 >> 172.21.15.66:0/1202596997 conn(0x7fc3cc0794d0 msgr2=0x7fc3cc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:41:49.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 -- 172.21.15.66:0/1202596997 shutdown_connections 2024-08-31T06:41:49.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.497+0000 7fc3d2f35640 1 -- 172.21.15.66:0/1202596997 wait complete. 2024-08-31T06:41:49.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.498+0000 7fc3d2f35640 1 Processor -- start 2024-08-31T06:41:49.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.498+0000 7fc3d2f35640 1 -- start start 2024-08-31T06:41:49.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.498+0000 7fc3d2f35640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3cc102800 0x7fc3cc10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:49.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.498+0000 7fc3d2f35640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3cc108140 0x7fc3cc110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:49.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.498+0000 7fc3d2f35640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc108a90 0x7fc3cc1107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:49.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.498+0000 7fc3d2f35640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc1136d0 con 0x7fc3cc102800 2024-08-31T06:41:49.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.498+0000 7fc3d2f35640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc113550 con 0x7fc3cc108a90 2024-08-31T06:41:49.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.498+0000 7fc3d2f35640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc3cc113850 con 0x7fc3cc108140 2024-08-31T06:41:49.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc108a90 0x7fc3cc1107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc108a90 0x7fc3cc1107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59570/0 (socket says 172.21.15.66:59570) 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 -- 172.21.15.66:0/117863727 learned_addr learned my addr 172.21.15.66:0/117863727 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3cbfff640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3cc108140 0x7fc3cc110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d0cd1640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3cc102800 0x7fc3cc10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 -- 172.21.15.66:0/117863727 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3cc108140 msgr2=0x7fc3cc110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3cc108140 0x7fc3cc110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 -- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3cc102800 msgr2=0x7fc3cc10fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3cc102800 0x7fc3cc10fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 -- 172.21.15.66:0/117863727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3cc1a83c0 con 0x7fc3cc108a90 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d14d2640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc108a90 0x7fc3cc1107d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400eaa0 tx=0x7fc3c400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3c9ffb640 1 -- 172.21.15.66:0/117863727 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400cdb0 con 0x7fc3cc108a90 2024-08-31T06:41:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3cc1a86b0 con 0x7fc3cc108a90 2024-08-31T06:41:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3c9ffb640 1 -- 172.21.15.66:0/117863727 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3c4005020 con 0x7fc3cc108a90 2024-08-31T06:41:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.499+0000 7fc3c9ffb640 1 -- 172.21.15.66:0/117863727 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40116d0 con 0x7fc3cc108a90 2024-08-31T06:41:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.500+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3cc1a8bf0 con 0x7fc3cc108a90 2024-08-31T06:41:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.501+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3cc102c10 con 0x7fc3cc108a90 2024-08-31T06:41:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.503+0000 7fc3c9ffb640 1 -- 172.21.15.66:0/117863727 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fc3c40051d0 con 0x7fc3cc108a90 2024-08-31T06:41:49.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.504+0000 7fc3c9ffb640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3b40b4b80 0x7fc3b40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:41:49.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.504+0000 7fc3c9ffb640 1 -- 172.21.15.66:0/117863727 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5180+0+0 (secure 0 0 0) 0x7fc3c40e4a70 con 0x7fc3cc108a90 2024-08-31T06:41:49.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.504+0000 7fc3d0cd1640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3b40b4b80 0x7fc3b40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:41:49.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.505+0000 7fc3d0cd1640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3b40b4b80 0x7fc3b40b7090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc1117a0 tx=0x7fc3bc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:41:49.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.507+0000 7fc3c9ffb640 1 -- 172.21.15.66:0/117863727 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc3c4016030 con 0x7fc3cc108a90 2024-08-31T06:41:49.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:49.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:41:49.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T06:41:49.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi037 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi037 to 5697M 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:49.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:49.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi037 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi037 to 5697M 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:49.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:49.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:49.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:41:49.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: osdmap e41: 7 total, 6 up, 7 in 2024-08-31T06:41:49.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:49.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:49.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi037 2024-08-31T06:41:49.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:41:49.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi037 to 5697M 2024-08-31T06:41:49.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.640 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:49.640 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:41:49.640 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:41:49.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:41:49.704+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc3cc0635a0 con 0x7fc3b40b4b80 2024-08-31T06:41:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:41:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:41:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] boot 2024-08-31T06:41:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T06:41:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:50.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:41:50.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:41:50.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] boot 2024-08-31T06:41:50.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T06:41:50.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:50.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:50.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:50.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:50.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:50.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:41:50.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:41:50.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: osd.6 [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] boot 2024-08-31T06:41:50.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: osdmap e42: 7 total, 7 up, 7 in 2024-08-31T06:41:50.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-31T06:41:50.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:41:50.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:41:50.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:41:50.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:41:51.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:51 smithi037 ceph-mon[18612]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:51.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:51 smithi037 ceph-mon[18612]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T06:41:51.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:51 smithi066 ceph-mon[22244]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:51.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:51 smithi066 ceph-mon[22244]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T06:41:51.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:51 smithi106 ceph-mon[22134]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-08-31T06:41:51.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:51 smithi106 ceph-mon[22134]: osdmap e43: 7 total, 7 up, 7 in 2024-08-31T06:41:52.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:52 smithi037 ceph-mon[18612]: from='client.? 172.21.15.66:0/656636392' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"} : dispatch 2024-08-31T06:41:52.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:52 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"} : dispatch 2024-08-31T06:41:52.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:52 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"}]': finished 2024-08-31T06:41:52.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:52 smithi037 ceph-mon[18612]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T06:41:52.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:41:52.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:52 smithi066 ceph-mon[22244]: from='client.? 172.21.15.66:0/656636392' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"} : dispatch 2024-08-31T06:41:52.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:52 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"} : dispatch 2024-08-31T06:41:52.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:52 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"}]': finished 2024-08-31T06:41:52.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:52 smithi066 ceph-mon[22244]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T06:41:52.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:41:52.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:52 smithi106 ceph-mon[22134]: from='client.? 172.21.15.66:0/656636392' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"} : dispatch 2024-08-31T06:41:52.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:52 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"} : dispatch 2024-08-31T06:41:52.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:52 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14c76b06-4472-44a9-8c2c-76f68ce298b4"}]': finished 2024-08-31T06:41:52.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:52 smithi106 ceph-mon[22134]: osdmap e44: 8 total, 7 up, 8 in 2024-08-31T06:41:52.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:41:53.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:53 smithi037 ceph-mon[18612]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:53.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:53 smithi037 ceph-mon[18612]: from='client.? 172.21.15.66:0/1690232179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:53.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:53 smithi066 ceph-mon[22244]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:53.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:53 smithi066 ceph-mon[22244]: from='client.? 172.21.15.66:0/1690232179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:53.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:53 smithi106 ceph-mon[22134]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:53.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:53 smithi106 ceph-mon[22134]: from='client.? 172.21.15.66:0/1690232179' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:41:55.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:55 smithi037 ceph-mon[18612]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:55.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:55 smithi066 ceph-mon[22244]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:55.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:55 smithi106 ceph-mon[22134]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:57.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:57 smithi037 ceph-mon[18612]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:57.631 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:57 smithi066 ceph-mon[22244]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:57.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:57 smithi106 ceph-mon[22134]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:59.371 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:41:59 smithi066 ceph-mon[22244]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:59.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:41:59 smithi037 ceph-mon[18612]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:41:59.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:41:59 smithi106 ceph-mon[22134]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:01.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:01 smithi037 ceph-mon[18612]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:01.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T06:42:01.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:01.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:01 smithi037 ceph-mon[18612]: Deploying daemon osd.7 on smithi066 2024-08-31T06:42:01.617 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:01 smithi106 ceph-mon[22134]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:01.617 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T06:42:01.617 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:01.617 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:01 smithi106 ceph-mon[22134]: Deploying daemon osd.7 on smithi066 2024-08-31T06:42:01.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:01 smithi066 ceph-mon[22244]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:01.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-31T06:42:01.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:01.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:01 smithi066 ceph-mon[22244]: Deploying daemon osd.7 on smithi066 2024-08-31T06:42:03.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:03 smithi037 ceph-mon[18612]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:03.608 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:03 smithi066 ceph-mon[22244]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:03.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:03 smithi106 ceph-mon[22134]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:05.591 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:05 smithi066 ceph-mon[22244]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:05.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:05 smithi106 ceph-mon[22134]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:05.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:05 smithi037 ceph-mon[18612]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:06.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:06 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:06.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:06 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:06.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:06 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:06.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:06 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:06.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:06 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:06.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:06 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:06.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:06 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:06.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:06 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:06.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:06 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:07.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:07 smithi066 ceph-mon[22244]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:07.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:07 smithi106 ceph-mon[22134]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:07.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:07 smithi037 ceph-mon[18612]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:09.844 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:09 smithi066 ceph-mon[22244]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:09.845 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:09.845 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:09.845 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:09.845 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:09.845 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:09 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:09.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.843+0000 7fc3c9ffb640 1 -- 172.21.15.66:0/117863727 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc3cc0635a0 con 0x7fc3b40b4b80 2024-08-31T06:42:09.846 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 7 on host 'smithi066' 2024-08-31T06:42:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3b40b4b80 msgr2=0x7fc3b40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3b40b4b80 0x7fc3b40b7090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc1117a0 tx=0x7fc3bc0058d0 comp rx=0 tx=0).stop 2024-08-31T06:42:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc108a90 msgr2=0x7fc3cc1107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc108a90 0x7fc3cc1107d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400eaa0 tx=0x7fc3c400ef60 comp rx=0 tx=0).stop 2024-08-31T06:42:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 shutdown_connections 2024-08-31T06:42:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3b40b4b80 0x7fc3b40b7090 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3cc108a90 0x7fc3cc1107d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:09.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3cc108140 0x7fc3cc110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 --2- 172.21.15.66:0/117863727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3cc102800 0x7fc3cc10fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 >> 172.21.15.66:0/117863727 conn(0x7fc3cc0794d0 msgr2=0x7fc3cc1011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:42:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 shutdown_connections 2024-08-31T06:42:09.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:42:09.846+0000 7fc3d2f35640 1 -- 172.21.15.66:0/117863727 wait complete. 2024-08-31T06:42:10.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:09 smithi106 ceph-mon[22134]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:10.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:10.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:10.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:10.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:10.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:09 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:09 smithi037 ceph-mon[18612]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:09 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:10.446 DEBUG:teuthology.orchestra.run.smithi066:osd.7> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.7.service 2024-08-31T06:42:10.448 INFO:tasks.cephadm:Deploying osd.8 on smithi106 with /dev/vg_nvme/lv_2... 2024-08-31T06:42:10.449 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-31T06:42:10.703 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:42:10.998 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:10 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:10.998 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:10 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:10.998 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:10 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:11.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:10 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:11.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:10 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:11.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:10 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:11.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:10 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:11.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:10 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:11.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:10 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:11.947 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:11 smithi066 ceph-mon[22244]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:12.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:11 smithi037 ceph-mon[18612]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:12.116 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:11 smithi106 ceph-mon[22134]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:12.638 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:42:12 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:42:12.301+0000 7fe1cfbb2640 -1 osd.7 0 log_to_monitors true 2024-08-31T06:42:13.064 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:12 smithi106 ceph-mon[22134]: from='osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:42:13.064 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:12 smithi106 ceph-mon[22134]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:42:13.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:12 smithi037 ceph-mon[18612]: from='osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:42:13.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:12 smithi037 ceph-mon[18612]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:42:13.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:12 smithi066 ceph-mon[22244]: from='osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:42:13.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:12 smithi066 ceph-mon[22244]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-31T06:42:13.317 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:42:13.347 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_2 2024-08-31T06:42:13.600 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:42:14.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 -- 172.21.15.106:0/2191590694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b9010dbd0 msgr2=0x7f3b901100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:14.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 --2- 172.21.15.106:0/2191590694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b9010dbd0 0x7f3b901100c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009ca0 tx=0x7f3b8802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:42:14.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 -- 172.21.15.106:0/2191590694 shutdown_connections 2024-08-31T06:42:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 --2- 172.21.15.106:0/2191590694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b901050c0 0x7f3b9010d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 --2- 172.21.15.106:0/2191590694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b9010dbd0 0x7f3b901100c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 --2- 172.21.15.106:0/2191590694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b90104770 0x7f3b90104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 -- 172.21.15.106:0/2191590694 >> 172.21.15.106:0/2191590694 conn(0x7f3b900794e0 msgr2=0x7f3b900798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:42:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 -- 172.21.15.106:0/2191590694 shutdown_connections 2024-08-31T06:42:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.053+0000 7f3b98398640 1 -- 172.21.15.106:0/2191590694 wait complete. 2024-08-31T06:42:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b98398640 1 Processor -- start 2024-08-31T06:42:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b98398640 1 -- start start 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b98398640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b90104770 0x7f3b9019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b98398640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b901050c0 0x7f3b9019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b98398640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b9010dbd0 0x7f3b9019f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b98398640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3b90113730 con 0x7f3b901050c0 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b98398640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3b901135b0 con 0x7f3b9010dbd0 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b98398640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3b901138b0 con 0x7f3b90104770 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b96134640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b90104770 0x7f3b9019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b96134640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b90104770 0x7f3b9019a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:33056/0 (socket says 172.21.15.106:33056) 2024-08-31T06:42:14.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.054+0000 7f3b96134640 1 -- 172.21.15.106:0/2561283367 learned_addr learned my addr 172.21.15.106:0/2561283367 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b96935640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b9010dbd0 0x7f3b9019f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b95933640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b901050c0 0x7f3b9019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b96134640 1 -- 172.21.15.106:0/2561283367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b9010dbd0 msgr2=0x7f3b9019f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b96134640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b9010dbd0 0x7f3b9019f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b96134640 1 -- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b901050c0 msgr2=0x7f3b9019a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b96134640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b901050c0 0x7f3b9019a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b96134640 1 -- 172.21.15.106:0/2561283367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b901a0070 con 0x7f3b90104770 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b96935640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b9010dbd0 0x7f3b9019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b96134640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b90104770 0x7f3b9019a100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c970 tx=0x7f3b8c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b877fe640 1 -- 172.21.15.106:0/2561283367 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c004220 con 0x7f3b90104770 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b901a0360 con 0x7f3b90104770 2024-08-31T06:42:14.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b877fe640 1 -- 172.21.15.106:0/2561283367 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b8c007e40 con 0x7f3b90104770 2024-08-31T06:42:14.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b877fe640 1 -- 172.21.15.106:0/2561283367 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00f450 con 0x7f3b90104770 2024-08-31T06:42:14.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.055+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b901a6ac0 con 0x7f3b90104770 2024-08-31T06:42:14.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.056+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b90104b80 con 0x7f3b90104770 2024-08-31T06:42:14.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.059+0000 7f3b877fe640 1 -- 172.21.15.106:0/2561283367 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f3b8c003610 con 0x7f3b90104770 2024-08-31T06:42:14.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.060+0000 7f3b877fe640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b7c0b4b80 0x7f3b7c0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:42:14.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.060+0000 7f3b95933640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b7c0b4b80 0x7f3b7c0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:42:14.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.060+0000 7f3b877fe640 1 -- 172.21.15.106:0/2561283367 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5332+0+0 (secure 0 0 0) 0x7f3b8c0e4760 con 0x7f3b90104770 2024-08-31T06:42:14.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.061+0000 7f3b95933640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b7c0b4b80 0x7f3b7c0b7090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b90102210 tx=0x7f3b8000b590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:42:14.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.063+0000 7f3b877fe640 1 -- 172.21.15.106:0/2561283367 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3b8c014030 con 0x7f3b90104770 2024-08-31T06:42:14.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:42:13.860+0000 7fe1cbb34640 -1 osd.7 0 waiting for initial osdmap 2024-08-31T06:42:14.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:42:13.878+0000 7fe1c7932640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:14.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:14.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:13 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:14.255+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3b900635a0 con 0x7f3b7c0b4b80 2024-08-31T06:42:14.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:14.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T06:42:14.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T06:42:14.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:14.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:42:14.257 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:14.258 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:13 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:14.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-31T06:42:14.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: osdmap e45: 8 total, 7 up, 8 in 2024-08-31T06:42:14.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:14.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:42:14.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:42:14.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:14.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:14.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:14.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:14.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:13 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi066 2024-08-31T06:42:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi066 to 5696M 2024-08-31T06:42:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:42:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T06:42:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:15.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:42:15.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:42:15.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:15.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi066 2024-08-31T06:42:15.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi066 to 5696M 2024-08-31T06:42:15.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:42:15.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T06:42:15.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:15.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:15.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:42:15.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:42:15.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:15.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi066 2024-08-31T06:42:15.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi066 to 5696M 2024-08-31T06:42:15.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:42:15.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: osdmap e46: 8 total, 7 up, 8 in 2024-08-31T06:42:15.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:15.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:15.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:42:15.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:42:15.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:15 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:42:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:15 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:42:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:15 smithi106 ceph-mon[22134]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:15 smithi106 ceph-mon[22134]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:16.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:15 smithi106 ceph-mon[22134]: osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] boot 2024-08-31T06:42:16.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:15 smithi106 ceph-mon[22134]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T06:42:16.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:15 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:16.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:15 smithi106 ceph-mon[22134]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T06:42:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:15 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:42:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:15 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:42:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:15 smithi066 ceph-mon[22244]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:16.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:15 smithi066 ceph-mon[22244]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:16.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:15 smithi066 ceph-mon[22244]: osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] boot 2024-08-31T06:42:16.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:15 smithi066 ceph-mon[22244]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T06:42:16.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:15 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:16.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:15 smithi066 ceph-mon[22244]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T06:42:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:15 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:42:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:15 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:42:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:15 smithi037 ceph-mon[18612]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-08-31T06:42:16.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:15 smithi037 ceph-mon[18612]: from='client.24469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:16.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:15 smithi037 ceph-mon[18612]: osd.7 [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] boot 2024-08-31T06:42:16.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:15 smithi037 ceph-mon[18612]: osdmap e47: 8 total, 8 up, 8 in 2024-08-31T06:42:16.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:15 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-31T06:42:16.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:15 smithi037 ceph-mon[18612]: osdmap e48: 8 total, 8 up, 8 in 2024-08-31T06:42:17.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:16 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/271810289' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"} : dispatch 2024-08-31T06:42:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:16 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"} : dispatch 2024-08-31T06:42:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:16 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"}]': finished 2024-08-31T06:42:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:16 smithi066 ceph-mon[22244]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T06:42:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:17.164 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:16 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/271810289' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"} : dispatch 2024-08-31T06:42:17.164 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:16 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"} : dispatch 2024-08-31T06:42:17.164 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:16 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"}]': finished 2024-08-31T06:42:17.164 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:16 smithi106 ceph-mon[22134]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T06:42:17.164 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:16 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/271810289' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"} : dispatch 2024-08-31T06:42:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:16 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"} : dispatch 2024-08-31T06:42:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:16 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bea2e85a-3910-4109-845e-556410d644b6"}]': finished 2024-08-31T06:42:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:16 smithi037 ceph-mon[18612]: osdmap e49: 9 total, 8 up, 9 in 2024-08-31T06:42:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:17 smithi066 ceph-mon[22244]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:17 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/527582827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:42:18.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:17 smithi106 ceph-mon[22134]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:18.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:17 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/527582827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:42:18.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:17 smithi037 ceph-mon[18612]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:18.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:17 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/527582827' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:42:20.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:19 smithi106 ceph-mon[22134]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:20.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:19 smithi037 ceph-mon[18612]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:20.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:19 smithi066 ceph-mon[22244]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:22.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:21 smithi106 ceph-mon[22134]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:42:22.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:21 smithi037 ceph-mon[18612]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:42:22.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:21 smithi066 ceph-mon[22244]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:42:24.157 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:23 smithi106 ceph-mon[22134]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-08-31T06:42:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:23 smithi037 ceph-mon[18612]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-08-31T06:42:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:23 smithi066 ceph-mon[22244]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-08-31T06:42:26.041 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:25 smithi106 ceph-mon[22134]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-31T06:42:26.042 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T06:42:26.042 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:25 smithi037 ceph-mon[18612]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-31T06:42:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T06:42:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:25 smithi066 ceph-mon[22244]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-31T06:42:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-31T06:42:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:27.181 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:26 smithi106 ceph-mon[22134]: Deploying daemon osd.8 on smithi106 2024-08-31T06:42:27.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:26 smithi037 ceph-mon[18612]: Deploying daemon osd.8 on smithi106 2024-08-31T06:42:27.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:26 smithi066 ceph-mon[22244]: Deploying daemon osd.8 on smithi106 2024-08-31T06:42:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:27 smithi106 ceph-mon[22134]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:42:28.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:27 smithi037 ceph-mon[18612]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:42:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:27 smithi066 ceph-mon[22244]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-31T06:42:30.027 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:29 smithi106 ceph-mon[22134]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T06:42:30.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:29 smithi037 ceph-mon[18612]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T06:42:30.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:29 smithi066 ceph-mon[22244]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-31T06:42:31.178 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:30 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:31.178 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:30 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:31.178 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:30 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:31.289 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:30 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:31.289 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:30 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:31.289 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:30 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:31.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:30 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:31.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:30 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:31.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:30 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:32.004 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:31 smithi106 ceph-mon[22134]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:42:32.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:31 smithi037 ceph-mon[18612]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:42:32.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:31 smithi066 ceph-mon[22244]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:42:33.997 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:33 smithi106 ceph-mon[22134]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:33.998 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:33.998 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:33.998 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:33.998 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:33.998 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.335+0000 7f3b877fe640 1 -- 172.21.15.106:0/2561283367 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3b900635a0 con 0x7f3b7c0b4b80 2024-08-31T06:42:34.336 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 8 on host 'smithi106' 2024-08-31T06:42:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b7c0b4b80 msgr2=0x7f3b7c0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b7c0b4b80 0x7f3b7c0b7090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b90102210 tx=0x7f3b8000b590 comp rx=0 tx=0).stop 2024-08-31T06:42:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b90104770 msgr2=0x7f3b9019a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b90104770 0x7f3b9019a100 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c970 tx=0x7f3b8c00ce30 comp rx=0 tx=0).stop 2024-08-31T06:42:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 shutdown_connections 2024-08-31T06:42:34.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3b7c0b4b80 0x7f3b7c0b7090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:34.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b901050c0 0x7f3b9019a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:34.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b9010dbd0 0x7f3b9019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:34.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 --2- 172.21.15.106:0/2561283367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b90104770 0x7f3b9019a100 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:34.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 >> 172.21.15.106:0/2561283367 conn(0x7f3b900794e0 msgr2=0x7f3b901005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:42:34.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 shutdown_connections 2024-08-31T06:42:34.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:42:34.337+0000 7f3b98398640 1 -- 172.21.15.106:0/2561283367 wait complete. 2024-08-31T06:42:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:33 smithi037 ceph-mon[18612]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:34.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:33 smithi066 ceph-mon[22244]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:34.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:34.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:34.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:34.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:34.389 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:34.919 DEBUG:teuthology.orchestra.run.smithi106:osd.8> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.8.service 2024-08-31T06:42:34.921 INFO:tasks.cephadm:Deploying osd.9 on smithi037 with /dev/vg_nvme/lv_1... 2024-08-31T06:42:34.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T06:42:35.169 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:34 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:35.170 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:34 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:35.170 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:34 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:35.185 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:42:35.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:34 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:35.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:34 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:35.307 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:34 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:35.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:34 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:35.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:34 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:35.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:34 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:36.205 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:35 smithi106 ceph-mon[22134]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:36.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:35 smithi037 ceph-mon[18612]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:36.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:35 smithi066 ceph-mon[22244]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:36.457 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:42:36 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:42:36.215+0000 7f3910fb0640 -1 osd.8 0 log_to_monitors true 2024-08-31T06:42:37.194 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:36 smithi106 ceph-mon[22134]: from='osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:42:37.195 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:36 smithi106 ceph-mon[22134]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:42:37.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:36 smithi037 ceph-mon[18612]: from='osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:42:37.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:36 smithi037 ceph-mon[18612]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:42:37.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:36 smithi066 ceph-mon[22244]: from='osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:42:37.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:36 smithi066 ceph-mon[22244]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-31T06:42:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T06:42:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T06:42:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:38.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.143 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:42:38.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2024-08-31T06:42:38.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.197 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:38.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:38.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:38.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: osdmap e50: 9 total, 8 up, 9 in 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:42:38.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:38.424 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:42:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.870+0000 7f240fc94640 1 -- 172.21.15.37:0/1626307666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 msgr2=0x7f240810f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.870+0000 7f240fc94640 1 --2- 172.21.15.37:0/1626307666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 0x7f240810f340 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2400009ca0 tx=0x7f240002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:42:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 -- 172.21.15.37:0/1626307666 shutdown_connections 2024-08-31T06:42:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 --2- 172.21.15.37:0/1626307666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 0x7f240810f340 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 --2- 172.21.15.37:0/1626307666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24081081c0 0x7f24081085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 --2- 172.21.15.37:0/1626307666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2408102880 0x7f2408102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 -- 172.21.15.37:0/1626307666 >> 172.21.15.37:0/1626307666 conn(0x7f2408079510 msgr2=0x7f2408079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 -- 172.21.15.37:0/1626307666 shutdown_connections 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 -- 172.21.15.37:0/1626307666 wait complete. 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 Processor -- start 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.871+0000 7f240fc94640 1 -- start start 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240fc94640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2408102880 0x7f240819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240fc94640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24081081c0 0x7f240819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240fc94640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 0x7f240819f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240fc94640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24081126c0 con 0x7f2408108b10 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240fc94640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2408112540 con 0x7f2408102880 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240fc94640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2408112840 con 0x7f24081081c0 2024-08-31T06:42:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 0x7f240819f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 0x7f240819f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40170/0 (socket says 172.21.15.37:40170) 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 -- 172.21.15.37:0/1480403330 learned_addr learned my addr 172.21.15.37:0/1480403330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240d22f640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24081081c0 0x7f240819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240da30640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2408102880 0x7f240819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 -- 172.21.15.37:0/1480403330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24081081c0 msgr2=0x7f240819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24081081c0 0x7f240819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 -- 172.21.15.37:0/1480403330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2408102880 msgr2=0x7f240819a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2408102880 0x7f240819a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 -- 172.21.15.37:0/1480403330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24081a00f0 con 0x7f2408108b10 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240d22f640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24081081c0 0x7f240819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.872+0000 7f240e231640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 0x7f240819f9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2400005cc0 tx=0x7f2400003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.873+0000 7f23feffd640 1 -- 172.21.15.37:0/1480403330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400032c10 con 0x7f2408108b10 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.873+0000 7f23feffd640 1 -- 172.21.15.37:0/1480403330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2400032db0 con 0x7f2408108b10 2024-08-31T06:42:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.873+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24081a0380 con 0x7f2408108b10 2024-08-31T06:42:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.873+0000 7f23feffd640 1 -- 172.21.15.37:0/1480403330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400030a60 con 0x7f2408108b10 2024-08-31T06:42:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.873+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24081a6b40 con 0x7f2408108b10 2024-08-31T06:42:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.874+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2408103b00 con 0x7f2408108b10 2024-08-31T06:42:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.875+0000 7f23feffd640 1 -- 172.21.15.37:0/1480403330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f2400030c00 con 0x7f2408108b10 2024-08-31T06:42:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.876+0000 7f23feffd640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f23f40b4c00 0x7f23f40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:42:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.876+0000 7f240da30640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f23f40b4c00 0x7f23f40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:42:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.876+0000 7f23feffd640 1 -- 172.21.15.37:0/1480403330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7f2400105980 con 0x7f2408108b10 2024-08-31T06:42:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.877+0000 7f240da30640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f23f40b4c00 0x7f23f40b7110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2404009bd0 tx=0x7f2404005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:42:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:38.879+0000 7f23feffd640 1 -- 172.21.15.37:0/1480403330 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f24000cd530 con 0x7f2408108b10 2024-08-31T06:42:39.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:42:39.081+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f240810b970 con 0x7f23f40b4c00 2024-08-31T06:42:39.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:42:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:42:38.860+0000 7f390cf32640 -1 osd.8 0 waiting for initial osdmap 2024-08-31T06:42:39.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:42:39.006+0000 7f3904d28640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:42:39.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:38 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi106 2024-08-31T06:42:39.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:38 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi106 to 5696M 2024-08-31T06:42:39.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:38 smithi106 ceph-mon[22134]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:42:39.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:38 smithi106 ceph-mon[22134]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T06:42:39.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:38 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:39.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:38 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:39.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:38 smithi106 ceph-mon[22134]: from='osd.8 ' entity='osd.8' 2024-08-31T06:42:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:38 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi106 2024-08-31T06:42:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:38 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi106 to 5696M 2024-08-31T06:42:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:38 smithi037 ceph-mon[18612]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:42:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:38 smithi037 ceph-mon[18612]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T06:42:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:38 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:38 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:39.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:38 smithi037 ceph-mon[18612]: from='osd.8 ' entity='osd.8' 2024-08-31T06:42:39.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:38 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi106 2024-08-31T06:42:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:38 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi106 to 5696M 2024-08-31T06:42:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:38 smithi066 ceph-mon[22244]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:42:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:38 smithi066 ceph-mon[22244]: osdmap e51: 9 total, 8 up, 9 in 2024-08-31T06:42:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:38 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:38 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:39.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:38 smithi066 ceph-mon[22244]: from='osd.8 ' entity='osd.8' 2024-08-31T06:42:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:42:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:42:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: osdmap e52: 9 total, 8 up, 9 in 2024-08-31T06:42:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:42:40.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:42:40.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:40.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:39 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:40.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:42:40.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:42:40.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: osdmap e52: 9 total, 8 up, 9 in 2024-08-31T06:42:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:42:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:42:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:39 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:42:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:42:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: osdmap e52: 9 total, 8 up, 9 in 2024-08-31T06:42:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:42:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:42:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:42:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:39 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:41.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:40 smithi037 ceph-mon[18612]: osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] boot 2024-08-31T06:42:41.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:40 smithi037 ceph-mon[18612]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T06:42:41.252 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:41.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:40 smithi106 ceph-mon[22134]: osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] boot 2024-08-31T06:42:41.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:40 smithi106 ceph-mon[22134]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T06:42:41.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:41.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:40 smithi066 ceph-mon[22244]: osd.8 [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] boot 2024-08-31T06:42:41.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:40 smithi066 ceph-mon[22244]: osdmap e53: 9 total, 9 up, 9 in 2024-08-31T06:42:41.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-31T06:42:42.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:41 smithi037 ceph-mon[18612]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:42.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:41 smithi037 ceph-mon[18612]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T06:42:42.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:41 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4063724703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c4c51ea-50dc-4c66-b1d9-df31b57d49fc"} : dispatch 2024-08-31T06:42:42.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:41 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4063724703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c4c51ea-50dc-4c66-b1d9-df31b57d49fc"}]': finished 2024-08-31T06:42:42.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:41 smithi037 ceph-mon[18612]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T06:42:42.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:42:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:41 smithi106 ceph-mon[22134]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:41 smithi106 ceph-mon[22134]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T06:42:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:41 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4063724703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c4c51ea-50dc-4c66-b1d9-df31b57d49fc"} : dispatch 2024-08-31T06:42:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:41 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4063724703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c4c51ea-50dc-4c66-b1d9-df31b57d49fc"}]': finished 2024-08-31T06:42:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:41 smithi106 ceph-mon[22134]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T06:42:42.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:42:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:41 smithi066 ceph-mon[22244]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 233 MiB used, 715 GiB / 715 GiB avail 2024-08-31T06:42:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:41 smithi066 ceph-mon[22244]: osdmap e54: 9 total, 9 up, 9 in 2024-08-31T06:42:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:41 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4063724703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5c4c51ea-50dc-4c66-b1d9-df31b57d49fc"} : dispatch 2024-08-31T06:42:42.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:41 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4063724703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5c4c51ea-50dc-4c66-b1d9-df31b57d49fc"}]': finished 2024-08-31T06:42:42.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:41 smithi066 ceph-mon[22244]: osdmap e55: 10 total, 9 up, 10 in 2024-08-31T06:42:42.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:42:43.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:42 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1229549076' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:42:43.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:42 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1229549076' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:42:43.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:42 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1229549076' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:42:44.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:43 smithi106 ceph-mon[22134]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:42:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:43 smithi037 ceph-mon[18612]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:42:44.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:43 smithi066 ceph-mon[22244]: pgmap v175: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:42:46.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:45 smithi106 ceph-mon[22134]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:42:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:45 smithi037 ceph-mon[18612]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:42:46.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:45 smithi066 ceph-mon[22244]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:42:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:47 smithi037 ceph-mon[18612]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T06:42:48.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:47 smithi106 ceph-mon[22134]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T06:42:48.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:47 smithi066 ceph-mon[22244]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-31T06:42:50.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:49 smithi106 ceph-mon[22134]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:42:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:49 smithi037 ceph-mon[18612]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:42:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:49 smithi066 ceph-mon[22244]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:42:51.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T06:42:51.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:51.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T06:42:51.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:51.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-31T06:42:51.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:42:52.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:51 smithi037 ceph-mon[18612]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T06:42:52.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:51 smithi037 ceph-mon[18612]: Deploying daemon osd.9 on smithi037 2024-08-31T06:42:52.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:51 smithi106 ceph-mon[22134]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T06:42:52.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:51 smithi106 ceph-mon[22134]: Deploying daemon osd.9 on smithi037 2024-08-31T06:42:52.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:51 smithi066 ceph-mon[22244]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-31T06:42:52.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:51 smithi066 ceph-mon[22244]: Deploying daemon osd.9 on smithi037 2024-08-31T06:42:54.260 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:53 smithi037 ceph-mon[18612]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-31T06:42:54.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:53 smithi106 ceph-mon[22134]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-31T06:42:54.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:53 smithi066 ceph-mon[22244]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-31T06:42:56.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:55 smithi037 ceph-mon[18612]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:42:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:55 smithi106 ceph-mon[22134]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:42:56.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:55 smithi066 ceph-mon[22244]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:42:57.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:57.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:57.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:57.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:42:57.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:57.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:42:58.099 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:42:58 smithi037 ceph-mon[18612]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:42:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:42:58 smithi106 ceph-mon[22134]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:42:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:42:58 smithi066 ceph-mon[22244]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:43:00.025 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 9 on host 'smithi037' 2024-08-31T06:43:00.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.023+0000 7f23feffd640 1 -- 172.21.15.37:0/1480403330 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f240810b970 con 0x7f23f40b4c00 2024-08-31T06:43:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f23f40b4c00 msgr2=0x7f23f40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:00.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f23f40b4c00 0x7f23f40b7110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2404009bd0 tx=0x7f2404005f90 comp rx=0 tx=0).stop 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 msgr2=0x7f240819f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 0x7f240819f9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2400005cc0 tx=0x7f2400003f90 comp rx=0 tx=0).stop 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 shutdown_connections 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f23f40b4c00 0x7f23f40b7110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2408108b10 0x7f240819f9c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24081081c0 0x7f240819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 --2- 172.21.15.37:0/1480403330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2408102880 0x7f240819a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 >> 172.21.15.37:0/1480403330 conn(0x7f2408079510 msgr2=0x7f2408101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 shutdown_connections 2024-08-31T06:43:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:00.026+0000 7f240fc94640 1 -- 172.21.15.37:0/1480403330 wait complete. 2024-08-31T06:43:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:00 smithi106 ceph-mon[22134]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:00.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:00.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:00 smithi037 ceph-mon[18612]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:00.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:00.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:00.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:00 smithi066 ceph-mon[22244]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:00.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:00.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:00.671 DEBUG:teuthology.orchestra.run.smithi037:osd.9> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.9.service 2024-08-31T06:43:00.715 INFO:tasks.cephadm:Deploying osd.10 on smithi066 with /dev/vg_nvme/lv_1... 2024-08-31T06:43:00.715 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T06:43:00.985 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:43:01.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:01.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:01.343 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:01.343 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:02.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:02 smithi037 ceph-mon[18612]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:02.121 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:02 smithi066 ceph-mon[22244]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:02.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:02 smithi106 ceph-mon[22134]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:02.605 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:43:02 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:43:02.243+0000 7f2e81d28640 -1 osd.9 0 log_to_monitors true 2024-08-31T06:43:03.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:03 smithi066 ceph-mon[22244]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T06:43:03.251 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:03 smithi037 ceph-mon[18612]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T06:43:03.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:03 smithi106 ceph-mon[22134]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-31T06:43:03.632 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-08-31T06:43:03.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_1 2024-08-31T06:43:03.927 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:43:04.188 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:04.188 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T06:43:04.188 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T06:43:04.188 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:43:04.188 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:04.188 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:04.189 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:04.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T06:43:04.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:04.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.355 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:43:04.039+0000 7f2e7dcaa640 -1 osd.9 0 waiting for initial osdmap 2024-08-31T06:43:04.355 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:43:04.053+0000 7f2e79aa8640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:43:04.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:04.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-31T06:43:04.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: osdmap e56: 10 total, 9 up, 10 in 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:04.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.369+0000 7fe60073a640 1 -- 172.21.15.66:0/1018770878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 msgr2=0x7fe5f8102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.369+0000 7fe60073a640 1 --2- 172.21.15.66:0/1018770878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 0x7fe5f8102800 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009900 tx=0x7fe5f402a480 comp rx=0 tx=0).stop 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 -- 172.21.15.66:0/1018770878 shutdown_connections 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 --2- 172.21.15.66:0/1018770878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5f810ffa0 0x7fe5f81123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 --2- 172.21.15.66:0/1018770878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f8102d40 0x7fe5f810fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 --2- 172.21.15.66:0/1018770878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 0x7fe5f8102800 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 -- 172.21.15.66:0/1018770878 >> 172.21.15.66:0/1018770878 conn(0x7fe5f80794d0 msgr2=0x7fe5f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 -- 172.21.15.66:0/1018770878 shutdown_connections 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 -- 172.21.15.66:0/1018770878 wait complete. 2024-08-31T06:43:04.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 Processor -- start 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.370+0000 7fe60073a640 1 -- start start 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe60073a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 0x7fe5f819c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe60073a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f8102d40 0x7fe5f819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe60073a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5f810ffa0 0x7fe5f81a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe60073a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f81158c0 con 0x7fe5f810ffa0 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe60073a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8115740 con 0x7fe5f81023f0 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe60073a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8115a40 con 0x7fe5f8102d40 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 0x7fe5f819c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 0x7fe5f819c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49846/0 (socket says 172.21.15.66:49846) 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 -- 172.21.15.66:0/2153703286 learned_addr learned my addr 172.21.15.66:0/2153703286 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fdcd5640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f8102d40 0x7fe5f819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fecd7640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5f810ffa0 0x7fe5f81a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 -- 172.21.15.66:0/2153703286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f8102d40 msgr2=0x7fe5f819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:04.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f8102d40 0x7fe5f819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 -- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5f810ffa0 msgr2=0x7fe5f81a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5f810ffa0 0x7fe5f81a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 -- 172.21.15.66:0/2153703286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f81a22a0 con 0x7fe5f81023f0 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fecd7640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5f810ffa0 0x7fe5f81a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.371+0000 7fe5fe4d6640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 0x7fe5f819c330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009230 tx=0x7fe5f4004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.372+0000 7fe5ef7fe640 1 -- 172.21.15.66:0/2153703286 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f403f030 con 0x7fe5f81023f0 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.372+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f81a2530 con 0x7fe5f81023f0 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.372+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f81a8cf0 con 0x7fe5f81023f0 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.372+0000 7fe5ef7fe640 1 -- 172.21.15.66:0/2153703286 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5f4003a80 con 0x7fe5f81023f0 2024-08-31T06:43:04.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.372+0000 7fe5ef7fe640 1 -- 172.21.15.66:0/2153703286 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4035070 con 0x7fe5f81023f0 2024-08-31T06:43:04.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.373+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f8102800 con 0x7fe5f81023f0 2024-08-31T06:43:04.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.374+0000 7fe5ef7fe640 1 -- 172.21.15.66:0/2153703286 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fe5f4042030 con 0x7fe5f81023f0 2024-08-31T06:43:04.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.375+0000 7fe5ef7fe640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe5e40b4b80 0x7fe5e40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:04.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.375+0000 7fe5ef7fe640 1 -- 172.21.15.66:0/2153703286 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6196+0+0 (secure 0 0 0) 0x7fe5f4105500 con 0x7fe5f81023f0 2024-08-31T06:43:04.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.375+0000 7fe5fdcd5640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe5e40b4b80 0x7fe5e40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:04.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.376+0000 7fe5fdcd5640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe5e40b4b80 0x7fe5e40b7090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8079db0 tx=0x7fe5e800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:04.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.378+0000 7fe5ef7fe640 1 -- 172.21.15.66:0/2153703286 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe5f40cce70 con 0x7fe5f81023f0 2024-08-31T06:43:04.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:04.576+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe5f80635a0 con 0x7fe5e40b4b80 2024-08-31T06:43:05.235 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi037 2024-08-31T06:43:05.235 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi037 to 4273M 2024-08-31T06:43:05.235 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:43:05.235 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T06:43:05.235 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:05.235 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:05.236 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:43:05.236 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:43:05.236 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:05.236 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:05.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi037 2024-08-31T06:43:05.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi037 to 4273M 2024-08-31T06:43:05.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:43:05.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T06:43:05.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:05.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:05.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:43:05.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:43:05.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:05.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi037 2024-08-31T06:43:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi037 to 4273M 2024-08-31T06:43:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: from='osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-31T06:43:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: osdmap e57: 10 total, 9 up, 10 in 2024-08-31T06:43:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:05.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:43:05.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:43:05.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:05.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:06.277 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:06 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:43:06.277 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:06 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:43:06.277 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:06 smithi066 ceph-mon[22244]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:06.277 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:06 smithi066 ceph-mon[22244]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:06.277 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:06 smithi066 ceph-mon[22244]: osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] boot 2024-08-31T06:43:06.277 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:06 smithi066 ceph-mon[22244]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T06:43:06.277 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:06 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:06 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:43:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:06 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:43:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:06 smithi106 ceph-mon[22134]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:06 smithi106 ceph-mon[22134]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:06 smithi106 ceph-mon[22134]: osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] boot 2024-08-31T06:43:06.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:06 smithi106 ceph-mon[22134]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T06:43:06.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:06 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:06 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:43:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:06 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:43:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:06 smithi037 ceph-mon[18612]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-31T06:43:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:06 smithi037 ceph-mon[18612]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:06 smithi037 ceph-mon[18612]: osd.9 [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] boot 2024-08-31T06:43:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:06 smithi037 ceph-mon[18612]: osdmap e58: 10 total, 10 up, 10 in 2024-08-31T06:43:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:06 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-31T06:43:07.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:07 smithi106 ceph-mon[22134]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T06:43:07.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:07 smithi106 ceph-mon[22134]: from='client.? 172.21.15.66:0/2876114420' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"} : dispatch 2024-08-31T06:43:07.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:07 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"} : dispatch 2024-08-31T06:43:07.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:07 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"}]': finished 2024-08-31T06:43:07.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:07 smithi106 ceph-mon[22134]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T06:43:07.320 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:07 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:07.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:07 smithi037 ceph-mon[18612]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T06:43:07.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:07 smithi037 ceph-mon[18612]: from='client.? 172.21.15.66:0/2876114420' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"} : dispatch 2024-08-31T06:43:07.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:07 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"} : dispatch 2024-08-31T06:43:07.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:07 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"}]': finished 2024-08-31T06:43:07.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:07 smithi037 ceph-mon[18612]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T06:43:07.363 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:07 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:07.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:07 smithi066 ceph-mon[22244]: osdmap e59: 10 total, 10 up, 10 in 2024-08-31T06:43:07.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:07 smithi066 ceph-mon[22244]: from='client.? 172.21.15.66:0/2876114420' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"} : dispatch 2024-08-31T06:43:07.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:07 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"} : dispatch 2024-08-31T06:43:07.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:07 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "efb68c30-0c02-405f-a72f-27e68fafd2dd"}]': finished 2024-08-31T06:43:07.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:07 smithi066 ceph-mon[22244]: osdmap e60: 11 total, 10 up, 11 in 2024-08-31T06:43:07.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:07 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:08 smithi106 ceph-mon[22134]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:08 smithi106 ceph-mon[22134]: from='client.? 172.21.15.66:0/2986461209' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:43:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:08 smithi037 ceph-mon[18612]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:08 smithi037 ceph-mon[18612]: from='client.? 172.21.15.66:0/2986461209' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:43:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:08 smithi066 ceph-mon[22244]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:08 smithi066 ceph-mon[22244]: from='client.? 172.21.15.66:0/2986461209' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:43:10.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:10 smithi037 ceph-mon[18612]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:10.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:10 smithi066 ceph-mon[22244]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:10.570 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:10 smithi106 ceph-mon[22134]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:12.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:12 smithi106 ceph-mon[22134]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:12.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:12 smithi037 ceph-mon[18612]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:12.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:12 smithi066 ceph-mon[22244]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:14.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:14 smithi037 ceph-mon[18612]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:14 smithi066 ceph-mon[22244]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:14.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:14 smithi106 ceph-mon[22134]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:16 smithi037 ceph-mon[18612]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T06:43:16.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:16 smithi066 ceph-mon[22244]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T06:43:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:16.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:16 smithi106 ceph-mon[22134]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:16.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-31T06:43:16.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:17 smithi037 ceph-mon[18612]: Deploying daemon osd.10 on smithi066 2024-08-31T06:43:17.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:17 smithi066 ceph-mon[22244]: Deploying daemon osd.10 on smithi066 2024-08-31T06:43:17.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:17 smithi106 ceph-mon[22134]: Deploying daemon osd.10 on smithi066 2024-08-31T06:43:18.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:18 smithi037 ceph-mon[18612]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:18.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:18 smithi066 ceph-mon[22244]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:18.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:18 smithi106 ceph-mon[22134]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:20 smithi066 ceph-mon[22244]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:20.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:20 smithi037 ceph-mon[18612]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:20.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:20 smithi106 ceph-mon[22134]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:22.260 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:22 smithi066 ceph-mon[22244]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:22.260 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:22 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:22.260 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:22 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:22.260 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:22 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:22.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:22 smithi037 ceph-mon[18612]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:22.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:22 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:22.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:22 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:22.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:22 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:22.571 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:22 smithi106 ceph-mon[22134]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:22.571 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:22 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:22.571 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:22 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:22.571 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:22 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:24.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:24 smithi037 ceph-mon[18612]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:24 smithi066 ceph-mon[22244]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:24.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:24 smithi106 ceph-mon[22134]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:24.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.996+0000 7fe5ef7fe640 1 -- 172.21.15.66:0/2153703286 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe5f80635a0 con 0x7fe5e40b4b80 2024-08-31T06:43:24.998 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 10 on host 'smithi066' 2024-08-31T06:43:25.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.998+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe5e40b4b80 msgr2=0x7fe5e40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.998+0000 7fe60073a640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe5e40b4b80 0x7fe5e40b7090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8079db0 tx=0x7fe5e800b390 comp rx=0 tx=0).stop 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 msgr2=0x7fe5f819c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 0x7fe5f819c330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4009230 tx=0x7fe5f4004270 comp rx=0 tx=0).stop 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 shutdown_connections 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe5e40b4b80 0x7fe5e40b7090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5f810ffa0 0x7fe5f81a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f8102d40 0x7fe5f819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 --2- 172.21.15.66:0/2153703286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5f81023f0 0x7fe5f819c330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 >> 172.21.15.66:0/2153703286 conn(0x7fe5f80794d0 msgr2=0x7fe5f8111450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 shutdown_connections 2024-08-31T06:43:25.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-08-31T06:43:24.999+0000 7fe60073a640 1 -- 172.21.15.66:0/2153703286 wait complete. 2024-08-31T06:43:25.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:25.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:25.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:25.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:25.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.593 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:25.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:25.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:25.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:25.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:25.620 DEBUG:teuthology.orchestra.run.smithi066:osd.10> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.10.service 2024-08-31T06:43:25.623 INFO:tasks.cephadm:Deploying osd.11 on smithi106 with /dev/vg_nvme/lv_1... 2024-08-31T06:43:25.623 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-31T06:43:25.877 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:43:27.283 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:27 smithi106 ceph-mon[22134]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:27.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:27 smithi066 ceph-mon[22244]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:27.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:27 smithi037 ceph-mon[18612]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:28.138 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:43:27 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:43:27.818+0000 7fbf7651f640 -1 osd.10 0 log_to_monitors true 2024-08-31T06:43:28.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:28 smithi106 ceph-mon[22134]: from='osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:43:28.335 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:28 smithi106 ceph-mon[22134]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:43:28.340 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-08-31T06:43:28.363 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch daemon add osd smithi106:vg_nvme/lv_1 2024-08-31T06:43:28.440 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:28 smithi066 ceph-mon[22244]: from='osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:43:28.440 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:28 smithi066 ceph-mon[22244]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:43:28.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:28 smithi037 ceph-mon[18612]: from='osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:43:28.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:28 smithi037 ceph-mon[18612]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-31T06:43:28.615 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:43:29.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 -- 172.21.15.106:0/3091697669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 msgr2=0x7faca4109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:29.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 --2- 172.21.15.106:0/3091697669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 0x7faca4109690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fac8c009900 tx=0x7fac8c02a410 comp rx=0 tx=0).stop 2024-08-31T06:43:29.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 -- 172.21.15.106:0/3091697669 shutdown_connections 2024-08-31T06:43:29.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 --2- 172.21.15.106:0/3091697669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faca4109bd0 0x7faca4110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:29.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 --2- 172.21.15.106:0/3091697669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 0x7faca4109690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:29.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 --2- 172.21.15.106:0/3091697669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca4103940 0x7faca4103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:29.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 -- 172.21.15.106:0/3091697669 >> 172.21.15.106:0/3091697669 conn(0x7faca40ff3d0 msgr2=0x7faca4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:29.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 -- 172.21.15.106:0/3091697669 shutdown_connections 2024-08-31T06:43:29.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.124+0000 7faca8d39640 1 -- 172.21.15.106:0/3091697669 wait complete. 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.125+0000 7faca8d39640 1 Processor -- start 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.125+0000 7faca8d39640 1 -- start start 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca8d39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca4103940 0x7faca419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca8d39640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 0x7faca419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca8d39640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faca4109bd0 0x7faca419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca8d39640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faca4113740 con 0x7faca4103940 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca8d39640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faca41135c0 con 0x7faca4109bd0 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca8d39640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faca41138c0 con 0x7faca4109280 2024-08-31T06:43:29.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 0x7faca419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 0x7faca419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:45624/0 (socket says 172.21.15.106:45624) 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 -- 172.21.15.106:0/638667028 learned_addr learned my addr 172.21.15.106:0/638667028 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca2d9d640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faca4109bd0 0x7faca419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca259c640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca4103940 0x7faca419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 -- 172.21.15.106:0/638667028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faca4109bd0 msgr2=0x7faca419f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faca4109bd0 0x7faca419f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 -- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca4103940 msgr2=0x7faca419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca4103940 0x7faca419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 -- 172.21.15.106:0/638667028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca41a00e0 con 0x7faca4109280 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.126+0000 7faca1d9b640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 0x7faca419a710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fac8c005940 tx=0x7fac8c0040e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.127+0000 7fac9b7fe640 1 -- 172.21.15.106:0/638667028 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c03f030 con 0x7faca4109280 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.127+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca41a0370 con 0x7faca4109280 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.127+0000 7fac9b7fe640 1 -- 172.21.15.106:0/638667028 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac8c003a80 con 0x7faca4109280 2024-08-31T06:43:29.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.127+0000 7fac9b7fe640 1 -- 172.21.15.106:0/638667028 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c035070 con 0x7faca4109280 2024-08-31T06:43:29.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.127+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca41a6b30 con 0x7faca4109280 2024-08-31T06:43:29.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.128+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca4103d50 con 0x7faca4109280 2024-08-31T06:43:29.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.130+0000 7fac9b7fe640 1 -- 172.21.15.106:0/638667028 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fac8c042030 con 0x7faca4109280 2024-08-31T06:43:29.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.131+0000 7fac9b7fe640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fac900b4b80 0x7fac900b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:29.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.131+0000 7fac9b7fe640 1 -- 172.21.15.106:0/638667028 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6613+0+0 (secure 0 0 0) 0x7fac8c105390 con 0x7faca4109280 2024-08-31T06:43:29.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.131+0000 7faca259c640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fac900b4b80 0x7fac900b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:29.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.132+0000 7faca259c640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fac900b4b80 0x7fac900b7090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0058c0 tx=0x7fac9c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:29.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.133+0000 7fac9b7fe640 1 -- 172.21.15.106:0/638667028 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fac8c0cc510 con 0x7faca4109280 2024-08-31T06:43:29.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:29.327+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7faca410b9f0 con 0x7fac900b4b80 2024-08-31T06:43:29.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:29.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T06:43:29.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:43:29.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T06:43:29.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:29.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi066 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi066 to 4272M 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:29.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:29 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T06:43:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:43:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T06:43:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:43:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi066 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi066 to 4272M 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:29.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:29 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:43:29.247+0000 7fbf724a1640 -1 osd.10 0 waiting for initial osdmap 2024-08-31T06:43:29.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:43:29.264+0000 7fbf6e29f640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: osdmap e61: 11 total, 10 up, 11 in 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]} : dispatch 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi066 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:29.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi066 to 4272M 2024-08-31T06:43:29.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:29.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:29.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:29.639 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:29 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:30.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:30 smithi106 ceph-mon[22134]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:43:30.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:30 smithi106 ceph-mon[22134]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T06:43:30.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:30 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:30.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:30 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:30.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:30 smithi106 ceph-mon[22134]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:30.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:30 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:43:30.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:30 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:43:30.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:30 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:30.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:30 smithi037 ceph-mon[18612]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:43:30.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:30 smithi037 ceph-mon[18612]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T06:43:30.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:30 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:30.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:30 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:30.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:30 smithi037 ceph-mon[18612]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:30.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:30 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:43:30.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:30 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:43:30.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:30 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:30.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:30 smithi066 ceph-mon[22244]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-08-31T06:43:30.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:30 smithi066 ceph-mon[22244]: osdmap e62: 11 total, 10 up, 11 in 2024-08-31T06:43:30.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:30 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:30.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:30 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:30.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:30 smithi066 ceph-mon[22244]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi106:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:30.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:30 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-31T06:43:30.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:30 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-31T06:43:30.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:30 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:31.538 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:31 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:43:31.538 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:31 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:43:31.539 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:31 smithi066 ceph-mon[22244]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:31.539 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:31.539 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:31 smithi066 ceph-mon[22244]: osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] boot 2024-08-31T06:43:31.539 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:31 smithi066 ceph-mon[22244]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T06:43:31.539 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:31 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:43:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:31 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:43:31.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:31 smithi106 ceph-mon[22134]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:31.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:31.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:31 smithi106 ceph-mon[22134]: osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] boot 2024-08-31T06:43:31.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:31 smithi106 ceph-mon[22134]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T06:43:31.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:31.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:31 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:43:31.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:31 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:43:31.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:31 smithi037 ceph-mon[18612]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-31T06:43:31.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:31.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:31 smithi037 ceph-mon[18612]: osd.10 [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] boot 2024-08-31T06:43:31.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:31 smithi037 ceph-mon[18612]: osdmap e63: 11 total, 11 up, 11 in 2024-08-31T06:43:31.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-31T06:43:32.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:32 smithi106 ceph-mon[22134]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T06:43:32.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:32 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/3767412497' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"} : dispatch 2024-08-31T06:43:32.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:32 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"} : dispatch 2024-08-31T06:43:32.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:32 smithi106 ceph-mon[22134]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"}]': finished 2024-08-31T06:43:32.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:32 smithi106 ceph-mon[22134]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T06:43:32.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:32 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:32.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:32 smithi037 ceph-mon[18612]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T06:43:32.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:32 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/3767412497' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"} : dispatch 2024-08-31T06:43:32.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:32 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"} : dispatch 2024-08-31T06:43:32.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:32 smithi037 ceph-mon[18612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"}]': finished 2024-08-31T06:43:32.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:32 smithi037 ceph-mon[18612]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T06:43:32.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:32 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:32.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:32 smithi066 ceph-mon[22244]: osdmap e64: 11 total, 11 up, 11 in 2024-08-31T06:43:32.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:32 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/3767412497' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"} : dispatch 2024-08-31T06:43:32.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:32 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"} : dispatch 2024-08-31T06:43:32.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:32 smithi066 ceph-mon[22244]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da1db38f-04d8-4166-bc6a-fe685341d706"}]': finished 2024-08-31T06:43:32.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:32 smithi066 ceph-mon[22244]: osdmap e65: 12 total, 11 up, 12 in 2024-08-31T06:43:32.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:32 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:33.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:33 smithi106 ceph-mon[22134]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:33.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:33 smithi106 ceph-mon[22134]: from='client.? 172.21.15.106:0/820130171' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:43:33.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:33 smithi037 ceph-mon[18612]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:33.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:33 smithi037 ceph-mon[18612]: from='client.? 172.21.15.106:0/820130171' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:43:33.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:33 smithi066 ceph-mon[22244]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:33.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:33 smithi066 ceph-mon[22244]: from='client.? 172.21.15.106:0/820130171' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-31T06:43:35.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:35 smithi106 ceph-mon[22134]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:35.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:35 smithi037 ceph-mon[18612]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:35.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:35 smithi066 ceph-mon[22244]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:37.473 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:37 smithi106 ceph-mon[22134]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:43:37.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:37 smithi037 ceph-mon[18612]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:43:37.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:37 smithi066 ceph-mon[22244]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 323 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-31T06:43:39.456 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:39 smithi106 ceph-mon[22134]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:43:39.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:39 smithi037 ceph-mon[18612]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:43:39.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:39 smithi066 ceph-mon[22244]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-31T06:43:41.459 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:41 smithi106 ceph-mon[22134]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-08-31T06:43:41.460 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T06:43:41.460 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:41 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:41.460 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:41 smithi106 ceph-mon[22134]: Deploying daemon osd.11 on smithi106 2024-08-31T06:43:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:41 smithi037 ceph-mon[18612]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-08-31T06:43:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T06:43:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:41 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:41.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:41 smithi037 ceph-mon[18612]: Deploying daemon osd.11 on smithi106 2024-08-31T06:43:41.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:41 smithi066 ceph-mon[22244]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-08-31T06:43:41.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-31T06:43:41.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:41 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:41.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:41 smithi066 ceph-mon[22244]: Deploying daemon osd.11 on smithi106 2024-08-31T06:43:43.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:43 smithi106 ceph-mon[22134]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-31T06:43:43.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:43 smithi037 ceph-mon[18612]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-31T06:43:43.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:43 smithi066 ceph-mon[22244]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-31T06:43:45.478 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:45 smithi106 ceph-mon[22134]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:43:45.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:45 smithi037 ceph-mon[18612]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:43:45.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:45 smithi066 ceph-mon[22244]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:43:46.498 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:46.498 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:46.498 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:46 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:46.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:46.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:46.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:46 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:46.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:46.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:46.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:46 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:47.999 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:47 smithi106 ceph-mon[22134]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:43:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:47 smithi037 ceph-mon[18612]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:43:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:47 smithi066 ceph-mon[22244]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-31T06:43:49.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.391+0000 7fac9b7fe640 1 -- 172.21.15.106:0/638667028 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7faca410b9f0 con 0x7fac900b4b80 2024-08-31T06:43:49.393 INFO:teuthology.orchestra.run.smithi106.stdout:Created osd(s) 11 on host 'smithi106' 2024-08-31T06:43:49.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fac900b4b80 msgr2=0x7fac900b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:49.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fac900b4b80 0x7fac900b7090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0058c0 tx=0x7fac9c00a2d0 comp rx=0 tx=0).stop 2024-08-31T06:43:49.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 msgr2=0x7faca419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:49.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 0x7faca419a710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fac8c005940 tx=0x7fac8c0040e0 comp rx=0 tx=0).stop 2024-08-31T06:43:49.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 shutdown_connections 2024-08-31T06:43:49.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fac900b4b80 0x7fac900b7090 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:49.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faca4109bd0 0x7faca419f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:49.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca4109280 0x7faca419a710 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:49.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 --2- 172.21.15.106:0/638667028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca4103940 0x7faca419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:49.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 >> 172.21.15.106:0/638667028 conn(0x7faca40ff3d0 msgr2=0x7faca41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:49.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 shutdown_connections 2024-08-31T06:43:49.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:49.394+0000 7faca8d39640 1 -- 172.21.15.106:0/638667028 wait complete. 2024-08-31T06:43:50.033 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:50.033 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.033 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.033 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:50.033 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:50.034 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.034 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:50.034 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.034 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:49 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.060 DEBUG:teuthology.orchestra.run.smithi106:osd.11> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.11.service 2024-08-31T06:43:50.063 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-31T06:43:50.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.091 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:49 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:50.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:50.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:50.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:50.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:49 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:50.325 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:43:50.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 -- 172.21.15.37:0/2585391107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b41081c0 msgr2=0x7f22b41085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:50.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/2585391107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b41081c0 0x7f22b41085d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009900 tx=0x7f22a802a410 comp rx=0 tx=0).stop 2024-08-31T06:43:50.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 -- 172.21.15.37:0/2585391107 shutdown_connections 2024-08-31T06:43:50.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/2585391107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b41081c0 0x7f22b41085d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:50.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/2585391107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22b4108b10 0x7f22b410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:50.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/2585391107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22b4102880 0x7f22b4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:50.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 -- 172.21.15.37:0/2585391107 >> 172.21.15.37:0/2585391107 conn(0x7f22b4079510 msgr2=0x7f22b4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:50.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 -- 172.21.15.37:0/2585391107 shutdown_connections 2024-08-31T06:43:50.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.837+0000 7f22bb3bd640 1 -- 172.21.15.37:0/2585391107 wait complete. 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.838+0000 7f22bb3bd640 1 Processor -- start 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.838+0000 7f22bb3bd640 1 -- start start 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22bb3bd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22b4102880 0x7f22b4199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22bb3bd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22b41081c0 0x7f22b4199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22bb3bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b4108b10 0x7f22b419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22bb3bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22b4112630 con 0x7f22b4108b10 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22bb3bd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41124b0 con 0x7f22b4102880 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22bb3bd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f22b41127b0 con 0x7f22b41081c0 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b4108b10 0x7f22b419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b4108b10 0x7f22b419e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54694/0 (socket says 172.21.15.37:54694) 2024-08-31T06:43:50.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 -- 172.21.15.37:0/1774753760 learned_addr learned my addr 172.21.15.37:0/1774753760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b8958640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22b41081c0 0x7f22b4199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b9159640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22b4102880 0x7f22b4199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 -- 172.21.15.37:0/1774753760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22b41081c0 msgr2=0x7f22b4199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22b41081c0 0x7f22b4199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 -- 172.21.15.37:0/1774753760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22b4102880 msgr2=0x7f22b4199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22b4102880 0x7f22b4199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 -- 172.21.15.37:0/1774753760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b419f0d0 con 0x7f22b4108b10 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b9159640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22b4102880 0x7f22b4199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22b995a640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b4108b10 0x7f22b419e9a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00eb10 tx=0x7f22ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22a67fc640 1 -- 172.21.15.37:0/1774753760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac004b20 con 0x7f22b4108b10 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22a67fc640 1 -- 172.21.15.37:0/1774753760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22ac004cc0 con 0x7f22b4108b10 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b419f3c0 con 0x7f22b4108b10 2024-08-31T06:43:50.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.839+0000 7f22a67fc640 1 -- 172.21.15.37:0/1774753760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ac010690 con 0x7f22b4108b10 2024-08-31T06:43:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.840+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b41a5b20 con 0x7f22b4108b10 2024-08-31T06:43:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.841+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b4103b00 con 0x7f22b4108b10 2024-08-31T06:43:50.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.842+0000 7f22a67fc640 1 -- 172.21.15.37:0/1774753760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f22ac005020 con 0x7f22b4108b10 2024-08-31T06:43:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.843+0000 7f22a67fc640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22a00b4b80 0x7f22a00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.843+0000 7f22b9159640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22a00b4b80 0x7f22a00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.843+0000 7f22a67fc640 1 -- 172.21.15.37:0/1774753760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7024+0+0 (secure 0 0 0) 0x7f22ac0e5310 con 0x7f22b4108b10 2024-08-31T06:43:50.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.843+0000 7f22b9159640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22a00b4b80 0x7f22a00b7090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009b50 tx=0x7f22b0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:50.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:50.847+0000 7f22a67fc640 1 -- 172.21.15.37:0/1774753760 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f22ac0ac8d0 con 0x7f22b4108b10 2024-08-31T06:43:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.037+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f22b410a950 con 0x7f22b4108b10 2024-08-31T06:43:51.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.037+0000 7f22a67fc640 1 -- 172.21.15.37:0/1774753760 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f22b410a950 con 0x7f22b4108b10 2024-08-31T06:43:51.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22a00b4b80 msgr2=0x7f22a00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22a00b4b80 0x7f22a00b7090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009b50 tx=0x7f22b0005f90 comp rx=0 tx=0).stop 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b4108b10 msgr2=0x7f22b419e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b4108b10 0x7f22b419e9a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00eb10 tx=0x7f22ac00c2d0 comp rx=0 tx=0).stop 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 shutdown_connections 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22a00b4b80 0x7f22a00b7090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22b4108b10 0x7f22b419e9a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22b41081c0 0x7f22b4199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 --2- 172.21.15.37:0/1774753760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22b4102880 0x7f22b4199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 >> 172.21.15.37:0/1774753760 conn(0x7f22b4079510 msgr2=0x7f22b4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 shutdown_connections 2024-08-31T06:43:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:51.039+0000 7f22bb3bd640 1 -- 172.21.15.37:0/1774753760 wait complete. 2024-08-31T06:43:51.663 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:43:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:43:51.613+0000 7efd5e760640 -1 osd.11 0 log_to_monitors true 2024-08-31T06:43:51.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:51 smithi037 ceph-mon[18612]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:51.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:51 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1774753760' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:43:51.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:51 smithi037 ceph-mon[18612]: from='osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:43:51.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:51 smithi037 ceph-mon[18612]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:43:51.924 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1725086610,"num_in_osds":12,"osd_in_since":1725086611,"num_remapped_pgs":0} 2024-08-31T06:43:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:51 smithi106 ceph-mon[22134]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:51 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1774753760' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:43:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:51 smithi106 ceph-mon[22134]: from='osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:43:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:51 smithi106 ceph-mon[22134]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:43:52.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:51 smithi066 ceph-mon[22244]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:52.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:51 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1774753760' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:43:52.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:51 smithi066 ceph-mon[22244]: from='osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:43:52.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:51 smithi066 ceph-mon[22244]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-31T06:43:52.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd stat -f json 2024-08-31T06:43:52.951 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:52 smithi037 ceph-mon[18612]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T06:43:52.951 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:52 smithi037 ceph-mon[18612]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T06:43:52.951 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:52.952 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:52 smithi037 ceph-mon[18612]: from='osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:43:52.952 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:52 smithi037 ceph-mon[18612]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:43:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:52 smithi106 ceph-mon[22134]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T06:43:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:52 smithi106 ceph-mon[22134]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T06:43:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:52 smithi106 ceph-mon[22134]: from='osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:43:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:52 smithi106 ceph-mon[22134]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:43:53.066 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:43:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:43:52.672+0000 7efd5a6e2640 -1 osd.11 0 waiting for initial osdmap 2024-08-31T06:43:53.066 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:43:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:43:52.686+0000 7efd564e0640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-31T06:43:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:52 smithi066 ceph-mon[22244]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-31T06:43:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:52 smithi066 ceph-mon[22244]: osdmap e66: 12 total, 11 up, 12 in 2024-08-31T06:43:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:52 smithi066 ceph-mon[22244]: from='osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:43:53.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:52 smithi066 ceph-mon[22244]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]} : dispatch 2024-08-31T06:43:53.182 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:43:53.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 -- 172.21.15.37:0/3394523330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108140 msgr2=0x7f6d50108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 --2- 172.21.15.37:0/3394523330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108140 0x7f6d50108550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009900 tx=0x7f6d3c02a410 comp rx=0 tx=0).stop 2024-08-31T06:43:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 -- 172.21.15.37:0/3394523330 shutdown_connections 2024-08-31T06:43:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 --2- 172.21.15.37:0/3394523330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108140 0x7f6d50108550 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 --2- 172.21.15.37:0/3394523330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d50108a90 0x7f6d5010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 --2- 172.21.15.37:0/3394523330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d50102800 0x7f6d50102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 -- 172.21.15.37:0/3394523330 >> 172.21.15.37:0/3394523330 conn(0x7f6d500794d0 msgr2=0x7f6d500798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 -- 172.21.15.37:0/3394523330 shutdown_connections 2024-08-31T06:43:53.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.649+0000 7f6d56e87640 1 -- 172.21.15.37:0/3394523330 wait complete. 2024-08-31T06:43:53.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d56e87640 1 Processor -- start 2024-08-31T06:43:53.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d56e87640 1 -- start start 2024-08-31T06:43:53.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d56e87640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d50102800 0x7f6d5019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d56e87640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d50108140 0x7f6d5019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d56e87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108a90 0x7f6d5019f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d56e87640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6d501136d0 con 0x7f6d50108a90 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d56e87640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6d50113550 con 0x7f6d50102800 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d56e87640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6d50113850 con 0x7f6d50108140 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d55424640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108a90 0x7f6d5019f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d55424640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108a90 0x7f6d5019f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54704/0 (socket says 172.21.15.37:54704) 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d55424640 1 -- 172.21.15.37:0/2569230401 learned_addr learned my addr 172.21.15.37:0/2569230401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d54c23640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d50102800 0x7f6d5019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.650+0000 7f6d4ffff640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d50108140 0x7f6d5019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:53.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d55424640 1 -- 172.21.15.37:0/2569230401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d50108140 msgr2=0x7f6d5019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d55424640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d50108140 0x7f6d5019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d55424640 1 -- 172.21.15.37:0/2569230401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d50102800 msgr2=0x7f6d5019a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d55424640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d50102800 0x7f6d5019a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d55424640 1 -- 172.21.15.37:0/2569230401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d501a0090 con 0x7f6d50108a90 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d55424640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108a90 0x7f6d5019f960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800eaa0 tx=0x7f6d4800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d4dffb640 1 -- 172.21.15.37:0/2569230401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800cdb0 con 0x7f6d50108a90 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d4dffb640 1 -- 172.21.15.37:0/2569230401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d48005020 con 0x7f6d50108a90 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d501a0380 con 0x7f6d50108a90 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d4dffb640 1 -- 172.21.15.37:0/2569230401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d480116d0 con 0x7f6d50108a90 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.651+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d501a6ae0 con 0x7f6d50108a90 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.652+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d50102c10 con 0x7f6d50108a90 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.654+0000 7f6d4dffb640 1 -- 172.21.15.37:0/2569230401 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f6d480051d0 con 0x7f6d50108a90 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.654+0000 7f6d4dffb640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d400b4c00 0x7f6d400b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:53.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.654+0000 7f6d54c23640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d400b4c00 0x7f6d400b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:53.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.654+0000 7f6d4dffb640 1 -- 172.21.15.37:0/2569230401 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7062+0+0 (secure 0 0 0) 0x7f6d480e4d80 con 0x7f6d50108a90 2024-08-31T06:43:53.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.655+0000 7f6d54c23640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d400b4c00 0x7f6d400b7110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d44005fd0 tx=0x7f6d4400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:53.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.659+0000 7f6d4dffb640 1 -- 172.21.15.37:0/2569230401 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6d48016030 con 0x7f6d50108a90 2024-08-31T06:43:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.847+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f6d5010a2f0 con 0x7f6d50108a90 2024-08-31T06:43:53.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:53.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:43:53.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T06:43:53.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:53.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:53.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: Detected new or changed devices on smithi106 2024-08-31T06:43:53.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi106 to 4272M 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:53.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:53 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.848+0000 7f6d4dffb640 1 -- 172.21.15.37:0/2569230401 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f6d480abd40 con 0x7f6d50108a90 2024-08-31T06:43:53.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d400b4c00 msgr2=0x7f6d400b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d400b4c00 0x7f6d400b7110 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d44005fd0 tx=0x7f6d4400b390 comp rx=0 tx=0).stop 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108a90 msgr2=0x7f6d5019f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108a90 0x7f6d5019f960 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800eaa0 tx=0x7f6d4800ef60 comp rx=0 tx=0).stop 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 shutdown_connections 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d400b4c00 0x7f6d400b7110 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d50108a90 0x7f6d5019f960 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d50108140 0x7f6d5019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 --2- 172.21.15.37:0/2569230401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d50102800 0x7f6d5019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.850+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 >> 172.21.15.37:0/2569230401 conn(0x7f6d500794d0 msgr2=0x7f6d50105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.851+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 shutdown_connections 2024-08-31T06:43:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:53.851+0000 7f6d56e87640 1 -- 172.21.15.37:0/2569230401 wait complete. 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: Detected new or changed devices on smithi106 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:54.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:54.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi106 to 4272M 2024-08-31T06:43:54.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:54.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:54.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:54.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:53 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi106", "root=default"]}]': finished 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: osdmap e67: 12 total, 11 up, 12 in 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: Detected new or changed devices on smithi106 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:43:54.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi106 to 4272M 2024-08-31T06:43:54.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:54.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:54.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:54.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:53 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:54.671 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1725086633,"num_in_osds":12,"osd_in_since":1725086611,"num_remapped_pgs":0} 2024-08-31T06:43:54.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:43:54.962 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:43:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:54 smithi106 ceph-mon[22134]: purged_snaps scrub starts 2024-08-31T06:43:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:54 smithi106 ceph-mon[22134]: purged_snaps scrub ok 2024-08-31T06:43:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:54 smithi106 ceph-mon[22134]: osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] boot 2024-08-31T06:43:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:54 smithi106 ceph-mon[22134]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T06:43:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:54 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:54 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2569230401' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:43:55.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:54 smithi037 ceph-mon[18612]: purged_snaps scrub starts 2024-08-31T06:43:55.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:54 smithi037 ceph-mon[18612]: purged_snaps scrub ok 2024-08-31T06:43:55.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:54 smithi037 ceph-mon[18612]: osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] boot 2024-08-31T06:43:55.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:54 smithi037 ceph-mon[18612]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T06:43:55.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:54 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:55.083 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:54 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2569230401' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:43:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:54 smithi066 ceph-mon[22244]: purged_snaps scrub starts 2024-08-31T06:43:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:54 smithi066 ceph-mon[22244]: purged_snaps scrub ok 2024-08-31T06:43:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:54 smithi066 ceph-mon[22244]: osd.11 [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] boot 2024-08-31T06:43:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:54 smithi066 ceph-mon[22244]: osdmap e68: 12 total, 12 up, 12 in 2024-08-31T06:43:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:54 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-31T06:43:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:54 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2569230401' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-31T06:43:55.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 -- 172.21.15.37:0/3266314814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 msgr2=0x7faeb0108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/3266314814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 0x7faeb0108570 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7faea4009900 tx=0x7faea402a410 comp rx=0 tx=0).stop 2024-08-31T06:43:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 -- 172.21.15.37:0/3266314814 shutdown_connections 2024-08-31T06:43:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/3266314814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 0x7faeb0108570 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/3266314814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb0108ab0 0x7faeb010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/3266314814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb0102820 0x7faeb0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 -- 172.21.15.37:0/3266314814 >> 172.21.15.37:0/3266314814 conn(0x7faeb00794e0 msgr2=0x7faeb00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 -- 172.21.15.37:0/3266314814 shutdown_connections 2024-08-31T06:43:55.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.408+0000 7faeb4bfe640 1 -- 172.21.15.37:0/3266314814 wait complete. 2024-08-31T06:43:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeb4bfe640 1 Processor -- start 2024-08-31T06:43:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeb4bfe640 1 -- start start 2024-08-31T06:43:55.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeb4bfe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb0102820 0x7faeb019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeb4bfe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 0x7faeb019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeb4bfe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb0108ab0 0x7faeb01a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeb4bfe640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faeb0112610 con 0x7faeb0108160 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeb4bfe640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faeb0112490 con 0x7faeb0102820 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeb4bfe640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faeb0112790 con 0x7faeb0108ab0 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeadd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 0x7faeb019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeadd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 0x7faeb019c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37244/0 (socket says 172.21.15.37:37244) 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.409+0000 7faeadd9b640 1 -- 172.21.15.37:0/286995676 learned_addr learned my addr 172.21.15.37:0/286995676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeae59c640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb0102820 0x7faeb019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeaed9d640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb0108ab0 0x7faeb01a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeadd9b640 1 -- 172.21.15.37:0/286995676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb0108ab0 msgr2=0x7faeb01a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeadd9b640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb0108ab0 0x7faeb01a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeadd9b640 1 -- 172.21.15.37:0/286995676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb0102820 msgr2=0x7faeb019c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:55.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeadd9b640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb0102820 0x7faeb019c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeadd9b640 1 -- 172.21.15.37:0/286995676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb01a2370 con 0x7faeb0108160 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeaed9d640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb0108ab0 0x7faeb01a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeadd9b640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 0x7faeb019c9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faea4005940 tx=0x7faea40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7fae9f7fe640 1 -- 172.21.15.37:0/286995676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea403f030 con 0x7faeb0108160 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7fae9f7fe640 1 -- 172.21.15.37:0/286995676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faea4003c90 con 0x7faeb0108160 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7fae9f7fe640 1 -- 172.21.15.37:0/286995676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea4035070 con 0x7faeb0108160 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faeb01a2600 con 0x7faeb0108160 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.410+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faeb01a8dc0 con 0x7faeb0108160 2024-08-31T06:43:55.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.411+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faeb0103aa0 con 0x7faeb0108160 2024-08-31T06:43:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.413+0000 7fae9f7fe640 1 -- 172.21.15.37:0/286995676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7faea4042030 con 0x7faeb0108160 2024-08-31T06:43:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.413+0000 7fae9f7fe640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae980b4c00 0x7fae980b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.414+0000 7faeae59c640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae980b4c00 0x7fae980b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.414+0000 7fae9f7fe640 1 -- 172.21.15.37:0/286995676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7faea41056c0 con 0x7faeb0108160 2024-08-31T06:43:55.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.414+0000 7faeae59c640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae980b4c00 0x7fae980b7110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faea0009990 tx=0x7faea0009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:55.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.418+0000 7fae9f7fe640 1 -- 172.21.15.37:0/286995676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faea40ccbc0 con 0x7faeb0108160 2024-08-31T06:43:55.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.603+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faeb019d530 con 0x7faeb0108160 2024-08-31T06:43:55.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.604+0000 7fae9f7fe640 1 -- 172.21.15.37:0/286995676 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18759 (secure 0 0 0) 0x7faea40cc4c0 con 0x7faeb0108160 2024-08-31T06:43:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:43:55.607 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:43:54.675973+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:43:55.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae980b4c00 msgr2=0x7fae980b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:55.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae980b4c00 0x7fae980b7110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7faea0009990 tx=0x7faea0009110 comp rx=0 tx=0).stop 2024-08-31T06:43:55.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 msgr2=0x7faeb019c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:55.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 0x7faeb019c9a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faea4005940 tx=0x7faea40042f0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 shutdown_connections 2024-08-31T06:43:55.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae980b4c00 0x7fae980b7110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faeb0108160 0x7faeb019c9a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb0108ab0 0x7faeb01a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 --2- 172.21.15.37:0/286995676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb0102820 0x7faeb019c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:55.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 >> 172.21.15.37:0/286995676 conn(0x7faeb00794e0 msgr2=0x7faeb006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:55.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 shutdown_connections 2024-08-31T06:43:55.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:55.606+0000 7faeb4bfe640 1 -- 172.21.15.37:0/286995676 wait complete. 2024-08-31T06:43:55.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:55 smithi037 ceph-mon[18612]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:55.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:55 smithi037 ceph-mon[18612]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T06:43:55.972 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:55 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/286995676' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:43:56.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:55 smithi106 ceph-mon[22134]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:56.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:55 smithi106 ceph-mon[22134]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T06:43:56.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:55 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/286995676' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:43:56.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:55 smithi066 ceph-mon[22244]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-31T06:43:56.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:55 smithi066 ceph-mon[22244]: osdmap e69: 12 total, 12 up, 12 in 2024-08-31T06:43:56.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:55 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/286995676' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:43:56.268 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T06:40:10.611808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T06:43:56.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-31T06:43:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:43:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/1420904037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 msgr2=0x7f7df41103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/1420904037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 0x7f7df41103c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009ca0 tx=0x7f7dec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:43:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/1420904037 shutdown_connections 2024-08-31T06:43:56.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/1420904037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 0x7f7df41103c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/1420904037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7df4109240 0x7f7df4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/1420904037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df4103900 0x7f7df4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/1420904037 >> 172.21.15.37:0/1420904037 conn(0x7f7df407b5f0 msgr2=0x7f7df407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/1420904037 shutdown_connections 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/1420904037 wait complete. 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.975+0000 7f7dfb2e3640 1 Processor -- start 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7dfb2e3640 1 -- start start 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7dfb2e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7df4103900 0x7f7df419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7dfb2e3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df4109240 0x7f7df419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7dfb2e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 0x7f7df419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7dfb2e3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7df4113750 con 0x7f7df4109b90 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7dfb2e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7df41135d0 con 0x7f7df4103900 2024-08-31T06:43:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7dfb2e3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7df41138d0 con 0x7f7df4109240 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df9880640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 0x7f7df419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df9880640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 0x7f7df419f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37264/0 (socket says 172.21.15.37:37264) 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df9880640 1 -- 172.21.15.37:0/2377551962 learned_addr learned my addr 172.21.15.37:0/2377551962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df887e640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df4109240 0x7f7df419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df907f640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7df4103900 0x7f7df419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df9880640 1 -- 172.21.15.37:0/2377551962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df4109240 msgr2=0x7f7df419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df9880640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df4109240 0x7f7df419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df9880640 1 -- 172.21.15.37:0/2377551962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7df4103900 msgr2=0x7f7df419a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df9880640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7df4103900 0x7f7df419a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df9880640 1 -- 172.21.15.37:0/2377551962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df41a0110 con 0x7f7df4109b90 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.976+0000 7f7df907f640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7df4103900 0x7f7df419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.977+0000 7f7df9880640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 0x7f7df419f9e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7dec005cc0 tx=0x7f7dec032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.977+0000 7f7de67fc640 1 -- 172.21.15.37:0/2377551962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec032e00 con 0x7f7df4109b90 2024-08-31T06:43:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.977+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df41a03a0 con 0x7f7df4109b90 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.977+0000 7f7de67fc640 1 -- 172.21.15.37:0/2377551962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dec0044d0 con 0x7f7df4109b90 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.977+0000 7f7de67fc640 1 -- 172.21.15.37:0/2377551962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dec030b70 con 0x7f7df4109b90 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.977+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df41a6b60 con 0x7f7df4109b90 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.978+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df4103d10 con 0x7f7df4109b90 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.979+0000 7f7de67fc640 1 -- 172.21.15.37:0/2377551962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f7dec030d10 con 0x7f7df4109b90 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.980+0000 7f7de67fc640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7de00b4b80 0x7f7de00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.980+0000 7f7df907f640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7de00b4b80 0x7f7de00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.980+0000 7f7de67fc640 1 -- 172.21.15.37:0/2377551962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f7dec1062a0 con 0x7f7df4109b90 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.981+0000 7f7df907f640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7de00b4b80 0x7f7de00b7090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7df0005fd0 tx=0x7f7df000b5f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:56.984+0000 7f7de67fc640 1 -- 172.21.15.37:0/2377551962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7dec0cd700 con 0x7f7df4109b90 2024-08-31T06:43:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.170+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7df410b3f0 con 0x7f7df4109b90 2024-08-31T06:43:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.170+0000 7f7de67fc640 1 -- 172.21.15.37:0/2377551962 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f7dec0cd000 con 0x7f7df4109b90 2024-08-31T06:43:57.173 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-08-31T06:43:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7de00b4b80 msgr2=0x7f7de00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7de00b4b80 0x7f7de00b7090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7df0005fd0 tx=0x7f7df000b5f0 comp rx=0 tx=0).stop 2024-08-31T06:43:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 msgr2=0x7f7df419f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 0x7f7df419f9e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7dec005cc0 tx=0x7f7dec032a10 comp rx=0 tx=0).stop 2024-08-31T06:43:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 shutdown_connections 2024-08-31T06:43:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7de00b4b80 0x7f7de00b7090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7df4109b90 0x7f7df419f9e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7df4109240 0x7f7df419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 --2- 172.21.15.37:0/2377551962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7df4103900 0x7f7df419a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 >> 172.21.15.37:0/2377551962 conn(0x7f7df407b5f0 msgr2=0x7f7df4107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 shutdown_connections 2024-08-31T06:43:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:43:57.173+0000 7f7dfb2e3640 1 -- 172.21.15.37:0/2377551962 wait complete. 2024-08-31T06:43:57.925 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:57 smithi037 ceph-mon[18612]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:43:57.925 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:57 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2377551962' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:43:57.926 INFO:tasks.cephadm:Adding mds.a on smithi037 2024-08-31T06:43:57.926 INFO:tasks.cephadm:Adding mds.d on smithi037 2024-08-31T06:43:57.926 INFO:tasks.cephadm:Adding mds.g on smithi037 2024-08-31T06:43:57.926 INFO:tasks.cephadm:Adding mds.j on smithi037 2024-08-31T06:43:57.926 INFO:tasks.cephadm:Adding mds.b on smithi066 2024-08-31T06:43:57.926 INFO:tasks.cephadm:Adding mds.e on smithi066 2024-08-31T06:43:57.926 INFO:tasks.cephadm:Adding mds.h on smithi066 2024-08-31T06:43:57.927 INFO:tasks.cephadm:Adding mds.k on smithi066 2024-08-31T06:43:57.927 INFO:tasks.cephadm:Adding mds.c on smithi106 2024-08-31T06:43:57.927 INFO:tasks.cephadm:Adding mds.f on smithi106 2024-08-31T06:43:57.927 INFO:tasks.cephadm:Adding mds.i on smithi106 2024-08-31T06:43:57.927 INFO:tasks.cephadm:Adding mds.l on smithi106 2024-08-31T06:43:57.927 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph orch apply mds all '12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l' 2024-08-31T06:43:57.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:57 smithi106 ceph-mon[22134]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:43:57.956 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:57 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2377551962' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:43:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:57 smithi066 ceph-mon[22244]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:43:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:57 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2377551962' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:43:58.184 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:43:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 -- 172.21.15.106:0/1420873656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c10db90 msgr2=0x7f5f3c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 --2- 172.21.15.106:0/1420873656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c10db90 0x7f5f3c1100a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009ca0 tx=0x7f5f3402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 -- 172.21.15.106:0/1420873656 shutdown_connections 2024-08-31T06:43:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 --2- 172.21.15.106:0/1420873656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c105010 0x7f5f3c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 --2- 172.21.15.106:0/1420873656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c10db90 0x7f5f3c1100a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 --2- 172.21.15.106:0/1420873656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f3c1045e0 0x7f5f3c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 -- 172.21.15.106:0/1420873656 >> 172.21.15.106:0/1420873656 conn(0x7f5f3c0794d0 msgr2=0x7f5f3c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 -- 172.21.15.106:0/1420873656 shutdown_connections 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.620+0000 7f5f446ff640 1 -- 172.21.15.106:0/1420873656 wait complete. 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f446ff640 1 Processor -- start 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f446ff640 1 -- start start 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f446ff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c1045e0 0x7f5f3c19a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f446ff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c105010 0x7f5f3c19a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f446ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f3c10db90 0x7f5f3c19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f446ff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c113710 con 0x7f5f3c1045e0 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f446ff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c113590 con 0x7f5f3c10db90 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f446ff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c113890 con 0x7f5f3c105010 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f41c9a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c105010 0x7f5f3c19a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f41c9a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c105010 0x7f5f3c19a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:49560/0 (socket says 172.21.15.106:49560) 2024-08-31T06:43:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f41c9a640 1 -- 172.21.15.106:0/2376583387 learned_addr learned my addr 172.21.15.106:0/2376583387 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.621+0000 7f5f4249b640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c1045e0 0x7f5f3c19a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f42c9c640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f3c10db90 0x7f5f3c19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f41c9a640 1 -- 172.21.15.106:0/2376583387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f3c10db90 msgr2=0x7f5f3c19fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f41c9a640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f3c10db90 0x7f5f3c19fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f41c9a640 1 -- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c1045e0 msgr2=0x7f5f3c19a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f41c9a640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c1045e0 0x7f5f3c19a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f41c9a640 1 -- 172.21.15.106:0/2376583387 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c1a00f0 con 0x7f5f3c105010 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f42c9c640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f3c10db90 0x7f5f3c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f41c9a640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c105010 0x7f5f3c19a7e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800d740 tx=0x7f5f3800dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f337fe640 1 -- 172.21.15.106:0/2376583387 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38017070 con 0x7f5f3c105010 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3c1a03e0 con 0x7f5f3c105010 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f337fe640 1 -- 172.21.15.106:0/2376583387 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f3800de50 con 0x7f5f3c105010 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f337fe640 1 -- 172.21.15.106:0/2376583387 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3800f620 con 0x7f5f3c105010 2024-08-31T06:43:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.622+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f3c1a6c00 con 0x7f5f3c105010 2024-08-31T06:43:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.623+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f3c1049f0 con 0x7f5f3c105010 2024-08-31T06:43:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.625+0000 7f5f337fe640 1 -- 172.21.15.106:0/2376583387 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f5f3801a070 con 0x7f5f3c105010 2024-08-31T06:43:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.625+0000 7f5f337fe640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f280b4bb0 0x7f5f280b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:43:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.626+0000 7f5f337fe640 1 -- 172.21.15.106:0/2376583387 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f5f380e4750 con 0x7f5f3c105010 2024-08-31T06:43:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.626+0000 7f5f4249b640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f280b4bb0 0x7f5f280b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:43:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.626+0000 7f5f4249b640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f280b4bb0 0x7f5f280b70c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c06b9a0 tx=0x7f5f2c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:43:58.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.633+0000 7f5f337fe640 1 -- 172.21.15.106:0/2376583387 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5f380abc50 con 0x7f5f3c105010 2024-08-31T06:43:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.827+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l", "target": ["mon-mgr", ""]}) -- 0x7f5f3c106fa0 con 0x7f5f280b4bb0 2024-08-31T06:43:58.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.836+0000 7f5f337fe640 1 -- 172.21.15.106:0/2376583387 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f5f3c106fa0 con 0x7f5f280b4bb0 2024-08-31T06:43:58.837 INFO:teuthology.orchestra.run.smithi106.stdout:Scheduled mds.all update... 2024-08-31T06:43:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f280b4bb0 msgr2=0x7f5f280b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f280b4bb0 0x7f5f280b70c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c06b9a0 tx=0x7f5f2c005f90 comp rx=0 tx=0).stop 2024-08-31T06:43:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c105010 msgr2=0x7f5f3c19a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:43:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c105010 0x7f5f3c19a7e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800d740 tx=0x7f5f3800dc00 comp rx=0 tx=0).stop 2024-08-31T06:43:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 shutdown_connections 2024-08-31T06:43:58.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f280b4bb0 0x7f5f280b70c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f3c10db90 0x7f5f3c19fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c105010 0x7f5f3c19a7e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 --2- 172.21.15.106:0/2376583387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c1045e0 0x7f5f3c19a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:43:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 >> 172.21.15.106:0/2376583387 conn(0x7f5f3c0794d0 msgr2=0x7f5f3c106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:43:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 shutdown_connections 2024-08-31T06:43:58.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-08-31T06:43:58.838+0000 7f5f446ff640 1 -- 172.21.15.106:0/2376583387 wait complete. 2024-08-31T06:43:59.475 DEBUG:teuthology.orchestra.run.smithi037:mds.a> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.a.service 2024-08-31T06:43:59.478 DEBUG:teuthology.orchestra.run.smithi037:mds.d> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.d.service 2024-08-31T06:43:59.522 DEBUG:teuthology.orchestra.run.smithi037:mds.g> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.g.service 2024-08-31T06:43:59.565 DEBUG:teuthology.orchestra.run.smithi037:mds.j> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.j.service 2024-08-31T06:43:59.608 DEBUG:teuthology.orchestra.run.smithi066:mds.b> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.b.service 2024-08-31T06:43:59.611 DEBUG:teuthology.orchestra.run.smithi066:mds.e> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.e.service 2024-08-31T06:43:59.655 DEBUG:teuthology.orchestra.run.smithi066:mds.h> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.h.service 2024-08-31T06:43:59.699 DEBUG:teuthology.orchestra.run.smithi066:mds.k> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.k.service 2024-08-31T06:43:59.741 DEBUG:teuthology.orchestra.run.smithi106:mds.c> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.c.service 2024-08-31T06:43:59.743 DEBUG:teuthology.orchestra.run.smithi106:mds.f> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.f.service 2024-08-31T06:43:59.787 DEBUG:teuthology.orchestra.run.smithi106:mds.i> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.i.service 2024-08-31T06:43:59.830 DEBUG:teuthology.orchestra.run.smithi106:mds.l> sudo journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.l.service 2024-08-31T06:43:59.874 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-31T06:43:59.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:43:59.992 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:43:59.992 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:43:59.992 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l;count:12 2024-08-31T06:43:59.992 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:59.992 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:43:59.993 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:59.993 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:43:59.993 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:43:59.993 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:43:59.993 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:43:59.993 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:43:59.993 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:43:59 smithi106 ceph-mon[22134]: Deploying daemon mds.l on smithi106 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l;count:12 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:43:59 smithi037 ceph-mon[18612]: Deploying daemon mds.l on smithi106 2024-08-31T06:44:00.127 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='client.24589 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l;count:12 2024-08-31T06:44:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:44:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:44:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:00.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:00.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:43:59 smithi066 ceph-mon[22244]: Deploying daemon mds.l on smithi106 2024-08-31T06:44:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 -- 172.21.15.37:0/341236862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45010dbf0 msgr2=0x7fe4501100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 --2- 172.21.15.37:0/341236862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45010dbf0 0x7fe4501100e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe448009ca0 tx=0x7fe44802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 -- 172.21.15.37:0/341236862 shutdown_connections 2024-08-31T06:44:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 --2- 172.21.15.37:0/341236862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45010dbf0 0x7fe4501100e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 --2- 172.21.15.37:0/341236862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe4501050e0 0x7fe45010d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 --2- 172.21.15.37:0/341236862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe450104790 0x7fe450104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 -- 172.21.15.37:0/341236862 >> 172.21.15.37:0/341236862 conn(0x7fe4500794f0 msgr2=0x7fe450079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 -- 172.21.15.37:0/341236862 shutdown_connections 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.596+0000 7fe45566a640 1 -- 172.21.15.37:0/341236862 wait complete. 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.597+0000 7fe45566a640 1 Processor -- start 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.597+0000 7fe45566a640 1 -- start start 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.597+0000 7fe45566a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe450104790 0x7fe4501024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.597+0000 7fe45566a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4501050e0 0x7fe450102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.597+0000 7fe45566a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe45010dbf0 0x7fe450102f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.597+0000 7fe45566a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe450113770 con 0x7fe450104790 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.597+0000 7fe45566a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe4501135f0 con 0x7fe45010dbf0 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.597+0000 7fe45566a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe4501138f0 con 0x7fe4501050e0 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe450104790 0x7fe4501024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe450104790 0x7fe4501024d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37272/0 (socket says 172.21.15.37:37272) 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 -- 172.21.15.37:0/1026191340 learned_addr learned my addr 172.21.15.37:0/1026191340 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44e7fc640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4501050e0 0x7fe450102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44f7fe640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe45010dbf0 0x7fe450102f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 -- 172.21.15.37:0/1026191340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4501050e0 msgr2=0x7fe450102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4501050e0 0x7fe450102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 -- 172.21.15.37:0/1026191340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe45010dbf0 msgr2=0x7fe450102f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe45010dbf0 0x7fe450102f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 -- 172.21.15.37:0/1026191340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4501a84a0 con 0x7fe450104790 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe44effd640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe450104790 0x7fe4501024d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe44000e9f0 tx=0x7fe44000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe437fff640 1 -- 172.21.15.37:0/1026191340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44000cd80 con 0x7fe450104790 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4501a8790 con 0x7fe450104790 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe437fff640 1 -- 172.21.15.37:0/1026191340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe4400054b0 con 0x7fe450104790 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe437fff640 1 -- 172.21.15.37:0/1026191340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe440010430 con 0x7fe450104790 2024-08-31T06:44:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.598+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4501a8cd0 con 0x7fe450104790 2024-08-31T06:44:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.599+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe450104ba0 con 0x7fe450104790 2024-08-31T06:44:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.601+0000 7fe437fff640 1 -- 172.21.15.37:0/1026191340 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fe4400046c0 con 0x7fe450104790 2024-08-31T06:44:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.602+0000 7fe437fff640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe4380b4b80 0x7fe4380b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.602+0000 7fe44e7fc640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe4380b4b80 0x7fe4380b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:00.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.602+0000 7fe437fff640 1 -- 172.21.15.37:0/1026191340 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fe4400e54b0 con 0x7fe450104790 2024-08-31T06:44:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.602+0000 7fe44e7fc640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe4380b4b80 0x7fe4380b7090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe444005e00 tx=0x7fe444005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.605+0000 7fe437fff640 1 -- 172.21.15.37:0/1026191340 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe440056130 con 0x7fe450104790 2024-08-31T06:44:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.832+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4501037d0 con 0x7fe450104790 2024-08-31T06:44:00.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.832+0000 7fe437fff640 1 -- 172.21.15.37:0/1026191340 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fe4400ac9b0 con 0x7fe450104790 2024-08-31T06:44:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:00.835 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"btime":"2024-08-31T06:36:16:871294+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-31T06:44:00.835 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 1 2024-08-31T06:44:00.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe4380b4b80 msgr2=0x7fe4380b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe4380b4b80 0x7fe4380b7090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe444005e00 tx=0x7fe444005c50 comp rx=0 tx=0).stop 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe450104790 msgr2=0x7fe4501024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe450104790 0x7fe4501024d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe44000e9f0 tx=0x7fe44000edf0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 shutdown_connections 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe4380b4b80 0x7fe4380b7090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe45010dbf0 0x7fe450102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe4501050e0 0x7fe450102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 --2- 172.21.15.37:0/1026191340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe450104790 0x7fe4501024d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.835+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 >> 172.21.15.37:0/1026191340 conn(0x7fe4500794f0 msgr2=0x7fe4500ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.836+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 shutdown_connections 2024-08-31T06:44:00.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:00.836+0000 7fe45566a640 1 -- 172.21.15.37:0/1026191340 wait complete. 2024-08-31T06:44:01.046 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:00 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1026191340' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:01.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:00 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1026191340' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:01.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:00 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1026191340' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:01.315 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 systemd[1]: Starting Ceph mds.l for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:01.717 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 podman[53064]: 2024-08-31 06:44:01.343109092 +0000 UTC m=+0.015995800 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:01.717 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 podman[53064]: 2024-08-31 06:44:01.480956671 +0000 UTC m=+0.153843371 container create 285bef8cfd45b3e29e692f69b06be0eeddc16f613d463f5b5d14ec58bde50f26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:44:01.717 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 podman[53064]: 2024-08-31 06:44:01.717028455 +0000 UTC m=+0.389915161 container init 285bef8cfd45b3e29e692f69b06be0eeddc16f613d463f5b5d14ec58bde50f26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T06:44:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:01 smithi106 ceph-mon[22134]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:01 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.106:6832/1558689933,v1:172.21.15.106:6833/1558689933] up:boot 2024-08-31T06:44:02.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:01 smithi106 ceph-mon[22134]: fsmap 1 up:standby 2024-08-31T06:44:02.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:44:02.066 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 podman[53064]: 2024-08-31 06:44:01.719819877 +0000 UTC m=+0.392706587 container start 285bef8cfd45b3e29e692f69b06be0eeddc16f613d463f5b5d14ec58bde50f26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-31T06:44:02.066 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 ceph-mds[53082]: -- 172.21.15.106:0/89855232 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560a9a0fd860 con 0x560a9e2a3600 2024-08-31T06:44:02.066 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l[53078]: starting mds.l at 2024-08-31T06:44:02.066 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 bash[53064]: 285bef8cfd45b3e29e692f69b06be0eeddc16f613d463f5b5d14ec58bde50f26 2024-08-31T06:44:02.066 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 06:44:01 smithi106 systemd[1]: Started Ceph mds.l for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:02.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:01 smithi037 ceph-mon[18612]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:02.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:01 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.106:6832/1558689933,v1:172.21.15.106:6833/1558689933] up:boot 2024-08-31T06:44:02.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:01 smithi037 ceph-mon[18612]: fsmap 1 up:standby 2024-08-31T06:44:02.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:44:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:01 smithi066 ceph-mon[22244]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:01 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.106:6832/1558689933,v1:172.21.15.106:6833/1558689933] up:boot 2024-08-31T06:44:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:01 smithi066 ceph-mon[22244]: fsmap 1 up:standby 2024-08-31T06:44:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-31T06:44:02.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:02 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:02.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:02 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:02.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:02 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:02.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:02 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:02.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:02 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:02.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:02 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:02.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:02 smithi066 ceph-mon[22244]: Deploying daemon mds.k on smithi066 2024-08-31T06:44:03.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:02 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:03.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:02 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:03.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:02 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:03.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:02 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:03.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:02 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:03.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:02 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:03.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:02 smithi037 ceph-mon[18612]: Deploying daemon mds.k on smithi066 2024-08-31T06:44:03.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:02 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:03.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:02 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:03.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:02 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:03.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:02 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:03.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:02 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:03.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:02 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:03.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:02 smithi106 ceph-mon[22134]: Deploying daemon mds.k on smithi066 2024-08-31T06:44:03.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:03.779 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:04.061 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:03 smithi066 ceph-mon[22244]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:04.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:03 smithi037 ceph-mon[18612]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:04.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3560888923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68102800 msgr2=0x7f5b68102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:04.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3560888923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68102800 0x7f5b68102c10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009900 tx=0x7f5b5802a410 comp rx=0 tx=0).stop 2024-08-31T06:44:04.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3560888923 shutdown_connections 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3560888923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b68108a90 0x7f5b6810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3560888923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b68108140 0x7f5b68108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3560888923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68102800 0x7f5b68102c10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3560888923 >> 172.21.15.37:0/3560888923 conn(0x7f5b680794c0 msgr2=0x7f5b680798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3560888923 shutdown_connections 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.253+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3560888923 wait complete. 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6f0d0640 1 Processor -- start 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6f0d0640 1 -- start start 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6f0d0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b68102800 0x7f5b6819b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6f0d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108140 0x7f5b6819b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6f0d0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b68108a90 0x7f5b6819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6f0d0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68112610 con 0x7f5b68108140 2024-08-31T06:44:04.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6f0d0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68112490 con 0x7f5b68102800 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6f0d0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5b68112790 con 0x7f5b68108a90 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108140 0x7f5b6819b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b6ce6c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b68102800 0x7f5b6819b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108140 0x7f5b6819b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43496/0 (socket says 172.21.15.37:43496) 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.254+0000 7f5b67fff640 1 -- 172.21.15.37:0/3548676628 learned_addr learned my addr 172.21.15.37:0/3548676628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b6d66d640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b68108a90 0x7f5b6819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b67fff640 1 -- 172.21.15.37:0/3548676628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b68108a90 msgr2=0x7f5b6819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b67fff640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b68108a90 0x7f5b6819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b67fff640 1 -- 172.21.15.37:0/3548676628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b68102800 msgr2=0x7f5b6819b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b67fff640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b68102800 0x7f5b6819b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b67fff640 1 -- 172.21.15.37:0/3548676628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b681a62b0 con 0x7f5b68108140 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b67fff640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108140 0x7f5b6819b560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000b450 tx=0x7f5b5000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:04.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b65ffb640 1 -- 172.21.15.37:0/3548676628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50015020 con 0x7f5b68108140 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b681a65a0 con 0x7f5b68108140 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b65ffb640 1 -- 172.21.15.37:0/3548676628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b50011d20 con 0x7f5b68108140 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b65ffb640 1 -- 172.21.15.37:0/3548676628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50010e10 con 0x7f5b68108140 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.255+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b681a6ae0 con 0x7f5b68108140 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.256+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b68103a80 con 0x7f5b68108140 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.259+0000 7f5b65ffb640 1 -- 172.21.15.37:0/3548676628 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f5b50018020 con 0x7f5b68108140 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.259+0000 7f5b65ffb640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b540b4bb0 0x7f5b540b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.260+0000 7f5b6ce6c640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b540b4bb0 0x7f5b540b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.260+0000 7f5b65ffb640 1 -- 172.21.15.37:0/3548676628 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f5b500e4ce0 con 0x7f5b68108140 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.260+0000 7f5b6ce6c640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b540b4bb0 0x7f5b540b70c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5b6806c480 tx=0x7f5b580058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:04.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.263+0000 7f5b65ffb640 1 -- 172.21.15.37:0/3548676628 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5b5001f020 con 0x7f5b68108140 2024-08-31T06:44:04.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:03 smithi106 ceph-mon[22134]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:04.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.488+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b6806bd30 con 0x7f5b68108140 2024-08-31T06:44:04.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.491+0000 7f5b65ffb640 1 -- 172.21.15.37:0/3548676628 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f5b6806bd30 con 0x7f5b68108140 2024-08-31T06:44:04.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:04.493 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"btime":"2024-08-31T06:44:01:758306+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T06:44:04.493 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2024-08-31T06:44:04.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b540b4bb0 msgr2=0x7f5b540b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b540b4bb0 0x7f5b540b70c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5b6806c480 tx=0x7f5b580058d0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108140 msgr2=0x7f5b6819b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108140 0x7f5b6819b560 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000b450 tx=0x7f5b5000b910 comp rx=0 tx=0).stop 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 shutdown_connections 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b540b4bb0 0x7f5b540b70c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b68108140 0x7f5b6819b560 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b68108a90 0x7f5b6819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 --2- 172.21.15.37:0/3548676628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b68102800 0x7f5b6819b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 >> 172.21.15.37:0/3548676628 conn(0x7f5b680794c0 msgr2=0x7f5b68101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 shutdown_connections 2024-08-31T06:44:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:04.493+0000 7f5b6f0d0640 1 -- 172.21.15.37:0/3548676628 wait complete. 2024-08-31T06:44:04.637 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:44:04 smithi066 systemd[1]: Started Ceph mds.k for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:05.598 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:05.598 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.598 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3548676628' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: Deploying daemon mds.j on smithi037 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6832/305823266,v1:172.21.15.66:6833/305823266] up:boot 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: fsmap 2 up:standby 2024-08-31T06:44:05.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:05 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:44:05.777 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:05.777 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.777 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3548676628' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:05.777 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.777 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.777 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:05.778 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:05.778 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:05.778 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: Deploying daemon mds.j on smithi037 2024-08-31T06:44:05.778 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6832/305823266,v1:172.21.15.66:6833/305823266] up:boot 2024-08-31T06:44:05.778 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: fsmap 2 up:standby 2024-08-31T06:44:05.778 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:05 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:44:05.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:05.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3548676628' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: Deploying daemon mds.j on smithi037 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6832/305823266,v1:172.21.15.66:6833/305823266] up:boot 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: fsmap 2 up:standby 2024-08-31T06:44:05.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:05 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-31T06:44:07.256 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 systemd[1]: Starting Ceph mds.j for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:07.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:07.511 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 podman[61617]: 2024-08-31 06:44:07.157190441 +0000 UTC m=+0.015673351 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:07.511 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 podman[61617]: 2024-08-31 06:44:07.26198556 +0000 UTC m=+0.120468497 container create 659bc555155f922b21ee7abfea0cc896abd4073d87858b4665541cd837a524d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=) 2024-08-31T06:44:07.511 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 podman[61617]: 2024-08-31 06:44:07.472827434 +0000 UTC m=+0.331310343 container init 659bc555155f922b21ee7abfea0cc896abd4073d87858b4665541cd837a524d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-31T06:44:07.511 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 podman[61617]: 2024-08-31 06:44:07.476582459 +0000 UTC m=+0.335065359 container start 659bc555155f922b21ee7abfea0cc896abd4073d87858b4665541cd837a524d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-31T06:44:07.629 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:07.774 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:07 smithi037 ceph-mon[18612]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:07.774 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 ceph-mds[61661]: -- 172.21.15.37:0/2246030997 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d2c391b860 con 0x55d2c7ac1a80 2024-08-31T06:44:07.775 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j[61650]: starting mds.j at 2024-08-31T06:44:07.775 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 bash[61617]: 659bc555155f922b21ee7abfea0cc896abd4073d87858b4665541cd837a524d4 2024-08-31T06:44:07.775 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:44:07 smithi037 systemd[1]: Started Ceph mds.j for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:07.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:07 smithi106 ceph-mon[22134]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:07.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:07 smithi066 ceph-mon[22244]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.133+0000 7fbbcddba640 1 -- 172.21.15.37:0/3512185926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109240 msgr2=0x7fbbc8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 --2- 172.21.15.37:0/3512185926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109240 0x7fbbc8109650 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009900 tx=0x7fbbbc02a410 comp rx=0 tx=0).stop 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 -- 172.21.15.37:0/3512185926 shutdown_connections 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 --2- 172.21.15.37:0/3512185926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109240 0x7fbbc8109650 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 --2- 172.21.15.37:0/3512185926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc8109b90 0x7fbbc81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 --2- 172.21.15.37:0/3512185926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8103900 0x7fbbc8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 -- 172.21.15.37:0/3512185926 >> 172.21.15.37:0/3512185926 conn(0x7fbbc807b5f0 msgr2=0x7fbbc807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 -- 172.21.15.37:0/3512185926 shutdown_connections 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 -- 172.21.15.37:0/3512185926 wait complete. 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 Processor -- start 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.134+0000 7fbbcddba640 1 -- start start 2024-08-31T06:44:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbcddba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8103900 0x7fbbc819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbcddba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc8109240 0x7fbbc819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbcddba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109b90 0x7fbbc819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbcddba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc8113700 con 0x7fbbc8109b90 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbcddba640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc8113580 con 0x7fbbc8109240 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbcddba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc8113880 con 0x7fbbc8103900 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109b90 0x7fbbc819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109b90 0x7fbbc819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43530/0 (socket says 172.21.15.37:43530) 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 -- 172.21.15.37:0/2484267637 learned_addr learned my addr 172.21.15.37:0/2484267637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc6ffd640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc8109240 0x7fbbc819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc77fe640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8103900 0x7fbbc819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 -- 172.21.15.37:0/2484267637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8103900 msgr2=0x7fbbc819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8103900 0x7fbbc819a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 -- 172.21.15.37:0/2484267637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc8109240 msgr2=0x7fbbc819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc8109240 0x7fbbc819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 -- 172.21.15.37:0/2484267637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc81a0100 con 0x7fbbc8109b90 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc77fe640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8103900 0x7fbbc819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.135+0000 7fbbc7fff640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109b90 0x7fbbc819f9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000eaa0 tx=0x7fbbc000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.136+0000 7fbbc4ff9640 1 -- 172.21.15.37:0/2484267637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000cdb0 con 0x7fbbc8109b90 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.136+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc81a03f0 con 0x7fbbc8109b90 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.136+0000 7fbbc4ff9640 1 -- 172.21.15.37:0/2484267637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbc0005020 con 0x7fbbc8109b90 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.136+0000 7fbbc4ff9640 1 -- 172.21.15.37:0/2484267637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00116d0 con 0x7fbbc8109b90 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.136+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc81a6b50 con 0x7fbbc8109b90 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.137+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc8103d10 con 0x7fbbc8109b90 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.138+0000 7fbbc4ff9640 1 -- 172.21.15.37:0/2484267637 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fbbc00051d0 con 0x7fbbc8109b90 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.139+0000 7fbbc4ff9640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbb00b4b80 0x7fbbb00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.139+0000 7fbbc77fe640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbb00b4b80 0x7fbbb00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.140+0000 7fbbc4ff9640 1 -- 172.21.15.37:0/2484267637 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fbbc00e5430 con 0x7fbbc8109b90 2024-08-31T06:44:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.140+0000 7fbbc77fe640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbb00b4b80 0x7fbbb00b7090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009b40 tx=0x7fbbb8005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.143+0000 7fbbc4ff9640 1 -- 172.21.15.37:0/2484267637 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbbc0016030 con 0x7fbbc8109b90 2024-08-31T06:44:08.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.379+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbc819b2c0 con 0x7fbbc8109b90 2024-08-31T06:44:08.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.380+0000 7fbbc4ff9640 1 -- 172.21.15.37:0/2484267637 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7fbbc819b2c0 con 0x7fbbc8109b90 2024-08-31T06:44:08.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:08.382 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":4,"btime":"2024-08-31T06:44:07:533982+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T06:44:08.383 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 4 2024-08-31T06:44:08.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbb00b4b80 msgr2=0x7fbbb00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbb00b4b80 0x7fbbb00b7090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009b40 tx=0x7fbbb8005e50 comp rx=0 tx=0).stop 2024-08-31T06:44:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109b90 msgr2=0x7fbbc819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109b90 0x7fbbc819f9d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000eaa0 tx=0x7fbbc000ef60 comp rx=0 tx=0).stop 2024-08-31T06:44:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 shutdown_connections 2024-08-31T06:44:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbb00b4b80 0x7fbbb00b7090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc8109b90 0x7fbbc819f9d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbc8109240 0x7fbbc819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 --2- 172.21.15.37:0/2484267637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbc8103900 0x7fbbc819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:08.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 >> 172.21.15.37:0/2484267637 conn(0x7fbbc807b5f0 msgr2=0x7fbbc8105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:08.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 shutdown_connections 2024-08-31T06:44:08.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:08.382+0000 7fbbcddba640 1 -- 172.21.15.37:0/2484267637 wait complete. 2024-08-31T06:44:08.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.37:6834/2503140035,v1:172.21.15.37:6835/2503140035] up:boot 2024-08-31T06:44:08.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: fsmap 3 up:standby 2024-08-31T06:44:08.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T06:44:08.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:08.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:08.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:08.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: Deploying daemon mds.d on smithi037 2024-08-31T06:44:08.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:08 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2484267637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:08.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.37:6834/2503140035,v1:172.21.15.37:6835/2503140035] up:boot 2024-08-31T06:44:08.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: fsmap 3 up:standby 2024-08-31T06:44:08.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T06:44:08.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:08.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:08.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:08.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: Deploying daemon mds.d on smithi037 2024-08-31T06:44:08.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:08 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2484267637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:08.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.37:6834/2503140035,v1:172.21.15.37:6835/2503140035] up:boot 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: fsmap 3 up:standby 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: Deploying daemon mds.d on smithi037 2024-08-31T06:44:08.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:08 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2484267637' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:09.788 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:09 smithi037 ceph-mon[18612]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:09.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:09 smithi066 ceph-mon[22244]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:10.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:09 smithi106 ceph-mon[22134]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:10.855 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:10 smithi037 systemd[1]: Starting Ceph mds.d for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:11.118 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:10 smithi037 podman[62032]: 2024-08-31 06:44:10.761981625 +0000 UTC m=+0.016021530 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:11.118 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:10 smithi037 podman[62032]: 2024-08-31 06:44:10.86523208 +0000 UTC m=+0.119271986 container create db60f19020135f13e3bbbbd50285ffb04493bd6f9076dabf14b4d827a7739b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:44:11.118 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:11 smithi037 podman[62032]: 2024-08-31 06:44:11.11797652 +0000 UTC m=+0.372016425 container init db60f19020135f13e3bbbbd50285ffb04493bd6f9076dabf14b4d827a7739b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0) 2024-08-31T06:44:11.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:11.441 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:11.561 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:11 smithi037 podman[62032]: 2024-08-31 06:44:11.121635057 +0000 UTC m=+0.375674962 container start db60f19020135f13e3bbbbd50285ffb04493bd6f9076dabf14b4d827a7739b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T06:44:11.561 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-mds[62052]: -- 172.21.15.37:0/3581973014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560e97c7f860 con 0x560e9be25a80 2024-08-31T06:44:11.562 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d[62048]: starting mds.d at 2024-08-31T06:44:11.562 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:11 smithi037 bash[62032]: db60f19020135f13e3bbbbd50285ffb04493bd6f9076dabf14b4d827a7739b2e 2024-08-31T06:44:11.562 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:44:11 smithi037 systemd[1]: Started Ceph mds.d for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:11.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-mon[18612]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:11.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:11.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:11.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:11.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:11.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:11.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:11 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:11.920 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:11 smithi066 ceph-mon[22244]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:11.920 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:11 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:11.920 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:11 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:11.920 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:11 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:11.920 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:11 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:11.920 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:11 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:11.920 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:11 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 -- 172.21.15.37:0/1896685264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109b90 msgr2=0x7faa341103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 --2- 172.21.15.37:0/1896685264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109b90 0x7faa341103c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa2c009ca0 tx=0x7faa2c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:44:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 -- 172.21.15.37:0/1896685264 shutdown_connections 2024-08-31T06:44:11.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 --2- 172.21.15.37:0/1896685264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109b90 0x7faa341103c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 --2- 172.21.15.37:0/1896685264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa34109240 0x7faa34109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 --2- 172.21.15.37:0/1896685264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa34103900 0x7faa34103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 -- 172.21.15.37:0/1896685264 >> 172.21.15.37:0/1896685264 conn(0x7faa3407b5f0 msgr2=0x7faa3407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 -- 172.21.15.37:0/1896685264 shutdown_connections 2024-08-31T06:44:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 -- 172.21.15.37:0/1896685264 wait complete. 2024-08-31T06:44:11.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.980+0000 7faa394cc640 1 Processor -- start 2024-08-31T06:44:11.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa394cc640 1 -- start start 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa394cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa34103900 0x7faa3419a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa394cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109240 0x7faa3419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa394cc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa34109b90 0x7faa3419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa394cc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa34113750 con 0x7faa34109240 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa394cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa341135d0 con 0x7faa34103900 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa394cc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faa341138d0 con 0x7faa34109b90 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa2a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109240 0x7faa3419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa2a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109240 0x7faa3419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43576/0 (socket says 172.21.15.37:43576) 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa2a7fc640 1 -- 172.21.15.37:0/751924860 learned_addr learned my addr 172.21.15.37:0/751924860 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa32ffd640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa34103900 0x7faa3419a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa337fe640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa34109b90 0x7faa3419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa2a7fc640 1 -- 172.21.15.37:0/751924860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa34109b90 msgr2=0x7faa3419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa2a7fc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa34109b90 0x7faa3419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa2a7fc640 1 -- 172.21.15.37:0/751924860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa34103900 msgr2=0x7faa3419a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa2a7fc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa34103900 0x7faa3419a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.981+0000 7faa2a7fc640 1 -- 172.21.15.37:0/751924860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa341a01d0 con 0x7faa34109240 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.982+0000 7faa2a7fc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109240 0x7faa3419a800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00d750 tx=0x7faa1c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.982+0000 7faa30ff9640 1 -- 172.21.15.37:0/751924860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c017070 con 0x7faa34109240 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.982+0000 7faa30ff9640 1 -- 172.21.15.37:0/751924860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa1c0054b0 con 0x7faa34109240 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.982+0000 7faa30ff9640 1 -- 172.21.15.37:0/751924860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c004bc0 con 0x7faa34109240 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.982+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa341a04c0 con 0x7faa34109240 2024-08-31T06:44:11.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.982+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa341a6c20 con 0x7faa34109240 2024-08-31T06:44:11.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.983+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa34103d10 con 0x7faa34109240 2024-08-31T06:44:11.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.984+0000 7faa30ff9640 1 -- 172.21.15.37:0/751924860 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7faa1c009c30 con 0x7faa34109240 2024-08-31T06:44:11.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.985+0000 7faa30ff9640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faa200b4c00 0x7faa200b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.985+0000 7faa32ffd640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faa200b4c00 0x7faa200b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.985+0000 7faa30ff9640 1 -- 172.21.15.37:0/751924860 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7faa1c0e47a0 con 0x7faa34109240 2024-08-31T06:44:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.986+0000 7faa32ffd640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faa200b4c00 0x7faa200b7110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faa2400bbe0 tx=0x7faa2400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:11.989+0000 7faa30ff9640 1 -- 172.21.15.37:0/751924860 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7faa1c0abc00 con 0x7faa34109240 2024-08-31T06:44:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:11 smithi106 ceph-mon[22134]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:11 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:11 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:11 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:11 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:11 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:12.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:11 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:12.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.213+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa3402e430 con 0x7faa34109240 2024-08-31T06:44:12.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.213+0000 7faa30ff9640 1 -- 172.21.15.37:0/751924860 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7faa1c0ab500 con 0x7faa34109240 2024-08-31T06:44:12.215 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:12.215 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"btime":"2024-08-31T06:44:11:634935+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-31T06:44:12.215 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 5 2024-08-31T06:44:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.215+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faa200b4c00 msgr2=0x7faa200b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.215+0000 7faa394cc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faa200b4c00 0x7faa200b7110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faa2400bbe0 tx=0x7faa2400b390 comp rx=0 tx=0).stop 2024-08-31T06:44:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.215+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109240 msgr2=0x7faa3419a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.215+0000 7faa394cc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109240 0x7faa3419a800 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00d750 tx=0x7faa1c00dc10 comp rx=0 tx=0).stop 2024-08-31T06:44:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.215+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 shutdown_connections 2024-08-31T06:44:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.215+0000 7faa394cc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faa200b4c00 0x7faa200b7110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:12.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.216+0000 7faa394cc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa34109240 0x7faa3419a800 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.216+0000 7faa394cc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa34109b90 0x7faa3419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.216+0000 7faa394cc640 1 --2- 172.21.15.37:0/751924860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa34103900 0x7faa3419a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.216+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 >> 172.21.15.37:0/751924860 conn(0x7faa3407b5f0 msgr2=0x7faa34107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.216+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 shutdown_connections 2024-08-31T06:44:12.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:12.216+0000 7faa394cc640 1 -- 172.21.15.37:0/751924860 wait complete. 2024-08-31T06:44:12.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:12 smithi037 ceph-mon[18612]: Deploying daemon mds.e on smithi066 2024-08-31T06:44:12.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:12 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.37:6836/103394929,v1:172.21.15.37:6837/103394929] up:boot 2024-08-31T06:44:12.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:12 smithi037 ceph-mon[18612]: fsmap 4 up:standby 2024-08-31T06:44:12.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:12 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T06:44:12.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:12 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/751924860' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:12.912 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:12 smithi066 ceph-mon[22244]: Deploying daemon mds.e on smithi066 2024-08-31T06:44:12.912 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:12 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.37:6836/103394929,v1:172.21.15.37:6837/103394929] up:boot 2024-08-31T06:44:12.912 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:12 smithi066 ceph-mon[22244]: fsmap 4 up:standby 2024-08-31T06:44:12.912 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:12 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T06:44:12.912 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:12 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/751924860' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:13.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:12 smithi106 ceph-mon[22134]: Deploying daemon mds.e on smithi066 2024-08-31T06:44:13.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:12 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.37:6836/103394929,v1:172.21.15.37:6837/103394929] up:boot 2024-08-31T06:44:13.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:12 smithi106 ceph-mon[22134]: fsmap 4 up:standby 2024-08-31T06:44:13.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:12 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-31T06:44:13.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:12 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/751924860' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:13.313 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 systemd[1]: Starting Ceph mds.e for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:13.568 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 podman[52183]: 2024-08-31 06:44:13.215393167 +0000 UTC m=+0.016041426 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:13.569 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 podman[52183]: 2024-08-31 06:44:13.315703062 +0000 UTC m=+0.116351376 container create 229e00a0a109994d5140090fab9eea1aa23b3a45fb526ce62ae6453ef3c20966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.1) 2024-08-31T06:44:13.569 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 podman[52183]: 2024-08-31 06:44:13.568177075 +0000 UTC m=+0.368825334 container init 229e00a0a109994d5140090fab9eea1aa23b3a45fb526ce62ae6453ef3c20966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-31T06:44:13.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:13 smithi037 ceph-mon[18612]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:13.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:13 smithi066 ceph-mon[22244]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:13.887 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 podman[52183]: 2024-08-31 06:44:13.571435458 +0000 UTC m=+0.372083728 container start 229e00a0a109994d5140090fab9eea1aa23b3a45fb526ce62ae6453ef3c20966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:44:13.888 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 ceph-mds[52202]: -- 172.21.15.66:0/44504585 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b0cd697860 con 0x55b0d183d600 2024-08-31T06:44:13.888 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e[52198]: starting mds.e at 2024-08-31T06:44:13.888 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 bash[52183]: 229e00a0a109994d5140090fab9eea1aa23b3a45fb526ce62ae6453ef3c20966 2024-08-31T06:44:13.888 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:44:13 smithi066 systemd[1]: Started Ceph mds.e for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:13.924 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:13 smithi106 ceph-mon[22134]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:14.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6834/298046856,v1:172.21.15.66:6835/298046856] up:boot 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: fsmap 5 up:standby 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:14.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:14 smithi106 ceph-mon[22134]: Deploying daemon mds.f on smithi106 2024-08-31T06:44:14.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:15.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6834/298046856,v1:172.21.15.66:6835/298046856] up:boot 2024-08-31T06:44:15.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: fsmap 5 up:standby 2024-08-31T06:44:15.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:44:15.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:15.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:15.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:15.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:15.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:15.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:15.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:14 smithi037 ceph-mon[18612]: Deploying daemon mds.f on smithi106 2024-08-31T06:44:15.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6834/298046856,v1:172.21.15.66:6835/298046856] up:boot 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: fsmap 5 up:standby 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:15.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:14 smithi066 ceph-mon[22244]: Deploying daemon mds.f on smithi106 2024-08-31T06:44:15.249 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:15.733 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:15 smithi106 systemd[1]: Starting Ceph mds.f for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:15.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/2932058370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74102800 msgr2=0x7f6b74102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/2932058370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74102800 0x7f6b74102c10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009860 tx=0x7f6b7002a340 comp rx=0 tx=0).stop 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/2932058370 shutdown_connections 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/2932058370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74108a90 0x7f6b7410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/2932058370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b74108140 0x7f6b74108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/2932058370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74102800 0x7f6b74102c10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/2932058370 >> 172.21.15.37:0/2932058370 conn(0x7f6b740794d0 msgr2=0x7f6b740798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/2932058370 shutdown_connections 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.727+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/2932058370 wait complete. 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b7b2d7640 1 Processor -- start 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b7b2d7640 1 -- start start 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b7b2d7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b74102800 0x7f6b7419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b7b2d7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74108140 0x7f6b7419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:15.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b7b2d7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74108a90 0x7f6b7419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b7b2d7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b74112610 con 0x7f6b74108140 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b7b2d7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b74112490 con 0x7f6b74108a90 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b7b2d7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b74112790 con 0x7f6b74102800 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b78872640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74108140 0x7f6b7419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b78872640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74108140 0x7f6b7419b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37002/0 (socket says 172.21.15.37:37002) 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b78872640 1 -- 172.21.15.37:0/3822562643 learned_addr learned my addr 172.21.15.37:0/3822562643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.728+0000 7f6b79073640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b74102800 0x7f6b7419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b79874640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74108a90 0x7f6b7419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b78872640 1 -- 172.21.15.37:0/3822562643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b74102800 msgr2=0x7f6b7419afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b78872640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b74102800 0x7f6b7419afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b78872640 1 -- 172.21.15.37:0/3822562643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74108a90 msgr2=0x7f6b7419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b78872640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74108a90 0x7f6b7419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b78872640 1 -- 172.21.15.37:0/3822562643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b741a62d0 con 0x7f6b74108140 2024-08-31T06:44:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b78872640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74108140 0x7f6b7419b500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400b450 tx=0x7f6b6400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b6a7fc640 1 -- 172.21.15.37:0/3822562643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64015020 con 0x7f6b74108140 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b6a7fc640 1 -- 172.21.15.37:0/3822562643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b64011d20 con 0x7f6b74108140 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b741a65c0 con 0x7f6b74108140 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b6a7fc640 1 -- 172.21.15.37:0/3822562643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64010e10 con 0x7f6b74108140 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.729+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b741a6a80 con 0x7f6b74108140 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.731+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b74102c10 con 0x7f6b74108140 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.732+0000 7f6b6a7fc640 1 -- 172.21.15.37:0/3822562643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f6b64018020 con 0x7f6b74108140 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.733+0000 7f6b6a7fc640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b600b4b80 0x7f6b600b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.733+0000 7f6b79073640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b600b4b80 0x7f6b600b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.733+0000 7f6b6a7fc640 1 -- 172.21.15.37:0/3822562643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f6b640e4820 con 0x7f6b74108140 2024-08-31T06:44:15.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.734+0000 7f6b79073640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b600b4b80 0x7f6b600b7090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b700057c0 tx=0x7f6b700058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:15.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.740+0000 7f6b6a7fc640 1 -- 172.21.15.37:0/3822562643 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b6401f020 con 0x7f6b74108140 2024-08-31T06:44:15.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.962+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b7402e430 con 0x7f6b74108140 2024-08-31T06:44:15.963 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:15 smithi037 ceph-mon[18612]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:15.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.962+0000 7f6b6a7fc640 1 -- 172.21.15.37:0/3822562643 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4729 (secure 0 0 0) 0x7f6b6400d040 con 0x7f6b74108140 2024-08-31T06:44:15.964 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:15.964 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"btime":"2024-08-31T06:44:13:645943+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-31T06:44:15.964 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2024-08-31T06:44:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b600b4b80 msgr2=0x7f6b600b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b600b4b80 0x7f6b600b7090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b700057c0 tx=0x7f6b700058b0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74108140 msgr2=0x7f6b7419b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74108140 0x7f6b7419b500 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400b450 tx=0x7f6b6400b910 comp rx=0 tx=0).stop 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 shutdown_connections 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b600b4b80 0x7f6b600b7090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b74108140 0x7f6b7419b500 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74108a90 0x7f6b7419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 --2- 172.21.15.37:0/3822562643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b74102800 0x7f6b7419afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.964+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 >> 172.21.15.37:0/3822562643 conn(0x7f6b740794d0 msgr2=0x7f6b74101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.965+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 shutdown_connections 2024-08-31T06:44:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:15.965+0000 7f6b7b2d7640 1 -- 172.21.15.37:0/3822562643 wait complete. 2024-08-31T06:44:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:15 smithi106 ceph-mon[22134]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:16.065 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:15 smithi106 podman[53363]: 2024-08-31 06:44:15.776329569 +0000 UTC m=+0.112140385 container create 3251a0d061b3416a002867f6cee86f2d43f874970e8898d6c7d699d3feaaa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-31T06:44:16.065 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:15 smithi106 podman[53363]: 2024-08-31 06:44:15.679919523 +0000 UTC m=+0.015730350 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:15 smithi066 ceph-mon[22244]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:16.565 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:16 smithi106 podman[53363]: 2024-08-31 06:44:16.070579691 +0000 UTC m=+0.406390519 container init 3251a0d061b3416a002867f6cee86f2d43f874970e8898d6c7d699d3feaaa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T06:44:16.565 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:16 smithi106 podman[53363]: 2024-08-31 06:44:16.073284568 +0000 UTC m=+0.409095385 container start 3251a0d061b3416a002867f6cee86f2d43f874970e8898d6c7d699d3feaaa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:44:16.566 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-mds[53382]: -- 172.21.15.106:0/2577176352 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f1a1c2d860 con 0x55f1a5dd3180 2024-08-31T06:44:16.566 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f[53378]: starting mds.f at 2024-08-31T06:44:16.566 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:16 smithi106 bash[53363]: 3251a0d061b3416a002867f6cee86f2d43f874970e8898d6c7d699d3feaaa438 2024-08-31T06:44:16.566 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:44:16 smithi106 systemd[1]: Started Ceph mds.f for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:16.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3822562643' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:16.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:16.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:16.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:16.958 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:16.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:16.959 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:16 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:16 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3822562643' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:17.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:16 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:17.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:16 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3822562643' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:16 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:17.846 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:17 smithi106 ceph-mon[22134]: Deploying daemon mds.c on smithi106 2024-08-31T06:44:17.846 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:17 smithi106 ceph-mon[22134]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:17.847 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:17 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.106:6834/2636907745,v1:172.21.15.106:6835/2636907745] up:boot 2024-08-31T06:44:17.847 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:17 smithi106 ceph-mon[22134]: fsmap 6 up:standby 2024-08-31T06:44:17.847 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:17 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:44:18.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:17 smithi037 ceph-mon[18612]: Deploying daemon mds.c on smithi106 2024-08-31T06:44:18.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:17 smithi037 ceph-mon[18612]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:18.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:17 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.106:6834/2636907745,v1:172.21.15.106:6835/2636907745] up:boot 2024-08-31T06:44:18.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:17 smithi037 ceph-mon[18612]: fsmap 6 up:standby 2024-08-31T06:44:18.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:17 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:44:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:17 smithi066 ceph-mon[22244]: Deploying daemon mds.c on smithi106 2024-08-31T06:44:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:17 smithi066 ceph-mon[22244]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:17 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.106:6834/2636907745,v1:172.21.15.106:6835/2636907745] up:boot 2024-08-31T06:44:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:17 smithi066 ceph-mon[22244]: fsmap 6 up:standby 2024-08-31T06:44:18.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:17 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:44:18.231 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 systemd[1]: Starting Ceph mds.c for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:18.494 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 podman[53663]: 2024-08-31 06:44:18.23000373 +0000 UTC m=+0.109293954 container create a3afd8b272e8ca3317c226527091b488725894155ddee4461735b97751d046b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:44:18.494 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 podman[53663]: 2024-08-31 06:44:18.136326428 +0000 UTC m=+0.015616659 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:18.495 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 podman[53663]: 2024-08-31 06:44:18.45752052 +0000 UTC m=+0.336810750 container init a3afd8b272e8ca3317c226527091b488725894155ddee4461735b97751d046b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:44:18.495 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 podman[53663]: 2024-08-31 06:44:18.460262732 +0000 UTC m=+0.339552966 container start a3afd8b272e8ca3317c226527091b488725894155ddee4461735b97751d046b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:44:18.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:18.815 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 ceph-mds[53682]: -- 172.21.15.106:0/39601704 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563d53893c20 con 0x563d57a39600 2024-08-31T06:44:18.815 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c[53678]: starting mds.c at 2024-08-31T06:44:18.815 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 bash[53663]: a3afd8b272e8ca3317c226527091b488725894155ddee4461735b97751d046b6 2024-08-31T06:44:18.815 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:44:18 smithi106 systemd[1]: Started Ceph mds.c for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:19.056 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:19.619 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:19.619 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:19.619 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:19.619 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:19.620 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:19.620 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:19.620 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 -- 172.21.15.37:0/2110973628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908107910 msgr2=0x7f4908107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 --2- 172.21.15.37:0/2110973628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908107910 0x7f4908107d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009900 tx=0x7f48fc02a410 comp rx=0 tx=0).stop 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 -- 172.21.15.37:0/2110973628 shutdown_connections 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 --2- 172.21.15.37:0/2110973628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908107910 0x7f4908107d20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 --2- 172.21.15.37:0/2110973628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4908108260 0x7f490810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 --2- 172.21.15.37:0/2110973628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4908101fd0 0x7f49081023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 -- 172.21.15.37:0/2110973628 >> 172.21.15.37:0/2110973628 conn(0x7f4908079be0 msgr2=0x7f4908079ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 -- 172.21.15.37:0/2110973628 shutdown_connections 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 -- 172.21.15.37:0/2110973628 wait complete. 2024-08-31T06:44:19.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.619+0000 7f490d963640 1 Processor -- start 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f490d963640 1 -- start start 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f490d963640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4908101fd0 0x7f490819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f490d963640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4908107910 0x7f490819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f490d963640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908108260 0x7f49081a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f490d963640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4908111550 con 0x7f4908108260 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f490d963640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f49081113d0 con 0x7f4908107910 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f490d963640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f49081116d0 con 0x7f4908101fd0 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908108260 0x7f49081a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908108260 0x7f49081a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37020/0 (socket says 172.21.15.37:37020) 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49077fe640 1 -- 172.21.15.37:0/3809861475 learned_addr learned my addr 172.21.15.37:0/3809861475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49067fc640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4908107910 0x7f490819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f4906ffd640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4908101fd0 0x7f490819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:19.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49077fe640 1 -- 172.21.15.37:0/3809861475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4908101fd0 msgr2=0x7f490819c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49077fe640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4908101fd0 0x7f490819c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49077fe640 1 -- 172.21.15.37:0/3809861475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4908107910 msgr2=0x7f490819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49077fe640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4908107910 0x7f490819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.620+0000 7f49077fe640 1 -- 172.21.15.37:0/3809861475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49081a2260 con 0x7f4908108260 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.621+0000 7f49077fe640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908108260 0x7f49081a1bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f490000cce0 tx=0x7f490000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.621+0000 7f490c961640 1 -- 172.21.15.37:0/3809861475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f490000f450 con 0x7f4908108260 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.621+0000 7f490c961640 1 -- 172.21.15.37:0/3809861475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f490000fa80 con 0x7f4908108260 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.621+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49081a2550 con 0x7f4908108260 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.621+0000 7f490c961640 1 -- 172.21.15.37:0/3809861475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4900018ad0 con 0x7f4908108260 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.621+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49081a2a10 con 0x7f4908108260 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.622+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49081023e0 con 0x7f4908108260 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.623+0000 7f490c961640 1 -- 172.21.15.37:0/3809861475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f490000f5f0 con 0x7f4908108260 2024-08-31T06:44:19.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.624+0000 7f490c961640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48f00b4bb0 0x7f48f00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.624+0000 7f4906ffd640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48f00b4bb0 0x7f48f00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.624+0000 7f490c961640 1 -- 172.21.15.37:0/3809861475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f49000e5640 con 0x7f4908108260 2024-08-31T06:44:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.625+0000 7f4906ffd640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48f00b4bb0 0x7f48f00b70c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48f8005fd0 tx=0x7f48f8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:19.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.627+0000 7f490c961640 1 -- 172.21.15.37:0/3809861475 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4900014030 con 0x7f4908108260 2024-08-31T06:44:19.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.850+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f490819d4e0 con 0x7f4908108260 2024-08-31T06:44:19.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:19.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:19.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: Deploying daemon mds.h on smithi066 2024-08-31T06:44:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.106:6836/1095097353,v1:172.21.15.106:6837/1095097353] up:boot 2024-08-31T06:44:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: fsmap 7 up:standby 2024-08-31T06:44:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:44:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.851+0000 7f490c961640 1 -- 172.21.15.37:0/3809861475 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7f490819d4e0 con 0x7f4908108260 2024-08-31T06:44:19.853 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:19.853 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"btime":"2024-08-31T06:44:18:741851+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-31T06:44:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-08-31T06:44:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48f00b4bb0 msgr2=0x7f48f00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48f00b4bb0 0x7f48f00b70c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48f8005fd0 tx=0x7f48f8005850 comp rx=0 tx=0).stop 2024-08-31T06:44:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908108260 msgr2=0x7f49081a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908108260 0x7f49081a1bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f490000cce0 tx=0x7f490000a620 comp rx=0 tx=0).stop 2024-08-31T06:44:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 shutdown_connections 2024-08-31T06:44:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48f00b4bb0 0x7f48f00b70c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4908108260 0x7f49081a1bf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4908107910 0x7f490819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 --2- 172.21.15.37:0/3809861475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4908101fd0 0x7f490819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 >> 172.21.15.37:0/3809861475 conn(0x7f4908079be0 msgr2=0x7f49081037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 shutdown_connections 2024-08-31T06:44:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:19.853+0000 7f490d963640 1 -- 172.21.15.37:0/3809861475 wait complete. 2024-08-31T06:44:19.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: Deploying daemon mds.h on smithi066 2024-08-31T06:44:19.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.106:6836/1095097353,v1:172.21.15.106:6837/1095097353] up:boot 2024-08-31T06:44:19.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: fsmap 7 up:standby 2024-08-31T06:44:19.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:44:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: Deploying daemon mds.h on smithi066 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.106:6836/1095097353,v1:172.21.15.106:6837/1095097353] up:boot 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: fsmap 7 up:standby 2024-08-31T06:44:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:44:20.846 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:20 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3809861475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:20.846 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:20 smithi066 systemd[1]: Starting Ceph mds.h for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:20.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:20 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3809861475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:21.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:20 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3809861475' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:21.124 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:20 smithi066 podman[52486]: 2024-08-31 06:44:20.748852864 +0000 UTC m=+0.016859436 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:21.125 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:20 smithi066 podman[52486]: 2024-08-31 06:44:20.876388541 +0000 UTC m=+0.144395101 container create 3e711934342cd3f02932cfb0c90af3e1400e59e3324faa4967db2b4b34dc6ec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:44:21.125 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:21 smithi066 podman[52486]: 2024-08-31 06:44:21.087346383 +0000 UTC m=+0.355352945 container init 3e711934342cd3f02932cfb0c90af3e1400e59e3324faa4967db2b4b34dc6ec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-08-31T06:44:21.125 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:21 smithi066 podman[52486]: 2024-08-31 06:44:21.090378611 +0000 UTC m=+0.358385186 container start 3e711934342cd3f02932cfb0c90af3e1400e59e3324faa4967db2b4b34dc6ec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.1) 2024-08-31T06:44:21.125 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-mds[52505]: -- 172.21.15.66:0/3771643425 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55918c78d860 con 0x559190933600 2024-08-31T06:44:21.387 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h[52501]: starting mds.h at 2024-08-31T06:44:21.387 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:21 smithi066 bash[52486]: 3e711934342cd3f02932cfb0c90af3e1400e59e3324faa4967db2b4b34dc6ec4 2024-08-31T06:44:21.387 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:44:21 smithi066 systemd[1]: Started Ceph mds.h for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:21.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:21 smithi037 ceph-mon[18612]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:21.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:21.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:21.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:21 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:21.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-mon[22244]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:21.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:21.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:21.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:21 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:21.936 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:21 smithi106 ceph-mon[22134]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:21.936 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.936 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.937 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:21.937 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:21.937 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:21.937 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:21 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:22.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:22.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:22 smithi066 ceph-mon[22244]: Deploying daemon mds.i on smithi106 2024-08-31T06:44:22.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:22 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] up:boot 2024-08-31T06:44:22.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:22 smithi066 ceph-mon[22244]: fsmap 8 up:standby 2024-08-31T06:44:22.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:22 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:44:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:22.977 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:22 smithi106 ceph-mon[22134]: Deploying daemon mds.i on smithi106 2024-08-31T06:44:22.977 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:22 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] up:boot 2024-08-31T06:44:22.977 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:22 smithi106 ceph-mon[22134]: fsmap 8 up:standby 2024-08-31T06:44:22.977 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:22 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:44:22.983 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:22 smithi037 ceph-mon[18612]: Deploying daemon mds.i on smithi106 2024-08-31T06:44:22.983 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:22 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] up:boot 2024-08-31T06:44:22.983 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:22 smithi037 ceph-mon[18612]: fsmap 8 up:standby 2024-08-31T06:44:22.984 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:22 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:44:23.315 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 systemd[1]: Starting Ceph mds.i for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 -- 172.21.15.37:0/3234706365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 msgr2=0x7f4d301103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 --2- 172.21.15.37:0/3234706365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 0x7f4d301103f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d28009ca0 tx=0x7f4d2802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 -- 172.21.15.37:0/3234706365 shutdown_connections 2024-08-31T06:44:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 --2- 172.21.15.37:0/3234706365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 0x7f4d301103f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 --2- 172.21.15.37:0/3234706365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d30109270 0x7f4d30109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 --2- 172.21.15.37:0/3234706365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d30103930 0x7f4d30103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 -- 172.21.15.37:0/3234706365 >> 172.21.15.37:0/3234706365 conn(0x7f4d300ff380 msgr2=0x7f4d301017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 -- 172.21.15.37:0/3234706365 shutdown_connections 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 -- 172.21.15.37:0/3234706365 wait complete. 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.385+0000 7f4d359a3640 1 Processor -- start 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d359a3640 1 -- start start 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d359a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d30103930 0x7f4d300754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d359a3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d30109270 0x7f4d300759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d359a3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 0x7f4d30075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d359a3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4d30113780 con 0x7f4d30109bc0 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d359a3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4d30113600 con 0x7f4d30103930 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d359a3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4d30113900 con 0x7f4d30109270 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d2f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 0x7f4d30075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d2f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 0x7f4d30075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37032/0 (socket says 172.21.15.37:37032) 2024-08-31T06:44:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d2f7fe640 1 -- 172.21.15.37:0/1285307238 learned_addr learned my addr 172.21.15.37:0/1285307238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d2e7fc640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d30109270 0x7f4d300759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.386+0000 7f4d2effd640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d30103930 0x7f4d300754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d2e7fc640 1 -- 172.21.15.37:0/1285307238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d30103930 msgr2=0x7f4d300754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d2e7fc640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d30103930 0x7f4d300754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d2e7fc640 1 -- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 msgr2=0x7f4d30075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d2e7fc640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 0x7f4d30075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d2e7fc640 1 -- 172.21.15.37:0/1285307238 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d301a8410 con 0x7f4d30109270 2024-08-31T06:44:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d2f7fe640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 0x7f4d30075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d2e7fc640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d30109270 0x7f4d300759f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d3006b8d0 tx=0x7f4d2400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d349a1640 1 -- 172.21.15.37:0/1285307238 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400cc40 con 0x7f4d30109270 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d301a8700 con 0x7f4d30109270 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d349a1640 1 -- 172.21.15.37:0/1285307238 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d2400cde0 con 0x7f4d30109270 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d349a1640 1 -- 172.21.15.37:0/1285307238 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d24004800 con 0x7f4d30109270 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.387+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d301a8c40 con 0x7f4d30109270 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.388+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d30103d40 con 0x7f4d30109270 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.390+0000 7f4d349a1640 1 -- 172.21.15.37:0/1285307238 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f4d24004aa0 con 0x7f4d30109270 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.390+0000 7f4d349a1640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4d180b4b80 0x7f4d180b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.390+0000 7f4d2effd640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4d180b4b80 0x7f4d180b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.390+0000 7f4d349a1640 1 -- 172.21.15.37:0/1285307238 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f4d240e4dc0 con 0x7f4d30109270 2024-08-31T06:44:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.391+0000 7f4d2effd640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4d180b4b80 0x7f4d180b7090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4d30076f00 tx=0x7f4d2000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.395+0000 7f4d349a1640 1 -- 172.21.15.37:0/1285307238 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4d240ac260 con 0x7f4d30109270 2024-08-31T06:44:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.621+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d3002e430 con 0x7f4d30109270 2024-08-31T06:44:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.621+0000 7f4d349a1640 1 -- 172.21.15.37:0/1285307238 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f4d240abb60 con 0x7f4d30109270 2024-08-31T06:44:23.623 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:23.623 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":9,"btime":"2024-08-31T06:44:21:597104+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-08-31T06:44:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 9 2024-08-31T06:44:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4d180b4b80 msgr2=0x7f4d180b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4d180b4b80 0x7f4d180b7090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4d30076f00 tx=0x7f4d2000b390 comp rx=0 tx=0).stop 2024-08-31T06:44:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d30109270 msgr2=0x7f4d300759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d30109270 0x7f4d300759f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4d3006b8d0 tx=0x7f4d2400ee50 comp rx=0 tx=0).stop 2024-08-31T06:44:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 shutdown_connections 2024-08-31T06:44:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4d180b4b80 0x7f4d180b7090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d30109bc0 0x7f4d30075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d30109270 0x7f4d300759f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 --2- 172.21.15.37:0/1285307238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d30103930 0x7f4d300754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 >> 172.21.15.37:0/1285307238 conn(0x7f4d300ff380 msgr2=0x7f4d301017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 shutdown_connections 2024-08-31T06:44:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:23.624+0000 7f4d359a3640 1 -- 172.21.15.37:0/1285307238 wait complete. 2024-08-31T06:44:23.661 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:23 smithi106 ceph-mon[22134]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:23.662 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 podman[53965]: 2024-08-31 06:44:23.266242333 +0000 UTC m=+0.015733406 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:23.662 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 podman[53965]: 2024-08-31 06:44:23.417350527 +0000 UTC m=+0.166841663 container create 679d36093c9086e0e69a4cdb5c6446982ef67d989eecefaa3ab0e73562648006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0) 2024-08-31T06:44:23.662 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 podman[53965]: 2024-08-31 06:44:23.661355388 +0000 UTC m=+0.410846462 container init 679d36093c9086e0e69a4cdb5c6446982ef67d989eecefaa3ab0e73562648006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-31T06:44:23.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:23 smithi066 ceph-mon[22244]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:24.036 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:23 smithi037 ceph-mon[18612]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:24.065 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 podman[53965]: 2024-08-31 06:44:23.664436614 +0000 UTC m=+0.413927689 container start 679d36093c9086e0e69a4cdb5c6446982ef67d989eecefaa3ab0e73562648006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T06:44:24.065 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 ceph-mds[53984]: -- 172.21.15.106:0/2101924295 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be26019860 con 0x55be2a1bfa80 2024-08-31T06:44:24.066 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i[53980]: starting mds.i at 2024-08-31T06:44:24.066 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 bash[53965]: 679d36093c9086e0e69a4cdb5c6446982ef67d989eecefaa3ab0e73562648006 2024-08-31T06:44:24.066 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:44:23 smithi106 systemd[1]: Started Ceph mds.i for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:24.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:24 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1285307238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:24.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:24.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:24.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:24.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:24.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:24.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:24 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:24.811 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:24 smithi037 ceph-mon[18612]: Deploying daemon mds.g on smithi037 2024-08-31T06:44:24.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:24 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1285307238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:24.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:24 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:24.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:24 smithi066 ceph-mon[22244]: Deploying daemon mds.g on smithi037 2024-08-31T06:44:25.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:24 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1285307238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:25.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:25.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:25.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:25.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:25.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:25.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:24 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:25.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:24 smithi106 ceph-mon[22134]: Deploying daemon mds.g on smithi037 2024-08-31T06:44:25.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:25 smithi037 ceph-mon[18612]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:25.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:25 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] up:boot 2024-08-31T06:44:25.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:25 smithi037 ceph-mon[18612]: fsmap 9 up:standby 2024-08-31T06:44:25.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:25 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:44:25.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:25 smithi066 ceph-mon[22244]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:25.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:25 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] up:boot 2024-08-31T06:44:25.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:25 smithi066 ceph-mon[22244]: fsmap 9 up:standby 2024-08-31T06:44:25.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:25 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:44:26.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:25 smithi106 ceph-mon[22134]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:26.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:25 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] up:boot 2024-08-31T06:44:26.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:25 smithi106 ceph-mon[22134]: fsmap 9 up:standby 2024-08-31T06:44:26.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:25 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:44:26.105 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:25 smithi037 systemd[1]: Starting Ceph mds.g for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:26.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:26.493 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:26 smithi037 podman[62813]: 2024-08-31 06:44:26.095570373 +0000 UTC m=+0.015499114 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:26.493 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:26 smithi037 podman[62813]: 2024-08-31 06:44:26.223431894 +0000 UTC m=+0.143360617 container create 0a980fe2706afb70a90052acabd0e1e9d147795921947b2a95ea0154ec35a836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True) 2024-08-31T06:44:26.493 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:26 smithi037 podman[62813]: 2024-08-31 06:44:26.493130958 +0000 UTC m=+0.413059697 container init 0a980fe2706afb70a90052acabd0e1e9d147795921947b2a95ea0154ec35a836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-31T06:44:26.693 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:26.815 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:26 smithi037 podman[62813]: 2024-08-31 06:44:26.497194696 +0000 UTC m=+0.417123423 container start 0a980fe2706afb70a90052acabd0e1e9d147795921947b2a95ea0154ec35a836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T06:44:26.815 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:26 smithi037 ceph-mds[62852]: -- 172.21.15.37:0/2813923894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b0a7bd860 con 0x559b0e963600 2024-08-31T06:44:26.815 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:26 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g[62846]: starting mds.g at 2024-08-31T06:44:26.815 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:26 smithi037 bash[62813]: 0a980fe2706afb70a90052acabd0e1e9d147795921947b2a95ea0154ec35a836 2024-08-31T06:44:26.815 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:44:26 smithi037 systemd[1]: Started Ceph mds.g for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:27.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 -- 172.21.15.37:0/1936933257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108220 msgr2=0x7fbe58108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/1936933257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108220 0x7fbe58108630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbe40009900 tx=0x7fbe4002a410 comp rx=0 tx=0).stop 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 -- 172.21.15.37:0/1936933257 shutdown_connections 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/1936933257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108220 0x7fbe58108630 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/1936933257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe58108b70 0x7fbe5810f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/1936933257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe581028e0 0x7fbe58102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 -- 172.21.15.37:0/1936933257 >> 172.21.15.37:0/1936933257 conn(0x7fbe580794f0 msgr2=0x7fbe58079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 -- 172.21.15.37:0/1936933257 shutdown_connections 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.180+0000 7fbe5cc14640 1 -- 172.21.15.37:0/1936933257 wait complete. 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5cc14640 1 Processor -- start 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5cc14640 1 -- start start 2024-08-31T06:44:27.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5cc14640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe581028e0 0x7fbe58104f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5cc14640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe58108220 0x7fbe581054a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5cc14640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108b70 0x7fbe581059e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5cc14640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbe58112630 con 0x7fbe58108b70 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5cc14640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbe581124b0 con 0x7fbe581028e0 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5cc14640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbe581127b0 con 0x7fbe58108220 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe56d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108b70 0x7fbe581059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe581028e0 0x7fbe58104f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe56d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108b70 0x7fbe581059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54718/0 (socket says 172.21.15.37:54718) 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe56d9d640 1 -- 172.21.15.37:0/2608225100 learned_addr learned my addr 172.21.15.37:0/2608225100 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe5659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe581028e0 0x7fbe58104f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:52586/0 (socket says 172.21.15.37:52586) 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.181+0000 7fbe55d9b640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe58108220 0x7fbe581054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe56d9d640 1 -- 172.21.15.37:0/2608225100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe58108220 msgr2=0x7fbe581054a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:27.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe56d9d640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe58108220 0x7fbe581054a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe56d9d640 1 -- 172.21.15.37:0/2608225100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe581028e0 msgr2=0x7fbe58104f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe56d9d640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe581028e0 0x7fbe58104f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe56d9d640 1 -- 172.21.15.37:0/2608225100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe581a8440 con 0x7fbe58108b70 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe56d9d640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108b70 0x7fbe581059e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000b970 tx=0x7fbe5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe4f7fe640 1 -- 172.21.15.37:0/2608225100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50019070 con 0x7fbe58108b70 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe4f7fe640 1 -- 172.21.15.37:0/2608225100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe50014440 con 0x7fbe58108b70 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe4f7fe640 1 -- 172.21.15.37:0/2608225100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe500075d0 con 0x7fbe58108b70 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe581a8730 con 0x7fbe58108b70 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.182+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe581a8c70 con 0x7fbe58108b70 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.183+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe58103b60 con 0x7fbe58108b70 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.184+0000 7fbe4f7fe640 1 -- 172.21.15.37:0/2608225100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7fbe5001c070 con 0x7fbe58108b70 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.185+0000 7fbe4f7fe640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbe440b4b80 0x7fbe440b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.185+0000 7fbe5659c640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbe440b4b80 0x7fbe440b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:27.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.185+0000 7fbe4f7fe640 1 -- 172.21.15.37:0/2608225100 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fbe500e47a0 con 0x7fbe58108b70 2024-08-31T06:44:27.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.186+0000 7fbe5659c640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbe440b4b80 0x7fbe440b7090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe581069b0 tx=0x7fbe4800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:27.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.188+0000 7fbe4f7fe640 1 -- 172.21.15.37:0/2608225100 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbe500ab5b0 con 0x7fbe58108b70 2024-08-31T06:44:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.419+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe58102cf0 con 0x7fbe58108b70 2024-08-31T06:44:27.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.419+0000 7fbe4f7fe640 1 -- 172.21.15.37:0/2608225100 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8857 (secure 0 0 0) 0x7fbe500b4140 con 0x7fbe58108b70 2024-08-31T06:44:27.421 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:27.421 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":11,"btime":"2024-08-31T06:44:26:619031+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24658,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T06:44:27.421 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 11 2024-08-31T06:44:27.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbe440b4b80 msgr2=0x7fbe440b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:27.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbe440b4b80 0x7fbe440b7090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe581069b0 tx=0x7fbe4800b390 comp rx=0 tx=0).stop 2024-08-31T06:44:27.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108b70 msgr2=0x7fbe581059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:27.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108b70 0x7fbe581059e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbe5000b970 tx=0x7fbe5000be30 comp rx=0 tx=0).stop 2024-08-31T06:44:27.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 shutdown_connections 2024-08-31T06:44:27.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbe440b4b80 0x7fbe440b7090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe58108b70 0x7fbe581059e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe58108220 0x7fbe581054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 --2- 172.21.15.37:0/2608225100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe581028e0 0x7fbe58104f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:27.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 >> 172.21.15.37:0/2608225100 conn(0x7fbe580794f0 msgr2=0x7fbe58100b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:27.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 shutdown_connections 2024-08-31T06:44:27.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:27.422+0000 7fbe5cc14640 1 -- 172.21.15.37:0/2608225100 wait complete. 2024-08-31T06:44:27.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.37:6838/4551184,v1:172.21.15.37:6839/4551184] up:boot 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: fsmap 10 up:standby 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: Deploying daemon mds.a on smithi037 2024-08-31T06:44:27.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:27 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2608225100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:27.902 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:27.902 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.37:6838/4551184,v1:172.21.15.37:6839/4551184] up:boot 2024-08-31T06:44:27.902 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: fsmap 10 up:standby 2024-08-31T06:44:27.902 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:44:27.902 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:27.902 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:27.903 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:27.903 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:27.903 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:27.903 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:27.903 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: Deploying daemon mds.a on smithi037 2024-08-31T06:44:27.903 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:27 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2608225100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.37:6838/4551184,v1:172.21.15.37:6839/4551184] up:boot 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: fsmap 10 up:standby 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: Deploying daemon mds.a on smithi037 2024-08-31T06:44:28.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:27 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2608225100' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:29.605 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:29 smithi037 systemd[1]: Starting Ceph mds.a for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:44:29.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:29 smithi066 ceph-mon[22244]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:29.929 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:29 smithi037 ceph-mon[18612]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:29.930 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:29 smithi037 podman[63232]: 2024-08-31 06:44:29.543283251 +0000 UTC m=+0.015390095 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:44:29.930 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:29 smithi037 podman[63232]: 2024-08-31 06:44:29.702065072 +0000 UTC m=+0.174171941 container create 9f3a20e44d8d481ab119deffd39cdf7143f664d0c4f7584c70f02261dabb5fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T06:44:30.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:29 smithi106 ceph-mon[22134]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:30.355 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:29 smithi037 podman[63232]: 2024-08-31 06:44:29.929354907 +0000 UTC m=+0.401461744 container init 9f3a20e44d8d481ab119deffd39cdf7143f664d0c4f7584c70f02261dabb5fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:44:30.355 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:29 smithi037 podman[63232]: 2024-08-31 06:44:29.932169152 +0000 UTC m=+0.404275981 container start 9f3a20e44d8d481ab119deffd39cdf7143f664d0c4f7584c70f02261dabb5fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1) 2024-08-31T06:44:30.355 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:29 smithi037 ceph-mds[63251]: -- 172.21.15.37:0/2432316819 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635ffc19860 con 0x563603dbf180 2024-08-31T06:44:30.355 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:29 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a[63247]: starting mds.a at 2024-08-31T06:44:30.355 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:30 smithi037 bash[63232]: 9f3a20e44d8d481ab119deffd39cdf7143f664d0c4f7584c70f02261dabb5fe6 2024-08-31T06:44:30.355 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:44:30 smithi037 systemd[1]: Started Ceph mds.a for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:30.549 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:30.806 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:31.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.230 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:31.231 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:31.231 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:31.231 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: Deploying daemon mds.b on smithi066 2024-08-31T06:44:31.231 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.37:6840/407340451,v1:172.21.15.37:6841/407340451] up:boot 2024-08-31T06:44:31.231 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: fsmap 11 up:standby 2024-08-31T06:44:31.231 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:31 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:44:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: Deploying daemon mds.b on smithi066 2024-08-31T06:44:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.37:6840/407340451,v1:172.21.15.37:6841/407340451] up:boot 2024-08-31T06:44:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: fsmap 11 up:standby 2024-08-31T06:44:31.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:31 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:44:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.320+0000 7f5ae5188640 1 -- 172.21.15.37:0/2853255081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109240 msgr2=0x7f5ae0109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.320+0000 7f5ae5188640 1 --2- 172.21.15.37:0/2853255081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109240 0x7f5ae0109650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009900 tx=0x7f5ad402a410 comp rx=0 tx=0).stop 2024-08-31T06:44:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.320+0000 7f5ae5188640 1 -- 172.21.15.37:0/2853255081 shutdown_connections 2024-08-31T06:44:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.320+0000 7f5ae5188640 1 --2- 172.21.15.37:0/2853255081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109240 0x7f5ae0109650 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.320+0000 7f5ae5188640 1 --2- 172.21.15.37:0/2853255081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ae0109b90 0x7f5ae01103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.320+0000 7f5ae5188640 1 --2- 172.21.15.37:0/2853255081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ae0103900 0x7f5ae0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.320+0000 7f5ae5188640 1 -- 172.21.15.37:0/2853255081 >> 172.21.15.37:0/2853255081 conn(0x7f5ae007b5f0 msgr2=0x7f5ae007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.320+0000 7f5ae5188640 1 -- 172.21.15.37:0/2853255081 shutdown_connections 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.321+0000 7f5ae5188640 1 -- 172.21.15.37:0/2853255081 wait complete. 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.321+0000 7f5ae5188640 1 Processor -- start 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.321+0000 7f5ae5188640 1 -- start start 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5ae5188640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ae0103900 0x7f5ae019a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5ae5188640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ae0109240 0x7f5ae019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5ae5188640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109b90 0x7f5ae019fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5ae5188640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae0113700 con 0x7f5ae0109b90 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5ae5188640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae0113580 con 0x7f5ae0103900 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5ae5188640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae0113880 con 0x7f5ae0109240 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109b90 0x7f5ae019fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109b90 0x7f5ae019fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54760/0 (socket says 172.21.15.37:54760) 2024-08-31T06:44:31.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 -- 172.21.15.37:0/1013530859 learned_addr learned my addr 172.21.15.37:0/1013530859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5aded9d640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ae0103900 0x7f5ae019a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5ade59c640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ae0109240 0x7f5ae019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 -- 172.21.15.37:0/1013530859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ae0109240 msgr2=0x7f5ae019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ae0109240 0x7f5ae019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 -- 172.21.15.37:0/1013530859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ae0103900 msgr2=0x7f5ae019a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ae0103900 0x7f5ae019a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 -- 172.21.15.37:0/1013530859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae01a0140 con 0x7f5ae0109b90 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.322+0000 7f5adf59e640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109b90 0x7f5ae019fa10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009fd0 tx=0x7f5ad800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.323+0000 7f5ac7fff640 1 -- 172.21.15.37:0/1013530859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8017070 con 0x7f5ae0109b90 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.323+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae01a0430 con 0x7f5ae0109b90 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.323+0000 7f5ac7fff640 1 -- 172.21.15.37:0/1013530859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ad8003e00 con 0x7f5ae0109b90 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.323+0000 7f5ac7fff640 1 -- 172.21.15.37:0/1013530859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8010460 con 0x7f5ae0109b90 2024-08-31T06:44:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.323+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae01a6b90 con 0x7f5ae0109b90 2024-08-31T06:44:31.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.324+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae0103d10 con 0x7f5ae0109b90 2024-08-31T06:44:31.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.325+0000 7f5ac7fff640 1 -- 172.21.15.37:0/1013530859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f5ad8003970 con 0x7f5ae0109b90 2024-08-31T06:44:31.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.326+0000 7f5ac7fff640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5ac80b4b80 0x7f5ac80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:31.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.326+0000 7f5aded9d640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5ac80b4b80 0x7f5ac80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:31.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.326+0000 7f5ac7fff640 1 -- 172.21.15.37:0/1013530859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f5ad80e4f10 con 0x7f5ae0109b90 2024-08-31T06:44:31.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.327+0000 7f5aded9d640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5ac80b4b80 0x7f5ac80b7090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000bbe0 tx=0x7f5ad000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:31.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.329+0000 7f5ac7fff640 1 -- 172.21.15.37:0/1013530859 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5ad80abd20 con 0x7f5ae0109b90 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: Deploying daemon mds.b on smithi066 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.37:6840/407340451,v1:172.21.15.37:6841/407340451] up:boot 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: fsmap 11 up:standby 2024-08-31T06:44:31.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:31 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-31T06:44:31.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.553+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ae019b300 con 0x7f5ae0109b90 2024-08-31T06:44:31.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.554+0000 7f5ac7fff640 1 -- 172.21.15.37:0/1013530859 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9680 (secure 0 0 0) 0x7f5ad80b04e0 con 0x7f5ae0109b90 2024-08-31T06:44:31.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:31.555 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":12,"btime":"2024-08-31T06:44:30:628899+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24658,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-31T06:44:31.556 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 12 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5ac80b4b80 msgr2=0x7f5ac80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5ac80b4b80 0x7f5ac80b7090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000bbe0 tx=0x7f5ad000b390 comp rx=0 tx=0).stop 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109b90 msgr2=0x7f5ae019fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109b90 0x7f5ae019fa10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009fd0 tx=0x7f5ad800b260 comp rx=0 tx=0).stop 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 shutdown_connections 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5ac80b4b80 0x7f5ac80b7090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ae0109b90 0x7f5ae019fa10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ae0109240 0x7f5ae019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 --2- 172.21.15.37:0/1013530859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ae0103900 0x7f5ae019a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 >> 172.21.15.37:0/1013530859 conn(0x7f5ae007b5f0 msgr2=0x7f5ae0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:31.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 shutdown_connections 2024-08-31T06:44:31.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:31.557+0000 7f5ae5188640 1 -- 172.21.15.37:0/1013530859 wait complete. 2024-08-31T06:44:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:32 smithi066 ceph-mon[22244]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:32.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:32 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1013530859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:32 smithi037 ceph-mon[18612]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:32 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1013530859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:32.541 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:32 smithi106 ceph-mon[22134]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:32.541 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:32 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1013530859' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:32.887 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:44:32 smithi066 systemd[1]: Started Ceph mds.b for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:44:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:44:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] up:boot 2024-08-31T06:44:33.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: fsmap 12 up:standby 2024-08-31T06:44:33.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:44:33.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:44:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] up:boot 2024-08-31T06:44:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: fsmap 12 up:standby 2024-08-31T06:44:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:44:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] up:boot 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: fsmap 12 up:standby 2024-08-31T06:44:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:44:34.139 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:34.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:44:34.497 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:35.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 -- 172.21.15.37:0/2644753315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 msgr2=0x7ff4c810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:35.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 --2- 172.21.15.37:0/2644753315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 0x7ff4c810f2e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009900 tx=0x7ff4c002a410 comp rx=0 tx=0).stop 2024-08-31T06:44:35.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 -- 172.21.15.37:0/2644753315 shutdown_connections 2024-08-31T06:44:35.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 --2- 172.21.15.37:0/2644753315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 0x7ff4c810f2e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 --2- 172.21.15.37:0/2644753315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c8108160 0x7ff4c8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 --2- 172.21.15.37:0/2644753315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c8102820 0x7ff4c8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 -- 172.21.15.37:0/2644753315 >> 172.21.15.37:0/2644753315 conn(0x7ff4c80794e0 msgr2=0x7ff4c80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 -- 172.21.15.37:0/2644753315 shutdown_connections 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.016+0000 7ff4d070b640 1 -- 172.21.15.37:0/2644753315 wait complete. 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4d070b640 1 Processor -- start 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4d070b640 1 -- start start 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4d070b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c8102820 0x7ff4c819aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4d070b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c8108160 0x7ff4c819b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4d070b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 0x7ff4c819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4d070b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c81125c0 con 0x7ff4c8108ab0 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4d070b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c8112440 con 0x7ff4c8102820 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4d070b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c8112740 con 0x7ff4c8108160 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ceca8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 0x7ff4c819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:35.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ce4a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c8102820 0x7ff4c819aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ceca8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 0x7ff4c819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39434/0 (socket says 172.21.15.37:39434) 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ceca8640 1 -- 172.21.15.37:0/3569363983 learned_addr learned my addr 172.21.15.37:0/3569363983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4cdca6640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c8108160 0x7ff4c819b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ceca8640 1 -- 172.21.15.37:0/3569363983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c8108160 msgr2=0x7ff4c819b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ceca8640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c8108160 0x7ff4c819b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ceca8640 1 -- 172.21.15.37:0/3569363983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c8102820 msgr2=0x7ff4c819aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ceca8640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c8102820 0x7ff4c819aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.017+0000 7ff4ceca8640 1 -- 172.21.15.37:0/3569363983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c81a61c0 con 0x7ff4c8108ab0 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.018+0000 7ff4ceca8640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 0x7ff4c819b930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0005ab0 tx=0x7ff4c00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.018+0000 7ff4c77fe640 1 -- 172.21.15.37:0/3569363983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c003f030 con 0x7ff4c8108ab0 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.018+0000 7ff4c77fe640 1 -- 172.21.15.37:0/3569363983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4c0003a80 con 0x7ff4c8108ab0 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.018+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c81a6450 con 0x7ff4c8108ab0 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.018+0000 7ff4c77fe640 1 -- 172.21.15.37:0/3569363983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0035070 con 0x7ff4c8108ab0 2024-08-31T06:44:35.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.018+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c81a6980 con 0x7ff4c8108ab0 2024-08-31T06:44:35.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.019+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c8103aa0 con 0x7ff4c8108ab0 2024-08-31T06:44:35.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.020+0000 7ff4c77fe640 1 -- 172.21.15.37:0/3569363983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7ff4c0042030 con 0x7ff4c8108ab0 2024-08-31T06:44:35.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.021+0000 7ff4c77fe640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4b00b4c00 0x7ff4b00b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:35.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.021+0000 7ff4ce4a7640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4b00b4c00 0x7ff4b00b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:35.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.021+0000 7ff4c77fe640 1 -- 172.21.15.37:0/3569363983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7ff4c01056b0 con 0x7ff4c8108ab0 2024-08-31T06:44:35.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.022+0000 7ff4ce4a7640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4b00b4c00 0x7ff4b00b7110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff4c806c4a0 tx=0x7ff4b8009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:35.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.025+0000 7ff4c77fe640 1 -- 172.21.15.37:0/3569363983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff4c00cc4c0 con 0x7ff4c8108ab0 2024-08-31T06:44:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.254+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4c8102c30 con 0x7ff4c8108ab0 2024-08-31T06:44:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.254+0000 7ff4c77fe640 1 -- 172.21.15.37:0/3569363983 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10506 (secure 0 0 0) 0x7ff4c00d0c80 con 0x7ff4c8108ab0 2024-08-31T06:44:35.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:35.256 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"btime":"2024-08-31T06:44:33:078301+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24629,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24643,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24658,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-31T06:44:35.257 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2024-08-31T06:44:35.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4b00b4c00 msgr2=0x7ff4b00b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4b00b4c00 0x7ff4b00b7110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff4c806c4a0 tx=0x7ff4b8009760 comp rx=0 tx=0).stop 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 msgr2=0x7ff4c819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 0x7ff4c819b930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0005ab0 tx=0x7ff4c00040e0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 shutdown_connections 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4b00b4c00 0x7ff4b00b7110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4c8108ab0 0x7ff4c819b930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4c8108160 0x7ff4c819b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 --2- 172.21.15.37:0/3569363983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4c8102820 0x7ff4c819aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 >> 172.21.15.37:0/3569363983 conn(0x7ff4c80794e0 msgr2=0x7ff4c8105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 shutdown_connections 2024-08-31T06:44:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:35.257+0000 7ff4d070b640 1 -- 172.21.15.37:0/3569363983 wait complete. 2024-08-31T06:44:35.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:35.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:35.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:44:35.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:35 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:44:35.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:44:35.606 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.607 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:35 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:44:35.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:35.638 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:35 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:44:35.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-31T06:44:36.447 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:36 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3569363983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:36.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:36 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3569363983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:36.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:36 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3569363983' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:44:36.861 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:37.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 -- 172.21.15.37:0/3377920272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108170 msgr2=0x7f99f8108580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:37.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 --2- 172.21.15.37:0/3377920272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108170 0x7f99f8108580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009900 tx=0x7f99ec02a410 comp rx=0 tx=0).stop 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 -- 172.21.15.37:0/3377920272 shutdown_connections 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 --2- 172.21.15.37:0/3377920272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108170 0x7f99f8108580 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 --2- 172.21.15.37:0/3377920272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f8108ac0 0x7f99f810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 --2- 172.21.15.37:0/3377920272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99f8102880 0x7f99f8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 -- 172.21.15.37:0/3377920272 >> 172.21.15.37:0/3377920272 conn(0x7f99f8079550 msgr2=0x7f99f8079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 -- 172.21.15.37:0/3377920272 shutdown_connections 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.338+0000 7f99fe687640 1 -- 172.21.15.37:0/3377920272 wait complete. 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.339+0000 7f99fe687640 1 Processor -- start 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.339+0000 7f99fe687640 1 -- start start 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.339+0000 7f99fe687640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99f8102880 0x7f99f819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.339+0000 7f99fe687640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f8108170 0x7f99f819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.339+0000 7f99fe687640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108ac0 0x7f99f81a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:37.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.339+0000 7f99fe687640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8112600 con 0x7f99f8108ac0 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.339+0000 7f99fe687640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8112480 con 0x7f99f8102880 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.339+0000 7f99fe687640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f99f8112780 con 0x7f99f8108170 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108ac0 0x7f99f81a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108ac0 0x7f99f81a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39442/0 (socket says 172.21.15.37:39442) 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 -- 172.21.15.37:0/2684065372 learned_addr learned my addr 172.21.15.37:0/2684065372 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99f7fff640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99f8102880 0x7f99f819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99f77fe640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f8108170 0x7f99f819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 -- 172.21.15.37:0/2684065372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f8108170 msgr2=0x7f99f819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f8108170 0x7f99f819c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 -- 172.21.15.37:0/2684065372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99f8102880 msgr2=0x7f99f819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99f8102880 0x7f99f819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 -- 172.21.15.37:0/2684065372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f81a2300 con 0x7f99f8108ac0 2024-08-31T06:44:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99f77fe640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f8108170 0x7f99f819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fcc24640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108ac0 0x7f99f81a1bd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99f000cad0 tx=0x7f99f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99f57fa640 1 -- 172.21.15.37:0/2684065372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f000ae20 con 0x7f99f8108ac0 2024-08-31T06:44:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f81a25f0 con 0x7f99f8108ac0 2024-08-31T06:44:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99f57fa640 1 -- 172.21.15.37:0/2684065372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99f0005020 con 0x7f99f8108ac0 2024-08-31T06:44:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99f57fa640 1 -- 172.21.15.37:0/2684065372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f000f6b0 con 0x7f99f8108ac0 2024-08-31T06:44:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.340+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f81a8d50 con 0x7f99f8108ac0 2024-08-31T06:44:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.341+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f8102c90 con 0x7f99f8108ac0 2024-08-31T06:44:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.343+0000 7f99f57fa640 1 -- 172.21.15.37:0/2684065372 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f99f00051d0 con 0x7f99f8108ac0 2024-08-31T06:44:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.343+0000 7f99f57fa640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99e00b4b80 0x7f99e00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.344+0000 7f99f7fff640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99e00b4b80 0x7f99e00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.344+0000 7f99f57fa640 1 -- 172.21.15.37:0/2684065372 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f99f00e5130 con 0x7f99f8108ac0 2024-08-31T06:44:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.344+0000 7f99f7fff640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99e00b4b80 0x7f99e00b7090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f99e800bbe0 tx=0x7f99e800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:37.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.347+0000 7f99f57fa640 1 -- 172.21.15.37:0/2684065372 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f99f0014030 con 0x7f99f8108ac0 2024-08-31T06:44:37.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.548+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f99f802e430 con 0x7f99f8108ac0 2024-08-31T06:44:37.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:37 smithi037 ceph-mon[18612]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:37.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.550 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.549+0000 7f99f57fa640 1 -- 172.21.15.37:0/2684065372 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f99f00ac630 con 0x7f99f8108ac0 2024-08-31T06:44:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:37.551 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-08-31T06:44:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:44:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-08-31T06:44:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-08-31T06:44:37.551 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:44:37.551 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99e00b4b80 msgr2=0x7f99e00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99e00b4b80 0x7f99e00b7090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f99e800bbe0 tx=0x7f99e800b390 comp rx=0 tx=0).stop 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108ac0 msgr2=0x7f99f81a1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108ac0 0x7f99f81a1bd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99f000cad0 tx=0x7f99f000cf90 comp rx=0 tx=0).stop 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 shutdown_connections 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99e00b4b80 0x7f99e00b7090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99f8108ac0 0x7f99f81a1bd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99f8108170 0x7f99f819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.551+0000 7f99fe687640 1 --2- 172.21.15.37:0/2684065372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99f8102880 0x7f99f819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.552+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 >> 172.21.15.37:0/2684065372 conn(0x7f99f8079550 msgr2=0x7f99f8106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.552+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 shutdown_connections 2024-08-31T06:44:37.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:37.552+0000 7f99fe687640 1 -- 172.21.15.37:0/2684065372 wait complete. 2024-08-31T06:44:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:37 smithi106 ceph-mon[22134]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:37 smithi066 ceph-mon[22244]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:37.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:37.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.277 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-31T06:44:38.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-31T06:44:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:38.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:38 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2684065372' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T06:44:38.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:38 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:38 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:38 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:38.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:38 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:44:38.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:38 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:38 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2684065372' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T06:44:38.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:38 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:38 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:38 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:38.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:38 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:44:38.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:38 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:38 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2684065372' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-31T06:44:38.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:38 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:38 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:38 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:44:38.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:38 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:44:38.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:38 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:44:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 -- 172.21.15.37:0/2158034474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 msgr2=0x7f1c1c102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/2158034474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 0x7f1c1c102c50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009900 tx=0x7f1c1802a410 comp rx=0 tx=0).stop 2024-08-31T06:44:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 -- 172.21.15.37:0/2158034474 shutdown_connections 2024-08-31T06:44:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/2158034474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c1c108ad0 0x7f1c1c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/2158034474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1c108180 0x7f1c1c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:38.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/2158034474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 0x7f1c1c102c50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 -- 172.21.15.37:0/2158034474 >> 172.21.15.37:0/2158034474 conn(0x7f1c1c0794f0 msgr2=0x7f1c1c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 -- 172.21.15.37:0/2158034474 shutdown_connections 2024-08-31T06:44:38.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 -- 172.21.15.37:0/2158034474 wait complete. 2024-08-31T06:44:38.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.975+0000 7f1c23cc2640 1 Processor -- start 2024-08-31T06:44:38.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c23cc2640 1 -- start start 2024-08-31T06:44:38.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c23cc2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 0x7f1c1c19c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c23cc2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1c108180 0x7f1c1c19ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c23cc2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c1c108ad0 0x7f1c1c1a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c23cc2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c1137b0 con 0x7f1c1c102840 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c23cc2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c113630 con 0x7f1c1c108ad0 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c23cc2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1c113930 con 0x7f1c1c108180 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 0x7f1c1c19c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 0x7f1c1c19c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39470/0 (socket says 172.21.15.37:39470) 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 -- 172.21.15.37:0/3652180827 learned_addr learned my addr 172.21.15.37:0/3652180827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c2125d640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1c108180 0x7f1c1c19ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c2225f640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c1c108ad0 0x7f1c1c1a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 -- 172.21.15.37:0/3652180827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1c108180 msgr2=0x7f1c1c19ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1c108180 0x7f1c1c19ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 -- 172.21.15.37:0/3652180827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c1c108ad0 msgr2=0x7f1c1c1a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:38.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c1c108ad0 0x7f1c1c1a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 -- 172.21.15.37:0/3652180827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1c1a2410 con 0x7f1c1c102840 2024-08-31T06:44:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.976+0000 7f1c21a5e640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 0x7f1c1c19c4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009a20 tx=0x7f1c18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.977+0000 7f1c12ffd640 1 -- 172.21.15.37:0/3652180827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1803f030 con 0x7f1c1c102840 2024-08-31T06:44:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.977+0000 7f1c12ffd640 1 -- 172.21.15.37:0/3652180827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c180035f0 con 0x7f1c1c102840 2024-08-31T06:44:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.977+0000 7f1c12ffd640 1 -- 172.21.15.37:0/3652180827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18035070 con 0x7f1c1c102840 2024-08-31T06:44:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.977+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1c1a26a0 con 0x7f1c1c102840 2024-08-31T06:44:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.977+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1c1a8e60 con 0x7f1c1c102840 2024-08-31T06:44:38.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.978+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1c103ac0 con 0x7f1c1c102840 2024-08-31T06:44:38.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.980+0000 7f1c12ffd640 1 -- 172.21.15.37:0/3652180827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f1c18003aa0 con 0x7f1c1c102840 2024-08-31T06:44:38.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.980+0000 7f1c12ffd640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1c080b4b80 0x7f1c080b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:38.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.980+0000 7f1c2125d640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1c080b4b80 0x7f1c080b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:38.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.980+0000 7f1c12ffd640 1 -- 172.21.15.37:0/3652180827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f1c18105e20 con 0x7f1c1c102840 2024-08-31T06:44:38.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.981+0000 7f1c2125d640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1c080b4b80 0x7f1c080b7090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c079de0 tx=0x7f1c0c00a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:38.984+0000 7f1c12ffd640 1 -- 172.21.15.37:0/3652180827 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1c180cd320 con 0x7f1c1c102840 2024-08-31T06:44:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.173+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1c1c1a9030 con 0x7f1c1c102840 2024-08-31T06:44:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-08-31T06:44:39.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.605+0000 7f1c12ffd640 1 -- 172.21.15.37:0/3652180827 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7f1c180ccc20 con 0x7f1c1c102840 2024-08-31T06:44:39.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1c080b4b80 msgr2=0x7f1c080b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1c080b4b80 0x7f1c080b7090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c079de0 tx=0x7f1c0c00a4c0 comp rx=0 tx=0).stop 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 msgr2=0x7f1c1c19c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 0x7f1c1c19c4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1c18009a20 tx=0x7f1c18004270 comp rx=0 tx=0).stop 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 shutdown_connections 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1c080b4b80 0x7f1c080b7090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c1c108ad0 0x7f1c1c1a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c1c108180 0x7f1c1c19ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 --2- 172.21.15.37:0/3652180827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1c102840 0x7f1c1c19c4a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.608+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 >> 172.21.15.37:0/3652180827 conn(0x7f1c1c0794f0 msgr2=0x7f1c1c1060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.609+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 shutdown_connections 2024-08-31T06:44:39.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:39.609+0000 7f1c23cc2640 1 -- 172.21.15.37:0/3652180827 wait complete. 2024-08-31T06:44:39.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:39 smithi066 ceph-mon[22244]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:39.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:39 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3652180827' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T06:44:40.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:39 smithi037 ceph-mon[18612]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:40.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:39 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3652180827' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T06:44:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:39 smithi106 ceph-mon[22134]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:39 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3652180827' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-31T06:44:40.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-31T06:44:40.600 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:40.881 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:40 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3652180827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T06:44:40.881 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:40 smithi037 ceph-mon[18612]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T06:44:40.881 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:40 smithi037 ceph-mon[18612]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T06:44:40.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:40 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3652180827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T06:44:40.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:40 smithi066 ceph-mon[22244]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T06:44:40.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:40 smithi066 ceph-mon[22244]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T06:44:41.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:40 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3652180827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-31T06:44:41.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:40 smithi106 ceph-mon[22134]: osdmap e70: 12 total, 12 up, 12 in 2024-08-31T06:44:41.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:40 smithi106 ceph-mon[22134]: osdmap e71: 12 total, 12 up, 12 in 2024-08-31T06:44:41.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.119+0000 7f041271e640 1 -- 172.21.15.37:0/2988820971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 msgr2=0x7f040c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.119+0000 7f041271e640 1 --2- 172.21.15.37:0/2988820971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 0x7f040c1103c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0404009ca0 tx=0x7f040402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.119+0000 7f041271e640 1 -- 172.21.15.37:0/2988820971 shutdown_connections 2024-08-31T06:44:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.119+0000 7f041271e640 1 --2- 172.21.15.37:0/2988820971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 0x7f040c1103c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.119+0000 7f041271e640 1 --2- 172.21.15.37:0/2988820971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f040c109240 0x7f040c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.119+0000 7f041271e640 1 --2- 172.21.15.37:0/2988820971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f040c103900 0x7f040c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.119+0000 7f041271e640 1 -- 172.21.15.37:0/2988820971 >> 172.21.15.37:0/2988820971 conn(0x7f040c07b5f0 msgr2=0x7f040c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.119+0000 7f041271e640 1 -- 172.21.15.37:0/2988820971 shutdown_connections 2024-08-31T06:44:41.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.120+0000 7f041271e640 1 -- 172.21.15.37:0/2988820971 wait complete. 2024-08-31T06:44:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.120+0000 7f041271e640 1 Processor -- start 2024-08-31T06:44:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.120+0000 7f041271e640 1 -- start start 2024-08-31T06:44:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f041271e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f040c103900 0x7f040c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f041271e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f040c109240 0x7f040c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:41.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f041271e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 0x7f040c19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f041271e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f040c113750 con 0x7f040c109b90 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f041271e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1135d0 con 0x7f040c103900 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f041271e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f040c1138d0 con 0x7f040c109240 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 0x7f040c19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 0x7f040c19f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39492/0 (socket says 172.21.15.37:39492) 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 -- 172.21.15.37:0/2619229635 learned_addr learned my addr 172.21.15.37:0/2619229635 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f040b7fe640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f040c109240 0x7f040c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f040bfff640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f040c103900 0x7f040c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 -- 172.21.15.37:0/2619229635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f040c109240 msgr2=0x7f040c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f040c109240 0x7f040c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 -- 172.21.15.37:0/2619229635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f040c103900 msgr2=0x7f040c19a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:41.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f040c103900 0x7f040c19a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 -- 172.21.15.37:0/2619229635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c1a00b0 con 0x7f040c109b90 2024-08-31T06:44:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.121+0000 7f0410cbb640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 0x7f040c19f980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0404005e30 tx=0x7f04040093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.122+0000 7f04097fa640 1 -- 172.21.15.37:0/2619229635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404032d10 con 0x7f040c109b90 2024-08-31T06:44:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.122+0000 7f04097fa640 1 -- 172.21.15.37:0/2619229635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0404032eb0 con 0x7f040c109b90 2024-08-31T06:44:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.122+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c1a0340 con 0x7f040c109b90 2024-08-31T06:44:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.122+0000 7f04097fa640 1 -- 172.21.15.37:0/2619229635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404030b20 con 0x7f040c109b90 2024-08-31T06:44:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.122+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c1a6b00 con 0x7f040c109b90 2024-08-31T06:44:41.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.123+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040c103d10 con 0x7f040c109b90 2024-08-31T06:44:41.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.125+0000 7f04097fa640 1 -- 172.21.15.37:0/2619229635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f0404030cc0 con 0x7f040c109b90 2024-08-31T06:44:41.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.126+0000 7f04097fa640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03f40b4b80 0x7f03f40b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:41.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.126+0000 7f040bfff640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03f40b4b80 0x7f03f40b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:41.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.126+0000 7f04097fa640 1 -- 172.21.15.37:0/2619229635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7712+0+0 (secure 0 0 0) 0x7f0404106490 con 0x7f040c109b90 2024-08-31T06:44:41.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.126+0000 7f040bfff640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03f40b4b80 0x7f03f40b7090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00bbe0 tx=0x7f03fc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:41.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.129+0000 7f04097fa640 1 -- 172.21.15.37:0/2619229635 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0404083130 con 0x7f040c109b90 2024-08-31T06:44:41.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.313+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f040c19b270 con 0x7f040c109b90 2024-08-31T06:44:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.609+0000 7f04097fa640 1 -- 172.21.15.37:0/2619229635 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) ==== 170+0+0 (secure 0 0 0) 0x7f040c19b270 con 0x7f040c109b90 2024-08-31T06:44:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-08-31T06:44:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.612+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03f40b4b80 msgr2=0x7f03f40b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.612+0000 7f041271e640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03f40b4b80 0x7f03f40b7090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00bbe0 tx=0x7f03fc00b390 comp rx=0 tx=0).stop 2024-08-31T06:44:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.612+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 msgr2=0x7f040c19f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.612+0000 7f041271e640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 0x7f040c19f980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0404005e30 tx=0x7f04040093d0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.613+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 shutdown_connections 2024-08-31T06:44:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.613+0000 7f041271e640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03f40b4b80 0x7f03f40b7090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.613+0000 7f041271e640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f040c109b90 0x7f040c19f980 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.613+0000 7f041271e640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f040c109240 0x7f040c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.613+0000 7f041271e640 1 --2- 172.21.15.37:0/2619229635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f040c103900 0x7f040c19a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.613+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 >> 172.21.15.37:0/2619229635 conn(0x7f040c07b5f0 msgr2=0x7f040c1072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.613+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 shutdown_connections 2024-08-31T06:44:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:41.613+0000 7f041271e640 1 -- 172.21.15.37:0/2619229635 wait complete. 2024-08-31T06:44:41.856 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:41 smithi037 ceph-mon[18612]: pgmap v249: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:41.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:41 smithi037 ceph-mon[18612]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T06:44:41.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:41 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2619229635' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T06:44:41.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:41 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2619229635' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T06:44:41.857 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:41 smithi037 ceph-mon[18612]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T06:44:41.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:41 smithi066 ceph-mon[22244]: pgmap v249: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:41.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:41 smithi066 ceph-mon[22244]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T06:44:41.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:41 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2619229635' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T06:44:41.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:41 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2619229635' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T06:44:41.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:41 smithi066 ceph-mon[22244]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T06:44:42.056 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:41 smithi106 ceph-mon[22134]: pgmap v249: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:42.056 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:41 smithi106 ceph-mon[22134]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-31T06:44:42.056 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:41 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2619229635' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-31T06:44:42.056 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:41 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2619229635' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-31T06:44:42.056 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:41 smithi106 ceph-mon[22134]: osdmap e72: 12 total, 12 up, 12 in 2024-08-31T06:44:42.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-31T06:44:42.586 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 -- 172.21.15.37:0/4214985561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108ac0 msgr2=0x7ff4b010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 --2- 172.21.15.37:0/4214985561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108ac0 0x7ff4b010f2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009ca0 tx=0x7ff4a802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 -- 172.21.15.37:0/4214985561 shutdown_connections 2024-08-31T06:44:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 --2- 172.21.15.37:0/4214985561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108ac0 0x7ff4b010f2f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 --2- 172.21.15.37:0/4214985561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4b0108170 0x7ff4b0108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 --2- 172.21.15.37:0/4214985561 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b0102880 0x7ff4b0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 -- 172.21.15.37:0/4214985561 >> 172.21.15.37:0/4214985561 conn(0x7ff4b0079500 msgr2=0x7ff4b0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 -- 172.21.15.37:0/4214985561 shutdown_connections 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.092+0000 7ff4b720b640 1 -- 172.21.15.37:0/4214985561 wait complete. 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b720b640 1 Processor -- start 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b720b640 1 -- start start 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b720b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4b0102880 0x7ff4b019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b720b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108170 0x7ff4b019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b720b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b0108ac0 0x7ff4b019f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b720b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b0112620 con 0x7ff4b0108170 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b720b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b01124a0 con 0x7ff4b0108ac0 2024-08-31T06:44:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b720b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b01127a0 con 0x7ff4b0102880 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108170 0x7ff4b019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108170 0x7ff4b019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39498/0 (socket says 172.21.15.37:39498) 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4affff640 1 -- 172.21.15.37:0/1240344944 learned_addr learned my addr 172.21.15.37:0/1240344944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b4fa7640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4b0102880 0x7ff4b019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b57a8640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b0108ac0 0x7ff4b019f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4affff640 1 -- 172.21.15.37:0/1240344944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4b0102880 msgr2=0x7ff4b019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4affff640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4b0102880 0x7ff4b019a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4affff640 1 -- 172.21.15.37:0/1240344944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b0108ac0 msgr2=0x7ff4b019f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4affff640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b0108ac0 0x7ff4b019f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4affff640 1 -- 172.21.15.37:0/1240344944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b01a0070 con 0x7ff4b0108170 2024-08-31T06:44:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.093+0000 7ff4b57a8640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b0108ac0 0x7ff4b019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.094+0000 7ff4affff640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108170 0x7ff4b019a6a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4005fd0 tx=0x7ff4a400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.094+0000 7ff4adffb640 1 -- 172.21.15.37:0/1240344944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4017070 con 0x7ff4b0108170 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.094+0000 7ff4adffb640 1 -- 172.21.15.37:0/1240344944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4a4009c30 con 0x7ff4b0108170 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.094+0000 7ff4adffb640 1 -- 172.21.15.37:0/1240344944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4003c70 con 0x7ff4b0108170 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.094+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b01a0360 con 0x7ff4b0108170 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.094+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b01a6ac0 con 0x7ff4b0108170 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.095+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4b0103ab0 con 0x7ff4b0108170 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.096+0000 7ff4adffb640 1 -- 172.21.15.37:0/1240344944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7ff4a4003e10 con 0x7ff4b0108170 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.097+0000 7ff4adffb640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4980b4c00 0x7ff4980b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.098+0000 7ff4b4fa7640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4980b4c00 0x7ff4980b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.098+0000 7ff4adffb640 1 -- 172.21.15.37:0/1240344944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8094+0+0 (secure 0 0 0) 0x7ff4a40e5460 con 0x7ff4b0108170 2024-08-31T06:44:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.098+0000 7ff4b4fa7640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4980b4c00 0x7ff4980b7110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000bbc0 tx=0x7ff4a000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.101+0000 7ff4adffb640 1 -- 172.21.15.37:0/1240344944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff4a4020030 con 0x7ff4b0108170 2024-08-31T06:44:43.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.324+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff4b019b230 con 0x7ff4b0108170 2024-08-31T06:44:43.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.645+0000 7ff4adffb640 1 -- 172.21.15.37:0/1240344944 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff4a40ac6f0 con 0x7ff4b0108170 2024-08-31T06:44:43.646 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.647+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4980b4c00 msgr2=0x7ff4980b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.647+0000 7ff4b720b640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4980b4c00 0x7ff4980b7110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff4a000bbc0 tx=0x7ff4a000b390 comp rx=0 tx=0).stop 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.647+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108170 msgr2=0x7ff4b019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.647+0000 7ff4b720b640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108170 0x7ff4b019a6a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4005fd0 tx=0x7ff4a400dde0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.648+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 shutdown_connections 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.648+0000 7ff4b720b640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff4980b4c00 0x7ff4980b7110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.648+0000 7ff4b720b640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b0108170 0x7ff4b019a6a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.648+0000 7ff4b720b640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4b0108ac0 0x7ff4b019f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.648+0000 7ff4b720b640 1 --2- 172.21.15.37:0/1240344944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4b0102880 0x7ff4b019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.648+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 >> 172.21.15.37:0/1240344944 conn(0x7ff4b0079500 msgr2=0x7ff4b006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.648+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 shutdown_connections 2024-08-31T06:44:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:43.648+0000 7ff4b720b640 1 -- 172.21.15.37:0/1240344944 wait complete. 2024-08-31T06:44:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:43 smithi066 ceph-mon[22244]: pgmap v252: 97 pgs: 16 creating+peering, 23 active+clean, 58 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:43 smithi066 ceph-mon[22244]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T06:44:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:43 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1240344944' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T06:44:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:43 smithi066 ceph-mon[22244]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T06:44:43.983 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:43 smithi037 ceph-mon[18612]: pgmap v252: 97 pgs: 16 creating+peering, 23 active+clean, 58 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:43.983 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:43 smithi037 ceph-mon[18612]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T06:44:43.984 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:43 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1240344944' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T06:44:43.984 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:43 smithi037 ceph-mon[18612]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T06:44:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:43 smithi106 ceph-mon[22134]: pgmap v252: 97 pgs: 16 creating+peering, 23 active+clean, 58 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:43 smithi106 ceph-mon[22134]: osdmap e73: 12 total, 12 up, 12 in 2024-08-31T06:44:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:43 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1240344944' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-31T06:44:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:43 smithi106 ceph-mon[22134]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-31T06:44:44.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:44:44.565 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:44.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:44 smithi066 ceph-mon[22244]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T06:44:44.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:44 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1240344944' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T06:44:44.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:44 smithi066 ceph-mon[22244]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T06:44:44.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:44 smithi066 ceph-mon[22244]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T06:44:44.911 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:44 smithi037 ceph-mon[18612]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T06:44:44.912 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:44 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1240344944' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T06:44:44.912 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:44 smithi037 ceph-mon[18612]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T06:44:44.912 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:44 smithi037 ceph-mon[18612]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 -- 172.21.15.37:0/3809712328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 msgr2=0x7f21101101f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3809712328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 0x7f21101101f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2108009900 tx=0x7f210802a410 comp rx=0 tx=0).stop 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 -- 172.21.15.37:0/3809712328 shutdown_connections 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3809712328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 0x7f21101101f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3809712328 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2110109070 0x7f2110109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3809712328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2110103730 0x7f2110103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 -- 172.21.15.37:0/3809712328 >> 172.21.15.37:0/3809712328 conn(0x7f21100ff180 msgr2=0x7f21101015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 -- 172.21.15.37:0/3809712328 shutdown_connections 2024-08-31T06:44:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.000+0000 7f2116d9f640 1 -- 172.21.15.37:0/3809712328 wait complete. 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f2116d9f640 1 Processor -- start 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f2116d9f640 1 -- start start 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f2116d9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2110103730 0x7f2110199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f2116d9f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2110109070 0x7f211019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f2116d9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 0x7f211019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f2116d9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2110113540 con 0x7f21101099c0 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f2116d9f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f21101133c0 con 0x7f2110103730 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f2116d9f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f21101136c0 con 0x7f2110109070 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f211659e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 0x7f211019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f211659e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 0x7f211019f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50948/0 (socket says 172.21.15.37:50948) 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.001+0000 7f211659e640 1 -- 172.21.15.37:0/3725347855 learned_addr learned my addr 172.21.15.37:0/3725347855 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f211559c640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2110109070 0x7f211019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f2115d9d640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2110103730 0x7f2110199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f211659e640 1 -- 172.21.15.37:0/3725347855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2110109070 msgr2=0x7f211019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f211659e640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2110109070 0x7f211019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f211659e640 1 -- 172.21.15.37:0/3725347855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2110103730 msgr2=0x7f2110199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f211659e640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2110103730 0x7f2110199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f211659e640 1 -- 172.21.15.37:0/3725347855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211019ff00 con 0x7f21101099c0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f2115d9d640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2110103730 0x7f2110199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f211659e640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 0x7f211019f7d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2108005ab0 tx=0x7f21080040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f210effd640 1 -- 172.21.15.37:0/3725347855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210803f030 con 0x7f21101099c0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21101a0190 con 0x7f21101099c0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f210effd640 1 -- 172.21.15.37:0/3725347855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2108003a80 con 0x7f21101099c0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f210effd640 1 -- 172.21.15.37:0/3725347855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108035070 con 0x7f21101099c0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.002+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21101a6950 con 0x7f21101099c0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.003+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2110103b40 con 0x7f21101099c0 2024-08-31T06:44:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.005+0000 7f210effd640 1 -- 172.21.15.37:0/3725347855 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f2108042030 con 0x7f21101099c0 2024-08-31T06:44:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.006+0000 7f210effd640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f20f80b4b80 0x7f20f80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.006+0000 7f2115d9d640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f20f80b4b80 0x7f20f80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.006+0000 7f210effd640 1 -- 172.21.15.37:0/3725347855 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f2108105b00 con 0x7f21101099c0 2024-08-31T06:44:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.006+0000 7f2115d9d640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f20f80b4b80 0x7f20f80b7090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2100005fd0 tx=0x7f2100009520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.009+0000 7f210effd640 1 -- 172.21.15.37:0/3725347855 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f21080ccbf0 con 0x7f21101099c0 2024-08-31T06:44:45.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:44 smithi106 ceph-mon[22134]: osdmap e74: 12 total, 12 up, 12 in 2024-08-31T06:44:45.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:44 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1240344944' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-31T06:44:45.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:44 smithi106 ceph-mon[22134]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-31T06:44:45.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:44 smithi106 ceph-mon[22134]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-31T06:44:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.197+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f211019b0c0 con 0x7f21101099c0 2024-08-31T06:44:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.199+0000 7f210effd640 1 -- 172.21.15.37:0/3725347855 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22570 (secure 0 0 0) 0x7f211019b0c0 con 0x7f21101099c0 2024-08-31T06:44:45.201 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:45.201 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:44:43.326060+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:44:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f20f80b4b80 msgr2=0x7f20f80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f20f80b4b80 0x7f20f80b7090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2100005fd0 tx=0x7f2100009520 comp rx=0 tx=0).stop 2024-08-31T06:44:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 msgr2=0x7f211019f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 0x7f211019f7d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2108005ab0 tx=0x7f21080040e0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 shutdown_connections 2024-08-31T06:44:45.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f20f80b4b80 0x7f20f80b7090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21101099c0 0x7f211019f7d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2110109070 0x7f211019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 --2- 172.21.15.37:0/3725347855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2110103730 0x7f2110199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 >> 172.21.15.37:0/3725347855 conn(0x7f21100ff180 msgr2=0x7f21101015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 shutdown_connections 2024-08-31T06:44:45.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:45.202+0000 7f2116d9f640 1 -- 172.21.15.37:0/3725347855 wait complete. 2024-08-31T06:44:45.868 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:45 smithi037 ceph-mon[18612]: pgmap v255: 97 pgs: 16 creating+peering, 38 active+clean, 43 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:45.868 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:45 smithi037 ceph-mon[18612]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T06:44:45.868 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:45 smithi037 ceph-mon[18612]: Cluster is now healthy 2024-08-31T06:44:45.869 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:45 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] up:active 2024-08-31T06:44:45.869 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:45 smithi037 ceph-mon[18612]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:45.869 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:45 smithi037 ceph-mon[18612]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:45.869 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:45 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3725347855' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:44:45.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:45 smithi066 ceph-mon[22244]: pgmap v255: 97 pgs: 16 creating+peering, 38 active+clean, 43 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:45.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:45 smithi066 ceph-mon[22244]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:45 smithi066 ceph-mon[22244]: Cluster is now healthy 2024-08-31T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:45 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] up:active 2024-08-31T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:45 smithi066 ceph-mon[22244]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:45 smithi066 ceph-mon[22244]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:45.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:45 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3725347855' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:44:45.899 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:44:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:45 smithi106 ceph-mon[22134]: pgmap v255: 97 pgs: 16 creating+peering, 38 active+clean, 43 unknown; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:44:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:45 smithi106 ceph-mon[22134]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-31T06:44:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:45 smithi106 ceph-mon[22134]: Cluster is now healthy 2024-08-31T06:44:46.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:45 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] up:active 2024-08-31T06:44:46.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:45 smithi106 ceph-mon[22134]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:46.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:45 smithi106 ceph-mon[22134]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:46.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:45 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3725347855' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:44:46.155 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 -- 172.21.15.37:0/705975373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 msgr2=0x7f5f58109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/705975373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 0x7f5f58109670 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009900 tx=0x7f5f4802a410 comp rx=0 tx=0).stop 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 -- 172.21.15.37:0/705975373 shutdown_connections 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/705975373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 0x7f5f58109670 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/705975373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f58109bb0 0x7f5f581103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/705975373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f58103920 0x7f5f58103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 -- 172.21.15.37:0/705975373 >> 172.21.15.37:0/705975373 conn(0x7f5f580ff370 msgr2=0x7f5f581017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 -- 172.21.15.37:0/705975373 shutdown_connections 2024-08-31T06:44:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.626+0000 7f5f5ec99640 1 -- 172.21.15.37:0/705975373 wait complete. 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ec99640 1 Processor -- start 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ec99640 1 -- start start 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ec99640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f58103920 0x7f5f5819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ec99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 0x7f5f5819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ec99640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f58109bb0 0x7f5f5819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ec99640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5f58113760 con 0x7f5f58109260 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ec99640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581135e0 con 0x7f5f58109bb0 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ec99640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581138e0 con 0x7f5f58103920 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 0x7f5f5819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 0x7f5f5819a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50972/0 (socket says 172.21.15.37:50972) 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f4ffff640 1 -- 172.21.15.37:0/3433717383 learned_addr learned my addr 172.21.15.37:0/3433717383 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5ca35640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f58103920 0x7f5f5819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5d236640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f58109bb0 0x7f5f5819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f4ffff640 1 -- 172.21.15.37:0/3433717383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f58103920 msgr2=0x7f5f5819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f4ffff640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f58103920 0x7f5f5819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f4ffff640 1 -- 172.21.15.37:0/3433717383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f58109bb0 msgr2=0x7f5f5819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f4ffff640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f58109bb0 0x7f5f5819fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f4ffff640 1 -- 172.21.15.37:0/3433717383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f581a01a0 con 0x7f5f58109260 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.627+0000 7f5f5d236640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f58109bb0 0x7f5f5819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.628+0000 7f5f4ffff640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 0x7f5f5819a7d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5f48005940 tx=0x7f5f480040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.628+0000 7f5f4dffb640 1 -- 172.21.15.37:0/3433717383 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4803f030 con 0x7f5f58109260 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.628+0000 7f5f4dffb640 1 -- 172.21.15.37:0/3433717383 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f48003a80 con 0x7f5f58109260 2024-08-31T06:44:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.628+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f581a0430 con 0x7f5f58109260 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.628+0000 7f5f4dffb640 1 -- 172.21.15.37:0/3433717383 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48035070 con 0x7f5f58109260 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.628+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f581a6bf0 con 0x7f5f58109260 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.629+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f58103d30 con 0x7f5f58109260 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.631+0000 7f5f4dffb640 1 -- 172.21.15.37:0/3433717383 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f5f48042030 con 0x7f5f58109260 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.631+0000 7f5f4dffb640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f400b4c00 0x7f5f400b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.632+0000 7f5f5ca35640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f400b4c00 0x7f5f400b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.632+0000 7f5f4dffb640 1 -- 172.21.15.37:0/3433717383 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f5f48105a00 con 0x7f5f58109260 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.632+0000 7f5f5ca35640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f400b4c00 0x7f5f400b7110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f54005fd0 tx=0x7f5f5400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:46.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.635+0000 7f5f4dffb640 1 -- 172.21.15.37:0/3433717383 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5f480ccb50 con 0x7f5f58109260 2024-08-31T06:44:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.822+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5f5819b360 con 0x7f5f58109260 2024-08-31T06:44:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.823+0000 7f5f4dffb640 1 -- 172.21.15.37:0/3433717383 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22570 (secure 0 0 0) 0x7f5f5819b360 con 0x7f5f58109260 2024-08-31T06:44:46.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:44:46.826 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:44:43.326060+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:44:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f400b4c00 msgr2=0x7f5f400b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f400b4c00 0x7f5f400b7110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5f54005fd0 tx=0x7f5f5400b390 comp rx=0 tx=0).stop 2024-08-31T06:44:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 msgr2=0x7f5f5819a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 0x7f5f5819a7d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5f48005940 tx=0x7f5f480040e0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 shutdown_connections 2024-08-31T06:44:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5f400b4c00 0x7f5f400b7110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f58109260 0x7f5f5819a7d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f58109bb0 0x7f5f5819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 --2- 172.21.15.37:0/3433717383 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f58103920 0x7f5f5819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 >> 172.21.15.37:0/3433717383 conn(0x7f5f580ff370 msgr2=0x7f5f58101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 shutdown_connections 2024-08-31T06:44:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:46.826+0000 7f5f5ec99640 1 -- 172.21.15.37:0/3433717383 wait complete. 2024-08-31T06:44:47.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-31T06:44:47.721 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:47.841 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:47 smithi037 ceph-mon[18612]: pgmap v256: 97 pgs: 7 creating+peering, 78 active+clean, 12 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-08-31T06:44:47.842 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:47 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3433717383' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:44:47.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:47 smithi066 ceph-mon[22244]: pgmap v256: 97 pgs: 7 creating+peering, 78 active+clean, 12 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-08-31T06:44:47.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:47 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3433717383' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:44:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:47 smithi106 ceph-mon[22134]: pgmap v256: 97 pgs: 7 creating+peering, 78 active+clean, 12 unknown; 577 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-08-31T06:44:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:47 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3433717383' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:44:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 -- 172.21.15.37:0/806245761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800102800 msgr2=0x7f9800102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 --2- 172.21.15.37:0/806245761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800102800 0x7f9800102c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009900 tx=0x7f97f002a410 comp rx=0 tx=0).stop 2024-08-31T06:44:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 -- 172.21.15.37:0/806245761 shutdown_connections 2024-08-31T06:44:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 --2- 172.21.15.37:0/806245761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9800108a90 0x7f980010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 --2- 172.21.15.37:0/806245761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800108140 0x7f9800108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 --2- 172.21.15.37:0/806245761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800102800 0x7f9800102c10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 -- 172.21.15.37:0/806245761 >> 172.21.15.37:0/806245761 conn(0x7f98000794d0 msgr2=0x7f98000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 -- 172.21.15.37:0/806245761 shutdown_connections 2024-08-31T06:44:48.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.239+0000 7f980641a640 1 -- 172.21.15.37:0/806245761 wait complete. 2024-08-31T06:44:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.240+0000 7f980641a640 1 Processor -- start 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.240+0000 7f980641a640 1 -- start start 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.240+0000 7f980641a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800102800 0x7f9800103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.240+0000 7f980641a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800108140 0x7f9800104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.240+0000 7f980641a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9800108a90 0x7f9800104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.240+0000 7f980641a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9800112610 con 0x7f9800108140 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.240+0000 7f980641a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9800112490 con 0x7f9800102800 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.240+0000 7f980641a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9800112790 con 0x7f9800108a90 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800108140 0x7f9800104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800108140 0x7f9800104530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50990/0 (socket says 172.21.15.37:50990) 2024-08-31T06:44:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 -- 172.21.15.37:0/1497067148 learned_addr learned my addr 172.21.15.37:0/1497067148 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97fffff640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800102800 0x7f9800103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f98049b7640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9800108a90 0x7f9800104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 -- 172.21.15.37:0/1497067148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9800108a90 msgr2=0x7f9800104a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9800108a90 0x7f9800104a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 -- 172.21.15.37:0/1497067148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800102800 msgr2=0x7f9800103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800102800 0x7f9800103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 -- 172.21.15.37:0/1497067148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98001a8440 con 0x7f9800108140 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f98049b7640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9800108a90 0x7f9800104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97ff7fe640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800108140 0x7f9800104530 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f97f400b450 tx=0x7f97f400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97fd7fa640 1 -- 172.21.15.37:0/1497067148 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4015020 con 0x7f9800108140 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97fd7fa640 1 -- 172.21.15.37:0/1497067148 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97f4011d20 con 0x7f9800108140 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98001a8730 con 0x7f9800108140 2024-08-31T06:44:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f97fd7fa640 1 -- 172.21.15.37:0/1497067148 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f4010e10 con 0x7f9800108140 2024-08-31T06:44:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.241+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98001a8c70 con 0x7f9800108140 2024-08-31T06:44:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.242+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9800102c10 con 0x7f9800108140 2024-08-31T06:44:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.244+0000 7f97fd7fa640 1 -- 172.21.15.37:0/1497067148 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f97f4018020 con 0x7f9800108140 2024-08-31T06:44:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.244+0000 7f97fd7fa640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97e80b4b80 0x7f97e80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.245+0000 7f97fffff640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97e80b4b80 0x7f97e80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.245+0000 7f97fd7fa640 1 -- 172.21.15.37:0/1497067148 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f97f40e4f60 con 0x7f9800108140 2024-08-31T06:44:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.245+0000 7f97fffff640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97e80b4b80 0x7f97e80b7090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9800105a40 tx=0x7f97f00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.248+0000 7f97fd7fa640 1 -- 172.21.15.37:0/1497067148 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f97f401f020 con 0x7f9800108140 2024-08-31T06:44:48.389 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:44:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b[52802]: 2024-08-31T06:44:48.094+0000 7f48453f9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-31T06:44:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.471+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f98001a9050 con 0x7f9800108140 2024-08-31T06:44:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.624+0000 7f97fd7fa640 1 -- 172.21.15.37:0/1497067148 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f97f400d040 con 0x7f9800108140 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97e80b4b80 msgr2=0x7f97e80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97e80b4b80 0x7f97e80b7090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9800105a40 tx=0x7f97f00058d0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800108140 msgr2=0x7f9800104530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800108140 0x7f9800104530 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f97f400b450 tx=0x7f97f400b910 comp rx=0 tx=0).stop 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 shutdown_connections 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97e80b4b80 0x7f97e80b7090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9800108140 0x7f9800104530 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9800108a90 0x7f9800104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 --2- 172.21.15.37:0/1497067148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9800102800 0x7f9800103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 >> 172.21.15.37:0/1497067148 conn(0x7f98000794d0 msgr2=0x7f9800101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 shutdown_connections 2024-08-31T06:44:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:48.626+0000 7f980641a640 1 -- 172.21.15.37:0/1497067148 wait complete. 2024-08-31T06:44:48.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:48 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1497067148' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T06:44:48.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:48 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1497067148' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T06:44:49.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:48 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1497067148' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-31T06:44:49.302 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-08-31T06:44:49.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-08-31T06:44:49.556 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:49.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:49 smithi066 ceph-mon[22244]: pgmap v257: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-08-31T06:44:49.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:49 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1497067148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T06:44:49.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:49 smithi066 ceph-mon[22244]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:49.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:49 smithi037 ceph-mon[18612]: pgmap v257: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-08-31T06:44:49.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:49 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1497067148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T06:44:49.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:49 smithi037 ceph-mon[18612]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:49 smithi106 ceph-mon[22134]: pgmap v257: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-08-31T06:44:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:49 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1497067148' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-31T06:44:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:49 smithi106 ceph-mon[22134]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 -- 172.21.15.37:0/2346943930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4102880 msgr2=0x7f09a4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 --2- 172.21.15.37:0/2346943930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4102880 0x7f09a4102c90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0998009900 tx=0x7f099802a410 comp rx=0 tx=0).stop 2024-08-31T06:44:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 -- 172.21.15.37:0/2346943930 shutdown_connections 2024-08-31T06:44:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 --2- 172.21.15.37:0/2346943930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a4108b10 0x7f09a410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 --2- 172.21.15.37:0/2346943930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a41081c0 0x7f09a41085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 --2- 172.21.15.37:0/2346943930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4102880 0x7f09a4102c90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 -- 172.21.15.37:0/2346943930 >> 172.21.15.37:0/2346943930 conn(0x7f09a4079510 msgr2=0x7f09a4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:50.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 -- 172.21.15.37:0/2346943930 shutdown_connections 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 -- 172.21.15.37:0/2346943930 wait complete. 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 Processor -- start 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.084+0000 7f09aac51640 1 -- start start 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09aac51640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a4102880 0x7f09a419a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09aac51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a41081c0 0x7f09a419a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09aac51640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4108b10 0x7f09a419fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09aac51640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4113800 con 0x7f09a4108b10 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09aac51640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4113680 con 0x7f09a41081c0 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09aac51640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f09a4113980 con 0x7f09a4102880 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4108b10 0x7f09a419fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4108b10 0x7f09a419fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51010/0 (socket says 172.21.15.37:51010) 2024-08-31T06:44:50.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 -- 172.21.15.37:0/2816730508 learned_addr learned my addr 172.21.15.37:0/2816730508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a3fff640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a41081c0 0x7f09a419a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a89ed640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a4102880 0x7f09a419a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 -- 172.21.15.37:0/2816730508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a4102880 msgr2=0x7f09a419a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a4102880 0x7f09a419a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 -- 172.21.15.37:0/2816730508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a41081c0 msgr2=0x7f09a419a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a41081c0 0x7f09a419a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 -- 172.21.15.37:0/2816730508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a41a01c0 con 0x7f09a4108b10 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a89ed640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a4102880 0x7f09a419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.085+0000 7f09a91ee640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4108b10 0x7f09a419fa90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f099c00b970 tx=0x7f099c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.086+0000 7f09a1ffb640 1 -- 172.21.15.37:0/2816730508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c019070 con 0x7f09a4108b10 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.086+0000 7f09a1ffb640 1 -- 172.21.15.37:0/2816730508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f099c014440 con 0x7f09a4108b10 2024-08-31T06:44:50.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.086+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a41a04b0 con 0x7f09a4108b10 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.086+0000 7f09a1ffb640 1 -- 172.21.15.37:0/2816730508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c0075d0 con 0x7f09a4108b10 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.086+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a41a6c10 con 0x7f09a4108b10 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.087+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a4103b00 con 0x7f09a4108b10 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.088+0000 7f09a1ffb640 1 -- 172.21.15.37:0/2816730508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f099c01c070 con 0x7f09a4108b10 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.089+0000 7f09a1ffb640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09940b4c00 0x7f09940b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.089+0000 7f09a89ed640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09940b4c00 0x7f09940b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.089+0000 7f09a1ffb640 1 -- 172.21.15.37:0/2816730508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f099c0e4550 con 0x7f09a4108b10 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.089+0000 7f09a89ed640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09940b4c00 0x7f09940b7110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0998000c00 tx=0x7f0998005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:50.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.093+0000 7f09a1ffb640 1 -- 172.21.15.37:0/2816730508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f099c0ab050 con 0x7f09a4108b10 2024-08-31T06:44:50.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.316+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f09a410a910 con 0x7f09a4108b10 2024-08-31T06:44:50.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.631+0000 7f09a1ffb640 1 -- 172.21.15.37:0/2816730508 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f099c0af810 con 0x7f09a4108b10 2024-08-31T06:44:50.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09940b4c00 msgr2=0x7f09940b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09940b4c00 0x7f09940b7110 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0998000c00 tx=0x7f0998005a20 comp rx=0 tx=0).stop 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4108b10 msgr2=0x7f09a419fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4108b10 0x7f09a419fa90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f099c00b970 tx=0x7f099c00be30 comp rx=0 tx=0).stop 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 shutdown_connections 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09940b4c00 0x7f09940b7110 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09a4108b10 0x7f09a419fa90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09a41081c0 0x7f09a419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 --2- 172.21.15.37:0/2816730508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a4102880 0x7f09a419a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 >> 172.21.15.37:0/2816730508 conn(0x7f09a4079510 msgr2=0x7f09a41062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.634+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 shutdown_connections 2024-08-31T06:44:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:50.635+0000 7f09aac51640 1 -- 172.21.15.37:0/2816730508 wait complete. 2024-08-31T06:44:50.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:50 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2816730508' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T06:44:50.995 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:50 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2816730508' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T06:44:51.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:50 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2816730508' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-08-31T06:44:51.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-31T06:44:51.564 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:51.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:51 smithi037 ceph-mon[18612]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T06:44:51.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:51 smithi037 ceph-mon[18612]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T06:44:51.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:51 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2816730508' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T06:44:51.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:51 smithi037 ceph-mon[18612]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T06:44:51.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:51 smithi037 ceph-mon[18612]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:51.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:51 smithi037 ceph-mon[18612]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-31T06:44:51.885 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:51 smithi037 ceph-mon[18612]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-31T06:44:51.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:51 smithi066 ceph-mon[22244]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T06:44:51.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:51 smithi066 ceph-mon[22244]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T06:44:51.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:51 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2816730508' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T06:44:51.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:51 smithi066 ceph-mon[22244]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T06:44:51.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:51 smithi066 ceph-mon[22244]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:51.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:51 smithi066 ceph-mon[22244]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-31T06:44:51.889 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:51 smithi066 ceph-mon[22244]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-31T06:44:52.071 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:51 smithi106 ceph-mon[22134]: pgmap v258: 97 pgs: 97 active+clean; 579 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-08-31T06:44:52.071 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:51 smithi106 ceph-mon[22134]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-31T06:44:52.071 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:51 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2816730508' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-31T06:44:52.071 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:51 smithi106 ceph-mon[22134]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-31T06:44:52.072 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:51 smithi106 ceph-mon[22134]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-31T06:44:52.072 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:51 smithi106 ceph-mon[22134]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-31T06:44:52.072 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:51 smithi106 ceph-mon[22134]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-31T06:44:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 -- 172.21.15.37:0/17181645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4102880 msgr2=0x7f97d4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 --2- 172.21.15.37:0/17181645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4102880 0x7f97d4102c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009900 tx=0x7f97bc02a410 comp rx=0 tx=0).stop 2024-08-31T06:44:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 -- 172.21.15.37:0/17181645 shutdown_connections 2024-08-31T06:44:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 --2- 172.21.15.37:0/17181645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97d4108ac0 0x7f97d410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 --2- 172.21.15.37:0/17181645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97d4108170 0x7f97d4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 --2- 172.21.15.37:0/17181645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4102880 0x7f97d4102c90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 -- 172.21.15.37:0/17181645 >> 172.21.15.37:0/17181645 conn(0x7f97d4079530 msgr2=0x7f97d4079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 -- 172.21.15.37:0/17181645 shutdown_connections 2024-08-31T06:44:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.086+0000 7f97d883c640 1 -- 172.21.15.37:0/17181645 wait complete. 2024-08-31T06:44:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d883c640 1 Processor -- start 2024-08-31T06:44:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d883c640 1 -- start start 2024-08-31T06:44:52.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d883c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97d4102880 0x7f97d419afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:52.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d883c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4108170 0x7f97d419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:52.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d883c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97d4108ac0 0x7f97d419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:52.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d883c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97d4112640 con 0x7f97d4108170 2024-08-31T06:44:52.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d883c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41124c0 con 0x7f97d4108ac0 2024-08-31T06:44:52.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d883c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41127c0 con 0x7f97d4102880 2024-08-31T06:44:52.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4108170 0x7f97d419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:52.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4108170 0x7f97d419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51028/0 (socket says 172.21.15.37:51028) 2024-08-31T06:44:52.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d1d9b640 1 -- 172.21.15.37:0/1825387860 learned_addr learned my addr 172.21.15.37:0/1825387860 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:52.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d2d9d640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97d4108ac0 0x7f97d419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:52.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.087+0000 7f97d259c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97d4102880 0x7f97d419afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:52.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97d1d9b640 1 -- 172.21.15.37:0/1825387860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97d4102880 msgr2=0x7f97d419afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:52.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97d1d9b640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97d4102880 0x7f97d419afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97d1d9b640 1 -- 172.21.15.37:0/1825387860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97d4108ac0 msgr2=0x7f97d419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97d1d9b640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97d4108ac0 0x7f97d419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97d1d9b640 1 -- 172.21.15.37:0/1825387860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d41a6240 con 0x7f97d4108170 2024-08-31T06:44:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97d1d9b640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4108170 0x7f97d419b4f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f97c400e9c0 tx=0x7f97c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97cb7fe640 1 -- 172.21.15.37:0/1825387860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c400ccc0 con 0x7f97d4108170 2024-08-31T06:44:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97cb7fe640 1 -- 172.21.15.37:0/1825387860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97c40054b0 con 0x7f97d4108170 2024-08-31T06:44:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d41a6530 con 0x7f97d4108170 2024-08-31T06:44:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97cb7fe640 1 -- 172.21.15.37:0/1825387860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4010430 con 0x7f97d4108170 2024-08-31T06:44:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.088+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d41a6a20 con 0x7f97d4108170 2024-08-31T06:44:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.089+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d4102c90 con 0x7f97d4108170 2024-08-31T06:44:52.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.091+0000 7f97cb7fe640 1 -- 172.21.15.37:0/1825387860 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f97c4004ee0 con 0x7f97d4108170 2024-08-31T06:44:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.092+0000 7f97cb7fe640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97c00b4bb0 0x7f97c00b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.092+0000 7f97d259c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97c00b4bb0 0x7f97c00b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.092+0000 7f97cb7fe640 1 -- 172.21.15.37:0/1825387860 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f97c40e5480 con 0x7f97d4108170 2024-08-31T06:44:52.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.092+0000 7f97d259c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97c00b4bb0 0x7f97c00b70c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f97d406c120 tx=0x7f97bc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:52.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.096+0000 7f97cb7fe640 1 -- 172.21.15.37:0/1825387860 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f97c40ac5d0 con 0x7f97d4108170 2024-08-31T06:44:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.323+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f97d402e430 con 0x7f97d4108170 2024-08-31T06:44:52.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.654+0000 7f97cb7fe640 1 -- 172.21.15.37:0/1825387860 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f97c40abed0 con 0x7f97d4108170 2024-08-31T06:44:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97c00b4bb0 msgr2=0x7f97c00b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97c00b4bb0 0x7f97c00b70c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f97d406c120 tx=0x7f97bc0058d0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4108170 msgr2=0x7f97d419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4108170 0x7f97d419b4f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f97c400e9c0 tx=0x7f97c400ee80 comp rx=0 tx=0).stop 2024-08-31T06:44:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 shutdown_connections 2024-08-31T06:44:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97c00b4bb0 0x7f97c00b70c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97d4108170 0x7f97d419b4f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97d4108ac0 0x7f97d419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 --2- 172.21.15.37:0/1825387860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97d4102880 0x7f97d419afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 >> 172.21.15.37:0/1825387860 conn(0x7f97d4079530 msgr2=0x7f97d41062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 shutdown_connections 2024-08-31T06:44:52.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:52.657+0000 7f97d883c640 1 -- 172.21.15.37:0/1825387860 wait complete. 2024-08-31T06:44:53.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:52 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] up:active 2024-08-31T06:44:53.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:52 smithi037 ceph-mon[18612]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T06:44:53.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:52 smithi037 ceph-mon[18612]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T06:44:53.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:52 smithi037 ceph-mon[18612]: Cluster is now healthy 2024-08-31T06:44:53.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:52 smithi037 ceph-mon[18612]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-31T06:44:53.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:52 smithi037 ceph-mon[18612]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-31T06:44:53.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:52 smithi037 ceph-mon[18612]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-31T06:44:53.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:52 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1825387860' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T06:44:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:52 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] up:active 2024-08-31T06:44:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:52 smithi106 ceph-mon[22134]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T06:44:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:52 smithi106 ceph-mon[22134]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T06:44:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:52 smithi106 ceph-mon[22134]: Cluster is now healthy 2024-08-31T06:44:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:52 smithi106 ceph-mon[22134]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-31T06:44:53.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:52 smithi106 ceph-mon[22134]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-31T06:44:53.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:52 smithi106 ceph-mon[22134]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-31T06:44:53.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:52 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1825387860' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T06:44:53.096 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:52 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] up:active 2024-08-31T06:44:53.097 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:52 smithi066 ceph-mon[22244]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-31T06:44:53.097 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:52 smithi066 ceph-mon[22244]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-31T06:44:53.097 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:52 smithi066 ceph-mon[22244]: Cluster is now healthy 2024-08-31T06:44:53.097 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:52 smithi066 ceph-mon[22244]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-31T06:44:53.097 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:52 smithi066 ceph-mon[22244]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-31T06:44:53.097 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:52 smithi066 ceph-mon[22244]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-31T06:44:53.097 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:52 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1825387860' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-31T06:44:53.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-31T06:44:53.387 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:44:53 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b[52802]: 2024-08-31T06:44:53.095+0000 7f48453f9640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-08-31T06:44:53.387 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:44:53 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b[52802]: 2024-08-31T06:44:53.095+0000 7f48453f9640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-31T06:44:53.620 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:53.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:53 smithi037 ceph-mon[18612]: pgmap v259: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 8 op/s 2024-08-31T06:44:53.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:53 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1825387860' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T06:44:53.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:53 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] up:active 2024-08-31T06:44:53.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:53 smithi037 ceph-mon[18612]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-31T06:44:53.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:53 smithi037 ceph-mon[18612]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:44:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:53 smithi106 ceph-mon[22134]: pgmap v259: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 8 op/s 2024-08-31T06:44:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:53 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1825387860' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T06:44:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:53 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] up:active 2024-08-31T06:44:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:53 smithi106 ceph-mon[22134]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-31T06:44:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:53 smithi106 ceph-mon[22134]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:44:54.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.085+0000 7f4552e24640 1 -- 172.21.15.37:0/2952009696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108150 msgr2=0x7f454c108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.085+0000 7f4552e24640 1 --2- 172.21.15.37:0/2952009696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108150 0x7f454c108560 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4538009900 tx=0x7f453802a410 comp rx=0 tx=0).stop 2024-08-31T06:44:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.085+0000 7f4552e24640 1 -- 172.21.15.37:0/2952009696 shutdown_connections 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.085+0000 7f4552e24640 1 --2- 172.21.15.37:0/2952009696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108150 0x7f454c108560 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.085+0000 7f4552e24640 1 --2- 172.21.15.37:0/2952009696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f454c108aa0 0x7f454c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.085+0000 7f4552e24640 1 --2- 172.21.15.37:0/2952009696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454c102810 0x7f454c102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.086+0000 7f4552e24640 1 -- 172.21.15.37:0/2952009696 >> 172.21.15.37:0/2952009696 conn(0x7f454c0794b0 msgr2=0x7f454c0798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.086+0000 7f4552e24640 1 -- 172.21.15.37:0/2952009696 shutdown_connections 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.086+0000 7f4552e24640 1 -- 172.21.15.37:0/2952009696 wait complete. 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.086+0000 7f4552e24640 1 Processor -- start 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.086+0000 7f4552e24640 1 -- start start 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.086+0000 7f4552e24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454c102810 0x7f454c0ff390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.086+0000 7f4552e24640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f454c108150 0x7f454c0ff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4552e24640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108aa0 0x7f454c0ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4552e24640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f454c1125e0 con 0x7f454c108aa0 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4552e24640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f454c112460 con 0x7f454c102810 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4552e24640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f454c112760 con 0x7f454c108150 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108aa0 0x7f454c0ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108aa0 0x7f454c0ffe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51056/0 (socket says 172.21.15.37:51056) 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 -- 172.21.15.37:0/3632292232 learned_addr learned my addr 172.21.15.37:0/3632292232 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4550bc0640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454c102810 0x7f454c0ff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f454bfff640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f454c108150 0x7f454c0ff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 -- 172.21.15.37:0/3632292232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f454c108150 msgr2=0x7f454c0ff8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f454c108150 0x7f454c0ff8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 -- 172.21.15.37:0/3632292232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454c102810 msgr2=0x7f454c0ff390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454c102810 0x7f454c0ff390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 -- 172.21.15.37:0/3632292232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c1a8440 con 0x7f454c108aa0 2024-08-31T06:44:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f45513c1640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108aa0 0x7f454c0ffe10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f454400eaa0 tx=0x7f454400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4549ffb640 1 -- 172.21.15.37:0/3632292232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454400cdb0 con 0x7f454c108aa0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4549ffb640 1 -- 172.21.15.37:0/3632292232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4544005020 con 0x7f454c108aa0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4549ffb640 1 -- 172.21.15.37:0/3632292232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45440116d0 con 0x7f454c108aa0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.087+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c1a8730 con 0x7f454c108aa0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.088+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c1a8cc0 con 0x7f454c108aa0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.089+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454c103a90 con 0x7f454c108aa0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.090+0000 7f4549ffb640 1 -- 172.21.15.37:0/3632292232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f45440051d0 con 0x7f454c108aa0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.091+0000 7f4549ffb640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f453c0b4c00 0x7f453c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.091+0000 7f4550bc0640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f453c0b4c00 0x7f453c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.091+0000 7f4549ffb640 1 -- 172.21.15.37:0/3632292232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f45440e55f0 con 0x7f454c108aa0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.091+0000 7f4550bc0640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f453c0b4c00 0x7f453c0b7110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f454c100de0 tx=0x7f454000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.094+0000 7f4549ffb640 1 -- 172.21.15.37:0/3632292232 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4544016030 con 0x7f454c108aa0 2024-08-31T06:44:54.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:53 smithi066 ceph-mon[22244]: pgmap v259: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s wr, 8 op/s 2024-08-31T06:44:54.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:53 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1825387860' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-31T06:44:54.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:53 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] up:active 2024-08-31T06:44:54.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:53 smithi066 ceph-mon[22244]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-31T06:44:54.227 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:53 smithi066 ceph-mon[22244]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:44:54.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.318+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f454c102c20 con 0x7f454c108aa0 2024-08-31T06:44:54.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.662+0000 7f4549ffb640 1 -- 172.21.15.37:0/3632292232 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f45440ac7c0 con 0x7f454c108aa0 2024-08-31T06:44:54.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f453c0b4c00 msgr2=0x7f453c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:54.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f453c0b4c00 0x7f453c0b7110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f454c100de0 tx=0x7f454000b410 comp rx=0 tx=0).stop 2024-08-31T06:44:54.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108aa0 msgr2=0x7f454c0ffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:54.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108aa0 0x7f454c0ffe10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f454400eaa0 tx=0x7f454400ef60 comp rx=0 tx=0).stop 2024-08-31T06:44:54.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 shutdown_connections 2024-08-31T06:44:54.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f453c0b4c00 0x7f453c0b7110 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c108aa0 0x7f454c0ffe10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f454c108150 0x7f454c0ff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 --2- 172.21.15.37:0/3632292232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f454c102810 0x7f454c0ff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:54.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 >> 172.21.15.37:0/3632292232 conn(0x7f454c0794b0 msgr2=0x7f454c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:54.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 shutdown_connections 2024-08-31T06:44:54.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:54.664+0000 7f4552e24640 1 -- 172.21.15.37:0/3632292232 wait complete. 2024-08-31T06:44:54.954 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:54 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3632292232' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T06:44:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:54 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3632292232' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T06:44:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:54 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3632292232' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-31T06:44:55.347 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-08-31T06:44:55.347 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-31T06:44:55.600 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:55.988 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:55 smithi037 ceph-mon[18612]: pgmap v260: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-08-31T06:44:55.988 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:55 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3632292232' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T06:44:55.988 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:55 smithi037 ceph-mon[18612]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:44:56.068 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:55 smithi106 ceph-mon[22134]: pgmap v260: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-08-31T06:44:56.069 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:55 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3632292232' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T06:44:56.069 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:55 smithi106 ceph-mon[22134]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:44:56.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:55 smithi066 ceph-mon[22244]: pgmap v260: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 7 op/s 2024-08-31T06:44:56.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:55 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3632292232' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-31T06:44:56.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:55 smithi066 ceph-mon[22244]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 -- 172.21.15.37:0/2297299075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108160 msgr2=0x7f6dc8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 --2- 172.21.15.37:0/2297299075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108160 0x7f6dc8108570 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009900 tx=0x7f6db402a410 comp rx=0 tx=0).stop 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 -- 172.21.15.37:0/2297299075 shutdown_connections 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 --2- 172.21.15.37:0/2297299075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108160 0x7f6dc8108570 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 --2- 172.21.15.37:0/2297299075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc8108ab0 0x7f6dc810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 --2- 172.21.15.37:0/2297299075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dc8102820 0x7f6dc8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 -- 172.21.15.37:0/2297299075 >> 172.21.15.37:0/2297299075 conn(0x7f6dc80794e0 msgr2=0x7f6dc80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 -- 172.21.15.37:0/2297299075 shutdown_connections 2024-08-31T06:44:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 -- 172.21.15.37:0/2297299075 wait complete. 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.142+0000 7f6dceb56640 1 Processor -- start 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dceb56640 1 -- start start 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dceb56640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc8102820 0x7f6dc819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dceb56640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dc8108160 0x7f6dc819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dceb56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108ab0 0x7f6dc819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dceb56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8113710 con 0x7f6dc8108ab0 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dceb56640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8113590 con 0x7f6dc8102820 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dceb56640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc8113890 con 0x7f6dc8108160 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108ab0 0x7f6dc819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108ab0 0x7f6dc819f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44750/0 (socket says 172.21.15.37:44750) 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 -- 172.21.15.37:0/976008876 learned_addr learned my addr 172.21.15.37:0/976008876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcc8f2640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc8102820 0x7f6dc819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dc7fff640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dc8108160 0x7f6dc819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 -- 172.21.15.37:0/976008876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dc8108160 msgr2=0x7f6dc819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dc8108160 0x7f6dc819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 -- 172.21.15.37:0/976008876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc8102820 msgr2=0x7f6dc819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc8102820 0x7f6dc819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 -- 172.21.15.37:0/976008876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc81a0110 con 0x7f6dc8108ab0 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcc8f2640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc8102820 0x7f6dc819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dcd0f3640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108ab0 0x7f6dc819f9e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000eaa0 tx=0x7f6dc000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.143+0000 7f6dc5ffb640 1 -- 172.21.15.37:0/976008876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc000cdb0 con 0x7f6dc8108ab0 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.144+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc81a0400 con 0x7f6dc8108ab0 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.144+0000 7f6dc5ffb640 1 -- 172.21.15.37:0/976008876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6dc0005020 con 0x7f6dc8108ab0 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.144+0000 7f6dc5ffb640 1 -- 172.21.15.37:0/976008876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00116d0 con 0x7f6dc8108ab0 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.144+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc81a6b60 con 0x7f6dc8108ab0 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.145+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc8103aa0 con 0x7f6dc8108ab0 2024-08-31T06:44:56.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.146+0000 7f6dc5ffb640 1 -- 172.21.15.37:0/976008876 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f6dc00051d0 con 0x7f6dc8108ab0 2024-08-31T06:44:56.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.147+0000 7f6dc5ffb640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6db80b4b80 0x7f6db80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:56.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.147+0000 7f6dcc8f2640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6db80b4b80 0x7f6db80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:56.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.147+0000 7f6dc5ffb640 1 -- 172.21.15.37:0/976008876 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f6dc00e57e0 con 0x7f6dc8108ab0 2024-08-31T06:44:56.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.148+0000 7f6dcc8f2640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6db80b4b80 0x7f6db80b7090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009930 tx=0x7f6dbc008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:56.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.150+0000 7f6dc5ffb640 1 -- 172.21.15.37:0/976008876 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6dc0016030 con 0x7f6dc8108ab0 2024-08-31T06:44:56.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.363+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6dc80635a0 con 0x7f6db80b4b80 2024-08-31T06:44:56.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.393+0000 7f6dc5ffb640 1 -- 172.21.15.37:0/976008876 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6dc80635a0 con 0x7f6db80b4b80 2024-08-31T06:44:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6db80b4b80 msgr2=0x7f6db80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6db80b4b80 0x7f6db80b7090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009930 tx=0x7f6dbc008040 comp rx=0 tx=0).stop 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108ab0 msgr2=0x7f6dc819f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108ab0 0x7f6dc819f9e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000eaa0 tx=0x7f6dc000ef60 comp rx=0 tx=0).stop 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 shutdown_connections 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6db80b4b80 0x7f6db80b7090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc8108ab0 0x7f6dc819f9e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6dc8108160 0x7f6dc819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 --2- 172.21.15.37:0/976008876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dc8102820 0x7f6dc819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 >> 172.21.15.37:0/976008876 conn(0x7f6dc80794e0 msgr2=0x7f6dc81050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 shutdown_connections 2024-08-31T06:44:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:56.395+0000 7f6dceb56640 1 -- 172.21.15.37:0/976008876 wait complete. 2024-08-31T06:44:56.710 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:44:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:44:56.369+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:44:56.711 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:44:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:44:56.369+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:44:56.711 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:44:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:44:56.369+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:44:56.711 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:44:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:44:56.369+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:44:56.711 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:44:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:44:56.369+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:44:57.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-31T06:44:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:57.719 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:57 smithi037 ceph-mon[18612]: pgmap v261: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-31T06:44:57.719 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:57 smithi037 ceph-mon[18612]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 -- 172.21.15.37:0/2227554215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154109240 msgr2=0x7f6154109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 --2- 172.21.15.37:0/2227554215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154109240 0x7f6154109650 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f613c009900 tx=0x7f613c02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 -- 172.21.15.37:0/2227554215 shutdown_connections 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 --2- 172.21.15.37:0/2227554215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154109240 0x7f6154109650 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 --2- 172.21.15.37:0/2227554215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6154109b90 0x7f61541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 --2- 172.21.15.37:0/2227554215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6154103900 0x7f6154103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 -- 172.21.15.37:0/2227554215 >> 172.21.15.37:0/2227554215 conn(0x7f615407b5f0 msgr2=0x7f615407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 -- 172.21.15.37:0/2227554215 shutdown_connections 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.813+0000 7f6159ff7640 1 -- 172.21.15.37:0/2227554215 wait complete. 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6159ff7640 1 Processor -- start 2024-08-31T06:44:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6159ff7640 1 -- start start 2024-08-31T06:44:57.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6159ff7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154103900 0x7f615419a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:57.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6159ff7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6154109240 0x7f615419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6159ff7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6154109b90 0x7f615419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6159ff7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6154113720 con 0x7f6154103900 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6159ff7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f61541135a0 con 0x7f6154109240 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6159ff7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f61541138a0 con 0x7f6154109b90 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f61537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154103900 0x7f615419a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f61537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154103900 0x7f615419a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44786/0 (socket says 172.21.15.37:44786) 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f61537fe640 1 -- 172.21.15.37:0/43638529 learned_addr learned my addr 172.21.15.37:0/43638529 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f6153fff640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6154109b90 0x7f615419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.814+0000 7f614affd640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6154109240 0x7f615419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61537fe640 1 -- 172.21.15.37:0/43638529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6154109b90 msgr2=0x7f615419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61537fe640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6154109b90 0x7f615419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61537fe640 1 -- 172.21.15.37:0/43638529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6154109240 msgr2=0x7f615419a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61537fe640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6154109240 0x7f615419a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61537fe640 1 -- 172.21.15.37:0/43638529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61541a00e0 con 0x7f6154103900 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f6153fff640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6154109b90 0x7f615419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f614affd640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6154109240 0x7f615419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61537fe640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154103900 0x7f615419a230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f614400b4a0 tx=0x7f614400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61517fa640 1 -- 172.21.15.37:0/43638529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144014070 con 0x7f6154103900 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61541a03d0 con 0x7f6154103900 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61517fa640 1 -- 172.21.15.37:0/43638529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6144010aa0 con 0x7f6154103900 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f61517fa640 1 -- 172.21.15.37:0/43638529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6144017b70 con 0x7f6154103900 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.815+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61541a6bf0 con 0x7f6154103900 2024-08-31T06:44:57.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.816+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6154103d10 con 0x7f6154103900 2024-08-31T06:44:57.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.818+0000 7f61517fa640 1 -- 172.21.15.37:0/43638529 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 20) ==== 152594+0+0 (secure 0 0 0) 0x7f6144017070 con 0x7f6154103900 2024-08-31T06:44:57.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.818+0000 7f61517fa640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f61400b4bb0 0x7f61400b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:57.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.819+0000 7f614affd640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f61400b4bb0 0x7f61400b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:57.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.819+0000 7f61517fa640 1 -- 172.21.15.37:0/43638529 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f61440e48a0 con 0x7f6154103900 2024-08-31T06:44:57.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.819+0000 7f614affd640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f61400b4bb0 0x7f61400b70c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f613c0057c0 tx=0x7f613c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:57.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:57.822+0000 7f61517fa640 1 -- 172.21.15.37:0/43638529 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f61440ab9f0 con 0x7f6154103900 2024-08-31T06:44:58.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.035+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f61540635a0 con 0x7f61400b4bb0 2024-08-31T06:44:58.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.063+0000 7f61517fa640 1 -- 172.21.15.37:0/43638529 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f61540635a0 con 0x7f61400b4bb0 2024-08-31T06:44:58.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:57 smithi106 ceph-mon[22134]: pgmap v261: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-31T06:44:58.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:57 smithi106 ceph-mon[22134]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:58.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f61400b4bb0 msgr2=0x7f61400b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f61400b4bb0 0x7f61400b70c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f613c0057c0 tx=0x7f613c009680 comp rx=0 tx=0).stop 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154103900 msgr2=0x7f615419a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154103900 0x7f615419a230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f614400b4a0 tx=0x7f614400b960 comp rx=0 tx=0).stop 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 shutdown_connections 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f61400b4bb0 0x7f61400b70c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6154109b90 0x7f615419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6154109240 0x7f615419a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 --2- 172.21.15.37:0/43638529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6154103900 0x7f615419a230 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.065+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 >> 172.21.15.37:0/43638529 conn(0x7f615407b5f0 msgr2=0x7f61541073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.066+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 shutdown_connections 2024-08-31T06:44:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:58.066+0000 7f6159ff7640 1 -- 172.21.15.37:0/43638529 wait complete. 2024-08-31T06:44:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:57 smithi066 ceph-mon[22244]: pgmap v261: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 3.2 KiB/s wr, 11 op/s 2024-08-31T06:44:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:57 smithi066 ceph-mon[22244]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:58.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-31T06:44:58.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:58 smithi037 ceph-mon[18612]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:58.977 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:44:59.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:58 smithi106 ceph-mon[22134]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:59.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:58 smithi066 ceph-mon[22244]: from='client.14949 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 -- 172.21.15.37:0/3016328644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814108140 msgr2=0x7f6814108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 --2- 172.21.15.37:0/3016328644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814108140 0x7f6814108550 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6808009900 tx=0x7f680802a410 comp rx=0 tx=0).stop 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 -- 172.21.15.37:0/3016328644 shutdown_connections 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 --2- 172.21.15.37:0/3016328644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814108140 0x7f6814108550 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 --2- 172.21.15.37:0/3016328644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6814108a90 0x7f681410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 --2- 172.21.15.37:0/3016328644 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6814102800 0x7f6814102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 -- 172.21.15.37:0/3016328644 >> 172.21.15.37:0/3016328644 conn(0x7f68140794d0 msgr2=0x7f68140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 -- 172.21.15.37:0/3016328644 shutdown_connections 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.447+0000 7f6819299640 1 -- 172.21.15.37:0/3016328644 wait complete. 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6819299640 1 Processor -- start 2024-08-31T06:44:59.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6819299640 1 -- start start 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6819299640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814102800 0x7f681419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6819299640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6814108140 0x7f681419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6819299640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6814108a90 0x7f681419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6819299640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6814112590 con 0x7f6814102800 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6819299640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6814112410 con 0x7f6814108140 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6819299640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6814112710 con 0x7f6814108a90 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814102800 0x7f681419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814102800 0x7f681419afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44808/0 (socket says 172.21.15.37:44808) 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.448+0000 7f6812ffd640 1 -- 172.21.15.37:0/3353613219 learned_addr learned my addr 172.21.15.37:0/3353613219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f68127fc640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6814108140 0x7f681419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f68137fe640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6814108a90 0x7f681419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:59.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f6812ffd640 1 -- 172.21.15.37:0/3353613219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6814108a90 msgr2=0x7f681419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f6812ffd640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6814108a90 0x7f681419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f6812ffd640 1 -- 172.21.15.37:0/3353613219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6814108140 msgr2=0x7f681419b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f6812ffd640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6814108140 0x7f681419b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f6812ffd640 1 -- 172.21.15.37:0/3353613219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68141a6250 con 0x7f6814102800 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f68137fe640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6814108a90 0x7f681419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f68127fc640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6814108140 0x7f681419b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f6812ffd640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814102800 0x7f681419afc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f680400d770 tx=0x7f680400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f67fbfff640 1 -- 172.21.15.37:0/3353613219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804017070 con 0x7f6814102800 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f67fbfff640 1 -- 172.21.15.37:0/3353613219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68040054b0 con 0x7f6814102800 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68141a6540 con 0x7f6814102800 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f67fbfff640 1 -- 172.21.15.37:0/3353613219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804004c60 con 0x7f6814102800 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.449+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68141a6a00 con 0x7f6814102800 2024-08-31T06:44:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.450+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6814102c10 con 0x7f6814102800 2024-08-31T06:44:59.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.452+0000 7f67fbfff640 1 -- 172.21.15.37:0/3353613219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f6804004e00 con 0x7f6814102800 2024-08-31T06:44:59.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.452+0000 7f67fbfff640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f67fc0b4c40 0x7f67fc0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:44:59.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.453+0000 7f67fbfff640 1 -- 172.21.15.37:0/3353613219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f68040e5270 con 0x7f6814102800 2024-08-31T06:44:59.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.453+0000 7f68127fc640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f67fc0b4c40 0x7f67fc0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:44:59.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.453+0000 7f68127fc640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f67fc0b4c40 0x7f67fc0b7150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6808006010 tx=0x7f6808005de0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:44:59.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.456+0000 7f67fbfff640 1 -- 172.21.15.37:0/3353613219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f68040ac260 con 0x7f6814102800 2024-08-31T06:44:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.676+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f68140635a0 con 0x7f67fc0b4c40 2024-08-31T06:44:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.682+0000 7f67fbfff640 1 -- 172.21.15.37:0/3353613219 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f68140635a0 con 0x7f67fc0b4c40 2024-08-31T06:44:59.683 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_0/44e8f424-bdc4-40c2-8c72-f37d761e7a7b 2024-08-31T06:44:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f67fc0b4c40 msgr2=0x7f67fc0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f67fc0b4c40 0x7f67fc0b7150 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6808006010 tx=0x7f6808005de0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814102800 msgr2=0x7f681419afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:44:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814102800 0x7f681419afc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f680400d770 tx=0x7f680400dc30 comp rx=0 tx=0).stop 2024-08-31T06:44:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 shutdown_connections 2024-08-31T06:44:59.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f67fc0b4c40 0x7f67fc0b7150 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6814108a90 0x7f681419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6814108140 0x7f681419b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 --2- 172.21.15.37:0/3353613219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6814102800 0x7f681419afc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:44:59.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 >> 172.21.15.37:0/3353613219 conn(0x7f68140794d0 msgr2=0x7f6814104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:44:59.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 shutdown_connections 2024-08-31T06:44:59.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:44:59.684+0000 7f6819299640 1 -- 172.21.15.37:0/3353613219 wait complete. 2024-08-31T06:44:59.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:59 smithi037 ceph-mon[18612]: pgmap v262: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-08-31T06:44:59.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:44:59 smithi037 ceph-mon[18612]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-08-31T06:45:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:59 smithi106 ceph-mon[22134]: pgmap v262: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-08-31T06:45:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:44:59 smithi106 ceph-mon[22134]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-08-31T06:45:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:59 smithi066 ceph-mon[22244]: pgmap v262: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-08-31T06:45:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:44:59 smithi066 ceph-mon[22244]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-08-31T06:45:00.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-31T06:45:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:01.027 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:00 smithi037 ceph-mon[18612]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:01.038 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:00 smithi066 ceph-mon[22244]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:01.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:00 smithi106 ceph-mon[22134]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.122+0000 7fa6156e1640 1 -- 172.21.15.37:0/2377394141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 msgr2=0x7fa61010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2377394141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 0x7fa61010d5f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa604009900 tx=0x7fa60402a410 comp rx=0 tx=0).stop 2024-08-31T06:45:01.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 -- 172.21.15.37:0/2377394141 shutdown_connections 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2377394141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 0x7fa61010d5f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2377394141 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa61010dbb0 0x7fa6101100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2377394141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa610104750 0x7fa610104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 -- 172.21.15.37:0/2377394141 >> 172.21.15.37:0/2377394141 conn(0x7fa6100794d0 msgr2=0x7fa6100798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 -- 172.21.15.37:0/2377394141 shutdown_connections 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 -- 172.21.15.37:0/2377394141 wait complete. 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.123+0000 7fa6156e1640 1 Processor -- start 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa6156e1640 1 -- start start 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa6156e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa610104750 0x7fa61019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa6156e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 0x7fa61019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa6156e1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa61010dbb0 0x7fa61019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa6156e1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa610113680 con 0x7fa6101050a0 2024-08-31T06:45:01.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa6156e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa610113500 con 0x7fa610104750 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa6156e1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa610113800 con 0x7fa61010dbb0 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 0x7fa61019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 0x7fa61019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44824/0 (socket says 172.21.15.37:44824) 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60e7fc640 1 -- 172.21.15.37:0/2826979145 learned_addr learned my addr 172.21.15.37:0/2826979145 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60f7fe640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa61010dbb0 0x7fa61019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60effd640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa610104750 0x7fa61019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60e7fc640 1 -- 172.21.15.37:0/2826979145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa61010dbb0 msgr2=0x7fa61019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60e7fc640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa61010dbb0 0x7fa61019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60e7fc640 1 -- 172.21.15.37:0/2826979145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa610104750 msgr2=0x7fa61019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60e7fc640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa610104750 0x7fa61019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60e7fc640 1 -- 172.21.15.37:0/2826979145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6101a00a0 con 0x7fa6101050a0 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.124+0000 7fa60effd640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa610104750 0x7fa61019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.125+0000 7fa60e7fc640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 0x7fa61019a790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa604005940 tx=0x7fa6040040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:01.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.125+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2826979145 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60403f030 con 0x7fa6101050a0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.125+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6101a0330 con 0x7fa6101050a0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.125+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2826979145 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa604003a80 con 0x7fa6101050a0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.125+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6101a0860 con 0x7fa6101050a0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.125+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2826979145 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604035070 con 0x7fa6101050a0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.126+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa610104b60 con 0x7fa6101050a0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.127+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2826979145 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa604042030 con 0x7fa6101050a0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.128+0000 7fa5f7fff640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5f80b4c40 0x7fa5f80b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.128+0000 7fa60effd640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5f80b4c40 0x7fa5f80b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.128+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2826979145 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7fa604105c90 con 0x7fa6101050a0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.129+0000 7fa60effd640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5f80b4c40 0x7fa5f80b7150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa61006ba00 tx=0x7fa600007870 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:01.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.131+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2826979145 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa6101a0860 con 0x7fa6101050a0 2024-08-31T06:45:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.341+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa6100635a0 con 0x7fa5f80b4c40 2024-08-31T06:45:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.370+0000 7fa5f7fff640 1 -- 172.21.15.37:0/2826979145 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa6100635a0 con 0x7fa5f80b4c40 2024-08-31T06:45:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5f80b4c40 msgr2=0x7fa5f80b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5f80b4c40 0x7fa5f80b7150 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa61006ba00 tx=0x7fa600007870 comp rx=0 tx=0).stop 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 msgr2=0x7fa61019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 0x7fa61019a790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa604005940 tx=0x7fa6040040e0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 shutdown_connections 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5f80b4c40 0x7fa5f80b7150 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6101050a0 0x7fa61019a790 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa61010dbb0 0x7fa61019fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 --2- 172.21.15.37:0/2826979145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa610104750 0x7fa61019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 >> 172.21.15.37:0/2826979145 conn(0x7fa6100794d0 msgr2=0x7fa610100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 shutdown_connections 2024-08-31T06:45:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:01.372+0000 7fa6156e1640 1 -- 172.21.15.37:0/2826979145 wait complete. 2024-08-31T06:45:01.966 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:01 smithi106 ceph-mon[22134]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T06:45:02.050 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:01 smithi066 ceph-mon[22244]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T06:45:02.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:01 smithi037 ceph-mon[18612]: pgmap v263: 97 pgs: 97 active+clean; 582 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-31T06:45:02.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-31T06:45:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:02.826 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:02 smithi037 ceph-mon[18612]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 -- 172.21.15.37:0/870128877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108ab0 msgr2=0x7f0fb810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/870128877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108ab0 0x7f0fb810f2e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009ca0 tx=0x7f0fb002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 -- 172.21.15.37:0/870128877 shutdown_connections 2024-08-31T06:45:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/870128877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108ab0 0x7f0fb810f2e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/870128877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb8108160 0x7f0fb8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/870128877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb8102820 0x7f0fb8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 -- 172.21.15.37:0/870128877 >> 172.21.15.37:0/870128877 conn(0x7f0fb80794e0 msgr2=0x7f0fb80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 -- 172.21.15.37:0/870128877 shutdown_connections 2024-08-31T06:45:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.920+0000 7f0fbeb44640 1 -- 172.21.15.37:0/870128877 wait complete. 2024-08-31T06:45:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbeb44640 1 Processor -- start 2024-08-31T06:45:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbeb44640 1 -- start start 2024-08-31T06:45:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbeb44640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb8102820 0x7f0fb819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:02.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbeb44640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108160 0x7f0fb819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbeb44640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb8108ab0 0x7f0fb819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbeb44640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb8112630 con 0x7f0fb8108160 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbeb44640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb81124b0 con 0x7f0fb8102820 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbeb44640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb81127b0 con 0x7f0fb8108ab0 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108160 0x7f0fb819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbc8e0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb8102820 0x7f0fb819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108160 0x7f0fb819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44840/0 (socket says 172.21.15.37:44840) 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fb7fff640 1 -- 172.21.15.37:0/422921258 learned_addr learned my addr 172.21.15.37:0/422921258 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbc8e0640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb8102820 0x7f0fb819a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:57948/0 (socket says 172.21.15.37:57948) 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.921+0000 7f0fbd0e1640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb8108ab0 0x7f0fb819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fbc8e0640 1 -- 172.21.15.37:0/422921258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb8108ab0 msgr2=0x7f0fb819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:02.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fbc8e0640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb8108ab0 0x7f0fb819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fbc8e0640 1 -- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108160 msgr2=0x7f0fb819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fbc8e0640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108160 0x7f0fb819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fbc8e0640 1 -- 172.21.15.37:0/422921258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb81a00c0 con 0x7f0fb8102820 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fb7fff640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108160 0x7f0fb819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fbc8e0640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb8102820 0x7f0fb819a150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00e9f0 tx=0x7f0fac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fb5ffb640 1 -- 172.21.15.37:0/422921258 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00ccc0 con 0x7f0fb8102820 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb81a03b0 con 0x7f0fb8102820 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fb5ffb640 1 -- 172.21.15.37:0/422921258 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0fac0108c0 con 0x7f0fb8102820 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fb5ffb640 1 -- 172.21.15.37:0/422921258 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac0187c0 con 0x7f0fb8102820 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.922+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb81a6b10 con 0x7f0fb8102820 2024-08-31T06:45:02.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.923+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb8103aa0 con 0x7f0fb8102820 2024-08-31T06:45:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.925+0000 7f0fb5ffb640 1 -- 172.21.15.37:0/422921258 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f0fac010430 con 0x7f0fb8102820 2024-08-31T06:45:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.925+0000 7f0fb5ffb640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0fa80b4c10 0x7f0fa80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.925+0000 7f0fb7fff640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0fa80b4c10 0x7f0fa80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.926+0000 7f0fb5ffb640 1 -- 172.21.15.37:0/422921258 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f0fac0e55a0 con 0x7f0fb8102820 2024-08-31T06:45:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.926+0000 7f0fb7fff640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0fa80b4c10 0x7f0fa80b7120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8107830 tx=0x7f0fa4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:02.930+0000 7f0fb5ffb640 1 -- 172.21.15.37:0/422921258 <== mon.2 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0fac0abf40 con 0x7f0fb8102820 2024-08-31T06:45:03.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:02 smithi106 ceph-mon[22134]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:03.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:02 smithi066 ceph-mon[22244]: from='client.14961 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:03.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.143+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0fb8104d80 con 0x7f0fa80b4c10 2024-08-31T06:45:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.147+0000 7f0fb5ffb640 1 -- 172.21.15.37:0/422921258 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0fb8104d80 con 0x7f0fa80b4c10 2024-08-31T06:45:03.148 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_1/b9cd53ea-bd14-4d29-a1a0-60b74c9f04c9 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.149+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0fa80b4c10 msgr2=0x7f0fa80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.149+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0fa80b4c10 0x7f0fa80b7120 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8107830 tx=0x7f0fa4005f90 comp rx=0 tx=0).stop 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.149+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb8102820 msgr2=0x7f0fb819a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.149+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb8102820 0x7f0fb819a150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00e9f0 tx=0x7f0fac00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.149+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 shutdown_connections 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.149+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0fa80b4c10 0x7f0fa80b7120 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.149+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb8108160 0x7f0fb819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.149+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb8108ab0 0x7f0fb819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.150+0000 7f0fbeb44640 1 --2- 172.21.15.37:0/422921258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb8102820 0x7f0fb819a150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.150+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 >> 172.21.15.37:0/422921258 conn(0x7f0fb80794e0 msgr2=0x7f0fb8101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.150+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 shutdown_connections 2024-08-31T06:45:03.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:03.150+0000 7f0fbeb44640 1 -- 172.21.15.37:0/422921258 wait complete. 2024-08-31T06:45:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:03 smithi037 ceph-mon[18612]: pgmap v264: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-08-31T06:45:03.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:45:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:04.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:03 smithi106 ceph-mon[22134]: pgmap v264: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-08-31T06:45:04.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:03 smithi066 ceph-mon[22244]: pgmap v264: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.2 KiB/s wr, 14 op/s 2024-08-31T06:45:04.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 -- 172.21.15.37:0/3610056948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 msgr2=0x7f0620102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:04.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 --2- 172.21.15.37:0/3610056948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 0x7f0620102c30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0610009900 tx=0x7f061002a410 comp rx=0 tx=0).stop 2024-08-31T06:45:04.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 -- 172.21.15.37:0/3610056948 shutdown_connections 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 --2- 172.21.15.37:0/3610056948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0620108ab0 0x7f062010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 --2- 172.21.15.37:0/3610056948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0620108160 0x7f0620108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 --2- 172.21.15.37:0/3610056948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 0x7f0620102c30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 -- 172.21.15.37:0/3610056948 >> 172.21.15.37:0/3610056948 conn(0x7f06200794e0 msgr2=0x7f06200798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 -- 172.21.15.37:0/3610056948 shutdown_connections 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.499+0000 7f0625152640 1 -- 172.21.15.37:0/3610056948 wait complete. 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f0625152640 1 Processor -- start 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f0625152640 1 -- start start 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f0625152640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 0x7f062019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f0625152640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0620108160 0x7f062019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f0625152640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0620108ab0 0x7f062019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f0625152640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f06201136e0 con 0x7f0620102820 2024-08-31T06:45:04.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f0625152640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0620113560 con 0x7f0620108ab0 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f0625152640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0620113860 con 0x7f0620108160 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f061ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 0x7f062019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f061ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 0x7f062019a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39174/0 (socket says 172.21.15.37:39174) 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f061ed9d640 1 -- 172.21.15.37:0/3917931735 learned_addr learned my addr 172.21.15.37:0/3917931735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f061f59e640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0620108ab0 0x7f062019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.500+0000 7f061e59c640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0620108160 0x7f062019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f061ed9d640 1 -- 172.21.15.37:0/3917931735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0620108160 msgr2=0x7f062019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f061ed9d640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0620108160 0x7f062019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f061ed9d640 1 -- 172.21.15.37:0/3917931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0620108ab0 msgr2=0x7f062019f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:04.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f061ed9d640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0620108ab0 0x7f062019f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f061ed9d640 1 -- 172.21.15.37:0/3917931735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06201a00a0 con 0x7f0620102820 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f061ed9d640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 0x7f062019a130 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0610009230 tx=0x7f0610004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f0607fff640 1 -- 172.21.15.37:0/3917931735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061003f030 con 0x7f0620102820 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06201a0330 con 0x7f0620102820 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f0607fff640 1 -- 172.21.15.37:0/3917931735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0610003a80 con 0x7f0620102820 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f0607fff640 1 -- 172.21.15.37:0/3917931735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0610035070 con 0x7f0620102820 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.501+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06201a6af0 con 0x7f0620102820 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.502+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0620103aa0 con 0x7f0620102820 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.504+0000 7f0607fff640 1 -- 172.21.15.37:0/3917931735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f0610042030 con 0x7f0620102820 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.505+0000 7f0607fff640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f06080b4c10 0x7f06080b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.505+0000 7f061e59c640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f06080b4c10 0x7f06080b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:04.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.505+0000 7f0607fff640 1 -- 172.21.15.37:0/3917931735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f0610105d90 con 0x7f0620102820 2024-08-31T06:45:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.505+0000 7f061e59c640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f06080b4c10 0x7f06080b7120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0620100ae0 tx=0x7f0614005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:04.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.508+0000 7f0607fff640 1 -- 172.21.15.37:0/3917931735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f06100cc730 con 0x7f0620102820 2024-08-31T06:45:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.733+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f062010a8b0 con 0x7f0620102820 2024-08-31T06:45:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.734+0000 7f0607fff640 1 -- 172.21.15.37:0/3917931735 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7f06100d0ef0 con 0x7f0620102820 2024-08-31T06:45:04.737 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:04.737 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"btime":"2024-08-31T06:44:54:657185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:44:54.319927+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24656,24695,24658]},"id":1}]} 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f06080b4c10 msgr2=0x7f06080b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f06080b4c10 0x7f06080b7120 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0620100ae0 tx=0x7f0614005f90 comp rx=0 tx=0).stop 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 msgr2=0x7f062019a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 0x7f062019a130 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0610009230 tx=0x7f0610004270 comp rx=0 tx=0).stop 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 shutdown_connections 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f06080b4c10 0x7f06080b7120 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0620108ab0 0x7f062019f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0620108160 0x7f062019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 --2- 172.21.15.37:0/3917931735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0620102820 0x7f062019a130 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.736+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 >> 172.21.15.37:0/3917931735 conn(0x7f06200794e0 msgr2=0x7f06201012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:04.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.737+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 shutdown_connections 2024-08-31T06:45:04.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:04.737+0000 7f0625152640 1 -- 172.21.15.37:0/3917931735 wait complete. 2024-08-31T06:45:05.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:04 smithi106 ceph-mon[22134]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:05.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:04 smithi037 ceph-mon[18612]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:05.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:04 smithi066 ceph-mon[22244]: from='client.24773 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:45:05.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:45:05.697 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:06.020 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:05 smithi037 ceph-mon[18612]: pgmap v265: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-31T06:45:06.020 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:05 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3917931735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:06.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:05 smithi106 ceph-mon[22134]: pgmap v265: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-31T06:45:06.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:05 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3917931735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:06.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:05 smithi066 ceph-mon[22244]: pgmap v265: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-31T06:45:06.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:05 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3917931735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.159+0000 7f98fe8e2640 1 -- 172.21.15.37:0/2049490641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8109bb0 msgr2=0x7f98f81103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.159+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/2049490641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8109bb0 0x7f98f81103e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f98f0009ca0 tx=0x7f98f002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.159+0000 7f98fe8e2640 1 -- 172.21.15.37:0/2049490641 shutdown_connections 2024-08-31T06:45:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.159+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/2049490641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8109bb0 0x7f98f81103e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.159+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/2049490641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98f8109260 0x7f98f8109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.159+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/2049490641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98f8103920 0x7f98f8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.159+0000 7f98fe8e2640 1 -- 172.21.15.37:0/2049490641 >> 172.21.15.37:0/2049490641 conn(0x7f98f80ff3b0 msgr2=0x7f98f8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.160+0000 7f98fe8e2640 1 -- 172.21.15.37:0/2049490641 shutdown_connections 2024-08-31T06:45:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.160+0000 7f98fe8e2640 1 -- 172.21.15.37:0/2049490641 wait complete. 2024-08-31T06:45:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.160+0000 7f98fe8e2640 1 Processor -- start 2024-08-31T06:45:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.160+0000 7f98fe8e2640 1 -- start start 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98fe8e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8103920 0x7f98f819a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98fe8e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98f8109260 0x7f98f819a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98fe8e2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98f8109bb0 0x7f98f819f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98fe8e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f98f8113770 con 0x7f98f8103920 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98fe8e2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81135f0 con 0x7f98f8109260 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98fe8e2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81138f0 con 0x7f98f8109bb0 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8103920 0x7f98f819a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8103920 0x7f98f819a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39192/0 (socket says 172.21.15.37:39192) 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 -- 172.21.15.37:0/3473124307 learned_addr learned my addr 172.21.15.37:0/3473124307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98fce7f640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98f8109bb0 0x7f98f819f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f77fe640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98f8109260 0x7f98f819a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 -- 172.21.15.37:0/3473124307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98f8109bb0 msgr2=0x7f98f819f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98f8109bb0 0x7f98f819f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 -- 172.21.15.37:0/3473124307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98f8109260 msgr2=0x7f98f819a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98f8109260 0x7f98f819a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 -- 172.21.15.37:0/3473124307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f81a0090 con 0x7f98f8103920 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f77fe640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98f8109260 0x7f98f819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.161+0000 7f98f7fff640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8103920 0x7f98f819a120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c890 tx=0x7f98e800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.162+0000 7f98f57fa640 1 -- 172.21.15.37:0/3473124307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8004220 con 0x7f98f8103920 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.162+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f81a0380 con 0x7f98f8103920 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.162+0000 7f98f57fa640 1 -- 172.21.15.37:0/3473124307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98e8007e40 con 0x7f98f8103920 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.162+0000 7f98f57fa640 1 -- 172.21.15.37:0/3473124307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e8004a00 con 0x7f98f8103920 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.162+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f81a6ae0 con 0x7f98f8103920 2024-08-31T06:45:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.163+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f8104ba0 con 0x7f98f8103920 2024-08-31T06:45:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.164+0000 7f98f57fa640 1 -- 172.21.15.37:0/3473124307 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f98e80079b0 con 0x7f98f8103920 2024-08-31T06:45:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.165+0000 7f98f57fa640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f98e00b4c10 0x7f98e00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.165+0000 7f98f77fe640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f98e00b4c10 0x7f98e00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.165+0000 7f98f57fa640 1 -- 172.21.15.37:0/3473124307 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f98e80e5420 con 0x7f98f8103920 2024-08-31T06:45:06.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.165+0000 7f98f77fe640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f98e00b4c10 0x7f98e00b7120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f98f8102c00 tx=0x7f98ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:06.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.168+0000 7f98f57fa640 1 -- 172.21.15.37:0/3473124307 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f98e8014030 con 0x7f98f8103920 2024-08-31T06:45:06.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.354+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98f8103d30 con 0x7f98f8103920 2024-08-31T06:45:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.356+0000 7f98f57fa640 1 -- 172.21.15.37:0/3473124307 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22570 (secure 0 0 0) 0x7f98e80ac410 con 0x7f98f8103920 2024-08-31T06:45:06.358 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:06.358 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:44:43.326060+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:45:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f98e00b4c10 msgr2=0x7f98e00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f98e00b4c10 0x7f98e00b7120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f98f8102c00 tx=0x7f98ec005f90 comp rx=0 tx=0).stop 2024-08-31T06:45:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8103920 msgr2=0x7f98f819a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8103920 0x7f98f819a120 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f98e800c890 tx=0x7f98e800cd50 comp rx=0 tx=0).stop 2024-08-31T06:45:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 shutdown_connections 2024-08-31T06:45:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f98e00b4c10 0x7f98e00b7120 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98f8109bb0 0x7f98f819f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98f8109260 0x7f98f819a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 --2- 172.21.15.37:0/3473124307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98f8103920 0x7f98f819a120 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 >> 172.21.15.37:0/3473124307 conn(0x7f98f80ff3b0 msgr2=0x7f98f8106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 shutdown_connections 2024-08-31T06:45:06.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:06.359+0000 7f98fe8e2640 1 -- 172.21.15.37:0/3473124307 wait complete. 2024-08-31T06:45:06.989 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:06 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3473124307' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:07.017 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T06:45:07.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:45:07.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:06 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3473124307' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:07.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:06 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3473124307' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:07.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.773+0000 7f5d8f821640 1 -- 172.21.15.37:0/3012093566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d881082c0 msgr2=0x7f5d8810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:07.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.773+0000 7f5d8f821640 1 --2- 172.21.15.37:0/3012093566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d881082c0 0x7f5d8810eaf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009ca0 tx=0x7f5d8002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.773+0000 7f5d8f821640 1 -- 172.21.15.37:0/3012093566 shutdown_connections 2024-08-31T06:45:07.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.773+0000 7f5d8f821640 1 --2- 172.21.15.37:0/3012093566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d881082c0 0x7f5d8810eaf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.773+0000 7f5d8f821640 1 --2- 172.21.15.37:0/3012093566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d88107970 0x7f5d88107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.773+0000 7f5d8f821640 1 --2- 172.21.15.37:0/3012093566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d88102030 0x7f5d88102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.773+0000 7f5d8f821640 1 -- 172.21.15.37:0/3012093566 >> 172.21.15.37:0/3012093566 conn(0x7f5d88079c40 msgr2=0x7f5d8807a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.773+0000 7f5d8f821640 1 -- 172.21.15.37:0/3012093566 shutdown_connections 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 -- 172.21.15.37:0/3012093566 wait complete. 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 Processor -- start 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 -- start start 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d88102030 0x7f5d880fec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d88107970 0x7f5d880ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d881082c0 0x7f5d880ff6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88111e90 con 0x7f5d88107970 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88111d10 con 0x7f5d88102030 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.774+0000 7f5d8f821640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5d88112010 con 0x7f5d881082c0 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d88107970 0x7f5d880ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d88107970 0x7f5d880ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39200/0 (socket says 172.21.15.37:39200) 2024-08-31T06:45:07.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 -- 172.21.15.37:0/230549629 learned_addr learned my addr 172.21.15.37:0/230549629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8ddbe640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d881082c0 0x7f5d880ff6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8d5bd640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d88102030 0x7f5d880fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 -- 172.21.15.37:0/230549629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d881082c0 msgr2=0x7f5d880ff6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d881082c0 0x7f5d880ff6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 -- 172.21.15.37:0/230549629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d88102030 msgr2=0x7f5d880fec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d88102030 0x7f5d880fec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 -- 172.21.15.37:0/230549629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d881a8450 con 0x7f5d88107970 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8cdbc640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d88107970 0x7f5d880ff1b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800c8c0 tx=0x7f5d7800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d7e7fc640 1 -- 172.21.15.37:0/230549629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78007bb0 con 0x7f5d88107970 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d7e7fc640 1 -- 172.21.15.37:0/230549629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d78007d50 con 0x7f5d88107970 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d881a8740 con 0x7f5d88107970 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d7e7fc640 1 -- 172.21.15.37:0/230549629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d780186a0 con 0x7f5d88107970 2024-08-31T06:45:07.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.775+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d881a8cd0 con 0x7f5d88107970 2024-08-31T06:45:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.777+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d88102440 con 0x7f5d88107970 2024-08-31T06:45:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.778+0000 7f5d7e7fc640 1 -- 172.21.15.37:0/230549629 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f5d7800fa00 con 0x7f5d88107970 2024-08-31T06:45:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.779+0000 7f5d7e7fc640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5d740b4c90 0x7f5d740b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.779+0000 7f5d8d5bd640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5d740b4c90 0x7f5d740b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.779+0000 7f5d7e7fc640 1 -- 172.21.15.37:0/230549629 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f5d780e5390 con 0x7f5d88107970 2024-08-31T06:45:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.779+0000 7f5d8d5bd640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5d740b4c90 0x7f5d740b71a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005fd0 tx=0x7f5d84005e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:07.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.783+0000 7f5d7e7fc640 1 -- 172.21.15.37:0/230549629 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5d78014030 con 0x7f5d88107970 2024-08-31T06:45:07.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.964+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d880635a0 con 0x7f5d740b4c90 2024-08-31T06:45:07.967 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:07 smithi037 ceph-mon[18612]: pgmap v266: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-08-31T06:45:07.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.969+0000 7f5d7e7fc640 1 -- 172.21.15.37:0/230549629 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258692 (secure 0 0 0) 0x7f5d880635a0 con 0x7f5d740b4c90 2024-08-31T06:45:07.974 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:07.975 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:45:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5d740b4c90 msgr2=0x7f5d740b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5d740b4c90 0x7f5d740b71a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5d84005fd0 tx=0x7f5d84005e20 comp rx=0 tx=0).stop 2024-08-31T06:45:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d88107970 msgr2=0x7f5d880ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d88107970 0x7f5d880ff1b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800c8c0 tx=0x7f5d7800cd80 comp rx=0 tx=0).stop 2024-08-31T06:45:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 shutdown_connections 2024-08-31T06:45:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5d740b4c90 0x7f5d740b71a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d88107970 0x7f5d880ff1b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d881082c0 0x7f5d880ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 --2- 172.21.15.37:0/230549629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d88102030 0x7f5d880fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:07.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 >> 172.21.15.37:0/230549629 conn(0x7f5d88079c40 msgr2=0x7f5d881089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:07.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 shutdown_connections 2024-08-31T06:45:07.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:07.972+0000 7f5d8f821640 1 -- 172.21.15.37:0/230549629 wait complete. 2024-08-31T06:45:08.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:07 smithi106 ceph-mon[22134]: pgmap v266: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-08-31T06:45:08.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:07 smithi066 ceph-mon[22244]: pgmap v266: 97 pgs: 97 active+clean; 603 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-08-31T06:45:08.787 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-08-31T06:45:06.239313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":617324,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":165,"num_read_kb":143,"num_write":271,"num_write_kb":2218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360668,"kb_used_data":11420,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581156,"statfs":{"total":1151940427776,"available":1151571103744,"internally_reserved":0,"allocated":11694080,"data_stored":6593911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22518,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":84,"num_read_kb":74,"num_write":67,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003388"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656994+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:44:43.656994+0000","last_peered":"2024-08-31T06:44:43.656994+0000","last_clean":"2024-08-31T06:44:43.656994+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:44:43.656994+0000","last_undegraded":"2024-08-31T06:44:43.656994+0000","last_fullsized":"2024-08-31T06:44:43.656994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656950+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:44:43.656950+0000","last_peered":"2024-08-31T06:44:43.656950+0000","last_clean":"2024-08-31T06:44:43.656950+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:44:43.656950+0000","last_undegraded":"2024-08-31T06:44:43.656950+0000","last_fullsized":"2024-08-31T06:44:43.656950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657031+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:44:43.657031+0000","last_peered":"2024-08-31T06:44:43.657031+0000","last_clean":"2024-08-31T06:44:43.657031+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:44:43.657031+0000","last_undegraded":"2024-08-31T06:44:43.657031+0000","last_fullsized":"2024-08-31T06:44:43.657031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617665+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:44:43.617665+0000","last_peered":"2024-08-31T06:44:43.617665+0000","last_clean":"2024-08-31T06:44:43.617665+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:44:43.617665+0000","last_undegraded":"2024-08-31T06:44:43.617665+0000","last_fullsized":"2024-08-31T06:44:43.617665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655170+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:44:43.655170+0000","last_peered":"2024-08-31T06:44:43.655170+0000","last_clean":"2024-08-31T06:44:43.655170+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:44:43.655170+0000","last_undegraded":"2024-08-31T06:44:43.655170+0000","last_fullsized":"2024-08-31T06:44:43.655170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654310+0000","last_change":"2024-08-31T06:44:42.630022+0000","last_active":"2024-08-31T06:44:43.654310+0000","last_peered":"2024-08-31T06:44:43.654310+0000","last_clean":"2024-08-31T06:44:43.654310+0000","last_became_active":"2024-08-31T06:44:42.629576+0000","last_became_peered":"2024-08-31T06:44:42.629576+0000","last_unstale":"2024-08-31T06:44:43.654310+0000","last_undegraded":"2024-08-31T06:44:43.654310+0000","last_fullsized":"2024-08-31T06:44:43.654310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:59:52.525480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657069+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:44:43.657069+0000","last_peered":"2024-08-31T06:44:43.657069+0000","last_clean":"2024-08-31T06:44:43.657069+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:44:43.657069+0000","last_undegraded":"2024-08-31T06:44:43.657069+0000","last_fullsized":"2024-08-31T06:44:43.657069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654684+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:44:43.654684+0000","last_peered":"2024-08-31T06:44:43.654684+0000","last_clean":"2024-08-31T06:44:43.654684+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:44:43.654684+0000","last_undegraded":"2024-08-31T06:44:43.654684+0000","last_fullsized":"2024-08-31T06:44:43.654684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.659078+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:44:43.659078+0000","last_peered":"2024-08-31T06:44:43.659078+0000","last_clean":"2024-08-31T06:44:43.659078+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:44:43.659078+0000","last_undegraded":"2024-08-31T06:44:43.659078+0000","last_fullsized":"2024-08-31T06:44:43.659078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655231+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:44:43.655231+0000","last_peered":"2024-08-31T06:44:43.655231+0000","last_clean":"2024-08-31T06:44:43.655231+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:44:43.655231+0000","last_undegraded":"2024-08-31T06:44:43.655231+0000","last_fullsized":"2024-08-31T06:44:43.655231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658086+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:44:43.658086+0000","last_peered":"2024-08-31T06:44:43.658086+0000","last_clean":"2024-08-31T06:44:43.658086+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:44:43.658086+0000","last_undegraded":"2024-08-31T06:44:43.658086+0000","last_fullsized":"2024-08-31T06:44:43.658086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617657+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:44:43.617657+0000","last_peered":"2024-08-31T06:44:43.617657+0000","last_clean":"2024-08-31T06:44:43.617657+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:44:43.617657+0000","last_undegraded":"2024-08-31T06:44:43.617657+0000","last_fullsized":"2024-08-31T06:44:43.617657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617513+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:44:43.617513+0000","last_peered":"2024-08-31T06:44:43.617513+0000","last_clean":"2024-08-31T06:44:43.617513+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:44:43.617513+0000","last_undegraded":"2024-08-31T06:44:43.617513+0000","last_fullsized":"2024-08-31T06:44:43.617513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657435+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:44:43.657435+0000","last_peered":"2024-08-31T06:44:43.657435+0000","last_clean":"2024-08-31T06:44:43.657435+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:44:43.657435+0000","last_undegraded":"2024-08-31T06:44:43.657435+0000","last_fullsized":"2024-08-31T06:44:43.657435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656383+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:44:43.656383+0000","last_peered":"2024-08-31T06:44:43.656383+0000","last_clean":"2024-08-31T06:44:43.656383+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:44:43.656383+0000","last_undegraded":"2024-08-31T06:44:43.656383+0000","last_fullsized":"2024-08-31T06:44:43.656383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657231+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:44:43.657231+0000","last_peered":"2024-08-31T06:44:43.657231+0000","last_clean":"2024-08-31T06:44:43.657231+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:44:43.657231+0000","last_undegraded":"2024-08-31T06:44:43.657231+0000","last_fullsized":"2024-08-31T06:44:43.657231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657253+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:44:43.657253+0000","last_peered":"2024-08-31T06:44:43.657253+0000","last_clean":"2024-08-31T06:44:43.657253+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:44:43.657253+0000","last_undegraded":"2024-08-31T06:44:43.657253+0000","last_fullsized":"2024-08-31T06:44:43.657253+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654859+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:44:43.654859+0000","last_peered":"2024-08-31T06:44:43.654859+0000","last_clean":"2024-08-31T06:44:43.654859+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:44:43.654859+0000","last_undegraded":"2024-08-31T06:44:43.654859+0000","last_fullsized":"2024-08-31T06:44:43.654859+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658509+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:44:43.658509+0000","last_peered":"2024-08-31T06:44:43.658509+0000","last_clean":"2024-08-31T06:44:43.658509+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:44:43.658509+0000","last_undegraded":"2024-08-31T06:44:43.658509+0000","last_fullsized":"2024-08-31T06:44:43.658509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655845+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:44:43.655845+0000","last_peered":"2024-08-31T06:44:43.655845+0000","last_clean":"2024-08-31T06:44:43.655845+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:44:43.655845+0000","last_undegraded":"2024-08-31T06:44:43.655845+0000","last_fullsized":"2024-08-31T06:44:43.655845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617642+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:44:43.617642+0000","last_peered":"2024-08-31T06:44:43.617642+0000","last_clean":"2024-08-31T06:44:43.617642+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:44:43.617642+0000","last_undegraded":"2024-08-31T06:44:43.617642+0000","last_fullsized":"2024-08-31T06:44:43.617642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657676+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:44:43.657676+0000","last_peered":"2024-08-31T06:44:43.657676+0000","last_clean":"2024-08-31T06:44:43.657676+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:44:43.657676+0000","last_undegraded":"2024-08-31T06:44:43.657676+0000","last_fullsized":"2024-08-31T06:44:43.657676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654764+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:44:43.654764+0000","last_peered":"2024-08-31T06:44:43.654764+0000","last_clean":"2024-08-31T06:44:43.654764+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:44:43.654764+0000","last_undegraded":"2024-08-31T06:44:43.654764+0000","last_fullsized":"2024-08-31T06:44:43.654764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616404+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:44:43.616404+0000","last_peered":"2024-08-31T06:44:43.616404+0000","last_clean":"2024-08-31T06:44:43.616404+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:44:43.616404+0000","last_undegraded":"2024-08-31T06:44:43.616404+0000","last_fullsized":"2024-08-31T06:44:43.616404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656562+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:44:43.656562+0000","last_peered":"2024-08-31T06:44:43.656562+0000","last_clean":"2024-08-31T06:44:43.656562+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:44:43.656562+0000","last_undegraded":"2024-08-31T06:44:43.656562+0000","last_fullsized":"2024-08-31T06:44:43.656562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658671+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:44:43.658671+0000","last_peered":"2024-08-31T06:44:43.658671+0000","last_clean":"2024-08-31T06:44:43.658671+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:44:43.658671+0000","last_undegraded":"2024-08-31T06:44:43.658671+0000","last_fullsized":"2024-08-31T06:44:43.658671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656713+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:44:43.656713+0000","last_peered":"2024-08-31T06:44:43.656713+0000","last_clean":"2024-08-31T06:44:43.656713+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:44:43.656713+0000","last_undegraded":"2024-08-31T06:44:43.656713+0000","last_fullsized":"2024-08-31T06:44:43.656713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617412+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:44:43.617412+0000","last_peered":"2024-08-31T06:44:43.617412+0000","last_clean":"2024-08-31T06:44:43.617412+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:44:43.617412+0000","last_undegraded":"2024-08-31T06:44:43.617412+0000","last_fullsized":"2024-08-31T06:44:43.617412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657969+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:44:43.657969+0000","last_peered":"2024-08-31T06:44:43.657969+0000","last_clean":"2024-08-31T06:44:43.657969+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:44:43.657969+0000","last_undegraded":"2024-08-31T06:44:43.657969+0000","last_fullsized":"2024-08-31T06:44:43.657969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657149+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:44:43.657149+0000","last_peered":"2024-08-31T06:44:43.657149+0000","last_clean":"2024-08-31T06:44:43.657149+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:44:43.657149+0000","last_undegraded":"2024-08-31T06:44:43.657149+0000","last_fullsized":"2024-08-31T06:44:43.657149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656600+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:44:43.656600+0000","last_peered":"2024-08-31T06:44:43.656600+0000","last_clean":"2024-08-31T06:44:43.656600+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:44:43.656600+0000","last_undegraded":"2024-08-31T06:44:43.656600+0000","last_fullsized":"2024-08-31T06:44:43.656600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656915+0000","last_change":"2024-08-31T06:44:42.638920+0000","last_active":"2024-08-31T06:44:43.656915+0000","last_peered":"2024-08-31T06:44:43.656915+0000","last_clean":"2024-08-31T06:44:43.656915+0000","last_became_active":"2024-08-31T06:44:42.638450+0000","last_became_peered":"2024-08-31T06:44:42.638450+0000","last_unstale":"2024-08-31T06:44:43.656915+0000","last_undegraded":"2024-08-31T06:44:43.656915+0000","last_fullsized":"2024-08-31T06:44:43.656915+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:59:23.890225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654773+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:44:43.654773+0000","last_peered":"2024-08-31T06:44:43.654773+0000","last_clean":"2024-08-31T06:44:43.654773+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:44:43.654773+0000","last_undegraded":"2024-08-31T06:44:43.654773+0000","last_fullsized":"2024-08-31T06:44:43.654773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:00.687523+0000","last_change":"2024-08-31T06:44:40.629286+0000","last_active":"2024-08-31T06:45:00.687523+0000","last_peered":"2024-08-31T06:45:00.687523+0000","last_clean":"2024-08-31T06:45:00.687523+0000","last_became_active":"2024-08-31T06:44:40.628869+0000","last_became_peered":"2024-08-31T06:44:40.628869+0000","last_unstale":"2024-08-31T06:45:00.687523+0000","last_undegraded":"2024-08-31T06:45:00.687523+0000","last_fullsized":"2024-08-31T06:45:00.687523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:22.926606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616596+0000","last_change":"2024-08-31T06:44:42.637955+0000","last_active":"2024-08-31T06:44:43.616596+0000","last_peered":"2024-08-31T06:44:43.616596+0000","last_clean":"2024-08-31T06:44:43.616596+0000","last_became_active":"2024-08-31T06:44:42.637557+0000","last_became_peered":"2024-08-31T06:44:42.637557+0000","last_unstale":"2024-08-31T06:44:43.616596+0000","last_undegraded":"2024-08-31T06:44:43.616596+0000","last_fullsized":"2024-08-31T06:44:43.616596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:57.999781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.655766+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:44:51.655766+0000","last_peered":"2024-08-31T06:44:51.655766+0000","last_clean":"2024-08-31T06:44:51.655766+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:44:51.655766+0000","last_undegraded":"2024-08-31T06:44:51.655766+0000","last_fullsized":"2024-08-31T06:44:51.655766+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.657227+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:44:51.657227+0000","last_peered":"2024-08-31T06:44:51.657227+0000","last_clean":"2024-08-31T06:44:51.657227+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:44:51.657227+0000","last_undegraded":"2024-08-31T06:44:51.657227+0000","last_fullsized":"2024-08-31T06:44:51.657227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656494+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:44:43.656494+0000","last_peered":"2024-08-31T06:44:43.656494+0000","last_clean":"2024-08-31T06:44:43.656494+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:44:43.656494+0000","last_undegraded":"2024-08-31T06:44:43.656494+0000","last_fullsized":"2024-08-31T06:44:43.656494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617356+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:44:43.617356+0000","last_peered":"2024-08-31T06:44:43.617356+0000","last_clean":"2024-08-31T06:44:43.617356+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:44:43.617356+0000","last_undegraded":"2024-08-31T06:44:43.617356+0000","last_fullsized":"2024-08-31T06:44:43.617356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.653863+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:44:43.653863+0000","last_peered":"2024-08-31T06:44:43.653863+0000","last_clean":"2024-08-31T06:44:43.653863+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:44:43.653863+0000","last_undegraded":"2024-08-31T06:44:43.653863+0000","last_fullsized":"2024-08-31T06:44:43.653863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:59.685350+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:44:59.685350+0000","last_peered":"2024-08-31T06:44:59.685350+0000","last_clean":"2024-08-31T06:44:59.685350+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:44:59.685350+0000","last_undegraded":"2024-08-31T06:44:59.685350+0000","last_fullsized":"2024-08-31T06:44:59.685350+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658122+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:44:43.658122+0000","last_peered":"2024-08-31T06:44:43.658122+0000","last_clean":"2024-08-31T06:44:43.658122+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:44:43.658122+0000","last_undegraded":"2024-08-31T06:44:43.658122+0000","last_fullsized":"2024-08-31T06:44:43.658122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654318+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:44:50.654318+0000","last_peered":"2024-08-31T06:44:50.654318+0000","last_clean":"2024-08-31T06:44:50.654318+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:44:50.654318+0000","last_undegraded":"2024-08-31T06:44:50.654318+0000","last_fullsized":"2024-08-31T06:44:50.654318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658484+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:44:43.658484+0000","last_peered":"2024-08-31T06:44:43.658484+0000","last_clean":"2024-08-31T06:44:43.658484+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:44:43.658484+0000","last_undegraded":"2024-08-31T06:44:43.658484+0000","last_fullsized":"2024-08-31T06:44:43.658484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654972+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:44:50.654972+0000","last_peered":"2024-08-31T06:44:50.654972+0000","last_clean":"2024-08-31T06:44:50.654972+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:44:50.654972+0000","last_undegraded":"2024-08-31T06:44:50.654972+0000","last_fullsized":"2024-08-31T06:44:50.654972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658462+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:44:43.658462+0000","last_peered":"2024-08-31T06:44:43.658462+0000","last_clean":"2024-08-31T06:44:43.658462+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:44:43.658462+0000","last_undegraded":"2024-08-31T06:44:43.658462+0000","last_fullsized":"2024-08-31T06:44:43.658462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'15","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:00.687230+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:45:00.687230+0000","last_peered":"2024-08-31T06:45:00.687230+0000","last_clean":"2024-08-31T06:45:00.687230+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:45:00.687230+0000","last_undegraded":"2024-08-31T06:45:00.687230+0000","last_fullsized":"2024-08-31T06:45:00.687230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":32,"num_write":16,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656250+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:44:43.656250+0000","last_peered":"2024-08-31T06:44:43.656250+0000","last_clean":"2024-08-31T06:44:43.656250+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:44:43.656250+0000","last_undegraded":"2024-08-31T06:44:43.656250+0000","last_fullsized":"2024-08-31T06:44:43.656250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.657372+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:44:51.657372+0000","last_peered":"2024-08-31T06:44:51.657372+0000","last_clean":"2024-08-31T06:44:51.657372+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:44:51.657372+0000","last_undegraded":"2024-08-31T06:44:51.657372+0000","last_fullsized":"2024-08-31T06:44:51.657372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617079+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:44:43.617079+0000","last_peered":"2024-08-31T06:44:43.617079+0000","last_clean":"2024-08-31T06:44:43.617079+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:44:43.617079+0000","last_undegraded":"2024-08-31T06:44:43.617079+0000","last_fullsized":"2024-08-31T06:44:43.617079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654330+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:44:50.654330+0000","last_peered":"2024-08-31T06:44:50.654330+0000","last_clean":"2024-08-31T06:44:50.654330+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:44:50.654330+0000","last_undegraded":"2024-08-31T06:44:50.654330+0000","last_fullsized":"2024-08-31T06:44:50.654330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657709+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:44:43.657709+0000","last_peered":"2024-08-31T06:44:43.657709+0000","last_clean":"2024-08-31T06:44:43.657709+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:44:43.657709+0000","last_undegraded":"2024-08-31T06:44:43.657709+0000","last_fullsized":"2024-08-31T06:44:43.657709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:00.687795+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:45:00.687795+0000","last_peered":"2024-08-31T06:45:00.687795+0000","last_clean":"2024-08-31T06:45:00.687795+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:45:00.687795+0000","last_undegraded":"2024-08-31T06:45:00.687795+0000","last_fullsized":"2024-08-31T06:45:00.687795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655865+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:44:43.655865+0000","last_peered":"2024-08-31T06:44:43.655865+0000","last_clean":"2024-08-31T06:44:43.655865+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:44:43.655865+0000","last_undegraded":"2024-08-31T06:44:43.655865+0000","last_fullsized":"2024-08-31T06:44:43.655865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.658152+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:44:51.658152+0000","last_peered":"2024-08-31T06:44:51.658152+0000","last_clean":"2024-08-31T06:44:51.658152+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:44:51.658152+0000","last_undegraded":"2024-08-31T06:44:51.658152+0000","last_fullsized":"2024-08-31T06:44:51.658152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616540+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:44:43.616540+0000","last_peered":"2024-08-31T06:44:43.616540+0000","last_clean":"2024-08-31T06:44:43.616540+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:44:43.616540+0000","last_undegraded":"2024-08-31T06:44:43.616540+0000","last_fullsized":"2024-08-31T06:44:43.616540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:52.668592+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:44:52.668592+0000","last_peered":"2024-08-31T06:44:52.668592+0000","last_clean":"2024-08-31T06:44:52.668592+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:44:52.668592+0000","last_undegraded":"2024-08-31T06:44:52.668592+0000","last_fullsized":"2024-08-31T06:44:52.668592+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656419+0000","last_change":"2024-08-31T06:44:42.637547+0000","last_active":"2024-08-31T06:44:43.656419+0000","last_peered":"2024-08-31T06:44:43.656419+0000","last_clean":"2024-08-31T06:44:43.656419+0000","last_became_active":"2024-08-31T06:44:42.636903+0000","last_became_peered":"2024-08-31T06:44:42.636903+0000","last_unstale":"2024-08-31T06:44:43.656419+0000","last_undegraded":"2024-08-31T06:44:43.656419+0000","last_fullsized":"2024-08-31T06:44:43.656419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:21.205244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655612+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:44:43.655612+0000","last_peered":"2024-08-31T06:44:43.655612+0000","last_clean":"2024-08-31T06:44:43.655612+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:44:43.655612+0000","last_undegraded":"2024-08-31T06:44:43.655612+0000","last_fullsized":"2024-08-31T06:44:43.655612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657957+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:44:43.657957+0000","last_peered":"2024-08-31T06:44:43.657957+0000","last_clean":"2024-08-31T06:44:43.657957+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:44:43.657957+0000","last_undegraded":"2024-08-31T06:44:43.657957+0000","last_fullsized":"2024-08-31T06:44:43.657957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.661788+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:44:43.661788+0000","last_peered":"2024-08-31T06:44:43.661788+0000","last_clean":"2024-08-31T06:44:43.661788+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:44:43.661788+0000","last_undegraded":"2024-08-31T06:44:43.661788+0000","last_fullsized":"2024-08-31T06:44:43.661788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:44.880334+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:44:44.880334+0000","last_peered":"2024-08-31T06:44:44.880334+0000","last_clean":"2024-08-31T06:44:44.880334+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:44:44.880334+0000","last_undegraded":"2024-08-31T06:44:44.880334+0000","last_fullsized":"2024-08-31T06:44:44.880334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.657882+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:44:51.657882+0000","last_peered":"2024-08-31T06:44:51.657882+0000","last_clean":"2024-08-31T06:44:51.657882+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:44:51.657882+0000","last_undegraded":"2024-08-31T06:44:51.657882+0000","last_fullsized":"2024-08-31T06:44:51.657882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658359+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:44:43.658359+0000","last_peered":"2024-08-31T06:44:43.658359+0000","last_clean":"2024-08-31T06:44:43.658359+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:44:43.658359+0000","last_undegraded":"2024-08-31T06:44:43.658359+0000","last_fullsized":"2024-08-31T06:44:43.658359+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":87,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656864+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:44:43.656864+0000","last_peered":"2024-08-31T06:44:43.656864+0000","last_clean":"2024-08-31T06:44:43.656864+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:44:43.656864+0000","last_undegraded":"2024-08-31T06:44:43.656864+0000","last_fullsized":"2024-08-31T06:44:43.656864+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:52.667750+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:44:52.667750+0000","last_peered":"2024-08-31T06:44:52.667750+0000","last_clean":"2024-08-31T06:44:52.667750+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:44:52.667750+0000","last_undegraded":"2024-08-31T06:44:52.667750+0000","last_fullsized":"2024-08-31T06:44:52.667750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656832+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:44:43.656832+0000","last_peered":"2024-08-31T06:44:43.656832+0000","last_clean":"2024-08-31T06:44:43.656832+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:44:43.656832+0000","last_undegraded":"2024-08-31T06:44:43.656832+0000","last_fullsized":"2024-08-31T06:44:43.656832+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.656858+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:44:51.656858+0000","last_peered":"2024-08-31T06:44:51.656858+0000","last_clean":"2024-08-31T06:44:51.656858+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:44:51.656858+0000","last_undegraded":"2024-08-31T06:44:51.656858+0000","last_fullsized":"2024-08-31T06:44:51.656858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616995+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:44:43.616995+0000","last_peered":"2024-08-31T06:44:43.616995+0000","last_clean":"2024-08-31T06:44:43.616995+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:44:43.616995+0000","last_undegraded":"2024-08-31T06:44:43.616995+0000","last_fullsized":"2024-08-31T06:44:43.616995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:03.691154+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:45:03.691154+0000","last_peered":"2024-08-31T06:45:03.691154+0000","last_clean":"2024-08-31T06:45:03.691154+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:45:03.691154+0000","last_undegraded":"2024-08-31T06:45:03.691154+0000","last_fullsized":"2024-08-31T06:45:03.691154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616953+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:44:43.616953+0000","last_peered":"2024-08-31T06:44:43.616953+0000","last_clean":"2024-08-31T06:44:43.616953+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:44:43.616953+0000","last_undegraded":"2024-08-31T06:44:43.616953+0000","last_fullsized":"2024-08-31T06:44:43.616953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657485+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:44:43.657485+0000","last_peered":"2024-08-31T06:44:43.657485+0000","last_clean":"2024-08-31T06:44:43.657485+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:44:43.657485+0000","last_undegraded":"2024-08-31T06:44:43.657485+0000","last_fullsized":"2024-08-31T06:44:43.657485+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654818+0000","last_change":"2024-08-31T06:44:42.639401+0000","last_active":"2024-08-31T06:44:43.654818+0000","last_peered":"2024-08-31T06:44:43.654818+0000","last_clean":"2024-08-31T06:44:43.654818+0000","last_became_active":"2024-08-31T06:44:42.638993+0000","last_became_peered":"2024-08-31T06:44:42.638993+0000","last_unstale":"2024-08-31T06:44:43.654818+0000","last_undegraded":"2024-08-31T06:44:43.654818+0000","last_fullsized":"2024-08-31T06:44:43.654818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:58.688001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.653972+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:44:43.653972+0000","last_peered":"2024-08-31T06:44:43.653972+0000","last_clean":"2024-08-31T06:44:43.653972+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:44:43.653972+0000","last_undegraded":"2024-08-31T06:44:43.653972+0000","last_fullsized":"2024-08-31T06:44:43.653972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:46.256972+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:44:46.256972+0000","last_peered":"2024-08-31T06:44:46.256972+0000","last_clean":"2024-08-31T06:44:46.256972+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:44:46.256972+0000","last_undegraded":"2024-08-31T06:44:46.256972+0000","last_fullsized":"2024-08-31T06:44:46.256972+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.651379+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:44:50.651379+0000","last_peered":"2024-08-31T06:44:50.651379+0000","last_clean":"2024-08-31T06:44:50.651379+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:44:50.651379+0000","last_undegraded":"2024-08-31T06:44:50.651379+0000","last_fullsized":"2024-08-31T06:44:50.651379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617454+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:44:43.617454+0000","last_peered":"2024-08-31T06:44:43.617454+0000","last_clean":"2024-08-31T06:44:43.617454+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:44:43.617454+0000","last_undegraded":"2024-08-31T06:44:43.617454+0000","last_fullsized":"2024-08-31T06:44:43.617454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'9","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:03.655418+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:45:03.655418+0000","last_peered":"2024-08-31T06:45:03.655418+0000","last_clean":"2024-08-31T06:45:03.655418+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:45:03.655418+0000","last_undegraded":"2024-08-31T06:45:03.655418+0000","last_fullsized":"2024-08-31T06:45:03.655418+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656446+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:44:43.656446+0000","last_peered":"2024-08-31T06:44:43.656446+0000","last_clean":"2024-08-31T06:44:43.656446+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:44:43.656446+0000","last_undegraded":"2024-08-31T06:44:43.656446+0000","last_fullsized":"2024-08-31T06:44:43.656446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.651308+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:44:50.651308+0000","last_peered":"2024-08-31T06:44:50.651308+0000","last_clean":"2024-08-31T06:44:50.651308+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:44:50.651308+0000","last_undegraded":"2024-08-31T06:44:50.651308+0000","last_fullsized":"2024-08-31T06:44:50.651308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658102+0000","last_change":"2024-08-31T06:44:42.638435+0000","last_active":"2024-08-31T06:44:43.658102+0000","last_peered":"2024-08-31T06:44:43.658102+0000","last_clean":"2024-08-31T06:44:43.658102+0000","last_became_active":"2024-08-31T06:44:42.638051+0000","last_became_peered":"2024-08-31T06:44:42.638051+0000","last_unstale":"2024-08-31T06:44:43.658102+0000","last_undegraded":"2024-08-31T06:44:43.658102+0000","last_fullsized":"2024-08-31T06:44:43.658102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:21:21.834948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.653815+0000","last_change":"2024-08-31T06:44:40.763230+0000","last_active":"2024-08-31T06:44:50.653815+0000","last_peered":"2024-08-31T06:44:50.653815+0000","last_clean":"2024-08-31T06:44:50.653815+0000","last_became_active":"2024-08-31T06:44:40.762820+0000","last_became_peered":"2024-08-31T06:44:40.762820+0000","last_unstale":"2024-08-31T06:44:50.653815+0000","last_undegraded":"2024-08-31T06:44:50.653815+0000","last_fullsized":"2024-08-31T06:44:50.653815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:24.166049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654661+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:44:43.654661+0000","last_peered":"2024-08-31T06:44:43.654661+0000","last_clean":"2024-08-31T06:44:43.654661+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:44:43.654661+0000","last_undegraded":"2024-08-31T06:44:43.654661+0000","last_fullsized":"2024-08-31T06:44:43.654661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654173+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:44:50.654173+0000","last_peered":"2024-08-31T06:44:50.654173+0000","last_clean":"2024-08-31T06:44:50.654173+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:44:50.654173+0000","last_undegraded":"2024-08-31T06:44:50.654173+0000","last_fullsized":"2024-08-31T06:44:50.654173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656988+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:44:43.656988+0000","last_peered":"2024-08-31T06:44:43.656988+0000","last_clean":"2024-08-31T06:44:43.656988+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:44:43.656988+0000","last_undegraded":"2024-08-31T06:44:43.656988+0000","last_fullsized":"2024-08-31T06:44:43.656988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657181+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:44:43.657181+0000","last_peered":"2024-08-31T06:44:43.657181+0000","last_clean":"2024-08-31T06:44:43.657181+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:44:43.657181+0000","last_undegraded":"2024-08-31T06:44:43.657181+0000","last_fullsized":"2024-08-31T06:44:43.657181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657388+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:44:43.657388+0000","last_peered":"2024-08-31T06:44:43.657388+0000","last_clean":"2024-08-31T06:44:43.657388+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:44:43.657388+0000","last_undegraded":"2024-08-31T06:44:43.657388+0000","last_fullsized":"2024-08-31T06:44:43.657388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654692+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:44:50.654692+0000","last_peered":"2024-08-31T06:44:50.654692+0000","last_clean":"2024-08-31T06:44:50.654692+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:44:50.654692+0000","last_undegraded":"2024-08-31T06:44:50.654692+0000","last_fullsized":"2024-08-31T06:44:50.654692+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657229+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:44:43.657229+0000","last_peered":"2024-08-31T06:44:43.657229+0000","last_clean":"2024-08-31T06:44:43.657229+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:44:43.657229+0000","last_undegraded":"2024-08-31T06:44:43.657229+0000","last_fullsized":"2024-08-31T06:44:43.657229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616721+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:44:43.616721+0000","last_peered":"2024-08-31T06:44:43.616721+0000","last_clean":"2024-08-31T06:44:43.616721+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:44:43.616721+0000","last_undegraded":"2024-08-31T06:44:43.616721+0000","last_fullsized":"2024-08-31T06:44:43.616721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.663881+0000","last_change":"2024-08-31T06:44:40.623866+0000","last_active":"2024-08-31T06:44:43.663881+0000","last_peered":"2024-08-31T06:44:43.663881+0000","last_clean":"2024-08-31T06:44:43.663881+0000","last_became_active":"2024-08-31T06:44:40.623448+0000","last_became_peered":"2024-08-31T06:44:40.623448+0000","last_unstale":"2024-08-31T06:44:43.663881+0000","last_undegraded":"2024-08-31T06:44:43.663881+0000","last_fullsized":"2024-08-31T06:44:43.663881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:04.270696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658183+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:44:43.658183+0000","last_peered":"2024-08-31T06:44:43.658183+0000","last_clean":"2024-08-31T06:44:43.658183+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:44:43.658183+0000","last_undegraded":"2024-08-31T06:44:43.658183+0000","last_fullsized":"2024-08-31T06:44:43.658183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.656547+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:44:51.656547+0000","last_peered":"2024-08-31T06:44:51.656547+0000","last_clean":"2024-08-31T06:44:51.656547+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:44:51.656547+0000","last_undegraded":"2024-08-31T06:44:51.656547+0000","last_fullsized":"2024-08-31T06:44:51.656547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658491+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:44:43.658491+0000","last_peered":"2024-08-31T06:44:43.658491+0000","last_clean":"2024-08-31T06:44:43.658491+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:44:43.658491+0000","last_undegraded":"2024-08-31T06:44:43.658491+0000","last_fullsized":"2024-08-31T06:44:43.658491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.662594+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:44:43.662594+0000","last_peered":"2024-08-31T06:44:43.662594+0000","last_clean":"2024-08-31T06:44:43.662594+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:44:43.662594+0000","last_undegraded":"2024-08-31T06:44:43.662594+0000","last_fullsized":"2024-08-31T06:44:43.662594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655927+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:44:43.655927+0000","last_peered":"2024-08-31T06:44:43.655927+0000","last_clean":"2024-08-31T06:44:43.655927+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:44:43.655927+0000","last_undegraded":"2024-08-31T06:44:43.655927+0000","last_fullsized":"2024-08-31T06:44:43.655927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.658447+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:44:51.658447+0000","last_peered":"2024-08-31T06:44:51.658447+0000","last_clean":"2024-08-31T06:44:51.658447+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:44:51.658447+0000","last_undegraded":"2024-08-31T06:44:51.658447+0000","last_fullsized":"2024-08-31T06:44:51.658447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":26722,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":84,"num_read_kb":74,"num_write":146,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":129106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776145,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":391675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1458176,"data_stored":1005877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":391911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":391831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":984152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":391300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":1421312,"data_stored":983445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986226,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149751,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":391494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378685,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":439634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":437893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":392571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":24299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:45:08.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:45:09.044 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:09.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:08 smithi106 ceph-mon[22134]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:09.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:08 smithi037 ceph-mon[18612]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:09.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:08 smithi066 ceph-mon[22244]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:09.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 -- 172.21.15.37:0/3910006410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30103920 msgr2=0x7f1e30103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 --2- 172.21.15.37:0/3910006410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30103920 0x7f1e30103d30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009900 tx=0x7f1e2c02a410 comp rx=0 tx=0).stop 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 -- 172.21.15.37:0/3910006410 shutdown_connections 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 --2- 172.21.15.37:0/3910006410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e30109bb0 0x7f1e301103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 --2- 172.21.15.37:0/3910006410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e30109260 0x7f1e30109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 --2- 172.21.15.37:0/3910006410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30103920 0x7f1e30103d30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 -- 172.21.15.37:0/3910006410 >> 172.21.15.37:0/3910006410 conn(0x7f1e300ff370 msgr2=0x7f1e301017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 -- 172.21.15.37:0/3910006410 shutdown_connections 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.513+0000 7f1e374a5640 1 -- 172.21.15.37:0/3910006410 wait complete. 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e374a5640 1 Processor -- start 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e374a5640 1 -- start start 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e374a5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e30103920 0x7f1e3019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:09.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e374a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30109260 0x7f1e3019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e374a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e30109bb0 0x7f1e3019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e374a5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30113720 con 0x7f1e30109260 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e374a5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1e301135a0 con 0x7f1e30109bb0 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e374a5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1e301138a0 con 0x7f1e30103920 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e34a40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30109260 0x7f1e3019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e34a40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30109260 0x7f1e3019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39214/0 (socket says 172.21.15.37:39214) 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.514+0000 7f1e34a40640 1 -- 172.21.15.37:0/4178743820 learned_addr learned my addr 172.21.15.37:0/4178743820 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e35241640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e30103920 0x7f1e3019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e35a42640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e30109bb0 0x7f1e3019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e34a40640 1 -- 172.21.15.37:0/4178743820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e30103920 msgr2=0x7f1e3019a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e34a40640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e30103920 0x7f1e3019a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e34a40640 1 -- 172.21.15.37:0/4178743820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e30109bb0 msgr2=0x7f1e3019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e34a40640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e30109bb0 0x7f1e3019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e34a40640 1 -- 172.21.15.37:0/4178743820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e301a0020 con 0x7f1e30109260 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e35a42640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e30109bb0 0x7f1e3019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e34a40640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30109260 0x7f1e3019a710 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400d740 tx=0x7f1e2400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e227fc640 1 -- 172.21.15.37:0/4178743820 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24017070 con 0x7f1e30109260 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e227fc640 1 -- 172.21.15.37:0/4178743820 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e2400de50 con 0x7f1e30109260 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e301a0310 con 0x7f1e30109260 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e227fc640 1 -- 172.21.15.37:0/4178743820 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400f620 con 0x7f1e30109260 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.515+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e301a6b30 con 0x7f1e30109260 2024-08-31T06:45:09.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.516+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e30103d30 con 0x7f1e30109260 2024-08-31T06:45:09.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.518+0000 7f1e227fc640 1 -- 172.21.15.37:0/4178743820 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f1e2401a070 con 0x7f1e30109260 2024-08-31T06:45:09.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.519+0000 7f1e227fc640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e1c0b4c40 0x7f1e1c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:09.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.519+0000 7f1e35241640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e1c0b4c40 0x7f1e1c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:09.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.519+0000 7f1e227fc640 1 -- 172.21.15.37:0/4178743820 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f1e240e4d20 con 0x7f1e30109260 2024-08-31T06:45:09.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.519+0000 7f1e35241640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e1c0b4c40 0x7f1e1c0b7150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0057c0 tx=0x7f1e2c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:09.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.522+0000 7f1e227fc640 1 -- 172.21.15.37:0/4178743820 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f1e240abcb0 con 0x7f1e30109260 2024-08-31T06:45:09.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.705+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e300635a0 con 0x7f1e1c0b4c40 2024-08-31T06:45:09.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.709+0000 7f1e227fc640 1 -- 172.21.15.37:0/4178743820 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258693 (secure 0 0 0) 0x7f1e300635a0 con 0x7f1e1c0b4c40 2024-08-31T06:45:09.713 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:09.714 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:45:09.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.712+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e1c0b4c40 msgr2=0x7f1e1c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.712+0000 7f1e374a5640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e1c0b4c40 0x7f1e1c0b7150 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0057c0 tx=0x7f1e2c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.712+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30109260 msgr2=0x7f1e3019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.712+0000 7f1e374a5640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30109260 0x7f1e3019a710 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400d740 tx=0x7f1e2400dc00 comp rx=0 tx=0).stop 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.712+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 shutdown_connections 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.712+0000 7f1e374a5640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e1c0b4c40 0x7f1e1c0b7150 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.712+0000 7f1e374a5640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e30109260 0x7f1e3019a710 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.712+0000 7f1e374a5640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e30109bb0 0x7f1e3019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.713+0000 7f1e374a5640 1 --2- 172.21.15.37:0/4178743820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e30103920 0x7f1e3019a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.713+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 >> 172.21.15.37:0/4178743820 conn(0x7f1e300ff370 msgr2=0x7f1e30101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.713+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 shutdown_connections 2024-08-31T06:45:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:09.713+0000 7f1e374a5640 1 -- 172.21.15.37:0/4178743820 wait complete. 2024-08-31T06:45:10.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:09 smithi106 ceph-mon[22134]: pgmap v267: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-08-31T06:45:10.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:09 smithi037 ceph-mon[18612]: pgmap v267: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-08-31T06:45:10.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:09 smithi066 ceph-mon[22244]: pgmap v267: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.7 KiB/s wr, 11 op/s 2024-08-31T06:45:10.411 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-08-31T06:45:08.239983+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641794,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":192,"num_read_kb":178,"num_write":278,"num_write_kb":2245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360696,"kb_used_data":11448,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581128,"statfs":{"total":1151940427776,"available":1151571075072,"internally_reserved":0,"allocated":11722752,"data_stored":6618498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46204,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":100,"num_read_kb":98,"num_write":33,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003554"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656994+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:44:43.656994+0000","last_peered":"2024-08-31T06:44:43.656994+0000","last_clean":"2024-08-31T06:44:43.656994+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:44:43.656994+0000","last_undegraded":"2024-08-31T06:44:43.656994+0000","last_fullsized":"2024-08-31T06:44:43.656994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656950+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:44:43.656950+0000","last_peered":"2024-08-31T06:44:43.656950+0000","last_clean":"2024-08-31T06:44:43.656950+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:44:43.656950+0000","last_undegraded":"2024-08-31T06:44:43.656950+0000","last_fullsized":"2024-08-31T06:44:43.656950+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657031+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:44:43.657031+0000","last_peered":"2024-08-31T06:44:43.657031+0000","last_clean":"2024-08-31T06:44:43.657031+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:44:43.657031+0000","last_undegraded":"2024-08-31T06:44:43.657031+0000","last_fullsized":"2024-08-31T06:44:43.657031+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617665+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:44:43.617665+0000","last_peered":"2024-08-31T06:44:43.617665+0000","last_clean":"2024-08-31T06:44:43.617665+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:44:43.617665+0000","last_undegraded":"2024-08-31T06:44:43.617665+0000","last_fullsized":"2024-08-31T06:44:43.617665+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655170+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:44:43.655170+0000","last_peered":"2024-08-31T06:44:43.655170+0000","last_clean":"2024-08-31T06:44:43.655170+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:44:43.655170+0000","last_undegraded":"2024-08-31T06:44:43.655170+0000","last_fullsized":"2024-08-31T06:44:43.655170+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654310+0000","last_change":"2024-08-31T06:44:42.630022+0000","last_active":"2024-08-31T06:44:43.654310+0000","last_peered":"2024-08-31T06:44:43.654310+0000","last_clean":"2024-08-31T06:44:43.654310+0000","last_became_active":"2024-08-31T06:44:42.629576+0000","last_became_peered":"2024-08-31T06:44:42.629576+0000","last_unstale":"2024-08-31T06:44:43.654310+0000","last_undegraded":"2024-08-31T06:44:43.654310+0000","last_fullsized":"2024-08-31T06:44:43.654310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:59:52.525480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657069+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:44:43.657069+0000","last_peered":"2024-08-31T06:44:43.657069+0000","last_clean":"2024-08-31T06:44:43.657069+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:44:43.657069+0000","last_undegraded":"2024-08-31T06:44:43.657069+0000","last_fullsized":"2024-08-31T06:44:43.657069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654684+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:44:43.654684+0000","last_peered":"2024-08-31T06:44:43.654684+0000","last_clean":"2024-08-31T06:44:43.654684+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:44:43.654684+0000","last_undegraded":"2024-08-31T06:44:43.654684+0000","last_fullsized":"2024-08-31T06:44:43.654684+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.659078+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:44:43.659078+0000","last_peered":"2024-08-31T06:44:43.659078+0000","last_clean":"2024-08-31T06:44:43.659078+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:44:43.659078+0000","last_undegraded":"2024-08-31T06:44:43.659078+0000","last_fullsized":"2024-08-31T06:44:43.659078+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655231+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:44:43.655231+0000","last_peered":"2024-08-31T06:44:43.655231+0000","last_clean":"2024-08-31T06:44:43.655231+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:44:43.655231+0000","last_undegraded":"2024-08-31T06:44:43.655231+0000","last_fullsized":"2024-08-31T06:44:43.655231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658086+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:44:43.658086+0000","last_peered":"2024-08-31T06:44:43.658086+0000","last_clean":"2024-08-31T06:44:43.658086+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:44:43.658086+0000","last_undegraded":"2024-08-31T06:44:43.658086+0000","last_fullsized":"2024-08-31T06:44:43.658086+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617657+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:44:43.617657+0000","last_peered":"2024-08-31T06:44:43.617657+0000","last_clean":"2024-08-31T06:44:43.617657+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:44:43.617657+0000","last_undegraded":"2024-08-31T06:44:43.617657+0000","last_fullsized":"2024-08-31T06:44:43.617657+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617513+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:44:43.617513+0000","last_peered":"2024-08-31T06:44:43.617513+0000","last_clean":"2024-08-31T06:44:43.617513+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:44:43.617513+0000","last_undegraded":"2024-08-31T06:44:43.617513+0000","last_fullsized":"2024-08-31T06:44:43.617513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657435+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:44:43.657435+0000","last_peered":"2024-08-31T06:44:43.657435+0000","last_clean":"2024-08-31T06:44:43.657435+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:44:43.657435+0000","last_undegraded":"2024-08-31T06:44:43.657435+0000","last_fullsized":"2024-08-31T06:44:43.657435+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656383+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:44:43.656383+0000","last_peered":"2024-08-31T06:44:43.656383+0000","last_clean":"2024-08-31T06:44:43.656383+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:44:43.656383+0000","last_undegraded":"2024-08-31T06:44:43.656383+0000","last_fullsized":"2024-08-31T06:44:43.656383+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657231+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:44:43.657231+0000","last_peered":"2024-08-31T06:44:43.657231+0000","last_clean":"2024-08-31T06:44:43.657231+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:44:43.657231+0000","last_undegraded":"2024-08-31T06:44:43.657231+0000","last_fullsized":"2024-08-31T06:44:43.657231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657253+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:44:43.657253+0000","last_peered":"2024-08-31T06:44:43.657253+0000","last_clean":"2024-08-31T06:44:43.657253+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:44:43.657253+0000","last_undegraded":"2024-08-31T06:44:43.657253+0000","last_fullsized":"2024-08-31T06:44:43.657253+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654859+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:44:43.654859+0000","last_peered":"2024-08-31T06:44:43.654859+0000","last_clean":"2024-08-31T06:44:43.654859+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:44:43.654859+0000","last_undegraded":"2024-08-31T06:44:43.654859+0000","last_fullsized":"2024-08-31T06:44:43.654859+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658509+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:44:43.658509+0000","last_peered":"2024-08-31T06:44:43.658509+0000","last_clean":"2024-08-31T06:44:43.658509+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:44:43.658509+0000","last_undegraded":"2024-08-31T06:44:43.658509+0000","last_fullsized":"2024-08-31T06:44:43.658509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655845+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:44:43.655845+0000","last_peered":"2024-08-31T06:44:43.655845+0000","last_clean":"2024-08-31T06:44:43.655845+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:44:43.655845+0000","last_undegraded":"2024-08-31T06:44:43.655845+0000","last_fullsized":"2024-08-31T06:44:43.655845+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617642+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:44:43.617642+0000","last_peered":"2024-08-31T06:44:43.617642+0000","last_clean":"2024-08-31T06:44:43.617642+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:44:43.617642+0000","last_undegraded":"2024-08-31T06:44:43.617642+0000","last_fullsized":"2024-08-31T06:44:43.617642+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657676+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:44:43.657676+0000","last_peered":"2024-08-31T06:44:43.657676+0000","last_clean":"2024-08-31T06:44:43.657676+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:44:43.657676+0000","last_undegraded":"2024-08-31T06:44:43.657676+0000","last_fullsized":"2024-08-31T06:44:43.657676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654764+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:44:43.654764+0000","last_peered":"2024-08-31T06:44:43.654764+0000","last_clean":"2024-08-31T06:44:43.654764+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:44:43.654764+0000","last_undegraded":"2024-08-31T06:44:43.654764+0000","last_fullsized":"2024-08-31T06:44:43.654764+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616404+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:44:43.616404+0000","last_peered":"2024-08-31T06:44:43.616404+0000","last_clean":"2024-08-31T06:44:43.616404+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:44:43.616404+0000","last_undegraded":"2024-08-31T06:44:43.616404+0000","last_fullsized":"2024-08-31T06:44:43.616404+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656562+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:44:43.656562+0000","last_peered":"2024-08-31T06:44:43.656562+0000","last_clean":"2024-08-31T06:44:43.656562+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:44:43.656562+0000","last_undegraded":"2024-08-31T06:44:43.656562+0000","last_fullsized":"2024-08-31T06:44:43.656562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658671+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:44:43.658671+0000","last_peered":"2024-08-31T06:44:43.658671+0000","last_clean":"2024-08-31T06:44:43.658671+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:44:43.658671+0000","last_undegraded":"2024-08-31T06:44:43.658671+0000","last_fullsized":"2024-08-31T06:44:43.658671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656713+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:44:43.656713+0000","last_peered":"2024-08-31T06:44:43.656713+0000","last_clean":"2024-08-31T06:44:43.656713+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:44:43.656713+0000","last_undegraded":"2024-08-31T06:44:43.656713+0000","last_fullsized":"2024-08-31T06:44:43.656713+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617412+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:44:43.617412+0000","last_peered":"2024-08-31T06:44:43.617412+0000","last_clean":"2024-08-31T06:44:43.617412+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:44:43.617412+0000","last_undegraded":"2024-08-31T06:44:43.617412+0000","last_fullsized":"2024-08-31T06:44:43.617412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657969+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:44:43.657969+0000","last_peered":"2024-08-31T06:44:43.657969+0000","last_clean":"2024-08-31T06:44:43.657969+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:44:43.657969+0000","last_undegraded":"2024-08-31T06:44:43.657969+0000","last_fullsized":"2024-08-31T06:44:43.657969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657149+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:44:43.657149+0000","last_peered":"2024-08-31T06:44:43.657149+0000","last_clean":"2024-08-31T06:44:43.657149+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:44:43.657149+0000","last_undegraded":"2024-08-31T06:44:43.657149+0000","last_fullsized":"2024-08-31T06:44:43.657149+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656600+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:44:43.656600+0000","last_peered":"2024-08-31T06:44:43.656600+0000","last_clean":"2024-08-31T06:44:43.656600+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:44:43.656600+0000","last_undegraded":"2024-08-31T06:44:43.656600+0000","last_fullsized":"2024-08-31T06:44:43.656600+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656915+0000","last_change":"2024-08-31T06:44:42.638920+0000","last_active":"2024-08-31T06:44:43.656915+0000","last_peered":"2024-08-31T06:44:43.656915+0000","last_clean":"2024-08-31T06:44:43.656915+0000","last_became_active":"2024-08-31T06:44:42.638450+0000","last_became_peered":"2024-08-31T06:44:42.638450+0000","last_unstale":"2024-08-31T06:44:43.656915+0000","last_undegraded":"2024-08-31T06:44:43.656915+0000","last_fullsized":"2024-08-31T06:44:43.656915+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T06:59:23.890225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654773+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:44:43.654773+0000","last_peered":"2024-08-31T06:44:43.654773+0000","last_clean":"2024-08-31T06:44:43.654773+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:44:43.654773+0000","last_undegraded":"2024-08-31T06:44:43.654773+0000","last_fullsized":"2024-08-31T06:44:43.654773+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:05.694395+0000","last_change":"2024-08-31T06:44:40.629286+0000","last_active":"2024-08-31T06:45:05.694395+0000","last_peered":"2024-08-31T06:45:05.694395+0000","last_clean":"2024-08-31T06:45:05.694395+0000","last_became_active":"2024-08-31T06:44:40.628869+0000","last_became_peered":"2024-08-31T06:44:40.628869+0000","last_unstale":"2024-08-31T06:45:05.694395+0000","last_undegraded":"2024-08-31T06:45:05.694395+0000","last_fullsized":"2024-08-31T06:45:05.694395+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:05:22.926606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616596+0000","last_change":"2024-08-31T06:44:42.637955+0000","last_active":"2024-08-31T06:44:43.616596+0000","last_peered":"2024-08-31T06:44:43.616596+0000","last_clean":"2024-08-31T06:44:43.616596+0000","last_became_active":"2024-08-31T06:44:42.637557+0000","last_became_peered":"2024-08-31T06:44:42.637557+0000","last_unstale":"2024-08-31T06:44:43.616596+0000","last_undegraded":"2024-08-31T06:44:43.616596+0000","last_fullsized":"2024-08-31T06:44:43.616596+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:46:57.999781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.655766+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:44:51.655766+0000","last_peered":"2024-08-31T06:44:51.655766+0000","last_clean":"2024-08-31T06:44:51.655766+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:44:51.655766+0000","last_undegraded":"2024-08-31T06:44:51.655766+0000","last_fullsized":"2024-08-31T06:44:51.655766+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.657227+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:44:51.657227+0000","last_peered":"2024-08-31T06:44:51.657227+0000","last_clean":"2024-08-31T06:44:51.657227+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:44:51.657227+0000","last_undegraded":"2024-08-31T06:44:51.657227+0000","last_fullsized":"2024-08-31T06:44:51.657227+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656494+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:44:43.656494+0000","last_peered":"2024-08-31T06:44:43.656494+0000","last_clean":"2024-08-31T06:44:43.656494+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:44:43.656494+0000","last_undegraded":"2024-08-31T06:44:43.656494+0000","last_fullsized":"2024-08-31T06:44:43.656494+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617356+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:44:43.617356+0000","last_peered":"2024-08-31T06:44:43.617356+0000","last_clean":"2024-08-31T06:44:43.617356+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:44:43.617356+0000","last_undegraded":"2024-08-31T06:44:43.617356+0000","last_fullsized":"2024-08-31T06:44:43.617356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.653863+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:44:43.653863+0000","last_peered":"2024-08-31T06:44:43.653863+0000","last_clean":"2024-08-31T06:44:43.653863+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:44:43.653863+0000","last_undegraded":"2024-08-31T06:44:43.653863+0000","last_fullsized":"2024-08-31T06:44:43.653863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:04.692056+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:45:04.692056+0000","last_peered":"2024-08-31T06:45:04.692056+0000","last_clean":"2024-08-31T06:45:04.692056+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:45:04.692056+0000","last_undegraded":"2024-08-31T06:45:04.692056+0000","last_fullsized":"2024-08-31T06:45:04.692056+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658122+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:44:43.658122+0000","last_peered":"2024-08-31T06:44:43.658122+0000","last_clean":"2024-08-31T06:44:43.658122+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:44:43.658122+0000","last_undegraded":"2024-08-31T06:44:43.658122+0000","last_fullsized":"2024-08-31T06:44:43.658122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654318+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:44:50.654318+0000","last_peered":"2024-08-31T06:44:50.654318+0000","last_clean":"2024-08-31T06:44:50.654318+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:44:50.654318+0000","last_undegraded":"2024-08-31T06:44:50.654318+0000","last_fullsized":"2024-08-31T06:44:50.654318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658484+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:44:43.658484+0000","last_peered":"2024-08-31T06:44:43.658484+0000","last_clean":"2024-08-31T06:44:43.658484+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:44:43.658484+0000","last_undegraded":"2024-08-31T06:44:43.658484+0000","last_fullsized":"2024-08-31T06:44:43.658484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654972+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:44:50.654972+0000","last_peered":"2024-08-31T06:44:50.654972+0000","last_clean":"2024-08-31T06:44:50.654972+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:44:50.654972+0000","last_undegraded":"2024-08-31T06:44:50.654972+0000","last_fullsized":"2024-08-31T06:44:50.654972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658462+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:44:43.658462+0000","last_peered":"2024-08-31T06:44:43.658462+0000","last_clean":"2024-08-31T06:44:43.658462+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:44:43.658462+0000","last_undegraded":"2024-08-31T06:44:43.658462+0000","last_fullsized":"2024-08-31T06:44:43.658462+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'22","reported_seq":75,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:05.695287+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:45:05.695287+0000","last_peered":"2024-08-31T06:45:05.695287+0000","last_clean":"2024-08-31T06:45:05.695287+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:45:05.695287+0000","last_undegraded":"2024-08-31T06:45:05.695287+0000","last_fullsized":"2024-08-31T06:45:05.695287+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46800,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656250+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:44:43.656250+0000","last_peered":"2024-08-31T06:44:43.656250+0000","last_clean":"2024-08-31T06:44:43.656250+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:44:43.656250+0000","last_undegraded":"2024-08-31T06:44:43.656250+0000","last_fullsized":"2024-08-31T06:44:43.656250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.657372+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:44:51.657372+0000","last_peered":"2024-08-31T06:44:51.657372+0000","last_clean":"2024-08-31T06:44:51.657372+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:44:51.657372+0000","last_undegraded":"2024-08-31T06:44:51.657372+0000","last_fullsized":"2024-08-31T06:44:51.657372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617079+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:44:43.617079+0000","last_peered":"2024-08-31T06:44:43.617079+0000","last_clean":"2024-08-31T06:44:43.617079+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:44:43.617079+0000","last_undegraded":"2024-08-31T06:44:43.617079+0000","last_fullsized":"2024-08-31T06:44:43.617079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654330+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:44:50.654330+0000","last_peered":"2024-08-31T06:44:50.654330+0000","last_clean":"2024-08-31T06:44:50.654330+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:44:50.654330+0000","last_undegraded":"2024-08-31T06:44:50.654330+0000","last_fullsized":"2024-08-31T06:44:50.654330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657709+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:44:43.657709+0000","last_peered":"2024-08-31T06:44:43.657709+0000","last_clean":"2024-08-31T06:44:43.657709+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:44:43.657709+0000","last_undegraded":"2024-08-31T06:44:43.657709+0000","last_fullsized":"2024-08-31T06:44:43.657709+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:05.694216+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:45:05.694216+0000","last_peered":"2024-08-31T06:45:05.694216+0000","last_clean":"2024-08-31T06:45:05.694216+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:45:05.694216+0000","last_undegraded":"2024-08-31T06:45:05.694216+0000","last_fullsized":"2024-08-31T06:45:05.694216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655865+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:44:43.655865+0000","last_peered":"2024-08-31T06:44:43.655865+0000","last_clean":"2024-08-31T06:44:43.655865+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:44:43.655865+0000","last_undegraded":"2024-08-31T06:44:43.655865+0000","last_fullsized":"2024-08-31T06:44:43.655865+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.658152+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:44:51.658152+0000","last_peered":"2024-08-31T06:44:51.658152+0000","last_clean":"2024-08-31T06:44:51.658152+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:44:51.658152+0000","last_undegraded":"2024-08-31T06:44:51.658152+0000","last_fullsized":"2024-08-31T06:44:51.658152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616540+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:44:43.616540+0000","last_peered":"2024-08-31T06:44:43.616540+0000","last_clean":"2024-08-31T06:44:43.616540+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:44:43.616540+0000","last_undegraded":"2024-08-31T06:44:43.616540+0000","last_fullsized":"2024-08-31T06:44:43.616540+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:52.668592+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:44:52.668592+0000","last_peered":"2024-08-31T06:44:52.668592+0000","last_clean":"2024-08-31T06:44:52.668592+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:44:52.668592+0000","last_undegraded":"2024-08-31T06:44:52.668592+0000","last_fullsized":"2024-08-31T06:44:52.668592+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656419+0000","last_change":"2024-08-31T06:44:42.637547+0000","last_active":"2024-08-31T06:44:43.656419+0000","last_peered":"2024-08-31T06:44:43.656419+0000","last_clean":"2024-08-31T06:44:43.656419+0000","last_became_active":"2024-08-31T06:44:42.636903+0000","last_became_peered":"2024-08-31T06:44:42.636903+0000","last_unstale":"2024-08-31T06:44:43.656419+0000","last_undegraded":"2024-08-31T06:44:43.656419+0000","last_fullsized":"2024-08-31T06:44:43.656419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:24:21.205244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655612+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:44:43.655612+0000","last_peered":"2024-08-31T06:44:43.655612+0000","last_clean":"2024-08-31T06:44:43.655612+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:44:43.655612+0000","last_undegraded":"2024-08-31T06:44:43.655612+0000","last_fullsized":"2024-08-31T06:44:43.655612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657957+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:44:43.657957+0000","last_peered":"2024-08-31T06:44:43.657957+0000","last_clean":"2024-08-31T06:44:43.657957+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:44:43.657957+0000","last_undegraded":"2024-08-31T06:44:43.657957+0000","last_fullsized":"2024-08-31T06:44:43.657957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.661788+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:44:43.661788+0000","last_peered":"2024-08-31T06:44:43.661788+0000","last_clean":"2024-08-31T06:44:43.661788+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:44:43.661788+0000","last_undegraded":"2024-08-31T06:44:43.661788+0000","last_fullsized":"2024-08-31T06:44:43.661788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:44.880334+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:44:44.880334+0000","last_peered":"2024-08-31T06:44:44.880334+0000","last_clean":"2024-08-31T06:44:44.880334+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:44:44.880334+0000","last_undegraded":"2024-08-31T06:44:44.880334+0000","last_fullsized":"2024-08-31T06:44:44.880334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.657882+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:44:51.657882+0000","last_peered":"2024-08-31T06:44:51.657882+0000","last_clean":"2024-08-31T06:44:51.657882+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:44:51.657882+0000","last_undegraded":"2024-08-31T06:44:51.657882+0000","last_fullsized":"2024-08-31T06:44:51.657882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658359+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:44:43.658359+0000","last_peered":"2024-08-31T06:44:43.658359+0000","last_clean":"2024-08-31T06:44:43.658359+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:44:43.658359+0000","last_undegraded":"2024-08-31T06:44:43.658359+0000","last_fullsized":"2024-08-31T06:44:43.658359+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":87,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656864+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:44:43.656864+0000","last_peered":"2024-08-31T06:44:43.656864+0000","last_clean":"2024-08-31T06:44:43.656864+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:44:43.656864+0000","last_undegraded":"2024-08-31T06:44:43.656864+0000","last_fullsized":"2024-08-31T06:44:43.656864+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:52.667750+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:44:52.667750+0000","last_peered":"2024-08-31T06:44:52.667750+0000","last_clean":"2024-08-31T06:44:52.667750+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:44:52.667750+0000","last_undegraded":"2024-08-31T06:44:52.667750+0000","last_fullsized":"2024-08-31T06:44:52.667750+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656832+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:44:43.656832+0000","last_peered":"2024-08-31T06:44:43.656832+0000","last_clean":"2024-08-31T06:44:43.656832+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:44:43.656832+0000","last_undegraded":"2024-08-31T06:44:43.656832+0000","last_fullsized":"2024-08-31T06:44:43.656832+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.656858+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:44:51.656858+0000","last_peered":"2024-08-31T06:44:51.656858+0000","last_clean":"2024-08-31T06:44:51.656858+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:44:51.656858+0000","last_undegraded":"2024-08-31T06:44:51.656858+0000","last_fullsized":"2024-08-31T06:44:51.656858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616995+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:44:43.616995+0000","last_peered":"2024-08-31T06:44:43.616995+0000","last_clean":"2024-08-31T06:44:43.616995+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:44:43.616995+0000","last_undegraded":"2024-08-31T06:44:43.616995+0000","last_fullsized":"2024-08-31T06:44:43.616995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:03.691154+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:45:03.691154+0000","last_peered":"2024-08-31T06:45:03.691154+0000","last_clean":"2024-08-31T06:45:03.691154+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:45:03.691154+0000","last_undegraded":"2024-08-31T06:45:03.691154+0000","last_fullsized":"2024-08-31T06:45:03.691154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616953+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:44:43.616953+0000","last_peered":"2024-08-31T06:44:43.616953+0000","last_clean":"2024-08-31T06:44:43.616953+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:44:43.616953+0000","last_undegraded":"2024-08-31T06:44:43.616953+0000","last_fullsized":"2024-08-31T06:44:43.616953+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657485+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:44:43.657485+0000","last_peered":"2024-08-31T06:44:43.657485+0000","last_clean":"2024-08-31T06:44:43.657485+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:44:43.657485+0000","last_undegraded":"2024-08-31T06:44:43.657485+0000","last_fullsized":"2024-08-31T06:44:43.657485+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654818+0000","last_change":"2024-08-31T06:44:42.639401+0000","last_active":"2024-08-31T06:44:43.654818+0000","last_peered":"2024-08-31T06:44:43.654818+0000","last_clean":"2024-08-31T06:44:43.654818+0000","last_became_active":"2024-08-31T06:44:42.638993+0000","last_became_peered":"2024-08-31T06:44:42.638993+0000","last_unstale":"2024-08-31T06:44:43.654818+0000","last_undegraded":"2024-08-31T06:44:43.654818+0000","last_fullsized":"2024-08-31T06:44:43.654818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:58.688001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.653972+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:44:43.653972+0000","last_peered":"2024-08-31T06:44:43.653972+0000","last_clean":"2024-08-31T06:44:43.653972+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:44:43.653972+0000","last_undegraded":"2024-08-31T06:44:43.653972+0000","last_fullsized":"2024-08-31T06:44:43.653972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:46.256972+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:44:46.256972+0000","last_peered":"2024-08-31T06:44:46.256972+0000","last_clean":"2024-08-31T06:44:46.256972+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:44:46.256972+0000","last_undegraded":"2024-08-31T06:44:46.256972+0000","last_fullsized":"2024-08-31T06:44:46.256972+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.651379+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:44:50.651379+0000","last_peered":"2024-08-31T06:44:50.651379+0000","last_clean":"2024-08-31T06:44:50.651379+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:44:50.651379+0000","last_undegraded":"2024-08-31T06:44:50.651379+0000","last_fullsized":"2024-08-31T06:44:50.651379+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.617454+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:44:43.617454+0000","last_peered":"2024-08-31T06:44:43.617454+0000","last_clean":"2024-08-31T06:44:43.617454+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:44:43.617454+0000","last_undegraded":"2024-08-31T06:44:43.617454+0000","last_fullsized":"2024-08-31T06:44:43.617454+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'9","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:45:03.655418+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:45:03.655418+0000","last_peered":"2024-08-31T06:45:03.655418+0000","last_clean":"2024-08-31T06:45:03.655418+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:45:03.655418+0000","last_undegraded":"2024-08-31T06:45:03.655418+0000","last_fullsized":"2024-08-31T06:45:03.655418+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656446+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:44:43.656446+0000","last_peered":"2024-08-31T06:44:43.656446+0000","last_clean":"2024-08-31T06:44:43.656446+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:44:43.656446+0000","last_undegraded":"2024-08-31T06:44:43.656446+0000","last_fullsized":"2024-08-31T06:44:43.656446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.651308+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:44:50.651308+0000","last_peered":"2024-08-31T06:44:50.651308+0000","last_clean":"2024-08-31T06:44:50.651308+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:44:50.651308+0000","last_undegraded":"2024-08-31T06:44:50.651308+0000","last_fullsized":"2024-08-31T06:44:50.651308+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658102+0000","last_change":"2024-08-31T06:44:42.638435+0000","last_active":"2024-08-31T06:44:43.658102+0000","last_peered":"2024-08-31T06:44:43.658102+0000","last_clean":"2024-08-31T06:44:43.658102+0000","last_became_active":"2024-08-31T06:44:42.638051+0000","last_became_peered":"2024-08-31T06:44:42.638051+0000","last_unstale":"2024-08-31T06:44:43.658102+0000","last_undegraded":"2024-08-31T06:44:43.658102+0000","last_fullsized":"2024-08-31T06:44:43.658102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:21:21.834948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.653815+0000","last_change":"2024-08-31T06:44:40.763230+0000","last_active":"2024-08-31T06:44:50.653815+0000","last_peered":"2024-08-31T06:44:50.653815+0000","last_clean":"2024-08-31T06:44:50.653815+0000","last_became_active":"2024-08-31T06:44:40.762820+0000","last_became_peered":"2024-08-31T06:44:40.762820+0000","last_unstale":"2024-08-31T06:44:50.653815+0000","last_undegraded":"2024-08-31T06:44:50.653815+0000","last_fullsized":"2024-08-31T06:44:50.653815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:37:24.166049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.654661+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:44:43.654661+0000","last_peered":"2024-08-31T06:44:43.654661+0000","last_clean":"2024-08-31T06:44:43.654661+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:44:43.654661+0000","last_undegraded":"2024-08-31T06:44:43.654661+0000","last_fullsized":"2024-08-31T06:44:43.654661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654173+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:44:50.654173+0000","last_peered":"2024-08-31T06:44:50.654173+0000","last_clean":"2024-08-31T06:44:50.654173+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:44:50.654173+0000","last_undegraded":"2024-08-31T06:44:50.654173+0000","last_fullsized":"2024-08-31T06:44:50.654173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.656988+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:44:43.656988+0000","last_peered":"2024-08-31T06:44:43.656988+0000","last_clean":"2024-08-31T06:44:43.656988+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:44:43.656988+0000","last_undegraded":"2024-08-31T06:44:43.656988+0000","last_fullsized":"2024-08-31T06:44:43.656988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657181+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:44:43.657181+0000","last_peered":"2024-08-31T06:44:43.657181+0000","last_clean":"2024-08-31T06:44:43.657181+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:44:43.657181+0000","last_undegraded":"2024-08-31T06:44:43.657181+0000","last_fullsized":"2024-08-31T06:44:43.657181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657388+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:44:43.657388+0000","last_peered":"2024-08-31T06:44:43.657388+0000","last_clean":"2024-08-31T06:44:43.657388+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:44:43.657388+0000","last_undegraded":"2024-08-31T06:44:43.657388+0000","last_fullsized":"2024-08-31T06:44:43.657388+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:50.654692+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:44:50.654692+0000","last_peered":"2024-08-31T06:44:50.654692+0000","last_clean":"2024-08-31T06:44:50.654692+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:44:50.654692+0000","last_undegraded":"2024-08-31T06:44:50.654692+0000","last_fullsized":"2024-08-31T06:44:50.654692+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.657229+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:44:43.657229+0000","last_peered":"2024-08-31T06:44:43.657229+0000","last_clean":"2024-08-31T06:44:43.657229+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:44:43.657229+0000","last_undegraded":"2024-08-31T06:44:43.657229+0000","last_fullsized":"2024-08-31T06:44:43.657229+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.616721+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:44:43.616721+0000","last_peered":"2024-08-31T06:44:43.616721+0000","last_clean":"2024-08-31T06:44:43.616721+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:44:43.616721+0000","last_undegraded":"2024-08-31T06:44:43.616721+0000","last_fullsized":"2024-08-31T06:44:43.616721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.663881+0000","last_change":"2024-08-31T06:44:40.623866+0000","last_active":"2024-08-31T06:44:43.663881+0000","last_peered":"2024-08-31T06:44:43.663881+0000","last_clean":"2024-08-31T06:44:43.663881+0000","last_became_active":"2024-08-31T06:44:40.623448+0000","last_became_peered":"2024-08-31T06:44:40.623448+0000","last_unstale":"2024-08-31T06:44:43.663881+0000","last_undegraded":"2024-08-31T06:44:43.663881+0000","last_fullsized":"2024-08-31T06:44:43.663881+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:04.270696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658183+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:44:43.658183+0000","last_peered":"2024-08-31T06:44:43.658183+0000","last_clean":"2024-08-31T06:44:43.658183+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:44:43.658183+0000","last_undegraded":"2024-08-31T06:44:43.658183+0000","last_fullsized":"2024-08-31T06:44:43.658183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.656547+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:44:51.656547+0000","last_peered":"2024-08-31T06:44:51.656547+0000","last_clean":"2024-08-31T06:44:51.656547+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:44:51.656547+0000","last_undegraded":"2024-08-31T06:44:51.656547+0000","last_fullsized":"2024-08-31T06:44:51.656547+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.658491+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:44:43.658491+0000","last_peered":"2024-08-31T06:44:43.658491+0000","last_clean":"2024-08-31T06:44:43.658491+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:44:43.658491+0000","last_undegraded":"2024-08-31T06:44:43.658491+0000","last_fullsized":"2024-08-31T06:44:43.658491+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.662594+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:44:43.662594+0000","last_peered":"2024-08-31T06:44:43.662594+0000","last_clean":"2024-08-31T06:44:43.662594+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:44:43.662594+0000","last_undegraded":"2024-08-31T06:44:43.662594+0000","last_fullsized":"2024-08-31T06:44:43.662594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:43.655927+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:44:43.655927+0000","last_peered":"2024-08-31T06:44:43.655927+0000","last_clean":"2024-08-31T06:44:43.655927+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:44:43.655927+0000","last_undegraded":"2024-08-31T06:44:43.655927+0000","last_fullsized":"2024-08-31T06:44:43.655927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-08-31T06:44:51.658447+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:44:51.658447+0000","last_peered":"2024-08-31T06:44:51.658447+0000","last_clean":"2024-08-31T06:44:51.658447+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:44:51.658447+0000","last_undegraded":"2024-08-31T06:44:51.658447+0000","last_fullsized":"2024-08-31T06:44:51.658447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":51192,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":111,"num_read_kb":109,"num_write":153,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":161728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776145,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":391675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939670,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28472,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716680,"statfs":{"total":95995035648,"available":95965880320,"internally_reserved":0,"allocated":1482752,"data_stored":1030347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27820,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717332,"statfs":{"total":95995035648,"available":95966547968,"internally_reserved":0,"allocated":815104,"data_stored":391911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":391831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462948,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28400,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716752,"statfs":{"total":95995035648,"available":95965954048,"internally_reserved":0,"allocated":1409024,"data_stored":984152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":391300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32572,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712580,"statfs":{"total":95995035648,"available":95961681920,"internally_reserved":0,"allocated":1421312,"data_stored":983445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":392128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149752,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":391611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378685,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":876544,"data_stored":439634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542212,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":851968,"data_stored":437893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":823296,"data_stored":392571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":48769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:45:10.415 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T06:45:10.415 INFO:tasks.cephadm:Setting up client nodes... 2024-08-31T06:45:10.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-31T06:45:10.670 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:11.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:10 smithi106 ceph-mon[22134]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:11.076 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:10 smithi037 ceph-mon[18612]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:11.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:10 smithi066 ceph-mon[22244]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.174+0000 7f032759e640 1 -- 172.21.15.37:0/116454072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 msgr2=0x7f0328103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.174+0000 7f032759e640 1 --2- 172.21.15.37:0/116454072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 0x7f0328103b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0318009900 tx=0x7f031802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.174+0000 7f032759e640 1 -- 172.21.15.37:0/116454072 shutdown_connections 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.174+0000 7f032759e640 1 --2- 172.21.15.37:0/116454072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03281099d0 0x7f0328110200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.174+0000 7f032759e640 1 --2- 172.21.15.37:0/116454072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0328109080 0x7f0328109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.174+0000 7f032759e640 1 --2- 172.21.15.37:0/116454072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 0x7f0328103b50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.174+0000 7f032759e640 1 -- 172.21.15.37:0/116454072 >> 172.21.15.37:0/116454072 conn(0x7f03280ff190 msgr2=0x7f03281015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.175+0000 7f032759e640 1 -- 172.21.15.37:0/116454072 shutdown_connections 2024-08-31T06:45:11.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.175+0000 7f032759e640 1 -- 172.21.15.37:0/116454072 wait complete. 2024-08-31T06:45:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.175+0000 7f032759e640 1 Processor -- start 2024-08-31T06:45:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032759e640 1 -- start start 2024-08-31T06:45:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 0x7f03280754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:11.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032759e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0328109080 0x7f03280759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032759e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03281099d0 0x7f0328075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0328113530 con 0x7f0328103740 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032759e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03281133b0 con 0x7f0328109080 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032759e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f03281136b0 con 0x7f03281099d0 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 0x7f03280754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 0x7f03280754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39226/0 (socket says 172.21.15.37:39226) 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032659c640 1 -- 172.21.15.37:0/2326310966 learned_addr learned my addr 172.21.15.37:0/2326310966 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f0325d9b640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0328109080 0x7f03280759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f0326d9d640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03281099d0 0x7f0328075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032659c640 1 -- 172.21.15.37:0/2326310966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03281099d0 msgr2=0x7f0328075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032659c640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03281099d0 0x7f0328075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032659c640 1 -- 172.21.15.37:0/2326310966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0328109080 msgr2=0x7f03280759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032659c640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0328109080 0x7f03280759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f032659c640 1 -- 172.21.15.37:0/2326310966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03281a81b0 con 0x7f0328103740 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f0325d9b640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0328109080 0x7f03280759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.176+0000 7f0326d9d640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03281099d0 0x7f0328075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.177+0000 7f032659c640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 0x7f03280754b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0318009230 tx=0x7f0318004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.177+0000 7f03177fe640 1 -- 172.21.15.37:0/2326310966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f031803f030 con 0x7f0328103740 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.177+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03281a8440 con 0x7f0328103740 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.177+0000 7f03177fe640 1 -- 172.21.15.37:0/2326310966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0318003a80 con 0x7f0328103740 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.177+0000 7f03177fe640 1 -- 172.21.15.37:0/2326310966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318035070 con 0x7f0328103740 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.177+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03281a8920 con 0x7f0328103740 2024-08-31T06:45:11.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.178+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0328103b50 con 0x7f0328103740 2024-08-31T06:45:11.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.180+0000 7f03177fe640 1 -- 172.21.15.37:0/2326310966 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f0318042030 con 0x7f0328103740 2024-08-31T06:45:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.181+0000 7f03177fe640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03100b4c00 0x7f03100b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:11.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.181+0000 7f0325d9b640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03100b4c00 0x7f03100b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.181+0000 7f03177fe640 1 -- 172.21.15.37:0/2326310966 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f0318105ff0 con 0x7f0328103740 2024-08-31T06:45:11.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.182+0000 7f0325d9b640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03100b4c00 0x7f03100b7110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0328108bc0 tx=0x7f031c00a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:11.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.184+0000 7f03177fe640 1 -- 172.21.15.37:0/2326310966 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f03180ccfa0 con 0x7f0328103740 2024-08-31T06:45:11.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.443+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f03280767b0 con 0x7f0328103740 2024-08-31T06:45:11.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.446+0000 7f03177fe640 1 -- 172.21.15.37:0/2326310966 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f03180cc8a0 con 0x7f0328103740 2024-08-31T06:45:11.448 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-08-31T06:45:11.448 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD3u9JmAb2RGhAAQz6PIlzPg4LGWLt0WTdm4Q== 2024-08-31T06:45:11.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03100b4c00 msgr2=0x7f03100b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:11.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03100b4c00 0x7f03100b7110 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0328108bc0 tx=0x7f031c00a5c0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 msgr2=0x7f03280754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:11.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 0x7f03280754b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0318009230 tx=0x7f0318004270 comp rx=0 tx=0).stop 2024-08-31T06:45:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 shutdown_connections 2024-08-31T06:45:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03100b4c00 0x7f03100b7110 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03281099d0 0x7f0328075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0328109080 0x7f03280759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 --2- 172.21.15.37:0/2326310966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0328103740 0x7f03280754b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 >> 172.21.15.37:0/2326310966 conn(0x7f03280ff190 msgr2=0x7f03281015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 shutdown_connections 2024-08-31T06:45:11.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:11.449+0000 7f032759e640 1 -- 172.21.15.37:0/2326310966 wait complete. 2024-08-31T06:45:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:11 smithi106 ceph-mon[22134]: pgmap v268: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-08-31T06:45:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:11 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2326310966' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T06:45:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:11 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2326310966' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T06:45:12.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:11 smithi037 ceph-mon[18612]: pgmap v268: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-08-31T06:45:12.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:11 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2326310966' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T06:45:12.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:11 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2326310966' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T06:45:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:11 smithi066 ceph-mon[22244]: pgmap v268: 97 pgs: 97 active+clean; 627 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.6 KiB/s wr, 7 op/s 2024-08-31T06:45:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:11 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2326310966' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-31T06:45:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:11 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2326310966' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-31T06:45:12.283 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:45:12.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-31T06:45:12.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-31T06:45:12.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph config log 1 --format=json 2024-08-31T06:45:12.614 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 -- 172.21.15.37:0/2920768956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201081c0 msgr2=0x7f6b201085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 --2- 172.21.15.37:0/2920768956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201081c0 0x7f6b201085d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009900 tx=0x7f6b0802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 -- 172.21.15.37:0/2920768956 shutdown_connections 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 --2- 172.21.15.37:0/2920768956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b201081c0 0x7f6b201085d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 --2- 172.21.15.37:0/2920768956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b20108b10 0x7f6b2010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 --2- 172.21.15.37:0/2920768956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b20102880 0x7f6b20102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 -- 172.21.15.37:0/2920768956 >> 172.21.15.37:0/2920768956 conn(0x7f6b20079510 msgr2=0x7f6b20079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 -- 172.21.15.37:0/2920768956 shutdown_connections 2024-08-31T06:45:13.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 -- 172.21.15.37:0/2920768956 wait complete. 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 Processor -- start 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.094+0000 7f6b25328640 1 -- start start 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b25328640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20102880 0x7f6b2010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b25328640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b201081c0 0x7f6b20110360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b25328640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b20108b10 0x7f6b201108a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b25328640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b201137a0 con 0x7f6b20102880 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b25328640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b20113620 con 0x7f6b20108b10 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b25328640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b20113920 con 0x7f6b201081c0 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20102880 0x7f6b2010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20102880 0x7f6b2010fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39246/0 (socket says 172.21.15.37:39246) 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 -- 172.21.15.37:0/3204294891 learned_addr learned my addr 172.21.15.37:0/3204294891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b17fff640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b201081c0 0x7f6b20110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:13.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 -- 172.21.15.37:0/3204294891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b201081c0 msgr2=0x7f6b20110360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b201081c0 0x7f6b20110360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 -- 172.21.15.37:0/3204294891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b20108b10 msgr2=0x7f6b201108a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b20108b10 0x7f6b201108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 -- 172.21.15.37:0/3204294891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b201a84d0 con 0x7f6b20102880 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b17fff640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b201081c0 0x7f6b20110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1effd640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20102880 0x7f6b2010fe20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c890 tx=0x7f6b1000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1cff9640 1 -- 172.21.15.37:0/3204294891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10004220 con 0x7f6b20102880 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.095+0000 7f6b1cff9640 1 -- 172.21.15.37:0/3204294891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b10007e40 con 0x7f6b20102880 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.096+0000 7f6b1cff9640 1 -- 172.21.15.37:0/3204294891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10004a00 con 0x7f6b20102880 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.096+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b201a87c0 con 0x7f6b20102880 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.096+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b201a8d50 con 0x7f6b20102880 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.097+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b20103b00 con 0x7f6b20102880 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.098+0000 7f6b1cff9640 1 -- 172.21.15.37:0/3204294891 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f6b100079b0 con 0x7f6b20102880 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.099+0000 7f6b1cff9640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b0c0b4c90 0x7f6b0c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:13.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.099+0000 7f6b17fff640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b0c0b4c90 0x7f6b0c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:13.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.099+0000 7f6b1cff9640 1 -- 172.21.15.37:0/3204294891 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f6b100e4fd0 con 0x7f6b20102880 2024-08-31T06:45:13.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.099+0000 7f6b17fff640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b0c0b4c90 0x7f6b0c0b71a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b08006010 tx=0x7f6b08000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:13.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.103+0000 7f6b1cff9640 1 -- 172.21.15.37:0/3204294891 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6b10014030 con 0x7f6b20102880 2024-08-31T06:45:13.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.290+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6b20102c90 con 0x7f6b20102880 2024-08-31T06:45:13.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.291+0000 7f6b1cff9640 1 -- 172.21.15.37:0/3204294891 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v52) ==== 86+0+133 (secure 0 0 0) 0x7f6b100ac060 con 0x7f6b20102880 2024-08-31T06:45:13.296 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:13.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.293+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b0c0b4c90 msgr2=0x7f6b0c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:13.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b0c0b4c90 0x7f6b0c0b71a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6b08006010 tx=0x7f6b08000bc0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20102880 msgr2=0x7f6b2010fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:13.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20102880 0x7f6b2010fe20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c890 tx=0x7f6b1000cd50 comp rx=0 tx=0).stop 2024-08-31T06:45:13.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 shutdown_connections 2024-08-31T06:45:13.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b0c0b4c90 0x7f6b0c0b71a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b20108b10 0x7f6b201108a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b201081c0 0x7f6b20110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 --2- 172.21.15.37:0/3204294891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b20102880 0x7f6b2010fe20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:13.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 >> 172.21.15.37:0/3204294891 conn(0x7f6b20079510 msgr2=0x7f6b201042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:13.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 shutdown_connections 2024-08-31T06:45:13.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:13.294+0000 7f6b25328640 1 -- 172.21.15.37:0/3204294891 wait complete. 2024-08-31T06:45:13.929 INFO:teuthology.orchestra.run.smithi037.stdout:[{"version":52,"timestamp":"2024-08-31T06:44:32.702252+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-31T06:45:13.929 INFO:tasks.ceph_manager:config epoch is 52 2024-08-31T06:45:13.930 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-31T06:45:13.930 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-31T06:45:13.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph mgr dump --format=json 2024-08-31T06:45:14.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:13 smithi106 ceph-mon[22134]: pgmap v269: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-08-31T06:45:14.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:13 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3204294891' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T06:45:14.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:13 smithi037 ceph-mon[18612]: pgmap v269: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-08-31T06:45:14.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:13 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3204294891' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T06:45:14.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:13 smithi066 ceph-mon[22244]: pgmap v269: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.4 KiB/s wr, 10 op/s 2024-08-31T06:45:14.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:13 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3204294891' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-31T06:45:14.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/3339084554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 msgr2=0x7f8a78109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/3339084554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 0x7f8a78109680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009900 tx=0x7f8a6c02a410 comp rx=0 tx=0).stop 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/3339084554 shutdown_connections 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/3339084554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 0x7f8a78109680 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/3339084554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a78109bc0 0x7f8a781103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/3339084554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a78103930 0x7f8a78103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/3339084554 >> 172.21.15.37:0/3339084554 conn(0x7f8a780ff380 msgr2=0x7f8a781017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/3339084554 shutdown_connections 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.672+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/3339084554 wait complete. 2024-08-31T06:45:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.673+0000 7f8a7e8ee640 1 Processor -- start 2024-08-31T06:45:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.673+0000 7f8a7e8ee640 1 -- start start 2024-08-31T06:45:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.673+0000 7f8a7e8ee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a78103930 0x7f8a7819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.673+0000 7f8a7e8ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 0x7f8a7819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.673+0000 7f8a7e8ee640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a78109bc0 0x7f8a7819f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.673+0000 7f8a7e8ee640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78113730 con 0x7f8a78109270 2024-08-31T06:45:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.673+0000 7f8a7e8ee640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781135b0 con 0x7f8a78103930 2024-08-31T06:45:14.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.673+0000 7f8a7e8ee640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8a781138b0 con 0x7f8a78109bc0 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 0x7f8a7819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 0x7f8a7819a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60430/0 (socket says 172.21.15.37:60430) 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 -- 172.21.15.37:0/4139379950 learned_addr learned my addr 172.21.15.37:0/4139379950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a7ce8b640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a78109bc0 0x7f8a7819f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a77fff640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a78103930 0x7f8a7819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 -- 172.21.15.37:0/4139379950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a78109bc0 msgr2=0x7f8a7819f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a78109bc0 0x7f8a7819f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 -- 172.21.15.37:0/4139379950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a78103930 msgr2=0x7f8a7819a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a78103930 0x7f8a7819a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 -- 172.21.15.37:0/4139379950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a781a00f0 con 0x7f8a78109270 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a777fe640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 0x7f8a7819a720 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005940 tx=0x7f8a6c005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a757fa640 1 -- 172.21.15.37:0/4139379950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c03f030 con 0x7f8a78109270 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a781a0380 con 0x7f8a78109270 2024-08-31T06:45:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a757fa640 1 -- 172.21.15.37:0/4139379950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a6c0043d0 con 0x7f8a78109270 2024-08-31T06:45:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.674+0000 7f8a757fa640 1 -- 172.21.15.37:0/4139379950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c035070 con 0x7f8a78109270 2024-08-31T06:45:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.675+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a781a6b40 con 0x7f8a78109270 2024-08-31T06:45:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.675+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a78103d40 con 0x7f8a78109270 2024-08-31T06:45:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.677+0000 7f8a757fa640 1 -- 172.21.15.37:0/4139379950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f8a6c042030 con 0x7f8a78109270 2024-08-31T06:45:14.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.678+0000 7f8a757fa640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8a600b4c10 0x7f8a600b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:14.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.678+0000 7f8a77fff640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8a600b4c10 0x7f8a600b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:14.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.678+0000 7f8a757fa640 1 -- 172.21.15.37:0/4139379950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f8a6c105a10 con 0x7f8a78109270 2024-08-31T06:45:14.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.679+0000 7f8a77fff640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8a600b4c10 0x7f8a600b7120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009bd0 tx=0x7f8a68005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:14.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.681+0000 7f8a757fa640 1 -- 172.21.15.37:0/4139379950 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8a6c0cc3b0 con 0x7f8a78109270 2024-08-31T06:45:14.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.915+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8a7819b2b0 con 0x7f8a78109270 2024-08-31T06:45:14.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.920+0000 7f8a757fa640 1 -- 172.21.15.37:0/4139379950 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+293208 (secure 0 0 0) 0x7f8a6c0d0b70 con 0x7f8a78109270 2024-08-31T06:45:14.929 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:14.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8a600b4c10 msgr2=0x7f8a600b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:14.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8a600b4c10 0x7f8a600b7120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009bd0 tx=0x7f8a68005f90 comp rx=0 tx=0).stop 2024-08-31T06:45:14.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 msgr2=0x7f8a7819a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:14.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 0x7f8a7819a720 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c005940 tx=0x7f8a6c005e10 comp rx=0 tx=0).stop 2024-08-31T06:45:14.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 shutdown_connections 2024-08-31T06:45:14.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8a600b4c10 0x7f8a600b7120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a78109270 0x7f8a7819a720 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a78109bc0 0x7f8a7819f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 --2- 172.21.15.37:0/4139379950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a78103930 0x7f8a7819a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 >> 172.21.15.37:0/4139379950 conn(0x7f8a780ff380 msgr2=0x7f8a781017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 shutdown_connections 2024-08-31T06:45:14.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:14.924+0000 7f8a7e8ee640 1 -- 172.21.15.37:0/4139379950 wait complete. 2024-08-31T06:45:15.637 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":1776458941},{"type":"v1","addr":"172.21.15.37:6801","nonce":1776458941}]},"active_addr":"172.21.15.37:6801/1776458941","active_change":"2024-08-31T06:38:18.150303+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24145,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24158,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.37:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3202629126}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1779625477}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2626518105}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1522306917}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2486287381}]}]} 2024-08-31T06:45:15.644 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-31T06:45:15.644 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-31T06:45:15.644 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:45:15.895 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:16.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:15 smithi037 ceph-mon[18612]: pgmap v270: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-08-31T06:45:16.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:15 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4139379950' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T06:45:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:15 smithi106 ceph-mon[22134]: pgmap v270: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-08-31T06:45:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:15 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4139379950' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T06:45:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:15 smithi066 ceph-mon[22244]: pgmap v270: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-08-31T06:45:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:15 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4139379950' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 -- 172.21.15.37:0/320623254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c108af0 msgr2=0x7f7c4c10f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 --2- 172.21.15.37:0/320623254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c108af0 0x7f7c4c10f320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009ca0 tx=0x7f7c4402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 -- 172.21.15.37:0/320623254 shutdown_connections 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 --2- 172.21.15.37:0/320623254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c108af0 0x7f7c4c10f320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 --2- 172.21.15.37:0/320623254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c4c1081a0 0x7f7c4c1085b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 --2- 172.21.15.37:0/320623254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c4c102f70 0x7f7c4c103380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 -- 172.21.15.37:0/320623254 >> 172.21.15.37:0/320623254 conn(0x7f7c4c079d30 msgr2=0x7f7c4c07a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 -- 172.21.15.37:0/320623254 shutdown_connections 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 -- 172.21.15.37:0/320623254 wait complete. 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 Processor -- start 2024-08-31T06:45:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.394+0000 7f7c521d1640 1 -- start start 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c521d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c102f70 0x7f7c4c10fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c521d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c4c1081a0 0x7f7c4c110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c521d1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c4c108af0 0x7f7c4c110880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c521d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c1137b0 con 0x7f7c4c102f70 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c521d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c113630 con 0x7f7c4c1081a0 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c521d1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c113930 con 0x7f7c4c108af0 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c102f70 0x7f7c4c10fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c102f70 0x7f7c4c10fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60452/0 (socket says 172.21.15.37:60452) 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 -- 172.21.15.37:0/685091925 learned_addr learned my addr 172.21.15.37:0/685091925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c43fff640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c4c1081a0 0x7f7c4c110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4bfff640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c4c108af0 0x7f7c4c110880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 -- 172.21.15.37:0/685091925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c4c108af0 msgr2=0x7f7c4c110880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c4c108af0 0x7f7c4c110880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 -- 172.21.15.37:0/685091925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c4c1081a0 msgr2=0x7f7c4c110340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c4c1081a0 0x7f7c4c110340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 -- 172.21.15.37:0/685091925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c1a8500 con 0x7f7c4c102f70 2024-08-31T06:45:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.395+0000 7f7c4b7fe640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c102f70 0x7f7c4c10fe00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00c890 tx=0x7f7c3c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.396+0000 7f7c497fa640 1 -- 172.21.15.37:0/685091925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004220 con 0x7f7c4c102f70 2024-08-31T06:45:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.396+0000 7f7c497fa640 1 -- 172.21.15.37:0/685091925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c3c007e40 con 0x7f7c4c102f70 2024-08-31T06:45:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.396+0000 7f7c497fa640 1 -- 172.21.15.37:0/685091925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c004a00 con 0x7f7c4c102f70 2024-08-31T06:45:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.396+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c1a87f0 con 0x7f7c4c102f70 2024-08-31T06:45:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.396+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c1a8ce0 con 0x7f7c4c102f70 2024-08-31T06:45:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.397+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4c103380 con 0x7f7c4c102f70 2024-08-31T06:45:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.398+0000 7f7c497fa640 1 -- 172.21.15.37:0/685091925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7c3c0079b0 con 0x7f7c4c102f70 2024-08-31T06:45:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.399+0000 7f7c497fa640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c380b4c90 0x7f7c380b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.399+0000 7f7c43fff640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c380b4c90 0x7f7c380b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.399+0000 7f7c497fa640 1 -- 172.21.15.37:0/685091925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f7c3c0e5400 con 0x7f7c4c102f70 2024-08-31T06:45:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.399+0000 7f7c43fff640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c380b4c90 0x7f7c380b71a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c06b040 tx=0x7f7c3400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.402+0000 7f7c497fa640 1 -- 172.21.15.37:0/685091925 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c3c014030 con 0x7f7c4c102f70 2024-08-31T06:45:16.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.586+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c4c111100 con 0x7f7c4c102f70 2024-08-31T06:45:16.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.588+0000 7f7c497fa640 1 -- 172.21.15.37:0/685091925 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22570 (secure 0 0 0) 0x7f7c3c0ac410 con 0x7f7c4c102f70 2024-08-31T06:45:16.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:16.590 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:44:43.326060+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:45:16.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c380b4c90 msgr2=0x7f7c380b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:16.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c380b4c90 0x7f7c380b71a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c06b040 tx=0x7f7c3400a2d0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c102f70 msgr2=0x7f7c4c10fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c102f70 0x7f7c4c10fe00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c00c890 tx=0x7f7c3c00cd50 comp rx=0 tx=0).stop 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 shutdown_connections 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c380b4c90 0x7f7c380b71a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c4c108af0 0x7f7c4c110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c4c1081a0 0x7f7c4c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 --2- 172.21.15.37:0/685091925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c102f70 0x7f7c4c10fe00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 >> 172.21.15.37:0/685091925 conn(0x7f7c4c079d30 msgr2=0x7f7c4c106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 shutdown_connections 2024-08-31T06:45:16.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:16.590+0000 7f7c521d1640 1 -- 172.21.15.37:0/685091925 wait complete. 2024-08-31T06:45:16.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:16 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/685091925' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:17.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:16 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/685091925' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:17.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:16 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/685091925' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:17.267 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-31T06:45:17.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:45:17.521 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:17.929 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:17 smithi037 ceph-mon[18612]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-08-31T06:45:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 -- 172.21.15.37:0/2921998997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109290 msgr2=0x7f88d41096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/2921998997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109290 0x7f88d41096a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009900 tx=0x7f88c802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 -- 172.21.15.37:0/2921998997 shutdown_connections 2024-08-31T06:45:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/2921998997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109290 0x7f88d41096a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/2921998997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88d4109be0 0x7f88d4110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/2921998997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88d4103950 0x7f88d4103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 -- 172.21.15.37:0/2921998997 >> 172.21.15.37:0/2921998997 conn(0x7f88d40ff3a0 msgr2=0x7f88d41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 -- 172.21.15.37:0/2921998997 shutdown_connections 2024-08-31T06:45:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.018+0000 7f88d8b7d640 1 -- 172.21.15.37:0/2921998997 wait complete. 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.019+0000 7f88d8b7d640 1 Processor -- start 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.019+0000 7f88d8b7d640 1 -- start start 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d8b7d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88d4103950 0x7f88d40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d8b7d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88d4109290 0x7f88d40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d8b7d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109be0 0x7f88d4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d8b7d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88d4113750 con 0x7f88d4109be0 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d8b7d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88d41135d0 con 0x7f88d4103950 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d8b7d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f88d41138d0 con 0x7f88d4109290 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109be0 0x7f88d4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109be0 0x7f88d4075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60468/0 (socket says 172.21.15.37:60468) 2024-08-31T06:45:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 -- 172.21.15.37:0/1779283704 learned_addr learned my addr 172.21.15.37:0/1779283704 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d1d9b640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88d4109290 0x7f88d40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d259c640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88d4103950 0x7f88d40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 -- 172.21.15.37:0/1779283704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88d4109290 msgr2=0x7f88d40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88d4109290 0x7f88d40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 -- 172.21.15.37:0/1779283704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88d4103950 msgr2=0x7f88d40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88d4103950 0x7f88d40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 -- 172.21.15.37:0/1779283704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d41a8390 con 0x7f88d4109be0 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d1d9b640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88d4109290 0x7f88d40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.020+0000 7f88d2d9d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109be0 0x7f88d4075f30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00cce0 tx=0x7f88cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.021+0000 7f88c37fe640 1 -- 172.21.15.37:0/1779283704 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00f450 con 0x7f88d4109be0 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.021+0000 7f88c37fe640 1 -- 172.21.15.37:0/1779283704 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88cc00fa80 con 0x7f88d4109be0 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.021+0000 7f88c37fe640 1 -- 172.21.15.37:0/1779283704 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc018ad0 con 0x7f88d4109be0 2024-08-31T06:45:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.021+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d41a8680 con 0x7f88d4109be0 2024-08-31T06:45:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.021+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d41a8b90 con 0x7f88d4109be0 2024-08-31T06:45:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.022+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d4103d60 con 0x7f88d4109be0 2024-08-31T06:45:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.023+0000 7f88c37fe640 1 -- 172.21.15.37:0/1779283704 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f88cc00f5f0 con 0x7f88d4109be0 2024-08-31T06:45:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.024+0000 7f88c37fe640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88bc0b4c90 0x7f88bc0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:18.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.024+0000 7f88d259c640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88bc0b4c90 0x7f88bc0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:18.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.024+0000 7f88c37fe640 1 -- 172.21.15.37:0/1779283704 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f88cc0e5bd0 con 0x7f88d4109be0 2024-08-31T06:45:18.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.025+0000 7f88d259c640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88bc0b4c90 0x7f88bc0b71a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f88c4005d00 tx=0x7f88c4005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.029+0000 7f88c37fe640 1 -- 172.21.15.37:0/1779283704 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f88cc014030 con 0x7f88d4109be0 2024-08-31T06:45:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:17 smithi106 ceph-mon[22134]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-08-31T06:45:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:17 smithi066 ceph-mon[22244]: pgmap v271: 97 pgs: 97 active+clean; 635 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.3 KiB/s wr, 7 op/s 2024-08-31T06:45:18.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.216+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88d40767b0 con 0x7f88d4109be0 2024-08-31T06:45:18.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.218+0000 7f88c37fe640 1 -- 172.21.15.37:0/1779283704 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22570 (secure 0 0 0) 0x7f88cc0acc70 con 0x7f88d4109be0 2024-08-31T06:45:18.221 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:18.221 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":74,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:44:43.326060+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:45:18.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88bc0b4c90 msgr2=0x7f88bc0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:18.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88bc0b4c90 0x7f88bc0b71a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f88c4005d00 tx=0x7f88c4005c70 comp rx=0 tx=0).stop 2024-08-31T06:45:18.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109be0 msgr2=0x7f88d4075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:18.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109be0 0x7f88d4075f30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00cce0 tx=0x7f88cc00a620 comp rx=0 tx=0).stop 2024-08-31T06:45:18.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 shutdown_connections 2024-08-31T06:45:18.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88bc0b4c90 0x7f88bc0b71a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88d4109be0 0x7f88d4075f30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88d4109290 0x7f88d40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 --2- 172.21.15.37:0/1779283704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88d4103950 0x7f88d40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:18.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 >> 172.21.15.37:0/1779283704 conn(0x7f88d40ff3a0 msgr2=0x7f88d41017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:18.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 shutdown_connections 2024-08-31T06:45:18.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:18.221+0000 7f88d8b7d640 1 -- 172.21.15.37:0/1779283704 wait complete. 2024-08-31T06:45:18.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-31T06:45:18.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T06:45:18.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-08-31T06:45:18.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-08-31T06:45:18.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-08-31T06:45:18.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-08-31T06:45:18.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-08-31T06:45:18.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T06:45:18.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]} : dispatch 2024-08-31T06:45:18.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:18 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1779283704' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:19.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-31T06:45:19.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-31T06:45:19.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-31T06:45:19.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-31T06:45:19.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-31T06:45:19.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-31T06:45:19.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-31T06:45:19.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-31T06:45:19.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-31T06:45:19.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-31T06:45:19.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-31T06:45:19.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-31T06:45:19.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-31T06:45:19.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T06:45:19.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-08-31T06:45:19.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-08-31T06:45:19.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-08-31T06:45:19.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-08-31T06:45:19.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-08-31T06:45:19.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T06:45:19.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]} : dispatch 2024-08-31T06:45:19.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:18 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1779283704' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:19.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-08-31T06:45:19.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-31T06:45:19.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2024-08-31T06:45:19.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-08-31T06:45:19.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]} : dispatch 2024-08-31T06:45:19.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-08-31T06:45:19.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-08-31T06:45:19.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2024-08-31T06:45:19.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]} : dispatch 2024-08-31T06:45:19.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:18 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1779283704' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:19.816 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.827 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.827 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:19.922 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:20.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-08-31T06:45:20.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-31T06:45:20.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T06:45:20.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-08-31T06:45:20.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-08-31T06:45:20.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-08-31T06:45:20.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-31T06:45:20.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-08-31T06:45:20.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T06:45:20.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-08-31T06:45:20.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:19 smithi037 ceph-mon[18612]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T06:45:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-08-31T06:45:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-31T06:45:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T06:45:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-08-31T06:45:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-08-31T06:45:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-08-31T06:45:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-31T06:45:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-08-31T06:45:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T06:45:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-08-31T06:45:20.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:19 smithi106 ceph-mon[22134]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T06:45:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2024-08-31T06:45:20.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:19 smithi066 ceph-mon[22244]: osdmap e75: 12 total, 12 up, 12 in 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.943+0000 7f719b1ef640 1 -- 172.21.15.37:0/2341845382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 msgr2=0x7f7194103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.943+0000 7f719b1ef640 1 --2- 172.21.15.37:0/2341845382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 0x7f7194103d30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7184009900 tx=0x7f718402a410 comp rx=0 tx=0).stop 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 -- 172.21.15.37:0/2341845382 shutdown_connections 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 --2- 172.21.15.37:0/2341845382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7194109bb0 0x7f71941103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 --2- 172.21.15.37:0/2341845382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7194109260 0x7f7194109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 --2- 172.21.15.37:0/2341845382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 0x7f7194103d30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 -- 172.21.15.37:0/2341845382 >> 172.21.15.37:0/2341845382 conn(0x7f71940ff330 msgr2=0x7f7194101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 -- 172.21.15.37:0/2341845382 shutdown_connections 2024-08-31T06:45:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 -- 172.21.15.37:0/2341845382 wait complete. 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 Processor -- start 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.944+0000 7f719b1ef640 1 -- start start 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f719b1ef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 0x7f719419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f719b1ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7194109260 0x7f719419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f719b1ef640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7194109bb0 0x7f719419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f719b1ef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7194113720 con 0x7f7194103920 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f719b1ef640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f71941135a0 con 0x7f7194109260 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f719b1ef640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f71941138a0 con 0x7f7194109bb0 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 0x7f719419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 0x7f719419a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60486/0 (socket says 172.21.15.37:60486) 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 -- 172.21.15.37:0/3485532526 learned_addr learned my addr 172.21.15.37:0/3485532526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f719978c640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7194109bb0 0x7f719419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7193fff640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7194109260 0x7f719419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 -- 172.21.15.37:0/3485532526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7194109bb0 msgr2=0x7f719419f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7194109bb0 0x7f719419f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 -- 172.21.15.37:0/3485532526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7194109260 msgr2=0x7f719419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7194109260 0x7f719419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 -- 172.21.15.37:0/3485532526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71941a0120 con 0x7f7194103920 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7198f8b640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 0x7f719419a1b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7184009230 tx=0x7f7184004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718403f030 con 0x7f7194103920 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7184003a80 con 0x7f7194103920 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184035070 con 0x7f7194103920 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.945+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71941a03b0 con 0x7f7194103920 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.946+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71941a6b70 con 0x7f7194103920 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.946+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7194108490 con 0x7f7194103920 2024-08-31T06:45:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.948+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7184042030 con 0x7f7194103920 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.949+0000 7f7191ffb640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f717c0b4c90 0x7f717c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.949+0000 7f7193fff640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f717c0b4c90 0x7f717c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.949+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7184105ec0 con 0x7f7194103920 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.949+0000 7f7191ffb640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] conn(0x7f717c0bea80 0x7f717c0c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.949+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 --> [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71840038d0 con 0x7f717c0bea80 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.949+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f7184106270 con 0x7f7194103920 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.950+0000 7f7193fff640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f717c0b4c90 0x7f717c0b71a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7194101b00 tx=0x7f718800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.950+0000 7f719978c640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] conn(0x7f717c0bea80 0x7f717c0c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.950+0000 7f719978c640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] conn(0x7f717c0bea80 0x7f717c0c0f70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.951+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 <== osd.10 v2:172.21.15.66:6824/2946007622 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f71840038d0 con 0x7f717c0bea80 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.965+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 --> [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7194104ba0 con 0x7f717c0bea80 2024-08-31T06:45:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f7191ffb640 1 -- 172.21.15.37:0/3485532526 <== osd.10 v2:172.21.15.66:6824/2946007622 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7194104ba0 con 0x7f717c0bea80 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 >> [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] conn(0x7f717c0bea80 msgr2=0x7f717c0c0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] conn(0x7f717c0bea80 0x7f717c0c0f70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f717c0b4c90 msgr2=0x7f717c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f717c0b4c90 0x7f717c0b71a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7194101b00 tx=0x7f718800b390 comp rx=0 tx=0).stop 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 msgr2=0x7f719419a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 --2- 172.21.15.37:0/3485532526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7194103920 0x7f719419a1b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7184009230 tx=0x7f7184004270 comp rx=0 tx=0).stop 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719978c640 1 -- 172.21.15.37:0/3485532526 reap_dead start 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 shutdown_connections 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 >> 172.21.15.37:0/3485532526 conn(0x7f71940ff330 msgr2=0x7f7194107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 shutdown_connections 2024-08-31T06:45:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:20.966+0000 7f719b1ef640 1 -- 172.21.15.37:0/3485532526 wait complete. 2024-08-31T06:45:20.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:20 smithi037 ceph-mon[18612]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T06:45:21.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:20 smithi106 ceph-mon[22134]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T06:45:21.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:20 smithi066 ceph-mon[22244]: osdmap e76: 12 total, 12 up, 12 in 2024-08-31T06:45:21.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:21 smithi037 ceph-mon[18612]: pgmap v275: 97 pgs: 3 peering, 94 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-31T06:45:22.007 INFO:teuthology.orchestra.run.smithi037.stdout:270582939673 2024-08-31T06:45:22.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-31T06:45:22.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:21 smithi106 ceph-mon[22134]: pgmap v275: 97 pgs: 3 peering, 94 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-31T06:45:22.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:21 smithi066 ceph-mon[22244]: pgmap v275: 97 pgs: 3 peering, 94 active+clean; 638 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-31T06:45:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 -- 172.21.15.37:0/2723403119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 msgr2=0x7ff064109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 --2- 172.21.15.37:0/2723403119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 0x7ff064109650 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff058009900 tx=0x7ff05802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 -- 172.21.15.37:0/2723403119 shutdown_connections 2024-08-31T06:45:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 --2- 172.21.15.37:0/2723403119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 0x7ff064109650 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 --2- 172.21.15.37:0/2723403119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff064109b90 0x7ff0641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 --2- 172.21.15.37:0/2723403119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff064103900 0x7ff064103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 -- 172.21.15.37:0/2723403119 >> 172.21.15.37:0/2723403119 conn(0x7ff06407b5f0 msgr2=0x7ff06407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 -- 172.21.15.37:0/2723403119 shutdown_connections 2024-08-31T06:45:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.838+0000 7ff06a925640 1 -- 172.21.15.37:0/2723403119 wait complete. 2024-08-31T06:45:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.839+0000 7ff06a925640 1 Processor -- start 2024-08-31T06:45:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.839+0000 7ff06a925640 1 -- start start 2024-08-31T06:45:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.839+0000 7ff06a925640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff064103900 0x7ff06419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.839+0000 7ff06a925640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 0x7ff06419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.839+0000 7ff06a925640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff064109b90 0x7ff06419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.839+0000 7ff06a925640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff064113700 con 0x7ff064109240 2024-08-31T06:45:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.839+0000 7ff06a925640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff064113580 con 0x7ff064103900 2024-08-31T06:45:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.839+0000 7ff06a925640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff064113880 con 0x7ff064109b90 2024-08-31T06:45:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 0x7ff06419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 0x7ff06419a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60504/0 (socket says 172.21.15.37:60504) 2024-08-31T06:45:22.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 -- 172.21.15.37:0/1857301884 learned_addr learned my addr 172.21.15.37:0/1857301884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:22.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff068ec2640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff064109b90 0x7ff06419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:22.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff063fff640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff064103900 0x7ff06419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:22.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 -- 172.21.15.37:0/1857301884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff064109b90 msgr2=0x7ff06419fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:22.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff064109b90 0x7ff06419fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:22.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 -- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff064103900 msgr2=0x7ff06419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:22.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff064103900 0x7ff06419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 -- 172.21.15.37:0/1857301884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0641a0140 con 0x7ff064109240 2024-08-31T06:45:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff063fff640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff064103900 0x7ff06419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:45:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0637fe640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 0x7ff06419a770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff058005940 tx=0x7ff0580040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05803f030 con 0x7ff064109240 2024-08-31T06:45:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0641a03d0 con 0x7ff064109240 2024-08-31T06:45:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff058003a80 con 0x7ff064109240 2024-08-31T06:45:22.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff058035070 con 0x7ff064109240 2024-08-31T06:45:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.840+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0641a6b90 con 0x7ff064109240 2024-08-31T06:45:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.841+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0640638f0 con 0x7ff064109240 2024-08-31T06:45:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.843+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff058042030 con 0x7ff064109240 2024-08-31T06:45:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.844+0000 7ff0617fa640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff04c0b4c10 0x7ff04c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.844+0000 7ff063fff640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff04c0b4c10 0x7ff04c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.844+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ff058105ea0 con 0x7ff064109240 2024-08-31T06:45:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.844+0000 7ff0617fa640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] conn(0x7ff04c0bea00 0x7ff04c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.844+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 --> [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff058040e70 con 0x7ff04c0bea00 2024-08-31T06:45:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.844+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff0581062f0 con 0x7ff064109240 2024-08-31T06:45:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.844+0000 7ff063fff640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff04c0b4c10 0x7ff04c0b7120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff054009b40 tx=0x7ff054005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.844+0000 7ff068ec2640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] conn(0x7ff04c0bea00 0x7ff04c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.845+0000 7ff068ec2640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] conn(0x7ff04c0bea00 0x7ff04c0c0ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.846+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 <== osd.7 v2:172.21.15.66:6816/1684993072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff058040e70 con 0x7ff04c0bea00 2024-08-31T06:45:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.860+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 --> [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff064063d20 con 0x7ff04c0bea00 2024-08-31T06:45:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.860+0000 7ff0617fa640 1 -- 172.21.15.37:0/1857301884 <== osd.7 v2:172.21.15.66:6816/1684993072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff064063d20 con 0x7ff04c0bea00 2024-08-31T06:45:22.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] conn(0x7ff04c0bea00 msgr2=0x7ff04c0c0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:22.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] conn(0x7ff04c0bea00 0x7ff04c0c0ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:22.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff04c0b4c10 msgr2=0x7ff04c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:22.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff04c0b4c10 0x7ff04c0b7120 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff054009b40 tx=0x7ff054005e50 comp rx=0 tx=0).stop 2024-08-31T06:45:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 msgr2=0x7ff06419a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 --2- 172.21.15.37:0/1857301884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff064109240 0x7ff06419a770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff058005940 tx=0x7ff0580040e0 comp rx=0 tx=0).stop 2024-08-31T06:45:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff068ec2640 1 -- 172.21.15.37:0/1857301884 reap_dead start 2024-08-31T06:45:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 shutdown_connections 2024-08-31T06:45:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 >> 172.21.15.37:0/1857301884 conn(0x7ff06407b5f0 msgr2=0x7ff0641053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 shutdown_connections 2024-08-31T06:45:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:22.861+0000 7ff06a925640 1 -- 172.21.15.37:0/1857301884 wait complete. 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 -- 172.21.15.37:0/1145275610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108a90 msgr2=0x7f9e7c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 --2- 172.21.15.37:0/1145275610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108a90 0x7f9e7c10f2c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009ca0 tx=0x7f9e7402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 -- 172.21.15.37:0/1145275610 shutdown_connections 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 --2- 172.21.15.37:0/1145275610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108a90 0x7f9e7c10f2c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 --2- 172.21.15.37:0/1145275610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e7c108140 0x7f9e7c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 --2- 172.21.15.37:0/1145275610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c102800 0x7f9e7c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 -- 172.21.15.37:0/1145275610 >> 172.21.15.37:0/1145275610 conn(0x7f9e7c0794c0 msgr2=0x7f9e7c0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 -- 172.21.15.37:0/1145275610 shutdown_connections 2024-08-31T06:45:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.104+0000 7f9e84430640 1 -- 172.21.15.37:0/1145275610 wait complete. 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e84430640 1 Processor -- start 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e84430640 1 -- start start 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e84430640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e7c102800 0x7f9e7c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e84430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108140 0x7f9e7c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e84430640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c108a90 0x7f9e7c199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e84430640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c112610 con 0x7f9e7c108140 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e84430640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c112490 con 0x7f9e7c108a90 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e84430640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c112790 con 0x7f9e7c102800 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e819cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108140 0x7f9e7c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e819cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108140 0x7f9e7c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60526/0 (socket says 172.21.15.37:60526) 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e819cb640 1 -- 172.21.15.37:0/4261691347 learned_addr learned my addr 172.21.15.37:0/4261691347 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e829cd640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c108a90 0x7f9e7c199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e821cc640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e7c102800 0x7f9e7c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e819cb640 1 -- 172.21.15.37:0/4261691347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e7c102800 msgr2=0x7f9e7c198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e819cb640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e7c102800 0x7f9e7c198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e819cb640 1 -- 172.21.15.37:0/4261691347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c108a90 msgr2=0x7f9e7c199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e819cb640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e7c108a90 0x7f9e7c199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e819cb640 1 -- 172.21.15.37:0/4261691347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c1a83a0 con 0x7f9e7c108140 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.105+0000 7f9e821cc640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e7c102800 0x7f9e7c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.106+0000 7f9e819cb640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108140 0x7f9e7c199230 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c970 tx=0x7f9e7000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.106+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70007bb0 con 0x7f9e7c108140 2024-08-31T06:45:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.106+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e70007d50 con 0x7f9e7c108140 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.106+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e7c1a8690 con 0x7f9e7c108140 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.106+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70018660 con 0x7f9e7c108140 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.106+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7c1a8b80 con 0x7f9e7c108140 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.107+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e7c0638f0 con 0x7f9e7c108140 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.108+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f9e7000f970 con 0x7f9e7c108140 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.109+0000 7f9e6f7fe640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9e680b4c10 0x7f9e680b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.109+0000 7f9e821cc640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9e680b4c10 0x7f9e680b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.109+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9e700e5c60 con 0x7f9e7c108140 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.109+0000 7f9e6f7fe640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] conn(0x7f9e680bea00 0x7f9e680c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.109+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 --> [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e7001ae50 con 0x7f9e680bea00 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.109+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f9e700e60b0 con 0x7f9e7c108140 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.110+0000 7f9e829cd640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] conn(0x7f9e680bea00 0x7f9e680c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.110+0000 7f9e821cc640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9e680b4c10 0x7f9e680b7120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9e78005d00 tx=0x7f9e78005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.110+0000 7f9e829cd640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] conn(0x7f9e680bea00 0x7f9e680c0ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.111+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 <== osd.9 v2:172.21.15.37:6826/2705884500 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e7001ae50 con 0x7f9e680bea00 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.126+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 --> [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e7c063cf0 con 0x7f9e680bea00 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e6f7fe640 1 -- 172.21.15.37:0/4261691347 <== osd.9 v2:172.21.15.37:6826/2705884500 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9e7c063cf0 con 0x7f9e680bea00 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] conn(0x7f9e680bea00 msgr2=0x7f9e680c0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] conn(0x7f9e680bea00 0x7f9e680c0ef0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9e680b4c10 msgr2=0x7f9e680b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9e680b4c10 0x7f9e680b7120 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9e78005d00 tx=0x7f9e78005c90 comp rx=0 tx=0).stop 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108140 msgr2=0x7f9e7c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 --2- 172.21.15.37:0/4261691347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e7c108140 0x7f9e7c199230 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000c970 tx=0x7f9e7000ce30 comp rx=0 tx=0).stop 2024-08-31T06:45:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e829cd640 1 -- 172.21.15.37:0/4261691347 reap_dead start 2024-08-31T06:45:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 shutdown_connections 2024-08-31T06:45:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 >> 172.21.15.37:0/4261691347 conn(0x7f9e7c0794c0 msgr2=0x7f9e7c104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 shutdown_connections 2024-08-31T06:45:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.127+0000 7f9e84430640 1 -- 172.21.15.37:0/4261691347 wait complete. 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 -- 172.21.15.37:0/580983451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 msgr2=0x7f529010d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 --2- 172.21.15.37:0/580983451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 0x7f529010d610 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5280009900 tx=0x7f528002a410 comp rx=0 tx=0).stop 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 -- 172.21.15.37:0/580983451 shutdown_connections 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 --2- 172.21.15.37:0/580983451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 0x7f529010d610 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 --2- 172.21.15.37:0/580983451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f529010dbd0 0x7f52901100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 --2- 172.21.15.37:0/580983451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5290104770 0x7f5290104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 -- 172.21.15.37:0/580983451 >> 172.21.15.37:0/580983451 conn(0x7f52900794e0 msgr2=0x7f52900798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 -- 172.21.15.37:0/580983451 shutdown_connections 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 -- 172.21.15.37:0/580983451 wait complete. 2024-08-31T06:45:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.928+0000 7f5297ab8640 1 Processor -- start 2024-08-31T06:45:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5297ab8640 1 -- start start 2024-08-31T06:45:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5297ab8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5290104770 0x7f529019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5297ab8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 0x7f529019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5297ab8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f529010dbd0 0x7f529019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5297ab8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5290113740 con 0x7f52901050c0 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5297ab8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f52901135c0 con 0x7f5290104770 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5297ab8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f52901138c0 con 0x7f529010dbd0 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5295053640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 0x7f529019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5296055640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f529010dbd0 0x7f529019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5295053640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 0x7f529019a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60574/0 (socket says 172.21.15.37:60574) 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5295053640 1 -- 172.21.15.37:0/3237594027 learned_addr learned my addr 172.21.15.37:0/3237594027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.929+0000 7f5295854640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5290104770 0x7f529019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5295053640 1 -- 172.21.15.37:0/3237594027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f529010dbd0 msgr2=0x7f529019fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5295053640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f529010dbd0 0x7f529019fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5295053640 1 -- 172.21.15.37:0/3237594027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5290104770 msgr2=0x7f529019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5295053640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5290104770 0x7f529019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5295053640 1 -- 172.21.15.37:0/3237594027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52901a0160 con 0x7f52901050c0 2024-08-31T06:45:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5295053640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 0x7f529019a790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5280005940 tx=0x7f52800040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528003f030 con 0x7f52901050c0 2024-08-31T06:45:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52901a03f0 con 0x7f52901050c0 2024-08-31T06:45:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5280003a80 con 0x7f52901050c0 2024-08-31T06:45:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280035070 con 0x7f52901050c0 2024-08-31T06:45:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.930+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5290102390 con 0x7f52901050c0 2024-08-31T06:45:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.931+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52900638b0 con 0x7f52901050c0 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.933+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f5280042030 con 0x7f52901050c0 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.934+0000 7f5286ffd640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f527c0b4c90 0x7f527c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.934+0000 7f5295854640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f527c0b4c90 0x7f527c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.934+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f5280105dd0 con 0x7f52901050c0 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.934+0000 7f5286ffd640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] conn(0x7f527c0bea80 0x7f527c0c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.934+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 --> [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f527c0c1640 con 0x7f527c0bea80 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.934+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f5280106220 con 0x7f52901050c0 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.934+0000 7f5296055640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] conn(0x7f527c0bea80 0x7f527c0c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.934+0000 7f5295854640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f527c0b4c90 0x7f527c0b71a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f529006c6e0 tx=0x7f528c009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:23.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.935+0000 7f5296055640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] conn(0x7f527c0bea80 0x7f527c0c0f70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:23.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.936+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 <== osd.3 v2:172.21.15.37:6810/2145517998 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f527c0c1640 con 0x7f527c0bea80 2024-08-31T06:45:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.950+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 --> [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5290063cb0 con 0x7f527c0bea80 2024-08-31T06:45:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.950+0000 7f5286ffd640 1 -- 172.21.15.37:0/3237594027 <== osd.3 v2:172.21.15.37:6810/2145517998 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5290063cb0 con 0x7f527c0bea80 2024-08-31T06:45:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] conn(0x7f527c0bea80 msgr2=0x7f527c0c0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] conn(0x7f527c0bea80 0x7f527c0c0f70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f527c0b4c90 msgr2=0x7f527c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f527c0b4c90 0x7f527c0b71a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f529006c6e0 tx=0x7f528c009110 comp rx=0 tx=0).stop 2024-08-31T06:45:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 msgr2=0x7f529019a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 --2- 172.21.15.37:0/3237594027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52901050c0 0x7f529019a790 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5280005940 tx=0x7f52800040e0 comp rx=0 tx=0).stop 2024-08-31T06:45:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5296055640 1 -- 172.21.15.37:0/3237594027 reap_dead start 2024-08-31T06:45:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 shutdown_connections 2024-08-31T06:45:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 >> 172.21.15.37:0/3237594027 conn(0x7f52900794e0 msgr2=0x7f52900ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 shutdown_connections 2024-08-31T06:45:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.951+0000 7f5297ab8640 1 -- 172.21.15.37:0/3237594027 wait complete. 2024-08-31T06:45:24.037 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:23 smithi037 ceph-mon[18612]: pgmap v276: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 894 B/s wr, 7 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:24.067 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:23 smithi106 ceph-mon[22134]: pgmap v276: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 894 B/s wr, 7 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:24.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:23 smithi066 ceph-mon[22244]: pgmap v276: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 894 B/s wr, 7 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:24.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 -- 172.21.15.37:0/1752948343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68109ba0 msgr2=0x7f9a681103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 --2- 172.21.15.37:0/1752948343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68109ba0 0x7f9a681103d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009ca0 tx=0x7f9a6002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 -- 172.21.15.37:0/1752948343 shutdown_connections 2024-08-31T06:45:24.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 --2- 172.21.15.37:0/1752948343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68109ba0 0x7f9a681103d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 --2- 172.21.15.37:0/1752948343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a68109250 0x7f9a68109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 --2- 172.21.15.37:0/1752948343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a68101d10 0x7f9a68102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 -- 172.21.15.37:0/1752948343 >> 172.21.15.37:0/1752948343 conn(0x7f9a68077a00 msgr2=0x7f9a68077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 -- 172.21.15.37:0/1752948343 shutdown_connections 2024-08-31T06:45:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.219+0000 7f9a6fb09640 1 -- 172.21.15.37:0/1752948343 wait complete. 2024-08-31T06:45:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6fb09640 1 Processor -- start 2024-08-31T06:45:24.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6fb09640 1 -- start start 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6fb09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68101d10 0x7f9a6819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6fb09640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a68109250 0x7f9a6819a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6fb09640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a68109ba0 0x7f9a6819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6fb09640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a68113760 con 0x7f9a68101d10 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6fb09640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681135e0 con 0x7f9a68109250 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6fb09640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9a681138e0 con 0x7f9a68109ba0 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d8a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68101d10 0x7f9a6819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d8a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68101d10 0x7f9a6819a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60542/0 (socket says 172.21.15.37:60542) 2024-08-31T06:45:24.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d8a5640 1 -- 172.21.15.37:0/4134529029 learned_addr learned my addr 172.21.15.37:0/4134529029 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d0a4640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a68109250 0x7f9a6819a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d8a5640 1 -- 172.21.15.37:0/4134529029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a68109ba0 msgr2=0x7f9a6819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d8a5640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a68109ba0 0x7f9a6819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d8a5640 1 -- 172.21.15.37:0/4134529029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a68109250 msgr2=0x7f9a6819a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d8a5640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a68109250 0x7f9a6819a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.220+0000 7f9a6d8a5640 1 -- 172.21.15.37:0/4134529029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a681a0020 con 0x7f9a68101d10 2024-08-31T06:45:24.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.221+0000 7f9a6d8a5640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68101d10 0x7f9a6819a0b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400d950 tx=0x7f9a6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.221+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a64017070 con 0x7f9a68101d10 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.221+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a64009c30 con 0x7f9a68101d10 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.221+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a681a0310 con 0x7f9a68101d10 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.221+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400f620 con 0x7f9a68101d10 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.221+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a681a6a70 con 0x7f9a68101d10 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.222+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a680638f0 con 0x7f9a68101d10 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.223+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f9a64010460 con 0x7f9a68101d10 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.224+0000 7f9a5effd640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9a540b4c90 0x7f9a540b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.224+0000 7f9a6d0a4640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9a540b4c90 0x7f9a540b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:24.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.224+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9a640e53d0 con 0x7f9a68101d10 2024-08-31T06:45:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.224+0000 7f9a5effd640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] conn(0x7f9a540bea80 0x7f9a540c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.224+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 --> [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a64011e50 con 0x7f9a540bea80 2024-08-31T06:45:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.224+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f9a640e5820 con 0x7f9a68101d10 2024-08-31T06:45:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.224+0000 7f9a6d0a4640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9a540b4c90 0x7f9a540b71a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9a68108f20 tx=0x7f9a5800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.225+0000 7f9a6e0a6640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] conn(0x7f9a540bea80 0x7f9a540c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.225+0000 7f9a6e0a6640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] conn(0x7f9a540bea80 0x7f9a540c0f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.226+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 <== osd.1 v2:172.21.15.66:6800/2563390022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9a64011e50 con 0x7f9a540bea80 2024-08-31T06:45:24.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.240+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 --> [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9a68063d20 con 0x7f9a540bea80 2024-08-31T06:45:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.240+0000 7f9a5effd640 1 -- 172.21.15.37:0/4134529029 <== osd.1 v2:172.21.15.66:6800/2563390022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9a68063d20 con 0x7f9a540bea80 2024-08-31T06:45:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.240+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 >> [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] conn(0x7f9a540bea80 msgr2=0x7f9a540c0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.240+0000 7f9a6fb09640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] conn(0x7f9a540bea80 0x7f9a540c0f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9a540b4c90 msgr2=0x7f9a540b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6fb09640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9a540b4c90 0x7f9a540b71a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9a68108f20 tx=0x7f9a5800b390 comp rx=0 tx=0).stop 2024-08-31T06:45:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68101d10 msgr2=0x7f9a6819a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6fb09640 1 --2- 172.21.15.37:0/4134529029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a68101d10 0x7f9a6819a0b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400d950 tx=0x7f9a6400de10 comp rx=0 tx=0).stop 2024-08-31T06:45:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6e0a6640 1 -- 172.21.15.37:0/4134529029 reap_dead start 2024-08-31T06:45:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 shutdown_connections 2024-08-31T06:45:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 >> 172.21.15.37:0/4134529029 conn(0x7f9a68077a00 msgr2=0x7f9a681072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 shutdown_connections 2024-08-31T06:45:24.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:23.241+0000 7f9a6fb09640 1 -- 172.21.15.37:0/4134529029 wait complete. 2024-08-31T06:45:24.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 -- 172.21.15.37:0/903543927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0105030 msgr2=0x7fb1b010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 --2- 172.21.15.37:0/903543927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0105030 0x7fb1b010d670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb198009900 tx=0x7fb19802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 -- 172.21.15.37:0/903543927 shutdown_connections 2024-08-31T06:45:24.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 --2- 172.21.15.37:0/903543927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0105030 0x7fb1b010d670 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 --2- 172.21.15.37:0/903543927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b010dbb0 0x7fb1b0110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 --2- 172.21.15.37:0/903543927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1b0104600 0x7fb1b0104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 -- 172.21.15.37:0/903543927 >> 172.21.15.37:0/903543927 conn(0x7fb1b00794d0 msgr2=0x7fb1b00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 -- 172.21.15.37:0/903543927 shutdown_connections 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.128+0000 7fb1b4b40640 1 -- 172.21.15.37:0/903543927 wait complete. 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1b4b40640 1 Processor -- start 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1b4b40640 1 -- start start 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1b4b40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0104600 0x7fb1b019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1b4b40640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b0105030 0x7fb1b019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1b4b40640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1b010dbb0 0x7fb1b019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1b4b40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b0113670 con 0x7fb1b0104600 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1b4b40640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b01134f0 con 0x7fb1b010dbb0 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1b4b40640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b01137f0 con 0x7fb1b0105030 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1ae59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0104600 0x7fb1b019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:24.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1ae59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0104600 0x7fb1b019a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60600/0 (socket says 172.21.15.37:60600) 2024-08-31T06:45:24.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1ae59c640 1 -- 172.21.15.37:0/3268786574 learned_addr learned my addr 172.21.15.37:0/3268786574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:24.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1ae59c640 1 -- 172.21.15.37:0/3268786574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b0105030 msgr2=0x7fb1b019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1ae59c640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1b0105030 0x7fb1b019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1ae59c640 1 -- 172.21.15.37:0/3268786574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1b010dbb0 msgr2=0x7fb1b019f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1ae59c640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1b010dbb0 0x7fb1b019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.129+0000 7fb1ae59c640 1 -- 172.21.15.37:0/3268786574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b019ff50 con 0x7fb1b0104600 2024-08-31T06:45:24.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.130+0000 7fb1ae59c640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0104600 0x7fb1b019a0a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000cce0 tx=0x7fb1a000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.130+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a000f650 con 0x7fb1b0104600 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.130+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b01a0240 con 0x7fb1b0104600 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.130+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1a000fc80 con 0x7fb1b0104600 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.130+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0018ae0 con 0x7fb1b0104600 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.130+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b01a6a60 con 0x7fb1b0104600 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.131+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1b0063870 con 0x7fb1b0104600 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.132+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb1a0018c80 con 0x7fb1b0104600 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.133+0000 7fb1a77fe640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb19c0b4c40 0x7fb19c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.133+0000 7fb1add9b640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb19c0b4c40 0x7fb19c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.133+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb1a00e5e30 con 0x7fb1b0104600 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.133+0000 7fb1a77fe640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] conn(0x7fb19c0bea30 0x7fb19c0c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.133+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 --> [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1a0016e50 con 0x7fb19c0bea30 2024-08-31T06:45:24.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.133+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fb1a00e61e0 con 0x7fb1b0104600 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.134+0000 7fb1aed9d640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] conn(0x7fb19c0bea30 0x7fb19c0c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.134+0000 7fb1add9b640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb19c0b4c40 0x7fb19c0b7150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb19802a910 tx=0x7fb198000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.134+0000 7fb1aed9d640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] conn(0x7fb19c0bea30 0x7fb19c0c0f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.135+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 <== osd.4 v2:172.21.15.66:6808/3848335265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1a0016e50 con 0x7fb19c0bea30 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.149+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 --> [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1b0063c70 con 0x7fb19c0bea30 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.149+0000 7fb1a77fe640 1 -- 172.21.15.37:0/3268786574 <== osd.4 v2:172.21.15.66:6808/3848335265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb1b0063c70 con 0x7fb19c0bea30 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 >> [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] conn(0x7fb19c0bea30 msgr2=0x7fb19c0c0f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] conn(0x7fb19c0bea30 0x7fb19c0c0f20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb19c0b4c40 msgr2=0x7fb19c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb19c0b4c40 0x7fb19c0b7150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb19802a910 tx=0x7fb198000bc0 comp rx=0 tx=0).stop 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0104600 msgr2=0x7fb1b019a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 --2- 172.21.15.37:0/3268786574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1b0104600 0x7fb1b019a0a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000cce0 tx=0x7fb1a000a620 comp rx=0 tx=0).stop 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1aed9d640 1 -- 172.21.15.37:0/3268786574 reap_dead start 2024-08-31T06:45:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 shutdown_connections 2024-08-31T06:45:24.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 >> 172.21.15.37:0/3268786574 conn(0x7fb1b00794d0 msgr2=0x7fb1b0100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:24.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 shutdown_connections 2024-08-31T06:45:24.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:24.150+0000 7fb1b4b40640 1 -- 172.21.15.37:0/3268786574 wait complete. 2024-08-31T06:45:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 -- 172.21.15.37:0/2487388604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3954102f60 msgr2=0x7f3954103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 --2- 172.21.15.37:0/2487388604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3954102f60 0x7f3954103370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3944009be0 tx=0x7f394402a6c0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 -- 172.21.15.37:0/2487388604 shutdown_connections 2024-08-31T06:45:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 --2- 172.21.15.37:0/2487388604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3954104f30 0x7f3954105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 --2- 172.21.15.37:0/2487388604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954105880 0x7f395410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 --2- 172.21.15.37:0/2487388604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3954102f60 0x7f3954103370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 -- 172.21.15.37:0/2487388604 >> 172.21.15.37:0/2487388604 conn(0x7f3954077a00 msgr2=0x7f3954077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 -- 172.21.15.37:0/2487388604 shutdown_connections 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 -- 172.21.15.37:0/2487388604 wait complete. 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 Processor -- start 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.174+0000 7f395b658640 1 -- start start 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f395b658640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3954102f60 0x7f395419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f395b658640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3954104f30 0x7f395419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f395b658640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954105880 0x7f395419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f395b658640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39541136f0 con 0x7f3954104f30 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f395b658640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3954113570 con 0x7f3954102f60 2024-08-31T06:45:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f395b658640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3954113870 con 0x7f3954105880 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3954104f30 0x7f395419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3954104f30 0x7f395419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50646/0 (socket says 172.21.15.37:50646) 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 -- 172.21.15.37:0/4281267851 learned_addr learned my addr 172.21.15.37:0/4281267851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f39593f4640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3954102f60 0x7f395419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3959bf5640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954105880 0x7f395419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 -- 172.21.15.37:0/4281267851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954105880 msgr2=0x7f395419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954105880 0x7f395419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 -- 172.21.15.37:0/4281267851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3954102f60 msgr2=0x7f395419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3954102f60 0x7f395419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 -- 172.21.15.37:0/4281267851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39541a0090 con 0x7f3954104f30 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3959bf5640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3954105880 0x7f395419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f39593f4640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3954102f60 0x7f395419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.175+0000 7f3958bf3640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3954104f30 0x7f395419a6c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f394800e9a0 tx=0x7f394800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.176+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394800cd80 con 0x7f3954104f30 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.176+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39480035f0 con 0x7f3954104f30 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.176+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39541a0380 con 0x7f3954104f30 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.176+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3948010690 con 0x7f3954104f30 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.176+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39541a6ae0 con 0x7f3954104f30 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.176+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39540638f0 con 0x7f3954104f30 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.178+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f3948004000 con 0x7f3954104f30 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.179+0000 7f39527fc640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f393c0b4c10 0x7f393c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.179+0000 7f39593f4640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f393c0b4c10 0x7f393c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.179+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f39480e5ac0 con 0x7f3954104f30 2024-08-31T06:45:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.179+0000 7f39527fc640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] conn(0x7f393c0bea00 0x7f393c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.179+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 --> [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3948023e50 con 0x7f393c0bea00 2024-08-31T06:45:25.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.179+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f39480e5f10 con 0x7f3954104f30 2024-08-31T06:45:25.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.179+0000 7f3959bf5640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] conn(0x7f393c0bea00 0x7f393c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.180+0000 7f39593f4640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f393c0b4c10 0x7f393c0b7120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3944000f80 tx=0x7f3944004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:25.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.180+0000 7f3959bf5640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] conn(0x7f393c0bea00 0x7f393c0c0ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:25.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.180+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 <== osd.0 v2:172.21.15.37:6802/1467269550 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3948023e50 con 0x7f393c0bea00 2024-08-31T06:45:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.195+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 --> [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3954063cf0 con 0x7f393c0bea00 2024-08-31T06:45:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.195+0000 7f39527fc640 1 -- 172.21.15.37:0/4281267851 <== osd.0 v2:172.21.15.37:6802/1467269550 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3954063cf0 con 0x7f393c0bea00 2024-08-31T06:45:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] conn(0x7f393c0bea00 msgr2=0x7f393c0c0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] conn(0x7f393c0bea00 0x7f393c0c0ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f393c0b4c10 msgr2=0x7f393c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f393c0b4c10 0x7f393c0b7120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3944000f80 tx=0x7f3944004a40 comp rx=0 tx=0).stop 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3954104f30 msgr2=0x7f395419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 --2- 172.21.15.37:0/4281267851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3954104f30 0x7f395419a6c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f394800e9a0 tx=0x7f394800ee60 comp rx=0 tx=0).stop 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f3959bf5640 1 -- 172.21.15.37:0/4281267851 reap_dead start 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 shutdown_connections 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 >> 172.21.15.37:0/4281267851 conn(0x7f3954077a00 msgr2=0x7f3954106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 shutdown_connections 2024-08-31T06:45:25.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.196+0000 7f395b658640 1 -- 172.21.15.37:0/4281267851 wait complete. 2024-08-31T06:45:25.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:25 smithi037 ceph-mon[18612]: pgmap v277: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 894 B/s wr, 6 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3257045228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf781028b0 msgr2=0x7fdf78102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 --2- 172.21.15.37:0/3257045228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf781028b0 0x7fdf78102cc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009900 tx=0x7fdf6802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3257045228 shutdown_connections 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 --2- 172.21.15.37:0/3257045228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf78108b40 0x7fdf7810f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 --2- 172.21.15.37:0/3257045228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf781081f0 0x7fdf78108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 --2- 172.21.15.37:0/3257045228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf781028b0 0x7fdf78102cc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3257045228 >> 172.21.15.37:0/3257045228 conn(0x7fdf78079470 msgr2=0x7fdf78079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3257045228 shutdown_connections 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3257045228 wait complete. 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.880+0000 7fdf7e4ec640 1 Processor -- start 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7e4ec640 1 -- start start 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7e4ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf781028b0 0x7fdf7819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7e4ec640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf781081f0 0x7fdf7819a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7e4ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf78108b40 0x7fdf7819fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7e4ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdf78112690 con 0x7fdf78108b40 2024-08-31T06:45:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7e4ec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdf78112510 con 0x7fdf781028b0 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7e4ec640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdf78112810 con 0x7fdf781081f0 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7ca89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf78108b40 0x7fdf7819fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7ca89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf78108b40 0x7fdf7819fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50658/0 (socket says 172.21.15.37:50658) 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7ca89640 1 -- 172.21.15.37:0/3521700305 learned_addr learned my addr 172.21.15.37:0/3521700305 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf77fff640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf781028b0 0x7fdf7819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf6ffff640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf781081f0 0x7fdf7819a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7ca89640 1 -- 172.21.15.37:0/3521700305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf781081f0 msgr2=0x7fdf7819a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7ca89640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf781081f0 0x7fdf7819a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7ca89640 1 -- 172.21.15.37:0/3521700305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf781028b0 msgr2=0x7fdf7819a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7ca89640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf781028b0 0x7fdf7819a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.881+0000 7fdf7ca89640 1 -- 172.21.15.37:0/3521700305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf781a0180 con 0x7fdf78108b40 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.882+0000 7fdf7ca89640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf78108b40 0x7fdf7819fa50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000eb10 tx=0x7fdf7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.882+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70004b20 con 0x7fdf78108b40 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.882+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf70004cc0 con 0x7fdf78108b40 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.882+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf781a0470 con 0x7fdf78108b40 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.882+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf70010690 con 0x7fdf78108b40 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.883+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf781a6bd0 con 0x7fdf78108b40 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.884+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf78063830 con 0x7fdf78108b40 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.885+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fdf70005020 con 0x7fdf78108b40 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.885+0000 7fdf75ffb640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdf640b4c10 0x7fdf640b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.885+0000 7fdf77fff640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdf640b4c10 0x7fdf640b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.885+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fdf700e5a90 con 0x7fdf78108b40 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.886+0000 7fdf75ffb640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] conn(0x7fdf640bea00 0x7fdf640c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.886+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 --> [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf70019e70 con 0x7fdf640bea00 2024-08-31T06:45:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.886+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fdf700ea2c0 con 0x7fdf78108b40 2024-08-31T06:45:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.886+0000 7fdf77fff640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdf640b4c10 0x7fdf640b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf680057c0 tx=0x7fdf680058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.886+0000 7fdf6ffff640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] conn(0x7fdf640bea00 0x7fdf640c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.886+0000 7fdf6ffff640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] conn(0x7fdf640bea00 0x7fdf640c0ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.887+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 <== osd.11 v2:172.21.15.106:6824/2963314896 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf70019e70 con 0x7fdf640bea00 2024-08-31T06:45:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.901+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 --> [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf78063cb0 con 0x7fdf640bea00 2024-08-31T06:45:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf75ffb640 1 -- 172.21.15.37:0/3521700305 <== osd.11 v2:172.21.15.106:6824/2963314896 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdf78063cb0 con 0x7fdf640bea00 2024-08-31T06:45:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 >> [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] conn(0x7fdf640bea00 msgr2=0x7fdf640c0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] conn(0x7fdf640bea00 0x7fdf640c0ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdf640b4c10 msgr2=0x7fdf640b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdf640b4c10 0x7fdf640b7120 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf680057c0 tx=0x7fdf680058d0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf78108b40 msgr2=0x7fdf7819fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 --2- 172.21.15.37:0/3521700305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf78108b40 0x7fdf7819fa50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000eb10 tx=0x7fdf7000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7ca89640 1 -- 172.21.15.37:0/3521700305 reap_dead start 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 shutdown_connections 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 >> 172.21.15.37:0/3521700305 conn(0x7fdf78079470 msgr2=0x7fdf781019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 shutdown_connections 2024-08-31T06:45:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.902+0000 7fdf7e4ec640 1 -- 172.21.15.37:0/3521700305 wait complete. 2024-08-31T06:45:26.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:25 smithi106 ceph-mon[22134]: pgmap v277: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 894 B/s wr, 6 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:26.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:25 smithi066 ceph-mon[22244]: pgmap v277: 97 pgs: 3 peering, 94 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 894 B/s wr, 6 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 -- 172.21.15.37:0/2328543476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78109280 msgr2=0x7fcc78109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 --2- 172.21.15.37:0/2328543476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78109280 0x7fcc78109690 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009900 tx=0x7fcc6802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 -- 172.21.15.37:0/2328543476 shutdown_connections 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 --2- 172.21.15.37:0/2328543476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78109280 0x7fcc78109690 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 --2- 172.21.15.37:0/2328543476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc78109bd0 0x7fcc78110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 --2- 172.21.15.37:0/2328543476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc78103940 0x7fcc78103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 -- 172.21.15.37:0/2328543476 >> 172.21.15.37:0/2328543476 conn(0x7fcc780ff3d0 msgr2=0x7fcc78101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 -- 172.21.15.37:0/2328543476 shutdown_connections 2024-08-31T06:45:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.766+0000 7fcc7fdad640 1 -- 172.21.15.37:0/2328543476 wait complete. 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7fdad640 1 Processor -- start 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7fdad640 1 -- start start 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7fdad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78103940 0x7fcc781a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7fdad640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc78109280 0x7fcc781a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7fdad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc78109bd0 0x7fcc781ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7fdad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc78113740 con 0x7fcc78103940 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7fdad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcc781135c0 con 0x7fcc78109bd0 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7fdad640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcc781138c0 con 0x7fcc78109280 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7db49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78103940 0x7fcc781a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7db49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78103940 0x7fcc781a13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50650/0 (socket says 172.21.15.37:50650) 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7db49640 1 -- 172.21.15.37:0/774938275 learned_addr learned my addr 172.21.15.37:0/774938275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7d348640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc78109280 0x7fcc781a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.767+0000 7fcc7e34a640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc78109bd0 0x7fcc781ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.768+0000 7fcc7db49640 1 -- 172.21.15.37:0/774938275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc78109280 msgr2=0x7fcc781a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.768+0000 7fcc7db49640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc78109280 0x7fcc781a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.768+0000 7fcc7db49640 1 -- 172.21.15.37:0/774938275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc78109bd0 msgr2=0x7fcc781ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.768+0000 7fcc7db49640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc78109bd0 0x7fcc781ac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.768+0000 7fcc7db49640 1 -- 172.21.15.37:0/774938275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc781ac9a0 con 0x7fcc78103940 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.768+0000 7fcc7db49640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78103940 0x7fcc781a13e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c970 tx=0x7fcc7400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.771+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74007bb0 con 0x7fcc78103940 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.771+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc74007d50 con 0x7fcc78103940 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.771+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc781acb70 con 0x7fcc78103940 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.771+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74004e40 con 0x7fcc78103940 2024-08-31T06:45:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.771+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc781ad080 con 0x7fcc78103940 2024-08-31T06:45:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.772+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc780638f0 con 0x7fcc78103940 2024-08-31T06:45:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.773+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fcc74005000 con 0x7fcc78103940 2024-08-31T06:45:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.774+0000 7fcc6effd640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc640b4c90 0x7fcc640b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.774+0000 7fcc7d348640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc640b4c90 0x7fcc640b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.774+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fcc740e5440 con 0x7fcc78103940 2024-08-31T06:45:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.774+0000 7fcc6effd640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] conn(0x7fcc640bea80 0x7fcc640c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.774+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 --> [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc640c1640 con 0x7fcc640bea80 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.774+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fcc740e57f0 con 0x7fcc78103940 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.775+0000 7fcc7e34a640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] conn(0x7fcc640bea80 0x7fcc640c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.775+0000 7fcc7d348640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc640b4c90 0x7fcc640b71a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc68005940 tx=0x7fcc680058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.775+0000 7fcc7e34a640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] conn(0x7fcc640bea80 0x7fcc640c0f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.776+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 <== osd.6 v2:172.21.15.37:6818/1599298553 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc640c1640 con 0x7fcc640bea80 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.792+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 --> [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcc78063d70 con 0x7fcc640bea80 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc6effd640 1 -- 172.21.15.37:0/774938275 <== osd.6 v2:172.21.15.37:6818/1599298553 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcc78063d70 con 0x7fcc640bea80 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] conn(0x7fcc640bea80 msgr2=0x7fcc640c0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] conn(0x7fcc640bea80 0x7fcc640c0f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc640b4c90 msgr2=0x7fcc640b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc640b4c90 0x7fcc640b71a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcc68005940 tx=0x7fcc680058d0 comp rx=0 tx=0).stop 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78103940 msgr2=0x7fcc781a13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 --2- 172.21.15.37:0/774938275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc78103940 0x7fcc781a13e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcc7400c970 tx=0x7fcc7400ce30 comp rx=0 tx=0).stop 2024-08-31T06:45:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7e34a640 1 -- 172.21.15.37:0/774938275 reap_dead start 2024-08-31T06:45:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 shutdown_connections 2024-08-31T06:45:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 >> 172.21.15.37:0/774938275 conn(0x7fcc780ff3d0 msgr2=0x7fcc780ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 shutdown_connections 2024-08-31T06:45:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.793+0000 7fcc7fdad640 1 -- 172.21.15.37:0/774938275 wait complete. 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 -- 172.21.15.37:0/1760121049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109ba0 msgr2=0x7fa4941103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 --2- 172.21.15.37:0/1760121049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109ba0 0x7fa4941103d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa48c009ca0 tx=0x7fa48c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 -- 172.21.15.37:0/1760121049 shutdown_connections 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 --2- 172.21.15.37:0/1760121049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109ba0 0x7fa4941103d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 --2- 172.21.15.37:0/1760121049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494109250 0x7fa494109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 --2- 172.21.15.37:0/1760121049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa494103960 0x7fa494103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 -- 172.21.15.37:0/1760121049 >> 172.21.15.37:0/1760121049 conn(0x7fa49407b6b0 msgr2=0x7fa49407bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 -- 172.21.15.37:0/1760121049 shutdown_connections 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.081+0000 7fa49b8ab640 1 -- 172.21.15.37:0/1760121049 wait complete. 2024-08-31T06:45:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa49b8ab640 1 Processor -- start 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa49b8ab640 1 -- start start 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa49b8ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa494103960 0x7fa4940754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa49b8ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109250 0x7fa4940759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa49b8ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494109ba0 0x7fa494075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa49b8ab640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa494113760 con 0x7fa494109250 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa49b8ab640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa4941135e0 con 0x7fa494103960 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa49b8ab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa4941138e0 con 0x7fa494109ba0 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa498e46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109250 0x7fa4940759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa498e46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109250 0x7fa4940759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50628/0 (socket says 172.21.15.37:50628) 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa498e46640 1 -- 172.21.15.37:0/3813612382 learned_addr learned my addr 172.21.15.37:0/3813612382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.082+0000 7fa499e48640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494109ba0 0x7fa494075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa499647640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa494103960 0x7fa4940754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:27.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa498e46640 1 -- 172.21.15.37:0/3813612382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494109ba0 msgr2=0x7fa494075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa498e46640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa494109ba0 0x7fa494075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa498e46640 1 -- 172.21.15.37:0/3813612382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa494103960 msgr2=0x7fa4940754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa498e46640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa494103960 0x7fa4940754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa498e46640 1 -- 172.21.15.37:0/3813612382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4941a8320 con 0x7fa494109250 2024-08-31T06:45:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa498e46640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109250 0x7fa4940759f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa49000d740 tx=0x7fa49000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa490017070 con 0x7fa494109250 2024-08-31T06:45:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4941a8610 con 0x7fa494109250 2024-08-31T06:45:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa490010460 con 0x7fa494109250 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49000f620 con 0x7fa494109250 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.083+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4941a8ba0 con 0x7fa494109250 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.084+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4940638f0 con 0x7fa494109250 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.087+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa49001a070 con 0x7fa494109250 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.088+0000 7fa4867fc640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4800b4c10 0x7fa4800b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.088+0000 7fa499647640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4800b4c10 0x7fa4800b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.088+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa4900e51b0 con 0x7fa494109250 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.088+0000 7fa4867fc640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] conn(0x7fa4800bea00 0x7fa4800c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.088+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 --> [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4800c15c0 con 0x7fa4800bea00 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.088+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa4900e5600 con 0x7fa494109250 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.089+0000 7fa499647640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4800b4c10 0x7fa4800b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa494076f00 tx=0x7fa48800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.089+0000 7fa499e48640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] conn(0x7fa4800bea00 0x7fa4800c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.089+0000 7fa499e48640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] conn(0x7fa4800bea00 0x7fa4800c0ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.090+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 <== osd.2 v2:172.21.15.106:6800/863127215 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa4800c15c0 con 0x7fa4800bea00 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.104+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 --> [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa494063cf0 con 0x7fa4800bea00 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa4867fc640 1 -- 172.21.15.37:0/3813612382 <== osd.2 v2:172.21.15.106:6800/863127215 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa494063cf0 con 0x7fa4800bea00 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 >> [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] conn(0x7fa4800bea00 msgr2=0x7fa4800c0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] conn(0x7fa4800bea00 0x7fa4800c0ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4800b4c10 msgr2=0x7fa4800b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4800b4c10 0x7fa4800b7120 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa494076f00 tx=0x7fa48800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109250 msgr2=0x7fa4940759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 --2- 172.21.15.37:0/3813612382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa494109250 0x7fa4940759f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa49000d740 tx=0x7fa49000db40 comp rx=0 tx=0).stop 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa499e48640 1 -- 172.21.15.37:0/3813612382 reap_dead start 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 shutdown_connections 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 >> 172.21.15.37:0/3813612382 conn(0x7fa49407b6b0 msgr2=0x7fa4941072e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 shutdown_connections 2024-08-31T06:45:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:25.105+0000 7fa49b8ab640 1 -- 172.21.15.37:0/3813612382 wait complete. 2024-08-31T06:45:27.742 INFO:teuthology.orchestra.run.smithi037.stdout:81604378690 2024-08-31T06:45:27.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-31T06:45:28.033 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:27 smithi037 ceph-mon[18612]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 383 B/s wr, 4 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:27 smithi106 ceph-mon[22134]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 383 B/s wr, 4 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:27 smithi066 ceph-mon[22244]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 383 B/s wr, 4 op/s; 126 B/s, 0 objects/s recovering 2024-08-31T06:45:28.901 INFO:teuthology.orchestra.run.smithi037.stdout:60129542216 2024-08-31T06:45:28.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-31T06:45:29.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 -- 172.21.15.37:0/2136963730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 msgr2=0x7f441810f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 --2- 172.21.15.37:0/2136963730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 0x7f441810f300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4410009ca0 tx=0x7f441002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 -- 172.21.15.37:0/2136963730 shutdown_connections 2024-08-31T06:45:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 --2- 172.21.15.37:0/2136963730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 0x7f441810f300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 --2- 172.21.15.37:0/2136963730 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4418108180 0x7f4418108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 --2- 172.21.15.37:0/2136963730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4418102840 0x7f4418102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 -- 172.21.15.37:0/2136963730 >> 172.21.15.37:0/2136963730 conn(0x7f44180794f0 msgr2=0x7f4418079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 -- 172.21.15.37:0/2136963730 shutdown_connections 2024-08-31T06:45:29.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.080+0000 7f441d52d640 1 -- 172.21.15.37:0/2136963730 wait complete. 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.081+0000 7f441d52d640 1 Processor -- start 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.081+0000 7f441d52d640 1 -- start start 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.081+0000 7f441d52d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4418102840 0x7f441819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.081+0000 7f441d52d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4418108180 0x7f441819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.081+0000 7f441d52d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 0x7f441819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.081+0000 7f441d52d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4418113790 con 0x7f4418108ad0 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.081+0000 7f441d52d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4418113610 con 0x7f4418102840 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.081+0000 7f441d52d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4418113910 con 0x7f4418108180 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 0x7f441819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 0x7f441819f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50668/0 (socket says 172.21.15.37:50668) 2024-08-31T06:45:29.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 -- 172.21.15.37:0/460719748 learned_addr learned my addr 172.21.15.37:0/460719748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:29.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f4416ffd640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4418102840 0x7f441819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f440ffff640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4418108180 0x7f441819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 -- 172.21.15.37:0/460719748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4418108180 msgr2=0x7f441819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4418108180 0x7f441819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 -- 172.21.15.37:0/460719748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4418102840 msgr2=0x7f441819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4418102840 0x7f441819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 -- 172.21.15.37:0/460719748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44181a0050 con 0x7f4418108ad0 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f44177fe640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 0x7f441819f9e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4410005cc0 tx=0x7f4410032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410032e00 con 0x7f4418108ad0 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.082+0000 7f441d52d640 1 -- 172.21.15.37:0/460719748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44181a02e0 con 0x7f4418108ad0 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.083+0000 7f441d52d640 1 -- 172.21.15.37:0/460719748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44181a6b60 con 0x7f4418108ad0 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.083+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44100044d0 con 0x7f4418108ad0 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.083+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410030b70 con 0x7f4418108ad0 2024-08-31T06:45:29.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.083+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f44180638b0 con 0x7f4418108ad0 2024-08-31T06:45:29.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.085+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f4410030d10 con 0x7f4418108ad0 2024-08-31T06:45:29.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.086+0000 7f4414ff9640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44040b4cc0 0x7f44040b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.086+0000 7f4416ffd640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44040b4cc0 0x7f44040b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.086+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f4410106940 con 0x7f4418108ad0 2024-08-31T06:45:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.086+0000 7f4414ff9640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] conn(0x7f44040beab0 0x7f44040c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.086+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 --> [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4410045e50 con 0x7f44040beab0 2024-08-31T06:45:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.086+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f4410106d90 con 0x7f4418108ad0 2024-08-31T06:45:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.087+0000 7f4416ffd640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44040b4cc0 0x7f44040b71d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f440800bbe0 tx=0x7f440800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.087+0000 7f440ffff640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] conn(0x7f44040beab0 0x7f44040c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.087+0000 7f440ffff640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] conn(0x7f44040beab0 0x7f44040c0fa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.088+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 <== osd.8 v2:172.21.15.106:6816/638315270 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4410045e50 con 0x7f44040beab0 2024-08-31T06:45:29.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.103+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 --> [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4418063cb0 con 0x7f44040beab0 2024-08-31T06:45:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f4414ff9640 1 -- 172.21.15.37:0/460719748 <== osd.8 v2:172.21.15.106:6816/638315270 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4418063cb0 con 0x7f44040beab0 2024-08-31T06:45:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 >> [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] conn(0x7f44040beab0 msgr2=0x7f44040c0fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] conn(0x7f44040beab0 0x7f44040c0fa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44040b4cc0 msgr2=0x7f44040b71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44040b4cc0 0x7f44040b71d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f440800bbe0 tx=0x7f440800b390 comp rx=0 tx=0).stop 2024-08-31T06:45:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 msgr2=0x7f441819f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 --2- 172.21.15.37:0/460719748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418108ad0 0x7f441819f9e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4410005cc0 tx=0x7f4410032a10 comp rx=0 tx=0).stop 2024-08-31T06:45:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f44177fe640 1 -- 172.21.15.37:0/460719748 reap_dead start 2024-08-31T06:45:29.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 shutdown_connections 2024-08-31T06:45:29.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 >> 172.21.15.37:0/460719748 conn(0x7f44180794f0 msgr2=0x7f44181041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:29.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 shutdown_connections 2024-08-31T06:45:29.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.104+0000 7f440dffb640 1 -- 172.21.15.37:0/460719748 wait complete. 2024-08-31T06:45:29.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 -- 172.21.15.37:0/4178548342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 msgr2=0x7f10cc103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 --2- 172.21.15.37:0/4178548342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 0x7f10cc103d30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009900 tx=0x7f10bc02a410 comp rx=0 tx=0).stop 2024-08-31T06:45:29.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 -- 172.21.15.37:0/4178548342 shutdown_connections 2024-08-31T06:45:29.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 --2- 172.21.15.37:0/4178548342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10cc109bb0 0x7f10cc1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 --2- 172.21.15.37:0/4178548342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10cc109260 0x7f10cc109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 --2- 172.21.15.37:0/4178548342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 0x7f10cc103d30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 -- 172.21.15.37:0/4178548342 >> 172.21.15.37:0/4178548342 conn(0x7f10cc0ff370 msgr2=0x7f10cc1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 -- 172.21.15.37:0/4178548342 shutdown_connections 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.278+0000 7f10d267f640 1 -- 172.21.15.37:0/4178548342 wait complete. 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.279+0000 7f10d267f640 1 Processor -- start 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.279+0000 7f10d267f640 1 -- start start 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10d267f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 0x7f10cc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10d267f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10cc109260 0x7f10cc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10d267f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10cc109bb0 0x7f10cc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10d267f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc113720 con 0x7f10cc103920 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10d267f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc1135a0 con 0x7f10cc109bb0 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10d267f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f10cc1138a0 con 0x7f10cc109260 2024-08-31T06:45:29.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 0x7f10cc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 0x7f10cc0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50692/0 (socket says 172.21.15.37:50692) 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 -- 172.21.15.37:0/3210500078 learned_addr learned my addr 172.21.15.37:0/3210500078 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cb7fe640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10cc109260 0x7f10cc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10d0c1c640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10cc109bb0 0x7f10cc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 -- 172.21.15.37:0/3210500078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10cc109260 msgr2=0x7f10cc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10cc109260 0x7f10cc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 -- 172.21.15.37:0/3210500078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10cc109bb0 msgr2=0x7f10cc075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10cc109bb0 0x7f10cc075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 -- 172.21.15.37:0/3210500078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10cc1a8490 con 0x7f10cc103920 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.280+0000 7f10cbfff640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 0x7f10cc0754b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009230 tx=0x7f10bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.281+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc03f030 con 0x7f10cc103920 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.281+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10bc003a80 con 0x7f10cc103920 2024-08-31T06:45:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.281+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc035070 con 0x7f10cc103920 2024-08-31T06:45:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.281+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10cc1a8720 con 0x7f10cc103920 2024-08-31T06:45:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.281+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10cc1a8c00 con 0x7f10cc103920 2024-08-31T06:45:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.282+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10cc0638f0 con 0x7f10cc103920 2024-08-31T06:45:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.283+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f10bc042030 con 0x7f10cc103920 2024-08-31T06:45:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.284+0000 7f10c97fa640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10b40b4c10 0x7f10b40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.284+0000 7f10cb7fe640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10b40b4c10 0x7f10b40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.284+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f10bc106060 con 0x7f10cc103920 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.284+0000 7f10c97fa640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] conn(0x7f10b40bea00 0x7f10b40c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.284+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 --> [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10bc040e70 con 0x7f10b40bea00 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.284+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f10bc106410 con 0x7f10cc103920 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.284+0000 7f10cb7fe640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10b40b4c10 0x7f10b40b7120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10cc108e30 tx=0x7f10c000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.285+0000 7f10d0c1c640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] conn(0x7f10b40bea00 0x7f10b40c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.285+0000 7f10d0c1c640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] conn(0x7f10b40bea00 0x7f10b40c0ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.286+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 <== osd.5 v2:172.21.15.106:6808/1132176908 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10bc040e70 con 0x7f10b40bea00 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.299+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 --> [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f10cc063d70 con 0x7f10b40bea00 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10c97fa640 1 -- 172.21.15.37:0/3210500078 <== osd.5 v2:172.21.15.106:6808/1132176908 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f10cc063d70 con 0x7f10b40bea00 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 >> [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] conn(0x7f10b40bea00 msgr2=0x7f10b40c0ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d267f640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] conn(0x7f10b40bea00 0x7f10b40c0ef0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10b40b4c10 msgr2=0x7f10b40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d267f640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f10b40b4c10 0x7f10b40b7120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f10cc108e30 tx=0x7f10c000b390 comp rx=0 tx=0).stop 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 msgr2=0x7f10cc0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d267f640 1 --2- 172.21.15.37:0/3210500078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10cc103920 0x7f10cc0754b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009230 tx=0x7f10bc004270 comp rx=0 tx=0).stop 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d0c1c640 1 -- 172.21.15.37:0/3210500078 reap_dead start 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 shutdown_connections 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.300+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 >> 172.21.15.37:0/3210500078 conn(0x7f10cc0ff370 msgr2=0x7f10cc101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.301+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 shutdown_connections 2024-08-31T06:45:29.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:29.301+0000 7f10d267f640 1 -- 172.21.15.37:0/3210500078 wait complete. 2024-08-31T06:45:29.626 INFO:teuthology.orchestra.run.smithi037.stdout:133143986231 2024-08-31T06:45:29.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-31T06:45:29.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:29 smithi037 ceph-mon[18612]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 322 B/s wr, 5 op/s; 106 B/s, 0 objects/s recovering 2024-08-31T06:45:30.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:29 smithi106 ceph-mon[22134]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 322 B/s wr, 5 op/s; 106 B/s, 0 objects/s recovering 2024-08-31T06:45:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:29 smithi066 ceph-mon[22244]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 322 B/s wr, 5 op/s; 106 B/s, 0 objects/s recovering 2024-08-31T06:45:30.425 INFO:teuthology.orchestra.run.smithi037.stdout:249108103199 2024-08-31T06:45:30.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-31T06:45:30.863 INFO:teuthology.orchestra.run.smithi037.stdout:292057776150 2024-08-31T06:45:30.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-31T06:45:31.393 INFO:teuthology.orchestra.run.smithi037.stdout:111669149756 2024-08-31T06:45:31.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-31T06:45:31.963 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:31 smithi037 ceph-mon[18612]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 292 B/s wr, 5 op/s; 96 B/s, 0 objects/s recovering 2024-08-31T06:45:31.996 INFO:teuthology.orchestra.run.smithi037.stdout:38654705741 2024-08-31T06:45:31.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-31T06:45:32.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:31 smithi106 ceph-mon[22134]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 292 B/s wr, 5 op/s; 96 B/s, 0 objects/s recovering 2024-08-31T06:45:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:31 smithi066 ceph-mon[22244]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 292 B/s wr, 5 op/s; 96 B/s, 0 objects/s recovering 2024-08-31T06:45:32.467 INFO:teuthology.orchestra.run.smithi037.stdout:180388626479 2024-08-31T06:45:32.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-31T06:45:32.924 INFO:teuthology.orchestra.run.smithi037.stdout:158913790005 2024-08-31T06:45:32.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-31T06:45:33.523 INFO:teuthology.orchestra.run.smithi037.stdout:201863462952 2024-08-31T06:45:33.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-31T06:45:33.647 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:33.649 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:33.679 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:33.679 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:33.708 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:33.708 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:33.710 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:34.059 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:33 smithi037 ceph-mon[18612]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s; 84 B/s, 0 objects/s recovering 2024-08-31T06:45:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:33 smithi106 ceph-mon[22134]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s; 84 B/s, 0 objects/s recovering 2024-08-31T06:45:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:33 smithi066 ceph-mon[22244]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 7 op/s; 84 B/s, 0 objects/s recovering 2024-08-31T06:45:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 -- 172.21.15.37:0/292954907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188102030 msgr2=0x7fc188102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 --2- 172.21.15.37:0/292954907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188102030 0x7fc188102440 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc178009900 tx=0x7fc17802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 -- 172.21.15.37:0/292954907 shutdown_connections 2024-08-31T06:45:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 --2- 172.21.15.37:0/292954907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1881082c0 0x7fc18810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 --2- 172.21.15.37:0/292954907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc188107970 0x7fc188107d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 --2- 172.21.15.37:0/292954907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188102030 0x7fc188102440 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 -- 172.21.15.37:0/292954907 >> 172.21.15.37:0/292954907 conn(0x7fc188079c40 msgr2=0x7fc18807a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 -- 172.21.15.37:0/292954907 shutdown_connections 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.386+0000 7fc18e16b640 1 -- 172.21.15.37:0/292954907 wait complete. 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc18e16b640 1 Processor -- start 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc18e16b640 1 -- start start 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc18e16b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc188102030 0x7fc18819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc18e16b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188107970 0x7fc18819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc18e16b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1881082c0 0x7fc18819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc18e16b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1881137a0 con 0x7fc188107970 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc18e16b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc188113620 con 0x7fc1881082c0 2024-08-31T06:45:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc18e16b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc188113920 con 0x7fc188102030 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc186ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188107970 0x7fc18819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc186ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188107970 0x7fc18819a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52334/0 (socket says 172.21.15.37:52334) 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc186ffd640 1 -- 172.21.15.37:0/2869677617 learned_addr learned my addr 172.21.15.37:0/2869677617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc1877fe640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc188102030 0x7fc18819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.387+0000 7fc187fff640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1881082c0 0x7fc18819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc186ffd640 1 -- 172.21.15.37:0/2869677617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc188102030 msgr2=0x7fc18819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc186ffd640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc188102030 0x7fc18819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc186ffd640 1 -- 172.21.15.37:0/2869677617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1881082c0 msgr2=0x7fc18819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc186ffd640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1881082c0 0x7fc18819fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc186ffd640 1 -- 172.21.15.37:0/2869677617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1881a01a0 con 0x7fc188107970 2024-08-31T06:45:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc186ffd640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188107970 0x7fc18819a7d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00d740 tx=0x7fc17c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc184ff9640 1 -- 172.21.15.37:0/2869677617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c017070 con 0x7fc188107970 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc184ff9640 1 -- 172.21.15.37:0/2869677617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc17c00de50 con 0x7fc188107970 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1881a0490 con 0x7fc188107970 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc184ff9640 1 -- 172.21.15.37:0/2869677617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00f620 con 0x7fc188107970 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.388+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1881a6bf0 con 0x7fc188107970 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.389+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc188102440 con 0x7fc188107970 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.390+0000 7fc184ff9640 1 -- 172.21.15.37:0/2869677617 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fc17c01a070 con 0x7fc188107970 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.391+0000 7fc184ff9640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc1700b4c90 0x7fc1700b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.391+0000 7fc1877fe640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc1700b4c90 0x7fc1700b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.391+0000 7fc184ff9640 1 -- 172.21.15.37:0/2869677617 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc17c0e4d50 con 0x7fc188107970 2024-08-31T06:45:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.392+0000 7fc1877fe640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc1700b4c90 0x7fc1700b71a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc1780057c0 tx=0x7fc1780058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:34.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.396+0000 7fc184ff9640 1 -- 172.21.15.37:0/2869677617 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc17c0ab5f0 con 0x7fc188107970 2024-08-31T06:45:34.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.573+0000 7f5e4d246640 1 -- 172.21.15.37:0/3364982244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48106990 msgr2=0x7f5e48110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.573+0000 7f5e4d246640 1 --2- 172.21.15.37:0/3364982244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48106990 0x7f5e48110400 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009ca0 tx=0x7f5e4002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.573+0000 7f5e4d246640 1 -- 172.21.15.37:0/3364982244 shutdown_connections 2024-08-31T06:45:34.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.573+0000 7f5e4d246640 1 --2- 172.21.15.37:0/3364982244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48106990 0x7f5e48110400 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.573+0000 7f5e4d246640 1 --2- 172.21.15.37:0/3364982244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e48106040 0x7f5e48106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.573+0000 7f5e4d246640 1 --2- 172.21.15.37:0/3364982244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e48101df0 0x7f5e48102200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.573+0000 7f5e4d246640 1 -- 172.21.15.37:0/3364982244 >> 172.21.15.37:0/3364982244 conn(0x7f5e48077a00 msgr2=0x7f5e48077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:34.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.574+0000 7f5e4d246640 1 -- 172.21.15.37:0/3364982244 shutdown_connections 2024-08-31T06:45:34.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.574+0000 7f5e4d246640 1 -- 172.21.15.37:0/3364982244 wait complete. 2024-08-31T06:45:34.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.575+0000 7f5e4d246640 1 Processor -- start 2024-08-31T06:45:34.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.575+0000 7f5e4d246640 1 -- start start 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e4d246640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48101df0 0x7f5e48197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e4d246640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e48106040 0x7f5e48198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e4d246640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e48106990 0x7f5e4819d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e4d246640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48111500 con 0x7f5e48101df0 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e46d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48101df0 0x7f5e48197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e46d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48101df0 0x7f5e48197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52340/0 (socket says 172.21.15.37:52340) 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e46d9d640 1 -- 172.21.15.37:0/2939794862 learned_addr learned my addr 172.21.15.37:0/2939794862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48111380 con 0x7f5e48106990 2024-08-31T06:45:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5e48111680 con 0x7f5e48106040 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.576+0000 7f5e4659c640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e48106040 0x7f5e48198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.577+0000 7f5e4759e640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e48106990 0x7f5e4819d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.577+0000 7f5e46d9d640 1 -- 172.21.15.37:0/2939794862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e48106040 msgr2=0x7f5e48198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.577+0000 7f5e46d9d640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e48106040 0x7f5e48198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.577+0000 7f5e46d9d640 1 -- 172.21.15.37:0/2939794862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e48106990 msgr2=0x7f5e4819d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.577+0000 7f5e46d9d640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e48106990 0x7f5e4819d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.577+0000 7f5e46d9d640 1 -- 172.21.15.37:0/2939794862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4819dee0 con 0x7f5e48101df0 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.577+0000 7f5e4759e640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e48106990 0x7f5e4819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.577+0000 7f5e46d9d640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48101df0 0x7f5e48197f70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800e9c0 tx=0x7f5e3800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.578+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2939794862 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800cd80 con 0x7f5e48101df0 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.578+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2939794862 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e380044b0 con 0x7f5e48101df0 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.578+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4819e1d0 con 0x7f5e48101df0 2024-08-31T06:45:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.578+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e481a4930 con 0x7f5e48101df0 2024-08-31T06:45:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.579+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2939794862 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38010430 con 0x7f5e48101df0 2024-08-31T06:45:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.579+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e48102200 con 0x7f5e48101df0 2024-08-31T06:45:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.583+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2939794862 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f5e38003f00 con 0x7f5e48101df0 2024-08-31T06:45:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.583+0000 7f5e2ffff640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e300b4c90 0x7f5e300b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.583+0000 7f5e4659c640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e300b4c90 0x7f5e300b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.584+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2939794862 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f5e380e58c0 con 0x7f5e48101df0 2024-08-31T06:45:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.584+0000 7f5e4659c640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e300b4c90 0x7f5e300b71a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e4810a170 tx=0x7f5e3c00f040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.586+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2939794862 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5e380ac840 con 0x7f5e48101df0 2024-08-31T06:45:34.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.601+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc188109ad0 con 0x7fc188107970 2024-08-31T06:45:34.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.602+0000 7fc184ff9640 1 -- 172.21.15.37:0/2869677617 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc17c0b4180 con 0x7fc188107970 2024-08-31T06:45:34.603 INFO:teuthology.orchestra.run.smithi037.stdout:249108103201 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc1700b4c90 msgr2=0x7fc1700b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc1700b4c90 0x7fc1700b71a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc1780057c0 tx=0x7fc1780058d0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188107970 msgr2=0x7fc18819a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188107970 0x7fc18819a7d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00d740 tx=0x7fc17c00dc00 comp rx=0 tx=0).stop 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 shutdown_connections 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc1700b4c90 0x7fc1700b71a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc188107970 0x7fc18819a7d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1881082c0 0x7fc18819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 --2- 172.21.15.37:0/2869677617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc188102030 0x7fc18819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.605+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 >> 172.21.15.37:0/2869677617 conn(0x7fc188079c40 msgr2=0x7fc188105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.606+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 shutdown_connections 2024-08-31T06:45:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.606+0000 7fc18e16b640 1 -- 172.21.15.37:0/2869677617 wait complete. 2024-08-31T06:45:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.792+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f5e481990a0 con 0x7f5e48101df0 2024-08-31T06:45:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.792+0000 7f5e2ffff640 1 -- 172.21.15.37:0/2939794862 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5e380ac140 con 0x7f5e48101df0 2024-08-31T06:45:34.793 INFO:teuthology.orchestra.run.smithi037.stdout:133143986233 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.794+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e300b4c90 msgr2=0x7f5e300b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.794+0000 7f5e4d246640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e300b4c90 0x7f5e300b71a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5e4810a170 tx=0x7f5e3c00f040 comp rx=0 tx=0).stop 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.794+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48101df0 msgr2=0x7f5e48197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.794+0000 7f5e4d246640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48101df0 0x7f5e48197f70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800e9c0 tx=0x7f5e3800ee80 comp rx=0 tx=0).stop 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.795+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 shutdown_connections 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.795+0000 7f5e4d246640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e300b4c90 0x7f5e300b71a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.795+0000 7f5e4d246640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e48106990 0x7f5e4819d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.795+0000 7f5e4d246640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e48106040 0x7f5e48198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.795+0000 7f5e4d246640 1 --2- 172.21.15.37:0/2939794862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e48101df0 0x7f5e48197f70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.795+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 >> 172.21.15.37:0/2939794862 conn(0x7f5e48077a00 msgr2=0x7f5e48105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:34.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.795+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 shutdown_connections 2024-08-31T06:45:34.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:34.795+0000 7f5e4d246640 1 -- 172.21.15.37:0/2939794862 wait complete. 2024-08-31T06:45:35.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:34 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2869677617' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T06:45:35.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:34 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2869677617' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T06:45:35.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:34 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2869677617' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-31T06:45:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 -- 172.21.15.37:0/1015046501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109b90 msgr2=0x7f97bc1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 --2- 172.21.15.37:0/1015046501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109b90 0x7f97bc1103c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f97b4009ca0 tx=0x7f97b402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 -- 172.21.15.37:0/1015046501 shutdown_connections 2024-08-31T06:45:35.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 --2- 172.21.15.37:0/1015046501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109b90 0x7f97bc1103c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 --2- 172.21.15.37:0/1015046501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97bc109240 0x7f97bc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 --2- 172.21.15.37:0/1015046501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97bc103900 0x7f97bc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 -- 172.21.15.37:0/1015046501 >> 172.21.15.37:0/1015046501 conn(0x7f97bc07b5f0 msgr2=0x7f97bc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 -- 172.21.15.37:0/1015046501 shutdown_connections 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.233+0000 7f97c4298640 1 -- 172.21.15.37:0/1015046501 wait complete. 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c4298640 1 Processor -- start 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c4298640 1 -- start start 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c4298640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97bc103900 0x7f97bc19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c4298640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109240 0x7f97bc19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c4298640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97bc109b90 0x7f97bc19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c4298640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc113750 con 0x7f97bc109240 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c4298640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc1135d0 con 0x7f97bc109b90 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c4298640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f97bc1138d0 con 0x7f97bc103900 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c1833640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109240 0x7f97bc19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c1833640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109240 0x7f97bc19a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52348/0 (socket says 172.21.15.37:52348) 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c1833640 1 -- 172.21.15.37:0/3501683017 learned_addr learned my addr 172.21.15.37:0/3501683017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.234+0000 7f97c2034640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97bc103900 0x7f97bc19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c2835640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97bc109b90 0x7f97bc19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c1833640 1 -- 172.21.15.37:0/3501683017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97bc103900 msgr2=0x7f97bc19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c1833640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97bc103900 0x7f97bc19a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c1833640 1 -- 172.21.15.37:0/3501683017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97bc109b90 msgr2=0x7f97bc19f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:35.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c1833640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97bc109b90 0x7f97bc19f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c1833640 1 -- 172.21.15.37:0/3501683017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc1a0050 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c1833640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109240 0x7f97bc19a680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00d750 tx=0x7f97ac00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97b37fe640 1 -- 172.21.15.37:0/3501683017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac017070 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97bc1a0340 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97b37fe640 1 -- 172.21.15.37:0/3501683017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f97ac0054b0 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97b37fe640 1 -- 172.21.15.37:0/3501683017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac004bc0 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.235+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97bc1a6aa0 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.236+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97bc103d10 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.238+0000 7f97b37fe640 1 -- 172.21.15.37:0/3501683017 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f97ac009c30 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.239+0000 7f97b37fe640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97a80b4c10 0x7f97a80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.239+0000 7f97c2034640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97a80b4c10 0x7f97a80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.239+0000 7f97b37fe640 1 -- 172.21.15.37:0/3501683017 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f97ac0e5220 con 0x7f97bc109240 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.239+0000 7f97c2034640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97a80b4c10 0x7f97a80b7120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97b800bbe0 tx=0x7f97b800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:35.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.242+0000 7f97b37fe640 1 -- 172.21.15.37:0/3501683017 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f97ac0ac110 con 0x7f97bc109240 2024-08-31T06:45:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.431+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f97bc19b210 con 0x7f97bc109240 2024-08-31T06:45:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.431+0000 7f97b37fe640 1 -- 172.21.15.37:0/3501683017 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97ac0aba10 con 0x7f97bc109240 2024-08-31T06:45:35.433 INFO:teuthology.orchestra.run.smithi037.stdout:60129542218 2024-08-31T06:45:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97a80b4c10 msgr2=0x7f97a80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97a80b4c10 0x7f97a80b7120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f97b800bbe0 tx=0x7f97b800b390 comp rx=0 tx=0).stop 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109240 msgr2=0x7f97bc19a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109240 0x7f97bc19a680 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00d750 tx=0x7f97ac00dc10 comp rx=0 tx=0).stop 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 shutdown_connections 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f97a80b4c10 0x7f97a80b7120 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97bc109240 0x7f97bc19a680 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97bc109b90 0x7f97bc19f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 --2- 172.21.15.37:0/3501683017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97bc103900 0x7f97bc19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 >> 172.21.15.37:0/3501683017 conn(0x7f97bc07b5f0 msgr2=0x7f97bc107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 shutdown_connections 2024-08-31T06:45:35.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:35.433+0000 7f97c4298640 1 -- 172.21.15.37:0/3501683017 wait complete. 2024-08-31T06:45:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:35 smithi106 ceph-mon[22134]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:45:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:35 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2939794862' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T06:45:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:35 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3501683017' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T06:45:36.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:35 smithi037 ceph-mon[18612]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:45:36.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:35 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2939794862' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T06:45:36.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:35 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3501683017' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T06:45:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:35 smithi066 ceph-mon[22244]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:45:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:35 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2939794862' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-31T06:45:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:35 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3501683017' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-31T06:45:36.220 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542216 got 60129542218 for osd.1 2024-08-31T06:45:36.220 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.695+0000 7fcd95312640 1 -- 172.21.15.37:0/3846244540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 msgr2=0x7fcd90102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.695+0000 7fcd95312640 1 --2- 172.21.15.37:0/3846244540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 0x7fcd90102c90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009900 tx=0x7fcd8002a410 comp rx=0 tx=0).stop 2024-08-31T06:45:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 -- 172.21.15.37:0/3846244540 shutdown_connections 2024-08-31T06:45:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 --2- 172.21.15.37:0/3846244540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd90108ac0 0x7fcd9010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 --2- 172.21.15.37:0/3846244540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd90108170 0x7fcd90108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 --2- 172.21.15.37:0/3846244540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 0x7fcd90102c90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 -- 172.21.15.37:0/3846244540 >> 172.21.15.37:0/3846244540 conn(0x7fcd90079550 msgr2=0x7fcd90079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:36.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 -- 172.21.15.37:0/3846244540 shutdown_connections 2024-08-31T06:45:36.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 -- 172.21.15.37:0/3846244540 wait complete. 2024-08-31T06:45:36.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 Processor -- start 2024-08-31T06:45:36.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.696+0000 7fcd95312640 1 -- start start 2024-08-31T06:45:36.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd95312640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 0x7fcd9019a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd95312640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd90108170 0x7fcd9019a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd95312640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd90108ac0 0x7fcd9019fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd95312640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd90112620 con 0x7fcd90102880 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd95312640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcd901124a0 con 0x7fcd90108ac0 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd95312640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcd901127a0 con 0x7fcd90108170 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 0x7fcd9019a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 0x7fcd9019a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52364/0 (socket says 172.21.15.37:52364) 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 -- 172.21.15.37:0/1188648379 learned_addr learned my addr 172.21.15.37:0/1188648379 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8f7fe640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd90108ac0 0x7fcd9019fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd87fff640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd90108170 0x7fcd9019a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 -- 172.21.15.37:0/1188648379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd90108170 msgr2=0x7fcd9019a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd90108170 0x7fcd9019a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 -- 172.21.15.37:0/1188648379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd90108ac0 msgr2=0x7fcd9019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd90108ac0 0x7fcd9019fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 -- 172.21.15.37:0/1188648379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd901a0190 con 0x7fcd90102880 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd87fff640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd90108170 0x7fcd9019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8effd640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 0x7fcd9019a220 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009a20 tx=0x7fcd80004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8cff9640 1 -- 172.21.15.37:0/1188648379 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8003f030 con 0x7fcd90102880 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8cff9640 1 -- 172.21.15.37:0/1188648379 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd800035f0 con 0x7fcd90102880 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd8cff9640 1 -- 172.21.15.37:0/1188648379 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80035070 con 0x7fcd90102880 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.697+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd901a0420 con 0x7fcd90102880 2024-08-31T06:45:36.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.698+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd901a6be0 con 0x7fcd90102880 2024-08-31T06:45:36.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.699+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd90102c90 con 0x7fcd90102880 2024-08-31T06:45:36.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.700+0000 7fcd8cff9640 1 -- 172.21.15.37:0/1188648379 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fcd80003aa0 con 0x7fcd90102880 2024-08-31T06:45:36.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.701+0000 7fcd8cff9640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd7c0b4c90 0x7fcd7c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:36.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.701+0000 7fcd87fff640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd7c0b4c90 0x7fcd7c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:36.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.701+0000 7fcd8cff9640 1 -- 172.21.15.37:0/1188648379 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fcd80106380 con 0x7fcd90102880 2024-08-31T06:45:36.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.702+0000 7fcd87fff640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd7c0b4c90 0x7fcd7c0b71a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd90104690 tx=0x7fcd78005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:36.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.704+0000 7fcd8cff9640 1 -- 172.21.15.37:0/1188648379 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcd800cd210 con 0x7fcd90102880 2024-08-31T06:45:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.894+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcd9002e430 con 0x7fcd90102880 2024-08-31T06:45:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.894+0000 7fcd8cff9640 1 -- 172.21.15.37:0/1188648379 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcd800ccb10 con 0x7fcd90102880 2024-08-31T06:45:36.896 INFO:teuthology.orchestra.run.smithi037.stdout:180388626481 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd7c0b4c90 msgr2=0x7fcd7c0b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd7c0b4c90 0x7fcd7c0b71a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcd90104690 tx=0x7fcd78005ec0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 msgr2=0x7fcd9019a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 0x7fcd9019a220 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009a20 tx=0x7fcd80004270 comp rx=0 tx=0).stop 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 shutdown_connections 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcd7c0b4c90 0x7fcd7c0b71a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd90108ac0 0x7fcd9019fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd90108170 0x7fcd9019a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 --2- 172.21.15.37:0/1188648379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd90102880 0x7fcd9019a220 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 >> 172.21.15.37:0/1188648379 conn(0x7fcd90079550 msgr2=0x7fcd901019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 shutdown_connections 2024-08-31T06:45:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:36.897+0000 7fcd95312640 1 -- 172.21.15.37:0/1188648379 wait complete. 2024-08-31T06:45:37.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2628815565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108aa0 msgr2=0x7fd0f410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2628815565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108aa0 0x7fd0f410f2d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009ca0 tx=0x7fd0ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2628815565 shutdown_connections 2024-08-31T06:45:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2628815565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108aa0 0x7fd0f410f2d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2628815565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0f4108150 0x7fd0f4108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2628815565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0f4102ee0 0x7fd0f41032f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2628815565 >> 172.21.15.37:0/2628815565 conn(0x7fd0f4077a00 msgr2=0x7fd0f4077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2628815565 shutdown_connections 2024-08-31T06:45:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.941+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2628815565 wait complete. 2024-08-31T06:45:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.942+0000 7fd0fa3d7640 1 Processor -- start 2024-08-31T06:45:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.942+0000 7fd0fa3d7640 1 -- start start 2024-08-31T06:45:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0fa3d7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0f4102ee0 0x7fd0f419af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0fa3d7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108150 0x7fd0f419b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0fa3d7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0f4108aa0 0x7fd0f419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0fa3d7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f4112670 con 0x7fd0f4108150 2024-08-31T06:45:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0fa3d7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41124f0 con 0x7fd0f4102ee0 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0fa3d7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f41127f0 con 0x7fd0f4108aa0 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108150 0x7fd0f419b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108150 0x7fd0f419b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52372/0 (socket says 172.21.15.37:52372) 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 -- 172.21.15.37:0/2014985497 learned_addr learned my addr 172.21.15.37:0/2014985497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0f3fff640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0f4102ee0 0x7fd0f419af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0f8974640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0f4108aa0 0x7fd0f419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 -- 172.21.15.37:0/2014985497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0f4108aa0 msgr2=0x7fd0f419b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0f4108aa0 0x7fd0f419b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 -- 172.21.15.37:0/2014985497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0f4102ee0 msgr2=0x7fd0f419af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0f4102ee0 0x7fd0f419af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 -- 172.21.15.37:0/2014985497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f41a6220 con 0x7fd0f4108150 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0f3fff640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0f4102ee0 0x7fd0f419af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:45:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.943+0000 7fd0ebfff640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108150 0x7fd0f419b4a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00e9c0 tx=0x7fd0dc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.944+0000 7fd0f1ffb640 1 -- 172.21.15.37:0/2014985497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00ccc0 con 0x7fd0f4108150 2024-08-31T06:45:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.944+0000 7fd0f1ffb640 1 -- 172.21.15.37:0/2014985497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0dc0054b0 con 0x7fd0f4108150 2024-08-31T06:45:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.944+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f41a6510 con 0x7fd0f4108150 2024-08-31T06:45:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.944+0000 7fd0f1ffb640 1 -- 172.21.15.37:0/2014985497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc010430 con 0x7fd0f4108150 2024-08-31T06:45:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.944+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f41a6a00 con 0x7fd0f4108150 2024-08-31T06:45:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.946+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f41032f0 con 0x7fd0f4108150 2024-08-31T06:45:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.947+0000 7fd0f1ffb640 1 -- 172.21.15.37:0/2014985497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fd0dc004f20 con 0x7fd0f4108150 2024-08-31T06:45:37.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.948+0000 7fd0f1ffb640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0e00b4c10 0x7fd0e00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:37.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.948+0000 7fd0f3fff640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0e00b4c10 0x7fd0e00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:37.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.948+0000 7fd0f1ffb640 1 -- 172.21.15.37:0/2014985497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd0dc0e56d0 con 0x7fd0f4108150 2024-08-31T06:45:37.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.948+0000 7fd0f3fff640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0e00b4c10 0x7fd0e00b7120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd0f41026c0 tx=0x7fd0e4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:37.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:37.952+0000 7fd0f1ffb640 1 -- 172.21.15.37:0/2014985497 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd0dc0ac5c0 con 0x7fd0f4108150 2024-08-31T06:45:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:37 smithi106 ceph-mon[22134]: pgmap v283: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:45:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:37 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1188648379' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T06:45:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:37 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:45:38.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:37 smithi037 ceph-mon[18612]: pgmap v283: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:45:38.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:37 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1188648379' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T06:45:38.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:37 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:45:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:37 smithi066 ceph-mon[22244]: pgmap v283: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2024-08-31T06:45:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:37 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1188648379' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-31T06:45:38.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:37 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:45:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.141+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd0f410a300 con 0x7fd0f4108150 2024-08-31T06:45:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.142+0000 7fd0f1ffb640 1 -- 172.21.15.37:0/2014985497 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd0dc0abec0 con 0x7fd0f4108150 2024-08-31T06:45:38.143 INFO:teuthology.orchestra.run.smithi037.stdout:81604378692 2024-08-31T06:45:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0e00b4c10 msgr2=0x7fd0e00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0e00b4c10 0x7fd0e00b7120 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd0f41026c0 tx=0x7fd0e4005f90 comp rx=0 tx=0).stop 2024-08-31T06:45:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108150 msgr2=0x7fd0f419b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108150 0x7fd0f419b4a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00e9c0 tx=0x7fd0dc00ee80 comp rx=0 tx=0).stop 2024-08-31T06:45:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 shutdown_connections 2024-08-31T06:45:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0e00b4c10 0x7fd0e00b7120 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0f4108150 0x7fd0f419b4a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0f4108aa0 0x7fd0f419b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 --2- 172.21.15.37:0/2014985497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0f4102ee0 0x7fd0f419af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 >> 172.21.15.37:0/2014985497 conn(0x7fd0f4077a00 msgr2=0x7fd0f41061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 shutdown_connections 2024-08-31T06:45:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.144+0000 7fd0fa3d7640 1 -- 172.21.15.37:0/2014985497 wait complete. 2024-08-31T06:45:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 -- 172.21.15.37:0/2001309661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108180 msgr2=0x7f828c108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 --2- 172.21.15.37:0/2001309661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108180 0x7f828c108590 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f827c009900 tx=0x7f827c02a410 comp rx=0 tx=0).stop 2024-08-31T06:45:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 -- 172.21.15.37:0/2001309661 shutdown_connections 2024-08-31T06:45:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 --2- 172.21.15.37:0/2001309661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108180 0x7f828c108590 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 --2- 172.21.15.37:0/2001309661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c108ad0 0x7f828c10f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 --2- 172.21.15.37:0/2001309661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f828c102fe0 0x7f828c1033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 -- 172.21.15.37:0/2001309661 >> 172.21.15.37:0/2001309661 conn(0x7f828c077a60 msgr2=0x7f828c077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 -- 172.21.15.37:0/2001309661 shutdown_connections 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.326+0000 7f82933ce640 1 -- 172.21.15.37:0/2001309661 wait complete. 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f82933ce640 1 Processor -- start 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f82933ce640 1 -- start start 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f82933ce640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f828c102fe0 0x7f828c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f82933ce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c108180 0x7f828c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f82933ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108ad0 0x7f828c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f82933ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f828c112610 con 0x7f828c108ad0 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f82933ce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f828c112490 con 0x7f828c108180 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f82933ce640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f828c112790 con 0x7f828c102fe0 2024-08-31T06:45:38.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f829196b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108ad0 0x7f828c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:38.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f829196b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108ad0 0x7f828c19f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52394/0 (socket says 172.21.15.37:52394) 2024-08-31T06:45:38.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f829116a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f828c102fe0 0x7f828c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:38.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f829196b640 1 -- 172.21.15.37:0/1360351905 learned_addr learned my addr 172.21.15.37:0/1360351905 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:38.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.327+0000 7f8290969640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c108180 0x7f828c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:38.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f829196b640 1 -- 172.21.15.37:0/1360351905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f828c102fe0 msgr2=0x7f828c19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f829196b640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f828c102fe0 0x7f828c19a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f829196b640 1 -- 172.21.15.37:0/1360351905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c108180 msgr2=0x7f828c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f829196b640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c108180 0x7f828c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f829196b640 1 -- 172.21.15.37:0/1360351905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c1a00c0 con 0x7f828c108ad0 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f829196b640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108ad0 0x7f828c19f990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f828400eb10 tx=0x7f828400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f82827fc640 1 -- 172.21.15.37:0/1360351905 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284004b20 con 0x7f828c108ad0 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f82827fc640 1 -- 172.21.15.37:0/1360351905 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8284004cc0 con 0x7f828c108ad0 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828c1a03b0 con 0x7f828c108ad0 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f82827fc640 1 -- 172.21.15.37:0/1360351905 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284010690 con 0x7f828c108ad0 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.328+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f828c1a6b10 con 0x7f828c108ad0 2024-08-31T06:45:38.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.329+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f828c1033f0 con 0x7f828c108ad0 2024-08-31T06:45:38.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.331+0000 7f82827fc640 1 -- 172.21.15.37:0/1360351905 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f8284005020 con 0x7f828c108ad0 2024-08-31T06:45:38.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.331+0000 7f82827fc640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f82780b4c90 0x7f82780b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:38.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.332+0000 7f829116a640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f82780b4c90 0x7f82780b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:38.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.332+0000 7f82827fc640 1 -- 172.21.15.37:0/1360351905 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f82840e5a20 con 0x7f828c108ad0 2024-08-31T06:45:38.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.332+0000 7f829116a640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f82780b4c90 0x7f82780b71a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8288009bd0 tx=0x7f8288005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:38.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.336+0000 7f82827fc640 1 -- 172.21.15.37:0/1360351905 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f82840ac910 con 0x7f828c108ad0 2024-08-31T06:45:38.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.521+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f828c02e430 con 0x7f828c108ad0 2024-08-31T06:45:38.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.522+0000 7f82827fc640 1 -- 172.21.15.37:0/1360351905 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f82840ac210 con 0x7f828c108ad0 2024-08-31T06:45:38.523 INFO:teuthology.orchestra.run.smithi037.stdout:292057776152 2024-08-31T06:45:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f82780b4c90 msgr2=0x7f82780b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f82780b4c90 0x7f82780b71a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8288009bd0 tx=0x7f8288005f90 comp rx=0 tx=0).stop 2024-08-31T06:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108ad0 msgr2=0x7f828c19f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108ad0 0x7f828c19f990 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f828400eb10 tx=0x7f828400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 shutdown_connections 2024-08-31T06:45:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f82780b4c90 0x7f82780b71a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f828c108ad0 0x7f828c19f990 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c108180 0x7f828c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 --2- 172.21.15.37:0/1360351905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f828c102fe0 0x7f828c19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.524+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 >> 172.21.15.37:0/1360351905 conn(0x7f828c077a60 msgr2=0x7f828c1042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.525+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 shutdown_connections 2024-08-31T06:45:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:38.525+0000 7f82933ce640 1 -- 172.21.15.37:0/1360351905 wait complete. 2024-08-31T06:45:39.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:38 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2014985497' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T06:45:39.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:38 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1360351905' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T06:45:39.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:38 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2014985497' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T06:45:39.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:38 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1360351905' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T06:45:39.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:38 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2014985497' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-31T06:45:39.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:38 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1360351905' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-31T06:45:39.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 -- 172.21.15.37:0/222651575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 msgr2=0x7f72b810f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/222651575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 0x7f72b810f2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009900 tx=0x7f72b002a410 comp rx=0 tx=0).stop 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 -- 172.21.15.37:0/222651575 shutdown_connections 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/222651575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 0x7f72b810f2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/222651575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72b8108170 0x7f72b8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/222651575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b8102880 0x7f72b8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 -- 172.21.15.37:0/222651575 >> 172.21.15.37:0/222651575 conn(0x7f72b8079500 msgr2=0x7f72b8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 -- 172.21.15.37:0/222651575 shutdown_connections 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 -- 172.21.15.37:0/222651575 wait complete. 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.216+0000 7f72bd5f5640 1 Processor -- start 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72bd5f5640 1 -- start start 2024-08-31T06:45:39.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72bd5f5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72b8102880 0x7f72b8199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72bd5f5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b8108170 0x7f72b81995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72bd5f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 0x7f72b819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72bd5f5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72b81125f0 con 0x7f72b8108ac0 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72bd5f5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f72b8112470 con 0x7f72b8108170 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72bd5f5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f72b8112770 con 0x7f72b8102880 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 0x7f72b819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b6ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72b8102880 0x7f72b8199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 0x7f72b819e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52412/0 (socket says 172.21.15.37:52412) 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b8108170 0x7f72b81995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b77fe640 1 -- 172.21.15.37:0/3288816829 learned_addr learned my addr 172.21.15.37:0/3288816829 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b77fe640 1 -- 172.21.15.37:0/3288816829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72b8102880 msgr2=0x7f72b8199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b77fe640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72b8102880 0x7f72b8199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b77fe640 1 -- 172.21.15.37:0/3288816829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b8108170 msgr2=0x7f72b81995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.217+0000 7f72b77fe640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b8108170 0x7f72b81995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72b77fe640 1 -- 172.21.15.37:0/3288816829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b819ef90 con 0x7f72b8108ac0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72b6ffd640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72b8102880 0x7f72b8199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72b67fc640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b8108170 0x7f72b81995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72b77fe640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 0x7f72b819e860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f72b0005ab0 tx=0x7f72b0005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72affff640 1 -- 172.21.15.37:0/3288816829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b003f030 con 0x7f72b8108ac0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72affff640 1 -- 172.21.15.37:0/3288816829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72b00043d0 con 0x7f72b8108ac0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b819f220 con 0x7f72b8108ac0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72affff640 1 -- 172.21.15.37:0/3288816829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0035070 con 0x7f72b8108ac0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.218+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b81a59e0 con 0x7f72b8108ac0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.219+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b8103ab0 con 0x7f72b8108ac0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.221+0000 7f72affff640 1 -- 172.21.15.37:0/3288816829 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f72b0042030 con 0x7f72b8108ac0 2024-08-31T06:45:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.222+0000 7f72affff640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f72a40b4c10 0x7f72a40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.222+0000 7f72b6ffd640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f72a40b4c10 0x7f72a40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.222+0000 7f72affff640 1 -- 172.21.15.37:0/3288816829 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f72b0105b60 con 0x7f72b8108ac0 2024-08-31T06:45:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.223+0000 7f72b6ffd640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f72a40b4c10 0x7f72a40b7120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72a8005fd0 tx=0x7f72a8009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.225+0000 7f72affff640 1 -- 172.21.15.37:0/3288816829 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f72b00cc3a0 con 0x7f72b8108ac0 2024-08-31T06:45:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.414+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f72b8102c90 con 0x7f72b8108ac0 2024-08-31T06:45:39.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.414+0000 7f72affff640 1 -- 172.21.15.37:0/3288816829 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f72b8102c90 con 0x7f72b8108ac0 2024-08-31T06:45:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:38654705743 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f72a40b4c10 msgr2=0x7f72a40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f72a40b4c10 0x7f72a40b7120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72a8005fd0 tx=0x7f72a8009500 comp rx=0 tx=0).stop 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 msgr2=0x7f72b819e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 0x7f72b819e860 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f72b0005ab0 tx=0x7f72b0005e10 comp rx=0 tx=0).stop 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 shutdown_connections 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f72a40b4c10 0x7f72a40b7120 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b8108ac0 0x7f72b819e860 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b8108170 0x7f72b81995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 --2- 172.21.15.37:0/3288816829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72b8102880 0x7f72b8199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 >> 172.21.15.37:0/3288816829 conn(0x7f72b8079500 msgr2=0x7f72b8105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 shutdown_connections 2024-08-31T06:45:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:39.417+0000 7f72bd5f5640 1 -- 172.21.15.37:0/3288816829 wait complete. 2024-08-31T06:45:39.748 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626481 for osd.6 2024-08-31T06:45:39.748 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:40.126 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986231 got 133143986233 for osd.4 2024-08-31T06:45:40.126 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:40.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:40 smithi037 ceph-mon[18612]: pgmap v284: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-08-31T06:45:40.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:40 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.346 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:40 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3288816829' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T06:45:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:40 smithi066 ceph-mon[22244]: pgmap v284: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-08-31T06:45:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:40 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:40 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3288816829' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T06:45:40.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:40 smithi106 ceph-mon[22134]: pgmap v284: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-08-31T06:45:40.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:40 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:40.566 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:40 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3288816829' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-31T06:45:40.591 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103199 got 249108103201 for osd.9 2024-08-31T06:45:40.591 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:40.804 INFO:teuthology.orchestra.run.smithi037.stdout:227633266726 2024-08-31T06:45:40.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-31T06:45:41.234 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:41 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2033663412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T06:45:41.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:41 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2033663412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T06:45:41.407 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378690 got 81604378692 for osd.2 2024-08-31T06:45:41.408 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/1695167981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf7810dbd0 msgr2=0x7fbf781100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/1695167981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf7810dbd0 0x7fbf781100c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbf70009ca0 tx=0x7fbf7002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/1695167981 shutdown_connections 2024-08-31T06:45:41.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/1695167981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf7810dbd0 0x7fbf781100c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/1695167981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf781050c0 0x7fbf7810d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/1695167981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf78104770 0x7fbf78104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/1695167981 >> 172.21.15.37:0/1695167981 conn(0x7fbf780794e0 msgr2=0x7fbf780798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/1695167981 shutdown_connections 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.758+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/1695167981 wait complete. 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7ed3a640 1 Processor -- start 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7ed3a640 1 -- start start 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7ed3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78104770 0x7fbf781024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7ed3a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf781050c0 0x7fbf781029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7ed3a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7810dbd0 0x7fbf78102f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7ed3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf78113730 con 0x7fbf78104770 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7ed3a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbf781135b0 con 0x7fbf781050c0 2024-08-31T06:45:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7ed3a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbf781138b0 con 0x7fbf7810dbd0 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7cad6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78104770 0x7fbf781024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7cad6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78104770 0x7fbf781024b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52432/0 (socket says 172.21.15.37:52432) 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf7cad6640 1 -- 172.21.15.37:0/2033663412 learned_addr learned my addr 172.21.15.37:0/2033663412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.759+0000 7fbf77fff640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf781050c0 0x7fbf781029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7d2d7640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7810dbd0 0x7fbf78102f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7cad6640 1 -- 172.21.15.37:0/2033663412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7810dbd0 msgr2=0x7fbf78102f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7cad6640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7810dbd0 0x7fbf78102f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7cad6640 1 -- 172.21.15.37:0/2033663412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf781050c0 msgr2=0x7fbf781029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7cad6640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf781050c0 0x7fbf781029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7cad6640 1 -- 172.21.15.37:0/2033663412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf781a8460 con 0x7fbf78104770 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7cad6640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78104770 0x7fbf781024b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800e9c0 tx=0x7fbf6800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf75ffb640 1 -- 172.21.15.37:0/2033663412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6800cd80 con 0x7fbf78104770 2024-08-31T06:45:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf781a8750 con 0x7fbf78104770 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf75ffb640 1 -- 172.21.15.37:0/2033663412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf680044b0 con 0x7fbf78104770 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf75ffb640 1 -- 172.21.15.37:0/2033663412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68010430 con 0x7fbf78104770 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.760+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf781a8c90 con 0x7fbf78104770 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.761+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7806bfe0 con 0x7fbf78104770 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.763+0000 7fbf75ffb640 1 -- 172.21.15.37:0/2033663412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fbf68003f00 con 0x7fbf78104770 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.763+0000 7fbf75ffb640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf600b4c10 0x7fbf600b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.764+0000 7fbf77fff640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf600b4c10 0x7fbf600b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stdout:111669149759 2024-08-31T06:45:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.764+0000 7fbf75ffb640 1 -- 172.21.15.37:0/2033663412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbf680e5930 con 0x7fbf78104770 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.764+0000 7fbf77fff640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf600b4c10 0x7fbf600b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbf78079e90 tx=0x7fbf6c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.768+0000 7fbf75ffb640 1 -- 172.21.15.37:0/2033663412 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbf680ac7c0 con 0x7fbf78104770 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.960+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbf78104b80 con 0x7fbf78104770 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.960+0000 7fbf75ffb640 1 -- 172.21.15.37:0/2033663412 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbf680ac0c0 con 0x7fbf78104770 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf600b4c10 msgr2=0x7fbf600b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf600b4c10 0x7fbf600b7120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbf78079e90 tx=0x7fbf6c00b390 comp rx=0 tx=0).stop 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78104770 msgr2=0x7fbf781024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78104770 0x7fbf781024b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800e9c0 tx=0x7fbf6800ee80 comp rx=0 tx=0).stop 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 shutdown_connections 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf600b4c10 0x7fbf600b7120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf7810dbd0 0x7fbf78102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf781050c0 0x7fbf781029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 --2- 172.21.15.37:0/2033663412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf78104770 0x7fbf781024b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:41.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 >> 172.21.15.37:0/2033663412 conn(0x7fbf780794e0 msgr2=0x7fbf78100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:41.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 shutdown_connections 2024-08-31T06:45:41.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:40.962+0000 7fbf7ed3a640 1 -- 172.21.15.37:0/2033663412 wait complete. 2024-08-31T06:45:41.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:41 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2033663412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-31T06:45:42.314 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776150 got 292057776152 for osd.11 2024-08-31T06:45:42.314 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:42.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:42 smithi037 ceph-mon[18612]: pgmap v285: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:45:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:42 smithi066 ceph-mon[22244]: pgmap v285: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:45:42.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:42 smithi106 ceph-mon[22134]: pgmap v285: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:45:42.636 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149756 got 111669149759 for osd.3 2024-08-31T06:45:42.636 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:43.108 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705741 got 38654705743 for osd.0 2024-08-31T06:45:43.108 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.732+0000 7f08805fb640 1 -- 172.21.15.37:0/2337093804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0878106070 msgr2=0x7f0878106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.732+0000 7f08805fb640 1 --2- 172.21.15.37:0/2337093804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0878106070 0x7f0878106480 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f086c009900 tx=0x7f086c02a410 comp rx=0 tx=0).stop 2024-08-31T06:45:43.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.732+0000 7f08805fb640 1 -- 172.21.15.37:0/2337093804 shutdown_connections 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.732+0000 7f08805fb640 1 --2- 172.21.15.37:0/2337093804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0878106070 0x7f0878106480 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.732+0000 7f08805fb640 1 --2- 172.21.15.37:0/2337093804 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08781069c0 0x7f0878110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.732+0000 7f08805fb640 1 --2- 172.21.15.37:0/2337093804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878101e20 0x7f0878102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.732+0000 7f08805fb640 1 -- 172.21.15.37:0/2337093804 >> 172.21.15.37:0/2337093804 conn(0x7f0878079d30 msgr2=0x7f087807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.732+0000 7f08805fb640 1 -- 172.21.15.37:0/2337093804 shutdown_connections 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 -- 172.21.15.37:0/2337093804 wait complete. 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 Processor -- start 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 -- start start 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0878101e20 0x7f087819a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:43.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878106070 0x7f087819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08781069c0 0x7f087819f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0878113740 con 0x7f08781069c0 2024-08-31T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f08781135c0 con 0x7f0878106070 2024-08-31T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.733+0000 7f08805fb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f08781138c0 con 0x7f0878101e20 2024-08-31T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08781069c0 0x7f087819f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08781069c0 0x7f087819f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52450/0 (socket says 172.21.15.37:52450) 2024-08-31T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 -- 172.21.15.37:0/2561864941 learned_addr learned my addr 172.21.15.37:0/2561864941 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:43.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087db96640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878106070 0x7f087819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087e397640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0878101e20 0x7f087819a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 -- 172.21.15.37:0/2561864941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0878101e20 msgr2=0x7f087819a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0878101e20 0x7f087819a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 -- 172.21.15.37:0/2561864941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878106070 msgr2=0x7f087819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878106070 0x7f087819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 -- 172.21.15.37:0/2561864941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08781a0120 con 0x7f08781069c0 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f087eb98640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08781069c0 0x7f087819f9f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f087000eb10 tx=0x7f087000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f086b7fe640 1 -- 172.21.15.37:0/2561864941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870004b20 con 0x7f08781069c0 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f086b7fe640 1 -- 172.21.15.37:0/2561864941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0870004cc0 con 0x7f08781069c0 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f086b7fe640 1 -- 172.21.15.37:0/2561864941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870010690 con 0x7f08781069c0 2024-08-31T06:45:43.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08781a0410 con 0x7f08781069c0 2024-08-31T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.734+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08781a6b70 con 0x7f08781069c0 2024-08-31T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.735+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f087806b5f0 con 0x7f08781069c0 2024-08-31T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.737+0000 7f086b7fe640 1 -- 172.21.15.37:0/2561864941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f0870005000 con 0x7f08781069c0 2024-08-31T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.737+0000 7f086b7fe640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f08640b4c10 0x7f08640b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.738+0000 7f087e397640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f08640b4c10 0x7f08640b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.738+0000 7f086b7fe640 1 -- 172.21.15.37:0/2561864941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f08700e5cb0 con 0x7f08781069c0 2024-08-31T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.738+0000 7f087e397640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f08640b4c10 0x7f08640b7120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0874005fd0 tx=0x7f0874005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:43.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.741+0000 7f086b7fe640 1 -- 172.21.15.37:0/2561864941 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0870056130 con 0x7f08781069c0 2024-08-31T06:45:43.760 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:43.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.934+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f087810bae0 con 0x7f08781069c0 2024-08-31T06:45:43.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.934+0000 7f086b7fe640 1 -- 172.21.15.37:0/2561864941 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f08700acb40 con 0x7f08781069c0 2024-08-31T06:45:43.936 INFO:teuthology.orchestra.run.smithi037.stdout:270582939678 2024-08-31T06:45:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f08640b4c10 msgr2=0x7f08640b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f08640b4c10 0x7f08640b7120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0874005fd0 tx=0x7f0874005850 comp rx=0 tx=0).stop 2024-08-31T06:45:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08781069c0 msgr2=0x7f087819f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08781069c0 0x7f087819f9f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f087000eb10 tx=0x7f087000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 shutdown_connections 2024-08-31T06:45:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f08640b4c10 0x7f08640b7120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08781069c0 0x7f087819f9f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0878106070 0x7f087819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 --2- 172.21.15.37:0/2561864941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0878101e20 0x7f087819a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:43.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 >> 172.21.15.37:0/2561864941 conn(0x7f0878079d30 msgr2=0x7f0878107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:43.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 shutdown_connections 2024-08-31T06:45:43.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:43.937+0000 7f08805fb640 1 -- 172.21.15.37:0/2561864941 wait complete. 2024-08-31T06:45:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:44 smithi037 ceph-mon[18612]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:45:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:44 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2561864941' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T06:45:44.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:44 smithi066 ceph-mon[22244]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:45:44.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:44 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2561864941' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T06:45:44.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:44 smithi106 ceph-mon[22134]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:45:44.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:44 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2561864941' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-31T06:45:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 -- 172.21.15.37:0/2468693597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724109b90 msgr2=0x7fe7241103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/2468693597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724109b90 0x7fe7241103c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009900 tx=0x7fe71c02a410 comp rx=0 tx=0).stop 2024-08-31T06:45:44.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 -- 172.21.15.37:0/2468693597 shutdown_connections 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/2468693597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724109b90 0x7fe7241103c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/2468693597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724109240 0x7fe724109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/2468693597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe724103900 0x7fe724103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 -- 172.21.15.37:0/2468693597 >> 172.21.15.37:0/2468693597 conn(0x7fe72407b5f0 msgr2=0x7fe72407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 -- 172.21.15.37:0/2468693597 shutdown_connections 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.762+0000 7fe72c3d4640 1 -- 172.21.15.37:0/2468693597 wait complete. 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72c3d4640 1 Processor -- start 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72c3d4640 1 -- start start 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72c3d4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724103900 0x7fe7240754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72c3d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724109240 0x7fe7240759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72c3d4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe724109b90 0x7fe724075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72c3d4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe724113740 con 0x7fe724103900 2024-08-31T06:45:44.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72c3d4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe7241135c0 con 0x7fe724109240 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72c3d4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe7241138c0 con 0x7fe724109b90 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a170640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724103900 0x7fe7240754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a170640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724103900 0x7fe7240754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33054/0 (socket says 172.21.15.37:33054) 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a170640 1 -- 172.21.15.37:0/779812806 learned_addr learned my addr 172.21.15.37:0/779812806 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72996f640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724109240 0x7fe7240759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a971640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe724109b90 0x7fe724075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a170640 1 -- 172.21.15.37:0/779812806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe724109b90 msgr2=0x7fe724075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a170640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe724109b90 0x7fe724075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a170640 1 -- 172.21.15.37:0/779812806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724109240 msgr2=0x7fe7240759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a170640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724109240 0x7fe7240759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.763+0000 7fe72a170640 1 -- 172.21.15.37:0/779812806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7241a83e0 con 0x7fe724103900 2024-08-31T06:45:44.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.764+0000 7fe72a971640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe724109b90 0x7fe724075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.764+0000 7fe72996f640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724109240 0x7fe7240759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.764+0000 7fe72a170640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724103900 0x7fe7240754b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe71400cce0 tx=0x7fe71400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.764+0000 7fe7237fe640 1 -- 172.21.15.37:0/779812806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71400f650 con 0x7fe724103900 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.764+0000 7fe7237fe640 1 -- 172.21.15.37:0/779812806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe71400fc80 con 0x7fe724103900 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.764+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7241a86d0 con 0x7fe724103900 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.764+0000 7fe7237fe640 1 -- 172.21.15.37:0/779812806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714018ae0 con 0x7fe724103900 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.764+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7241a8b60 con 0x7fe724103900 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.766+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe724103d10 con 0x7fe724103900 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.767+0000 7fe7237fe640 1 -- 172.21.15.37:0/779812806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fe714018c80 con 0x7fe724103900 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.768+0000 7fe7237fe640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe70c0b4c10 0x7fe70c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.768+0000 7fe72996f640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe70c0b4c10 0x7fe70c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.768+0000 7fe7237fe640 1 -- 172.21.15.37:0/779812806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe7140e5c00 con 0x7fe724103900 2024-08-31T06:45:44.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.768+0000 7fe72996f640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe70c0b4c10 0x7fe70c0b7120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe724106260 tx=0x7fe718008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:44.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.772+0000 7fe7237fe640 1 -- 172.21.15.37:0/779812806 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe714014030 con 0x7fe724103900 2024-08-31T06:45:44.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.968+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe7240767b0 con 0x7fe724103900 2024-08-31T06:45:44.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.969+0000 7fe7237fe640 1 -- 172.21.15.37:0/779812806 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe7140acb80 con 0x7fe724103900 2024-08-31T06:45:44.970 INFO:teuthology.orchestra.run.smithi037.stdout:158913790008 2024-08-31T06:45:44.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe70c0b4c10 msgr2=0x7fe70c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:44.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe70c0b4c10 0x7fe70c0b7120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe724106260 tx=0x7fe718008040 comp rx=0 tx=0).stop 2024-08-31T06:45:44.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724103900 msgr2=0x7fe7240754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:44.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724103900 0x7fe7240754b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe71400cce0 tx=0x7fe71400a620 comp rx=0 tx=0).stop 2024-08-31T06:45:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 shutdown_connections 2024-08-31T06:45:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe70c0b4c10 0x7fe70c0b7120 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe724109b90 0x7fe724075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe724109240 0x7fe7240759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 --2- 172.21.15.37:0/779812806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe724103900 0x7fe7240754b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 >> 172.21.15.37:0/779812806 conn(0x7fe72407b5f0 msgr2=0x7fe724107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 shutdown_connections 2024-08-31T06:45:44.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:44.971+0000 7fe72c3d4640 1 -- 172.21.15.37:0/779812806 wait complete. 2024-08-31T06:45:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 -- 172.21.15.37:0/347214246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 msgr2=0x7f367c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 --2- 172.21.15.37:0/347214246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 0x7f367c102c10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3678009900 tx=0x7f367802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 -- 172.21.15.37:0/347214246 shutdown_connections 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 --2- 172.21.15.37:0/347214246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c108a90 0x7f367c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 --2- 172.21.15.37:0/347214246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f367c108140 0x7f367c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 --2- 172.21.15.37:0/347214246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 0x7f367c102c10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 -- 172.21.15.37:0/347214246 >> 172.21.15.37:0/347214246 conn(0x7f367c0794d0 msgr2=0x7f367c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 -- 172.21.15.37:0/347214246 shutdown_connections 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.014+0000 7f3684316640 1 -- 172.21.15.37:0/347214246 wait complete. 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f3684316640 1 Processor -- start 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f3684316640 1 -- start start 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f3684316640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 0x7f367c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f3684316640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f367c108140 0x7f367c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f3684316640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c108a90 0x7f367c19f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f3684316640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f367c1125c0 con 0x7f367c102800 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f3684316640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f367c112440 con 0x7f367c108a90 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f3684316640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f367c112740 con 0x7f367c108140 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f36820b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 0x7f367c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f36820b2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 0x7f367c19a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33070/0 (socket says 172.21.15.37:33070) 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f36820b2640 1 -- 172.21.15.37:0/4145283983 learned_addr learned my addr 172.21.15.37:0/4145283983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f36818b1640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f367c108140 0x7f367c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.015+0000 7f36828b3640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c108a90 0x7f367c19f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36820b2640 1 -- 172.21.15.37:0/4145283983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f367c108140 msgr2=0x7f367c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36820b2640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f367c108140 0x7f367c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36820b2640 1 -- 172.21.15.37:0/4145283983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c108a90 msgr2=0x7f367c19f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36820b2640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c108a90 0x7f367c19f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36820b2640 1 -- 172.21.15.37:0/4145283983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367c1a00b0 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36820b2640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 0x7f367c19a140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3678009230 tx=0x7f36780319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36737fe640 1 -- 172.21.15.37:0/4145283983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f367803f030 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367c1a0340 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36737fe640 1 -- 172.21.15.37:0/4145283983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f36780043d0 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f36737fe640 1 -- 172.21.15.37:0/4145283983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3678035070 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.016+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367c109290 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.017+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f367c103a80 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.019+0000 7f36737fe640 1 -- 172.21.15.37:0/4145283983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f3678042030 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.019+0000 7f36737fe640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f36680b4c10 0x7f36680b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.019+0000 7f36818b1640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f36680b4c10 0x7f36680b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.019+0000 7f36737fe640 1 -- 172.21.15.37:0/4145283983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3678105c90 con 0x7f367c102800 2024-08-31T06:45:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.020+0000 7f36818b1640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f36680b4c10 0x7f36680b7120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f367c102190 tx=0x7f366c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.023+0000 7f36737fe640 1 -- 172.21.15.37:0/4145283983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f36780ccb80 con 0x7f367c102800 2024-08-31T06:45:45.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.212+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f367c102c10 con 0x7f367c102800 2024-08-31T06:45:45.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.212+0000 7f36737fe640 1 -- 172.21.15.37:0/4145283983 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f36780cc480 con 0x7f367c102800 2024-08-31T06:45:45.214 INFO:teuthology.orchestra.run.smithi037.stdout:201863462956 2024-08-31T06:45:45.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f36680b4c10 msgr2=0x7f36680b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:45.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f36680b4c10 0x7f36680b7120 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f367c102190 tx=0x7f366c005f90 comp rx=0 tx=0).stop 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 msgr2=0x7f367c19a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 0x7f367c19a140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3678009230 tx=0x7f36780319a0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 shutdown_connections 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f36680b4c10 0x7f36680b7120 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c108a90 0x7f367c19f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f367c108140 0x7f367c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 --2- 172.21.15.37:0/4145283983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f367c102800 0x7f367c19a140 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 >> 172.21.15.37:0/4145283983 conn(0x7f367c0794d0 msgr2=0x7f367c100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 shutdown_connections 2024-08-31T06:45:45.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:45.214+0000 7f3684316640 1 -- 172.21.15.37:0/4145283983 wait complete. 2024-08-31T06:45:45.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:45 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/779812806' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T06:45:45.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:45 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/779812806' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T06:45:45.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:45 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/779812806' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-31T06:45:46.089 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939673 got 270582939678 for osd.10 2024-08-31T06:45:46.090 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:46.310 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:46 smithi037 ceph-mon[18612]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:46.310 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:46 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4145283983' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T06:45:46.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:46 smithi066 ceph-mon[22244]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:46.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:46 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4145283983' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T06:45:46.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:46 smithi106 ceph-mon[22134]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:46.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:46 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4145283983' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-31T06:45:46.689 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790005 got 158913790008 for osd.5 2024-08-31T06:45:46.689 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:47.149 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462952 got 201863462956 for osd.7 2024-08-31T06:45:47.149 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:47.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 -- 172.21.15.37:0/30341467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 msgr2=0x7fb14c107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:47.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 --2- 172.21.15.37:0/30341467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 0x7fb14c107470 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009930 tx=0x7fb13c02a420 comp rx=0 tx=0).stop 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 -- 172.21.15.37:0/30341467 shutdown_connections 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 --2- 172.21.15.37:0/30341467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 0x7fb14c107470 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 --2- 172.21.15.37:0/30341467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14c107a30 0x7fb14c107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 --2- 172.21.15.37:0/30341467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb14c1025f0 0x7fb14c102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 -- 172.21.15.37:0/30341467 >> 172.21.15.37:0/30341467 conn(0x7fb14c079470 msgr2=0x7fb14c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 -- 172.21.15.37:0/30341467 shutdown_connections 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.666+0000 7fb1539ab640 1 -- 172.21.15.37:0/30341467 wait complete. 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb1539ab640 1 Processor -- start 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb1539ab640 1 -- start start 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb1539ab640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb14c1025f0 0x7fb14c1a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb1539ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 0x7fb14c1a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb1539ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14c107a30 0x7fb14c1a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:47.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb1539ab640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c119d80 con 0x7fb14c102f40 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb1539ab640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c119c00 con 0x7fb14c107a30 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb1539ab640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c119f00 con 0x7fb14c1025f0 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb150f46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 0x7fb14c1a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb150f46640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 0x7fb14c1a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33086/0 (socket says 172.21.15.37:33086) 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb150f46640 1 -- 172.21.15.37:0/3493200875 learned_addr learned my addr 172.21.15.37:0/3493200875 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb151747640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb14c1025f0 0x7fb14c1a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb151f48640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14c107a30 0x7fb14c1a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb150f46640 1 -- 172.21.15.37:0/3493200875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb14c1025f0 msgr2=0x7fb14c1a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb150f46640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb14c1025f0 0x7fb14c1a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb150f46640 1 -- 172.21.15.37:0/3493200875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14c107a30 msgr2=0x7fb14c1a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb150f46640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14c107a30 0x7fb14c1a6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.667+0000 7fb150f46640 1 -- 172.21.15.37:0/3493200875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c1a66e0 con 0x7fb14c102f40 2024-08-31T06:45:47.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.668+0000 7fb150f46640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 0x7fb14c1a0dd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb13c005940 tx=0x7fb13c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.668+0000 7fb1427fc640 1 -- 172.21.15.37:0/3493200875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c03f030 con 0x7fb14c102f40 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.668+0000 7fb1427fc640 1 -- 172.21.15.37:0/3493200875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb13c003c90 con 0x7fb14c102f40 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.668+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c1a6970 con 0x7fb14c102f40 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.668+0000 7fb1427fc640 1 -- 172.21.15.37:0/3493200875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c035070 con 0x7fb14c102f40 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.668+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c1a6e50 con 0x7fb14c102f40 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.669+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c107470 con 0x7fb14c102f40 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.670+0000 7fb1427fc640 1 -- 172.21.15.37:0/3493200875 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fb13c042030 con 0x7fb14c102f40 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.671+0000 7fb1427fc640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1380b4c40 0x7fb1380b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.671+0000 7fb151747640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1380b4c40 0x7fb1380b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.671+0000 7fb1427fc640 1 -- 172.21.15.37:0/3493200875 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb13c105900 con 0x7fb14c102f40 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.672+0000 7fb151747640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1380b4c40 0x7fb1380b7150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb1480058c0 tx=0x7fb14800a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:47.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.676+0000 7fb1427fc640 1 -- 172.21.15.37:0/3493200875 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb13c0cc7f0 con 0x7fb14c102f40 2024-08-31T06:45:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.862+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb14c1ad2b0 con 0x7fb14c102f40 2024-08-31T06:45:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.863+0000 7fb1427fc640 1 -- 172.21.15.37:0/3493200875 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb13c0cc0f0 con 0x7fb14c102f40 2024-08-31T06:45:47.864 INFO:teuthology.orchestra.run.smithi037.stdout:227633266730 2024-08-31T06:45:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1380b4c40 msgr2=0x7fb1380b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1380b4c40 0x7fb1380b7150 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb1480058c0 tx=0x7fb14800a250 comp rx=0 tx=0).stop 2024-08-31T06:45:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 msgr2=0x7fb14c1a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 0x7fb14c1a0dd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb13c005940 tx=0x7fb13c0042f0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 shutdown_connections 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1380b4c40 0x7fb1380b7150 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb14c102f40 0x7fb14c1a0dd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb14c107a30 0x7fb14c1a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 --2- 172.21.15.37:0/3493200875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb14c1025f0 0x7fb14c1a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 >> 172.21.15.37:0/3493200875 conn(0x7fb14c079470 msgr2=0x7fb14c105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 shutdown_connections 2024-08-31T06:45:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:47.865+0000 7fb1539ab640 1 -- 172.21.15.37:0/3493200875 wait complete. 2024-08-31T06:45:48.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:48 smithi037 ceph-mon[18612]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:45:48.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:48 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3493200875' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T06:45:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:48 smithi066 ceph-mon[22244]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:45:48.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:48 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3493200875' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T06:45:48.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:48 smithi106 ceph-mon[22134]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:45:48.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:48 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3493200875' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-31T06:45:48.811 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266726 got 227633266730 for osd.8 2024-08-31T06:45:48.812 DEBUG:teuthology.parallel:result is None 2024-08-31T06:45:48.812 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T06:45:48.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:45:49.079 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.526+0000 7f79ec14c640 1 -- 172.21.15.37:0/112349887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e4104650 msgr2=0x7f79e4104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.526+0000 7f79ec14c640 1 --2- 172.21.15.37:0/112349887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e4104650 0x7f79e4104a60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009be0 tx=0x7f79e002a6c0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.526+0000 7f79ec14c640 1 -- 172.21.15.37:0/112349887 shutdown_connections 2024-08-31T06:45:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.526+0000 7f79ec14c640 1 --2- 172.21.15.37:0/112349887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79e410dc00 0x7f79e41100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.526+0000 7f79ec14c640 1 --2- 172.21.15.37:0/112349887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e4105080 0x7f79e410d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.526+0000 7f79ec14c640 1 --2- 172.21.15.37:0/112349887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e4104650 0x7f79e4104a60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.526+0000 7f79ec14c640 1 -- 172.21.15.37:0/112349887 >> 172.21.15.37:0/112349887 conn(0x7f79e40794f0 msgr2=0x7f79e4079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.527+0000 7f79ec14c640 1 -- 172.21.15.37:0/112349887 shutdown_connections 2024-08-31T06:45:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.527+0000 7f79ec14c640 1 -- 172.21.15.37:0/112349887 wait complete. 2024-08-31T06:45:49.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.527+0000 7f79ec14c640 1 Processor -- start 2024-08-31T06:45:49.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.527+0000 7f79ec14c640 1 -- start start 2024-08-31T06:45:49.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ec14c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79e4104650 0x7f79e419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:49.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ec14c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e4105080 0x7f79e419a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ec14c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e410dc00 0x7f79e419fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ec14c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41136f0 con 0x7f79e410dc00 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ec14c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4113570 con 0x7f79e4105080 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ec14c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4113870 con 0x7f79e4104650 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ea6e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e410dc00 0x7f79e419fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ea6e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e410dc00 0x7f79e419fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33096/0 (socket says 172.21.15.37:33096) 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ea6e9640 1 -- 172.21.15.37:0/67814627 learned_addr learned my addr 172.21.15.37:0/67814627 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79e9ee8640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79e4104650 0x7f79e419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79e96e7640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e4105080 0x7f79e419a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ea6e9640 1 -- 172.21.15.37:0/67814627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79e4104650 msgr2=0x7f79e419a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ea6e9640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79e4104650 0x7f79e419a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ea6e9640 1 -- 172.21.15.37:0/67814627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e4105080 msgr2=0x7f79e419a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:49.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ea6e9640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e4105080 0x7f79e419a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79ea6e9640 1 -- 172.21.15.37:0/67814627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e41a0130 con 0x7f79e410dc00 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.528+0000 7f79e96e7640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e4105080 0x7f79e419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.529+0000 7f79ea6e9640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e410dc00 0x7f79e419fa00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e970 tx=0x7f79dc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.529+0000 7f79daffd640 1 -- 172.21.15.37:0/67814627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00ccc0 con 0x7f79e410dc00 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.529+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e41a0420 con 0x7f79e410dc00 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.529+0000 7f79daffd640 1 -- 172.21.15.37:0/67814627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79dc00ce60 con 0x7f79e410dc00 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.529+0000 7f79daffd640 1 -- 172.21.15.37:0/67814627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc010430 con 0x7f79e410dc00 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.529+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e41a6b80 con 0x7f79e410dc00 2024-08-31T06:45:49.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.530+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e406bf80 con 0x7f79e410dc00 2024-08-31T06:45:49.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.533+0000 7f79daffd640 1 -- 172.21.15.37:0/67814627 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f79dc004ef0 con 0x7f79e410dc00 2024-08-31T06:45:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.533+0000 7f79daffd640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79d00b4c10 0x7f79d00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.533+0000 7f79e9ee8640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79d00b4c10 0x7f79d00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:49.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.533+0000 7f79daffd640 1 -- 172.21.15.37:0/67814627 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f79dc0e5a90 con 0x7f79e410dc00 2024-08-31T06:45:49.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.534+0000 7f79e9ee8640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79d00b4c10 0x7f79d00b7120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79e0006010 tx=0x7f79e0031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:49.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.537+0000 7f79daffd640 1 -- 172.21.15.37:0/67814627 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f79dc056130 con 0x7f79e410dc00 2024-08-31T06:45:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.740+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79e40635a0 con 0x7f79d00b4c10 2024-08-31T06:45:49.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.745+0000 7f79daffd640 1 -- 172.21.15.37:0/67814627 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258709 (secure 0 0 0) 0x7f79e40635a0 con 0x7f79d00b4c10 2024-08-31T06:45:49.748 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:45:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79d00b4c10 msgr2=0x7f79d00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79d00b4c10 0x7f79d00b7120 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79e0006010 tx=0x7f79e0031000 comp rx=0 tx=0).stop 2024-08-31T06:45:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e410dc00 msgr2=0x7f79e419fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e410dc00 0x7f79e419fa00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00e970 tx=0x7f79dc00ed70 comp rx=0 tx=0).stop 2024-08-31T06:45:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 shutdown_connections 2024-08-31T06:45:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f79d00b4c10 0x7f79d00b7120 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e410dc00 0x7f79e419fa00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79e4105080 0x7f79e419a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 --2- 172.21.15.37:0/67814627 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79e4104650 0x7f79e419a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 >> 172.21.15.37:0/67814627 conn(0x7f79e40794f0 msgr2=0x7f79e4100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 shutdown_connections 2024-08-31T06:45:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:49.748+0000 7f79ec14c640 1 -- 172.21.15.37:0/67814627 wait complete. 2024-08-31T06:45:50.258 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:50 smithi037 ceph-mon[18612]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:45:50.258 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:50.258 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:50 smithi066 ceph-mon[22244]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:45:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:50.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:50.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:50 smithi106 ceph-mon[22134]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:45:50.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:50.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:50.578 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-08-31T06:45:48.260198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654756,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":428,"num_read_kb":312,"num_write":288,"num_write_kb":2262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361180,"kb_used_data":11868,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580644,"statfs":{"total":1151940427776,"available":1151570579456,"internally_reserved":0,"allocated":12152832,"data_stored":6868716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003722"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.746064+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:45:19.746064+0000","last_peered":"2024-08-31T06:45:19.746064+0000","last_clean":"2024-08-31T06:45:19.746064+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:45:19.746064+0000","last_undegraded":"2024-08-31T06:45:19.746064+0000","last_fullsized":"2024-08-31T06:45:19.746064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753581+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:45:19.753581+0000","last_peered":"2024-08-31T06:45:19.753581+0000","last_clean":"2024-08-31T06:45:19.753581+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:45:19.753581+0000","last_undegraded":"2024-08-31T06:45:19.753581+0000","last_fullsized":"2024-08-31T06:45:19.753581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753102+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:45:19.753102+0000","last_peered":"2024-08-31T06:45:19.753102+0000","last_clean":"2024-08-31T06:45:19.753102+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:45:19.753102+0000","last_undegraded":"2024-08-31T06:45:19.753102+0000","last_fullsized":"2024-08-31T06:45:19.753102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940933+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:45:19.940933+0000","last_peered":"2024-08-31T06:45:19.940933+0000","last_clean":"2024-08-31T06:45:19.940933+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:45:19.940933+0000","last_undegraded":"2024-08-31T06:45:19.940933+0000","last_fullsized":"2024-08-31T06:45:19.940933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748810+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:45:19.748810+0000","last_peered":"2024-08-31T06:45:19.748810+0000","last_clean":"2024-08-31T06:45:19.748810+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:45:19.748810+0000","last_undegraded":"2024-08-31T06:45:19.748810+0000","last_fullsized":"2024-08-31T06:45:19.748810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756818+0000","last_change":"2024-08-31T06:45:19.756707+0000","last_active":"2024-08-31T06:45:19.756818+0000","last_peered":"2024-08-31T06:45:19.756818+0000","last_clean":"2024-08-31T06:45:19.756818+0000","last_became_active":"2024-08-31T06:45:19.756086+0000","last_became_peered":"2024-08-31T06:45:19.756086+0000","last_unstale":"2024-08-31T06:45:19.756818+0000","last_undegraded":"2024-08-31T06:45:19.756818+0000","last_fullsized":"2024-08-31T06:45:19.756818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:44:24.147502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752598+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:45:19.752598+0000","last_peered":"2024-08-31T06:45:19.752598+0000","last_clean":"2024-08-31T06:45:19.752598+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:45:19.752598+0000","last_undegraded":"2024-08-31T06:45:19.752598+0000","last_fullsized":"2024-08-31T06:45:19.752598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939347+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:45:19.939347+0000","last_peered":"2024-08-31T06:45:19.939347+0000","last_clean":"2024-08-31T06:45:19.939347+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:45:19.939347+0000","last_undegraded":"2024-08-31T06:45:19.939347+0000","last_fullsized":"2024-08-31T06:45:19.939347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.750694+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:45:19.750694+0000","last_peered":"2024-08-31T06:45:19.750694+0000","last_clean":"2024-08-31T06:45:19.750694+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:45:19.750694+0000","last_undegraded":"2024-08-31T06:45:19.750694+0000","last_fullsized":"2024-08-31T06:45:19.750694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749739+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:45:19.749739+0000","last_peered":"2024-08-31T06:45:19.749739+0000","last_clean":"2024-08-31T06:45:19.749739+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:45:19.749739+0000","last_undegraded":"2024-08-31T06:45:19.749739+0000","last_fullsized":"2024-08-31T06:45:19.749739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753219+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:45:19.753219+0000","last_peered":"2024-08-31T06:45:19.753219+0000","last_clean":"2024-08-31T06:45:19.753219+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:45:19.753219+0000","last_undegraded":"2024-08-31T06:45:19.753219+0000","last_fullsized":"2024-08-31T06:45:19.753219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940867+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:45:19.940867+0000","last_peered":"2024-08-31T06:45:19.940867+0000","last_clean":"2024-08-31T06:45:19.940867+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:45:19.940867+0000","last_undegraded":"2024-08-31T06:45:19.940867+0000","last_fullsized":"2024-08-31T06:45:19.940867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940480+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:45:19.940480+0000","last_peered":"2024-08-31T06:45:19.940480+0000","last_clean":"2024-08-31T06:45:19.940480+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:45:19.940480+0000","last_undegraded":"2024-08-31T06:45:19.940480+0000","last_fullsized":"2024-08-31T06:45:19.940480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752521+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:45:19.752521+0000","last_peered":"2024-08-31T06:45:19.752521+0000","last_clean":"2024-08-31T06:45:19.752521+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:45:19.752521+0000","last_undegraded":"2024-08-31T06:45:19.752521+0000","last_fullsized":"2024-08-31T06:45:19.752521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751681+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:45:19.751681+0000","last_peered":"2024-08-31T06:45:19.751681+0000","last_clean":"2024-08-31T06:45:19.751681+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:45:19.751681+0000","last_undegraded":"2024-08-31T06:45:19.751681+0000","last_fullsized":"2024-08-31T06:45:19.751681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748985+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:45:19.748985+0000","last_peered":"2024-08-31T06:45:19.748985+0000","last_clean":"2024-08-31T06:45:19.748985+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:45:19.748985+0000","last_undegraded":"2024-08-31T06:45:19.748985+0000","last_fullsized":"2024-08-31T06:45:19.748985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.746100+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:45:19.746100+0000","last_peered":"2024-08-31T06:45:19.746100+0000","last_clean":"2024-08-31T06:45:19.746100+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:45:19.746100+0000","last_undegraded":"2024-08-31T06:45:19.746100+0000","last_fullsized":"2024-08-31T06:45:19.746100+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756255+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:45:19.756255+0000","last_peered":"2024-08-31T06:45:19.756255+0000","last_clean":"2024-08-31T06:45:19.756255+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:45:19.756255+0000","last_undegraded":"2024-08-31T06:45:19.756255+0000","last_fullsized":"2024-08-31T06:45:19.756255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752176+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:45:19.752176+0000","last_peered":"2024-08-31T06:45:19.752176+0000","last_clean":"2024-08-31T06:45:19.752176+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:45:19.752176+0000","last_undegraded":"2024-08-31T06:45:19.752176+0000","last_fullsized":"2024-08-31T06:45:19.752176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.745517+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:45:19.745517+0000","last_peered":"2024-08-31T06:45:19.745517+0000","last_clean":"2024-08-31T06:45:19.745517+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:45:19.745517+0000","last_undegraded":"2024-08-31T06:45:19.745517+0000","last_fullsized":"2024-08-31T06:45:19.745517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940504+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:45:19.940504+0000","last_peered":"2024-08-31T06:45:19.940504+0000","last_clean":"2024-08-31T06:45:19.940504+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:45:19.940504+0000","last_undegraded":"2024-08-31T06:45:19.940504+0000","last_fullsized":"2024-08-31T06:45:19.940504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749706+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:45:19.749706+0000","last_peered":"2024-08-31T06:45:19.749706+0000","last_clean":"2024-08-31T06:45:19.749706+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:45:19.749706+0000","last_undegraded":"2024-08-31T06:45:19.749706+0000","last_fullsized":"2024-08-31T06:45:19.749706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939293+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:45:19.939293+0000","last_peered":"2024-08-31T06:45:19.939293+0000","last_clean":"2024-08-31T06:45:19.939293+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:45:19.939293+0000","last_undegraded":"2024-08-31T06:45:19.939293+0000","last_fullsized":"2024-08-31T06:45:19.939293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748158+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:45:19.748158+0000","last_peered":"2024-08-31T06:45:19.748158+0000","last_clean":"2024-08-31T06:45:19.748158+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:45:19.748158+0000","last_undegraded":"2024-08-31T06:45:19.748158+0000","last_fullsized":"2024-08-31T06:45:19.748158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939641+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:45:19.939641+0000","last_peered":"2024-08-31T06:45:19.939641+0000","last_clean":"2024-08-31T06:45:19.939641+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:45:19.939641+0000","last_undegraded":"2024-08-31T06:45:19.939641+0000","last_fullsized":"2024-08-31T06:45:19.939641+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752402+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:45:19.752402+0000","last_peered":"2024-08-31T06:45:19.752402+0000","last_clean":"2024-08-31T06:45:19.752402+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:45:19.752402+0000","last_undegraded":"2024-08-31T06:45:19.752402+0000","last_fullsized":"2024-08-31T06:45:19.752402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.745835+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:45:19.745835+0000","last_peered":"2024-08-31T06:45:19.745835+0000","last_clean":"2024-08-31T06:45:19.745835+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:45:19.745835+0000","last_undegraded":"2024-08-31T06:45:19.745835+0000","last_fullsized":"2024-08-31T06:45:19.745835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940509+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:45:19.940509+0000","last_peered":"2024-08-31T06:45:19.940509+0000","last_clean":"2024-08-31T06:45:19.940509+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:45:19.940509+0000","last_undegraded":"2024-08-31T06:45:19.940509+0000","last_fullsized":"2024-08-31T06:45:19.940509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753102+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:45:19.753102+0000","last_peered":"2024-08-31T06:45:19.753102+0000","last_clean":"2024-08-31T06:45:19.753102+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:45:19.753102+0000","last_undegraded":"2024-08-31T06:45:19.753102+0000","last_fullsized":"2024-08-31T06:45:19.753102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751615+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:45:19.751615+0000","last_peered":"2024-08-31T06:45:19.751615+0000","last_clean":"2024-08-31T06:45:19.751615+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:45:19.751615+0000","last_undegraded":"2024-08-31T06:45:19.751615+0000","last_fullsized":"2024-08-31T06:45:19.751615+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751880+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:45:19.751880+0000","last_peered":"2024-08-31T06:45:19.751880+0000","last_clean":"2024-08-31T06:45:19.751880+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:45:19.751880+0000","last_undegraded":"2024-08-31T06:45:19.751880+0000","last_fullsized":"2024-08-31T06:45:19.751880+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754662+0000","last_change":"2024-08-31T06:45:19.754501+0000","last_active":"2024-08-31T06:45:19.754662+0000","last_peered":"2024-08-31T06:45:19.754662+0000","last_clean":"2024-08-31T06:45:19.754662+0000","last_became_active":"2024-08-31T06:45:19.754085+0000","last_became_peered":"2024-08-31T06:45:19.754085+0000","last_unstale":"2024-08-31T06:45:19.754662+0000","last_undegraded":"2024-08-31T06:45:19.754662+0000","last_fullsized":"2024-08-31T06:45:19.754662+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:50:04.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748306+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:45:19.748306+0000","last_peered":"2024-08-31T06:45:19.748306+0000","last_clean":"2024-08-31T06:45:19.748306+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:45:19.748306+0000","last_undegraded":"2024-08-31T06:45:19.748306+0000","last_fullsized":"2024-08-31T06:45:19.748306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:45.987793+0000","last_change":"2024-08-31T06:45:19.947200+0000","last_active":"2024-08-31T06:45:45.987793+0000","last_peered":"2024-08-31T06:45:45.987793+0000","last_clean":"2024-08-31T06:45:45.987793+0000","last_became_active":"2024-08-31T06:45:19.942294+0000","last_became_peered":"2024-08-31T06:45:19.942294+0000","last_unstale":"2024-08-31T06:45:45.987793+0000","last_undegraded":"2024-08-31T06:45:45.987793+0000","last_fullsized":"2024-08-31T06:45:45.987793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:40.241862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.942200+0000","last_change":"2024-08-31T06:45:19.942081+0000","last_active":"2024-08-31T06:45:19.942200+0000","last_peered":"2024-08-31T06:45:19.942200+0000","last_clean":"2024-08-31T06:45:19.942200+0000","last_became_active":"2024-08-31T06:45:19.941427+0000","last_became_peered":"2024-08-31T06:45:19.941427+0000","last_unstale":"2024-08-31T06:45:19.942200+0000","last_undegraded":"2024-08-31T06:45:19.942200+0000","last_fullsized":"2024-08-31T06:45:19.942200+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:47.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749301+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:45:19.749301+0000","last_peered":"2024-08-31T06:45:19.749301+0000","last_clean":"2024-08-31T06:45:19.749301+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:45:19.749301+0000","last_undegraded":"2024-08-31T06:45:19.749301+0000","last_fullsized":"2024-08-31T06:45:19.749301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940290+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:45:19.940290+0000","last_peered":"2024-08-31T06:45:19.940290+0000","last_clean":"2024-08-31T06:45:19.940290+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:45:19.940290+0000","last_undegraded":"2024-08-31T06:45:19.940290+0000","last_fullsized":"2024-08-31T06:45:19.940290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939415+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:45:19.939415+0000","last_peered":"2024-08-31T06:45:19.939415+0000","last_clean":"2024-08-31T06:45:19.939415+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:45:19.939415+0000","last_undegraded":"2024-08-31T06:45:19.939415+0000","last_fullsized":"2024-08-31T06:45:19.939415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748301+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:45:19.748301+0000","last_peered":"2024-08-31T06:45:19.748301+0000","last_clean":"2024-08-31T06:45:19.748301+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:45:19.748301+0000","last_undegraded":"2024-08-31T06:45:19.748301+0000","last_fullsized":"2024-08-31T06:45:19.748301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753676+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:45:19.753676+0000","last_peered":"2024-08-31T06:45:19.753676+0000","last_clean":"2024-08-31T06:45:19.753676+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:45:19.753676+0000","last_undegraded":"2024-08-31T06:45:19.753676+0000","last_fullsized":"2024-08-31T06:45:19.753676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:44.985119+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:45:44.985119+0000","last_peered":"2024-08-31T06:45:44.985119+0000","last_clean":"2024-08-31T06:45:44.985119+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:45:44.985119+0000","last_undegraded":"2024-08-31T06:45:44.985119+0000","last_fullsized":"2024-08-31T06:45:44.985119+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.750831+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:45:19.750831+0000","last_peered":"2024-08-31T06:45:19.750831+0000","last_clean":"2024-08-31T06:45:19.750831+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:45:19.750831+0000","last_undegraded":"2024-08-31T06:45:19.750831+0000","last_fullsized":"2024-08-31T06:45:19.750831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753069+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:45:19.753069+0000","last_peered":"2024-08-31T06:45:19.753069+0000","last_clean":"2024-08-31T06:45:19.753069+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:45:19.753069+0000","last_undegraded":"2024-08-31T06:45:19.753069+0000","last_fullsized":"2024-08-31T06:45:19.753069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753432+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:45:19.753432+0000","last_peered":"2024-08-31T06:45:19.753432+0000","last_clean":"2024-08-31T06:45:19.753432+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:45:19.753432+0000","last_undegraded":"2024-08-31T06:45:19.753432+0000","last_fullsized":"2024-08-31T06:45:19.753432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748845+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:45:19.748845+0000","last_peered":"2024-08-31T06:45:19.748845+0000","last_clean":"2024-08-31T06:45:19.748845+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:45:19.748845+0000","last_undegraded":"2024-08-31T06:45:19.748845+0000","last_fullsized":"2024-08-31T06:45:19.748845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748704+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:45:19.748704+0000","last_peered":"2024-08-31T06:45:19.748704+0000","last_clean":"2024-08-31T06:45:19.748704+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:45:19.748704+0000","last_undegraded":"2024-08-31T06:45:19.748704+0000","last_fullsized":"2024-08-31T06:45:19.748704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'28","reported_seq":168,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:45.986932+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:45:45.986932+0000","last_peered":"2024-08-31T06:45:45.986932+0000","last_clean":"2024-08-31T06:45:45.986932+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:45:45.986932+0000","last_undegraded":"2024-08-31T06:45:45.986932+0000","last_fullsized":"2024-08-31T06:45:45.986932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749286+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:45:19.749286+0000","last_peered":"2024-08-31T06:45:19.749286+0000","last_clean":"2024-08-31T06:45:19.749286+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:45:19.749286+0000","last_undegraded":"2024-08-31T06:45:19.749286+0000","last_fullsized":"2024-08-31T06:45:19.749286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752795+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:45:19.752795+0000","last_peered":"2024-08-31T06:45:19.752795+0000","last_clean":"2024-08-31T06:45:19.752795+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:45:19.752795+0000","last_undegraded":"2024-08-31T06:45:19.752795+0000","last_fullsized":"2024-08-31T06:45:19.752795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940209+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:45:19.940209+0000","last_peered":"2024-08-31T06:45:19.940209+0000","last_clean":"2024-08-31T06:45:19.940209+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:45:19.940209+0000","last_undegraded":"2024-08-31T06:45:19.940209+0000","last_fullsized":"2024-08-31T06:45:19.940209+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748495+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:45:19.748495+0000","last_peered":"2024-08-31T06:45:19.748495+0000","last_clean":"2024-08-31T06:45:19.748495+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:45:19.748495+0000","last_undegraded":"2024-08-31T06:45:19.748495+0000","last_fullsized":"2024-08-31T06:45:19.748495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752721+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:45:19.752721+0000","last_peered":"2024-08-31T06:45:19.752721+0000","last_clean":"2024-08-31T06:45:19.752721+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:45:19.752721+0000","last_undegraded":"2024-08-31T06:45:19.752721+0000","last_fullsized":"2024-08-31T06:45:19.752721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":85,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:45.759161+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:45:45.759161+0000","last_peered":"2024-08-31T06:45:45.759161+0000","last_clean":"2024-08-31T06:45:45.759161+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:45:45.759161+0000","last_undegraded":"2024-08-31T06:45:45.759161+0000","last_fullsized":"2024-08-31T06:45:45.759161+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752901+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:45:19.752901+0000","last_peered":"2024-08-31T06:45:19.752901+0000","last_clean":"2024-08-31T06:45:19.752901+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:45:19.752901+0000","last_undegraded":"2024-08-31T06:45:19.752901+0000","last_fullsized":"2024-08-31T06:45:19.752901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748696+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:45:19.748696+0000","last_peered":"2024-08-31T06:45:19.748696+0000","last_clean":"2024-08-31T06:45:19.748696+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:45:19.748696+0000","last_undegraded":"2024-08-31T06:45:19.748696+0000","last_fullsized":"2024-08-31T06:45:19.748696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748334+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:45:19.748334+0000","last_peered":"2024-08-31T06:45:19.748334+0000","last_clean":"2024-08-31T06:45:19.748334+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:45:19.748334+0000","last_undegraded":"2024-08-31T06:45:19.748334+0000","last_fullsized":"2024-08-31T06:45:19.748334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749698+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:45:19.749698+0000","last_peered":"2024-08-31T06:45:19.749698+0000","last_clean":"2024-08-31T06:45:19.749698+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:45:19.749698+0000","last_undegraded":"2024-08-31T06:45:19.749698+0000","last_fullsized":"2024-08-31T06:45:19.749698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941672+0000","last_change":"2024-08-31T06:45:19.941511+0000","last_active":"2024-08-31T06:45:19.941672+0000","last_peered":"2024-08-31T06:45:19.941672+0000","last_clean":"2024-08-31T06:45:19.941672+0000","last_became_active":"2024-08-31T06:45:19.940991+0000","last_became_peered":"2024-08-31T06:45:19.940991+0000","last_unstale":"2024-08-31T06:45:19.941672+0000","last_undegraded":"2024-08-31T06:45:19.941672+0000","last_fullsized":"2024-08-31T06:45:19.941672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:25.268854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940677+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:45:19.940677+0000","last_peered":"2024-08-31T06:45:19.940677+0000","last_clean":"2024-08-31T06:45:19.940677+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:45:19.940677+0000","last_undegraded":"2024-08-31T06:45:19.940677+0000","last_fullsized":"2024-08-31T06:45:19.940677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753225+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:45:19.753225+0000","last_peered":"2024-08-31T06:45:19.753225+0000","last_clean":"2024-08-31T06:45:19.753225+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:45:19.753225+0000","last_undegraded":"2024-08-31T06:45:19.753225+0000","last_fullsized":"2024-08-31T06:45:19.753225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748981+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:45:19.748981+0000","last_peered":"2024-08-31T06:45:19.748981+0000","last_clean":"2024-08-31T06:45:19.748981+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:45:19.748981+0000","last_undegraded":"2024-08-31T06:45:19.748981+0000","last_fullsized":"2024-08-31T06:45:19.748981+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752838+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:45:19.752838+0000","last_peered":"2024-08-31T06:45:19.752838+0000","last_clean":"2024-08-31T06:45:19.752838+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:45:19.752838+0000","last_undegraded":"2024-08-31T06:45:19.752838+0000","last_fullsized":"2024-08-31T06:45:19.752838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753167+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:45:19.753167+0000","last_peered":"2024-08-31T06:45:19.753167+0000","last_clean":"2024-08-31T06:45:19.753167+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:45:19.753167+0000","last_undegraded":"2024-08-31T06:45:19.753167+0000","last_fullsized":"2024-08-31T06:45:19.753167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753378+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:45:19.753378+0000","last_peered":"2024-08-31T06:45:19.753378+0000","last_clean":"2024-08-31T06:45:19.753378+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:45:19.753378+0000","last_undegraded":"2024-08-31T06:45:19.753378+0000","last_fullsized":"2024-08-31T06:45:19.753378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753410+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:45:19.753410+0000","last_peered":"2024-08-31T06:45:19.753410+0000","last_clean":"2024-08-31T06:45:19.753410+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:45:19.753410+0000","last_undegraded":"2024-08-31T06:45:19.753410+0000","last_fullsized":"2024-08-31T06:45:19.753410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941116+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:45:19.941116+0000","last_peered":"2024-08-31T06:45:19.941116+0000","last_clean":"2024-08-31T06:45:19.941116+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:45:19.941116+0000","last_undegraded":"2024-08-31T06:45:19.941116+0000","last_fullsized":"2024-08-31T06:45:19.941116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939492+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:45:19.939492+0000","last_peered":"2024-08-31T06:45:19.939492+0000","last_clean":"2024-08-31T06:45:19.939492+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:45:19.939492+0000","last_undegraded":"2024-08-31T06:45:19.939492+0000","last_fullsized":"2024-08-31T06:45:19.939492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753142+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:45:19.753142+0000","last_peered":"2024-08-31T06:45:19.753142+0000","last_clean":"2024-08-31T06:45:19.753142+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:45:19.753142+0000","last_undegraded":"2024-08-31T06:45:19.753142+0000","last_fullsized":"2024-08-31T06:45:19.753142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940176+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:45:19.940176+0000","last_peered":"2024-08-31T06:45:19.940176+0000","last_clean":"2024-08-31T06:45:19.940176+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:45:19.940176+0000","last_undegraded":"2024-08-31T06:45:19.940176+0000","last_fullsized":"2024-08-31T06:45:19.940176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:43.755359+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:45:43.755359+0000","last_peered":"2024-08-31T06:45:43.755359+0000","last_clean":"2024-08-31T06:45:43.755359+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:45:43.755359+0000","last_undegraded":"2024-08-31T06:45:43.755359+0000","last_fullsized":"2024-08-31T06:45:43.755359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748160+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:45:19.748160+0000","last_peered":"2024-08-31T06:45:19.748160+0000","last_clean":"2024-08-31T06:45:19.748160+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:45:19.748160+0000","last_undegraded":"2024-08-31T06:45:19.748160+0000","last_fullsized":"2024-08-31T06:45:19.748160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753337+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:45:19.753337+0000","last_peered":"2024-08-31T06:45:19.753337+0000","last_clean":"2024-08-31T06:45:19.753337+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:45:19.753337+0000","last_undegraded":"2024-08-31T06:45:19.753337+0000","last_fullsized":"2024-08-31T06:45:19.753337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.759702+0000","last_change":"2024-08-31T06:45:19.759585+0000","last_active":"2024-08-31T06:45:19.759702+0000","last_peered":"2024-08-31T06:45:19.759702+0000","last_clean":"2024-08-31T06:45:19.759702+0000","last_became_active":"2024-08-31T06:45:19.759026+0000","last_became_peered":"2024-08-31T06:45:19.759026+0000","last_unstale":"2024-08-31T06:45:19.759702+0000","last_undegraded":"2024-08-31T06:45:19.759702+0000","last_fullsized":"2024-08-31T06:45:19.759702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:54.716259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754330+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:45:19.754330+0000","last_peered":"2024-08-31T06:45:19.754330+0000","last_clean":"2024-08-31T06:45:19.754330+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:45:19.754330+0000","last_undegraded":"2024-08-31T06:45:19.754330+0000","last_fullsized":"2024-08-31T06:45:19.754330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748638+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:45:19.748638+0000","last_peered":"2024-08-31T06:45:19.748638+0000","last_clean":"2024-08-31T06:45:19.748638+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:45:19.748638+0000","last_undegraded":"2024-08-31T06:45:19.748638+0000","last_fullsized":"2024-08-31T06:45:19.748638+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749624+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:45:19.749624+0000","last_peered":"2024-08-31T06:45:19.749624+0000","last_clean":"2024-08-31T06:45:19.749624+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:45:19.749624+0000","last_undegraded":"2024-08-31T06:45:19.749624+0000","last_fullsized":"2024-08-31T06:45:19.749624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940565+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:45:19.940565+0000","last_peered":"2024-08-31T06:45:19.940565+0000","last_clean":"2024-08-31T06:45:19.940565+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:45:19.940565+0000","last_undegraded":"2024-08-31T06:45:19.940565+0000","last_fullsized":"2024-08-31T06:45:19.940565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'11","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756363+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:45:19.756363+0000","last_peered":"2024-08-31T06:45:19.756363+0000","last_clean":"2024-08-31T06:45:19.756363+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:45:19.756363+0000","last_undegraded":"2024-08-31T06:45:19.756363+0000","last_fullsized":"2024-08-31T06:45:19.756363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939664+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:45:19.939664+0000","last_peered":"2024-08-31T06:45:19.939664+0000","last_clean":"2024-08-31T06:45:19.939664+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:45:19.939664+0000","last_undegraded":"2024-08-31T06:45:19.939664+0000","last_fullsized":"2024-08-31T06:45:19.939664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941154+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:45:19.941154+0000","last_peered":"2024-08-31T06:45:19.941154+0000","last_clean":"2024-08-31T06:45:19.941154+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:45:19.941154+0000","last_undegraded":"2024-08-31T06:45:19.941154+0000","last_fullsized":"2024-08-31T06:45:19.941154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.942552+0000","last_change":"2024-08-31T06:45:19.942466+0000","last_active":"2024-08-31T06:45:19.942552+0000","last_peered":"2024-08-31T06:45:19.942552+0000","last_clean":"2024-08-31T06:45:19.942552+0000","last_became_active":"2024-08-31T06:45:19.941936+0000","last_became_peered":"2024-08-31T06:45:19.941936+0000","last_unstale":"2024-08-31T06:45:19.942552+0000","last_undegraded":"2024-08-31T06:45:19.942552+0000","last_fullsized":"2024-08-31T06:45:19.942552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:25.406883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.761034+0000","last_change":"2024-08-31T06:45:19.760954+0000","last_active":"2024-08-31T06:45:19.761034+0000","last_peered":"2024-08-31T06:45:19.761034+0000","last_clean":"2024-08-31T06:45:19.761034+0000","last_became_active":"2024-08-31T06:45:19.754797+0000","last_became_peered":"2024-08-31T06:45:19.754797+0000","last_unstale":"2024-08-31T06:45:19.761034+0000","last_undegraded":"2024-08-31T06:45:19.761034+0000","last_fullsized":"2024-08-31T06:45:19.761034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:25.559400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748137+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:45:19.748137+0000","last_peered":"2024-08-31T06:45:19.748137+0000","last_clean":"2024-08-31T06:45:19.748137+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:45:19.748137+0000","last_undegraded":"2024-08-31T06:45:19.748137+0000","last_fullsized":"2024-08-31T06:45:19.748137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939437+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:45:19.939437+0000","last_peered":"2024-08-31T06:45:19.939437+0000","last_clean":"2024-08-31T06:45:19.939437+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:45:19.939437+0000","last_undegraded":"2024-08-31T06:45:19.939437+0000","last_fullsized":"2024-08-31T06:45:19.939437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.745508+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:45:19.745508+0000","last_peered":"2024-08-31T06:45:19.745508+0000","last_clean":"2024-08-31T06:45:19.745508+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:45:19.745508+0000","last_undegraded":"2024-08-31T06:45:19.745508+0000","last_fullsized":"2024-08-31T06:45:19.745508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751756+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:45:19.751756+0000","last_peered":"2024-08-31T06:45:19.751756+0000","last_clean":"2024-08-31T06:45:19.751756+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:45:19.751756+0000","last_undegraded":"2024-08-31T06:45:19.751756+0000","last_fullsized":"2024-08-31T06:45:19.751756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939714+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:45:19.939714+0000","last_peered":"2024-08-31T06:45:19.939714+0000","last_clean":"2024-08-31T06:45:19.939714+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:45:19.939714+0000","last_undegraded":"2024-08-31T06:45:19.939714+0000","last_fullsized":"2024-08-31T06:45:19.939714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753193+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:45:19.753193+0000","last_peered":"2024-08-31T06:45:19.753193+0000","last_clean":"2024-08-31T06:45:19.753193+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:45:19.753193+0000","last_undegraded":"2024-08-31T06:45:19.753193+0000","last_fullsized":"2024-08-31T06:45:19.753193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756544+0000","last_change":"2024-08-31T06:45:19.756432+0000","last_active":"2024-08-31T06:45:19.756544+0000","last_peered":"2024-08-31T06:45:19.756544+0000","last_clean":"2024-08-31T06:45:19.756544+0000","last_became_active":"2024-08-31T06:45:19.751184+0000","last_became_peered":"2024-08-31T06:45:19.751184+0000","last_unstale":"2024-08-31T06:45:19.756544+0000","last_undegraded":"2024-08-31T06:45:19.756544+0000","last_fullsized":"2024-08-31T06:45:19.756544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:23.569829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748575+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:45:19.748575+0000","last_peered":"2024-08-31T06:45:19.748575+0000","last_clean":"2024-08-31T06:45:19.748575+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:45:19.748575+0000","last_undegraded":"2024-08-31T06:45:19.748575+0000","last_fullsized":"2024-08-31T06:45:19.748575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749443+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:45:19.749443+0000","last_peered":"2024-08-31T06:45:19.749443+0000","last_clean":"2024-08-31T06:45:19.749443+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:45:19.749443+0000","last_undegraded":"2024-08-31T06:45:19.749443+0000","last_fullsized":"2024-08-31T06:45:19.749443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753326+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:45:19.753326+0000","last_peered":"2024-08-31T06:45:19.753326+0000","last_clean":"2024-08-31T06:45:19.753326+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:45:19.753326+0000","last_undegraded":"2024-08-31T06:45:19.753326+0000","last_fullsized":"2024-08-31T06:45:19.753326+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939975+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:45:19.939975+0000","last_peered":"2024-08-31T06:45:19.939975+0000","last_clean":"2024-08-31T06:45:19.939975+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:45:19.939975+0000","last_undegraded":"2024-08-31T06:45:19.939975+0000","last_fullsized":"2024-08-31T06:45:19.939975+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939854+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:45:19.939854+0000","last_peered":"2024-08-31T06:45:19.939854+0000","last_clean":"2024-08-31T06:45:19.939854+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:45:19.939854+0000","last_undegraded":"2024-08-31T06:45:19.939854+0000","last_fullsized":"2024-08-31T06:45:19.939854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754818+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:45:19.754818+0000","last_peered":"2024-08-31T06:45:19.754818+0000","last_clean":"2024-08-31T06:45:19.754818+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:45:19.754818+0000","last_undegraded":"2024-08-31T06:45:19.754818+0000","last_fullsized":"2024-08-31T06:45:19.754818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64154,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":347,"num_read_kb":243,"num_write":163,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776154,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":409286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939679,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1527808,"data_stored":1060920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":409522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":409442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1441792,"data_stored":1001763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":408911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32608,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712544,"statfs":{"total":95995035648,"available":95961645056,"internally_reserved":0,"allocated":1454080,"data_stored":1001056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":410752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":851968,"data_stored":409222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378694,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":469194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542221,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":897024,"data_stored":468466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":856064,"data_stored":410182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:45:50.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:45:50.832 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:51.237 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:51 smithi037 ceph-mon[18612]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:51.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:51 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:45:51.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:51 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:45:51.238 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:51 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.328+0000 7fbf63c5b640 1 -- 172.21.15.37:0/899185045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c109bc0 msgr2=0x7fbf5c1103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.328+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/899185045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c109bc0 0x7fbf5c1103f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009ca0 tx=0x7fbf5402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.328+0000 7fbf63c5b640 1 -- 172.21.15.37:0/899185045 shutdown_connections 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.328+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/899185045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c109bc0 0x7fbf5c1103f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.328+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/899185045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf5c109270 0x7fbf5c109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.328+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/899185045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c103930 0x7fbf5c103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.328+0000 7fbf63c5b640 1 -- 172.21.15.37:0/899185045 >> 172.21.15.37:0/899185045 conn(0x7fbf5c0ff3a0 msgr2=0x7fbf5c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.329+0000 7fbf63c5b640 1 -- 172.21.15.37:0/899185045 shutdown_connections 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.329+0000 7fbf63c5b640 1 -- 172.21.15.37:0/899185045 wait complete. 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.329+0000 7fbf63c5b640 1 Processor -- start 2024-08-31T06:45:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.329+0000 7fbf63c5b640 1 -- start start 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.329+0000 7fbf63c5b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c103930 0x7fbf5c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf63c5b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c109270 0x7fbf5c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf63c5b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf5c109bc0 0x7fbf5c1a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf63c5b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c113780 con 0x7fbf5c103930 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf63c5b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c113600 con 0x7fbf5c109270 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf63c5b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c113900 con 0x7fbf5c109bc0 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c103930 0x7fbf5c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c103930 0x7fbf5c19c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33116/0 (socket says 172.21.15.37:33116) 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 -- 172.21.15.37:0/1755162573 learned_addr learned my addr 172.21.15.37:0/1755162573 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf611f6640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c109270 0x7fbf5c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 -- 172.21.15.37:0/1755162573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf5c109bc0 msgr2=0x7fbf5c1a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf5c109bc0 0x7fbf5c1a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 -- 172.21.15.37:0/1755162573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c109270 msgr2=0x7fbf5c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c109270 0x7fbf5c19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 -- 172.21.15.37:0/1755162573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c1a22a0 con 0x7fbf5c103930 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf611f6640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c109270 0x7fbf5c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf619f7640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c103930 0x7fbf5c19c330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800d950 tx=0x7fbf5800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf52ffd640 1 -- 172.21.15.37:0/1755162573 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf58017070 con 0x7fbf5c103930 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c1a2590 con 0x7fbf5c103930 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf52ffd640 1 -- 172.21.15.37:0/1755162573 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf58009c30 con 0x7fbf5c103930 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf52ffd640 1 -- 172.21.15.37:0/1755162573 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800f620 con 0x7fbf5c103930 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.330+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c1a8cf0 con 0x7fbf5c103930 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.331+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5c103d40 con 0x7fbf5c103930 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.333+0000 7fbf52ffd640 1 -- 172.21.15.37:0/1755162573 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fbf58005030 con 0x7fbf5c103930 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.334+0000 7fbf52ffd640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf480b4c10 0x7fbf480b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.334+0000 7fbf611f6640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf480b4c10 0x7fbf480b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.334+0000 7fbf52ffd640 1 -- 172.21.15.37:0/1755162573 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbf580e50b0 con 0x7fbf5c103930 2024-08-31T06:45:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.334+0000 7fbf611f6640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf480b4c10 0x7fbf480b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c105a30 tx=0x7fbf4c005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.337+0000 7fbf52ffd640 1 -- 172.21.15.37:0/1755162573 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbf580abfa0 con 0x7fbf5c103930 2024-08-31T06:45:51.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:51 smithi066 ceph-mon[22244]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:51.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:51 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:45:51.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:51 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:45:51.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:51 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:51.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.521+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf5c10f6c0 con 0x7fbf480b4c10 2024-08-31T06:45:51.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.526+0000 7fbf52ffd640 1 -- 172.21.15.37:0/1755162573 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258709 (secure 0 0 0) 0x7fbf5c10f6c0 con 0x7fbf480b4c10 2024-08-31T06:45:51.529 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:51.530 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:45:51.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf480b4c10 msgr2=0x7fbf480b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:51.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf480b4c10 0x7fbf480b7120 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c105a30 tx=0x7fbf4c005e50 comp rx=0 tx=0).stop 2024-08-31T06:45:51.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c103930 msgr2=0x7fbf5c19c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:51.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c103930 0x7fbf5c19c330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800d950 tx=0x7fbf5800de10 comp rx=0 tx=0).stop 2024-08-31T06:45:51.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 shutdown_connections 2024-08-31T06:45:51.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbf480b4c10 0x7fbf480b7120 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf5c109bc0 0x7fbf5c1a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c109270 0x7fbf5c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 --2- 172.21.15.37:0/1755162573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf5c103930 0x7fbf5c19c330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:51.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 >> 172.21.15.37:0/1755162573 conn(0x7fbf5c0ff3a0 msgr2=0x7fbf5c1088a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:51.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 shutdown_connections 2024-08-31T06:45:51.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:51.529+0000 7fbf63c5b640 1 -- 172.21.15.37:0/1755162573 wait complete. 2024-08-31T06:45:51.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:51 smithi106 ceph-mon[22134]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:51.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:51 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:45:51.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:51 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:45:51.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:51 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:45:52.237 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-08-31T06:45:50.260765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654756,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":428,"num_read_kb":312,"num_write":288,"num_write_kb":2262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":361180,"kb_used_data":11868,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124580644,"statfs":{"total":1151940427776,"available":1151570579456,"internally_reserved":0,"allocated":12152832,"data_stored":6868716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":357414204},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003625"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.746064+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:45:19.746064+0000","last_peered":"2024-08-31T06:45:19.746064+0000","last_clean":"2024-08-31T06:45:19.746064+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:45:19.746064+0000","last_undegraded":"2024-08-31T06:45:19.746064+0000","last_fullsized":"2024-08-31T06:45:19.746064+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753581+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:45:19.753581+0000","last_peered":"2024-08-31T06:45:19.753581+0000","last_clean":"2024-08-31T06:45:19.753581+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:45:19.753581+0000","last_undegraded":"2024-08-31T06:45:19.753581+0000","last_fullsized":"2024-08-31T06:45:19.753581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753102+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:45:19.753102+0000","last_peered":"2024-08-31T06:45:19.753102+0000","last_clean":"2024-08-31T06:45:19.753102+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:45:19.753102+0000","last_undegraded":"2024-08-31T06:45:19.753102+0000","last_fullsized":"2024-08-31T06:45:19.753102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940933+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:45:19.940933+0000","last_peered":"2024-08-31T06:45:19.940933+0000","last_clean":"2024-08-31T06:45:19.940933+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:45:19.940933+0000","last_undegraded":"2024-08-31T06:45:19.940933+0000","last_fullsized":"2024-08-31T06:45:19.940933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748810+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:45:19.748810+0000","last_peered":"2024-08-31T06:45:19.748810+0000","last_clean":"2024-08-31T06:45:19.748810+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:45:19.748810+0000","last_undegraded":"2024-08-31T06:45:19.748810+0000","last_fullsized":"2024-08-31T06:45:19.748810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756818+0000","last_change":"2024-08-31T06:45:19.756707+0000","last_active":"2024-08-31T06:45:19.756818+0000","last_peered":"2024-08-31T06:45:19.756818+0000","last_clean":"2024-08-31T06:45:19.756818+0000","last_became_active":"2024-08-31T06:45:19.756086+0000","last_became_peered":"2024-08-31T06:45:19.756086+0000","last_unstale":"2024-08-31T06:45:19.756818+0000","last_undegraded":"2024-08-31T06:45:19.756818+0000","last_fullsized":"2024-08-31T06:45:19.756818+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:44:24.147502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752598+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:45:19.752598+0000","last_peered":"2024-08-31T06:45:19.752598+0000","last_clean":"2024-08-31T06:45:19.752598+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:45:19.752598+0000","last_undegraded":"2024-08-31T06:45:19.752598+0000","last_fullsized":"2024-08-31T06:45:19.752598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939347+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:45:19.939347+0000","last_peered":"2024-08-31T06:45:19.939347+0000","last_clean":"2024-08-31T06:45:19.939347+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:45:19.939347+0000","last_undegraded":"2024-08-31T06:45:19.939347+0000","last_fullsized":"2024-08-31T06:45:19.939347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.750694+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:45:19.750694+0000","last_peered":"2024-08-31T06:45:19.750694+0000","last_clean":"2024-08-31T06:45:19.750694+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:45:19.750694+0000","last_undegraded":"2024-08-31T06:45:19.750694+0000","last_fullsized":"2024-08-31T06:45:19.750694+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749739+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:45:19.749739+0000","last_peered":"2024-08-31T06:45:19.749739+0000","last_clean":"2024-08-31T06:45:19.749739+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:45:19.749739+0000","last_undegraded":"2024-08-31T06:45:19.749739+0000","last_fullsized":"2024-08-31T06:45:19.749739+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753219+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:45:19.753219+0000","last_peered":"2024-08-31T06:45:19.753219+0000","last_clean":"2024-08-31T06:45:19.753219+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:45:19.753219+0000","last_undegraded":"2024-08-31T06:45:19.753219+0000","last_fullsized":"2024-08-31T06:45:19.753219+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940867+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:45:19.940867+0000","last_peered":"2024-08-31T06:45:19.940867+0000","last_clean":"2024-08-31T06:45:19.940867+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:45:19.940867+0000","last_undegraded":"2024-08-31T06:45:19.940867+0000","last_fullsized":"2024-08-31T06:45:19.940867+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940480+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:45:19.940480+0000","last_peered":"2024-08-31T06:45:19.940480+0000","last_clean":"2024-08-31T06:45:19.940480+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:45:19.940480+0000","last_undegraded":"2024-08-31T06:45:19.940480+0000","last_fullsized":"2024-08-31T06:45:19.940480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752521+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:45:19.752521+0000","last_peered":"2024-08-31T06:45:19.752521+0000","last_clean":"2024-08-31T06:45:19.752521+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:45:19.752521+0000","last_undegraded":"2024-08-31T06:45:19.752521+0000","last_fullsized":"2024-08-31T06:45:19.752521+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751681+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:45:19.751681+0000","last_peered":"2024-08-31T06:45:19.751681+0000","last_clean":"2024-08-31T06:45:19.751681+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:45:19.751681+0000","last_undegraded":"2024-08-31T06:45:19.751681+0000","last_fullsized":"2024-08-31T06:45:19.751681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748985+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:45:19.748985+0000","last_peered":"2024-08-31T06:45:19.748985+0000","last_clean":"2024-08-31T06:45:19.748985+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:45:19.748985+0000","last_undegraded":"2024-08-31T06:45:19.748985+0000","last_fullsized":"2024-08-31T06:45:19.748985+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.746100+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:45:19.746100+0000","last_peered":"2024-08-31T06:45:19.746100+0000","last_clean":"2024-08-31T06:45:19.746100+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:45:19.746100+0000","last_undegraded":"2024-08-31T06:45:19.746100+0000","last_fullsized":"2024-08-31T06:45:19.746100+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756255+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:45:19.756255+0000","last_peered":"2024-08-31T06:45:19.756255+0000","last_clean":"2024-08-31T06:45:19.756255+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:45:19.756255+0000","last_undegraded":"2024-08-31T06:45:19.756255+0000","last_fullsized":"2024-08-31T06:45:19.756255+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752176+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:45:19.752176+0000","last_peered":"2024-08-31T06:45:19.752176+0000","last_clean":"2024-08-31T06:45:19.752176+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:45:19.752176+0000","last_undegraded":"2024-08-31T06:45:19.752176+0000","last_fullsized":"2024-08-31T06:45:19.752176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.745517+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:45:19.745517+0000","last_peered":"2024-08-31T06:45:19.745517+0000","last_clean":"2024-08-31T06:45:19.745517+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:45:19.745517+0000","last_undegraded":"2024-08-31T06:45:19.745517+0000","last_fullsized":"2024-08-31T06:45:19.745517+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940504+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:45:19.940504+0000","last_peered":"2024-08-31T06:45:19.940504+0000","last_clean":"2024-08-31T06:45:19.940504+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:45:19.940504+0000","last_undegraded":"2024-08-31T06:45:19.940504+0000","last_fullsized":"2024-08-31T06:45:19.940504+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749706+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:45:19.749706+0000","last_peered":"2024-08-31T06:45:19.749706+0000","last_clean":"2024-08-31T06:45:19.749706+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:45:19.749706+0000","last_undegraded":"2024-08-31T06:45:19.749706+0000","last_fullsized":"2024-08-31T06:45:19.749706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939293+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:45:19.939293+0000","last_peered":"2024-08-31T06:45:19.939293+0000","last_clean":"2024-08-31T06:45:19.939293+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:45:19.939293+0000","last_undegraded":"2024-08-31T06:45:19.939293+0000","last_fullsized":"2024-08-31T06:45:19.939293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748158+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:45:19.748158+0000","last_peered":"2024-08-31T06:45:19.748158+0000","last_clean":"2024-08-31T06:45:19.748158+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:45:19.748158+0000","last_undegraded":"2024-08-31T06:45:19.748158+0000","last_fullsized":"2024-08-31T06:45:19.748158+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939641+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:45:19.939641+0000","last_peered":"2024-08-31T06:45:19.939641+0000","last_clean":"2024-08-31T06:45:19.939641+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:45:19.939641+0000","last_undegraded":"2024-08-31T06:45:19.939641+0000","last_fullsized":"2024-08-31T06:45:19.939641+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752402+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:45:19.752402+0000","last_peered":"2024-08-31T06:45:19.752402+0000","last_clean":"2024-08-31T06:45:19.752402+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:45:19.752402+0000","last_undegraded":"2024-08-31T06:45:19.752402+0000","last_fullsized":"2024-08-31T06:45:19.752402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.745835+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:45:19.745835+0000","last_peered":"2024-08-31T06:45:19.745835+0000","last_clean":"2024-08-31T06:45:19.745835+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:45:19.745835+0000","last_undegraded":"2024-08-31T06:45:19.745835+0000","last_fullsized":"2024-08-31T06:45:19.745835+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940509+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:45:19.940509+0000","last_peered":"2024-08-31T06:45:19.940509+0000","last_clean":"2024-08-31T06:45:19.940509+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:45:19.940509+0000","last_undegraded":"2024-08-31T06:45:19.940509+0000","last_fullsized":"2024-08-31T06:45:19.940509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753102+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:45:19.753102+0000","last_peered":"2024-08-31T06:45:19.753102+0000","last_clean":"2024-08-31T06:45:19.753102+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:45:19.753102+0000","last_undegraded":"2024-08-31T06:45:19.753102+0000","last_fullsized":"2024-08-31T06:45:19.753102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751615+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:45:19.751615+0000","last_peered":"2024-08-31T06:45:19.751615+0000","last_clean":"2024-08-31T06:45:19.751615+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:45:19.751615+0000","last_undegraded":"2024-08-31T06:45:19.751615+0000","last_fullsized":"2024-08-31T06:45:19.751615+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751880+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:45:19.751880+0000","last_peered":"2024-08-31T06:45:19.751880+0000","last_clean":"2024-08-31T06:45:19.751880+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:45:19.751880+0000","last_undegraded":"2024-08-31T06:45:19.751880+0000","last_fullsized":"2024-08-31T06:45:19.751880+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754662+0000","last_change":"2024-08-31T06:45:19.754501+0000","last_active":"2024-08-31T06:45:19.754662+0000","last_peered":"2024-08-31T06:45:19.754662+0000","last_clean":"2024-08-31T06:45:19.754662+0000","last_became_active":"2024-08-31T06:45:19.754085+0000","last_became_peered":"2024-08-31T06:45:19.754085+0000","last_unstale":"2024-08-31T06:45:19.754662+0000","last_undegraded":"2024-08-31T06:45:19.754662+0000","last_fullsized":"2024-08-31T06:45:19.754662+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:50:04.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748306+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:45:19.748306+0000","last_peered":"2024-08-31T06:45:19.748306+0000","last_clean":"2024-08-31T06:45:19.748306+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:45:19.748306+0000","last_undegraded":"2024-08-31T06:45:19.748306+0000","last_fullsized":"2024-08-31T06:45:19.748306+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":100,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:45.987793+0000","last_change":"2024-08-31T06:45:19.947200+0000","last_active":"2024-08-31T06:45:45.987793+0000","last_peered":"2024-08-31T06:45:45.987793+0000","last_clean":"2024-08-31T06:45:45.987793+0000","last_became_active":"2024-08-31T06:45:19.942294+0000","last_became_peered":"2024-08-31T06:45:19.942294+0000","last_unstale":"2024-08-31T06:45:45.987793+0000","last_undegraded":"2024-08-31T06:45:45.987793+0000","last_fullsized":"2024-08-31T06:45:45.987793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:40.241862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.942200+0000","last_change":"2024-08-31T06:45:19.942081+0000","last_active":"2024-08-31T06:45:19.942200+0000","last_peered":"2024-08-31T06:45:19.942200+0000","last_clean":"2024-08-31T06:45:19.942200+0000","last_became_active":"2024-08-31T06:45:19.941427+0000","last_became_peered":"2024-08-31T06:45:19.941427+0000","last_unstale":"2024-08-31T06:45:19.942200+0000","last_undegraded":"2024-08-31T06:45:19.942200+0000","last_fullsized":"2024-08-31T06:45:19.942200+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:47.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749301+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:45:19.749301+0000","last_peered":"2024-08-31T06:45:19.749301+0000","last_clean":"2024-08-31T06:45:19.749301+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:45:19.749301+0000","last_undegraded":"2024-08-31T06:45:19.749301+0000","last_fullsized":"2024-08-31T06:45:19.749301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940290+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:45:19.940290+0000","last_peered":"2024-08-31T06:45:19.940290+0000","last_clean":"2024-08-31T06:45:19.940290+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:45:19.940290+0000","last_undegraded":"2024-08-31T06:45:19.940290+0000","last_fullsized":"2024-08-31T06:45:19.940290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939415+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:45:19.939415+0000","last_peered":"2024-08-31T06:45:19.939415+0000","last_clean":"2024-08-31T06:45:19.939415+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:45:19.939415+0000","last_undegraded":"2024-08-31T06:45:19.939415+0000","last_fullsized":"2024-08-31T06:45:19.939415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748301+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:45:19.748301+0000","last_peered":"2024-08-31T06:45:19.748301+0000","last_clean":"2024-08-31T06:45:19.748301+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:45:19.748301+0000","last_undegraded":"2024-08-31T06:45:19.748301+0000","last_fullsized":"2024-08-31T06:45:19.748301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753676+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:45:19.753676+0000","last_peered":"2024-08-31T06:45:19.753676+0000","last_clean":"2024-08-31T06:45:19.753676+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:45:19.753676+0000","last_undegraded":"2024-08-31T06:45:19.753676+0000","last_fullsized":"2024-08-31T06:45:19.753676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:44.985119+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:45:44.985119+0000","last_peered":"2024-08-31T06:45:44.985119+0000","last_clean":"2024-08-31T06:45:44.985119+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:45:44.985119+0000","last_undegraded":"2024-08-31T06:45:44.985119+0000","last_fullsized":"2024-08-31T06:45:44.985119+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.750831+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:45:19.750831+0000","last_peered":"2024-08-31T06:45:19.750831+0000","last_clean":"2024-08-31T06:45:19.750831+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:45:19.750831+0000","last_undegraded":"2024-08-31T06:45:19.750831+0000","last_fullsized":"2024-08-31T06:45:19.750831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753069+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:45:19.753069+0000","last_peered":"2024-08-31T06:45:19.753069+0000","last_clean":"2024-08-31T06:45:19.753069+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:45:19.753069+0000","last_undegraded":"2024-08-31T06:45:19.753069+0000","last_fullsized":"2024-08-31T06:45:19.753069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753432+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:45:19.753432+0000","last_peered":"2024-08-31T06:45:19.753432+0000","last_clean":"2024-08-31T06:45:19.753432+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:45:19.753432+0000","last_undegraded":"2024-08-31T06:45:19.753432+0000","last_fullsized":"2024-08-31T06:45:19.753432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748845+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:45:19.748845+0000","last_peered":"2024-08-31T06:45:19.748845+0000","last_clean":"2024-08-31T06:45:19.748845+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:45:19.748845+0000","last_undegraded":"2024-08-31T06:45:19.748845+0000","last_fullsized":"2024-08-31T06:45:19.748845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748704+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:45:19.748704+0000","last_peered":"2024-08-31T06:45:19.748704+0000","last_clean":"2024-08-31T06:45:19.748704+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:45:19.748704+0000","last_undegraded":"2024-08-31T06:45:19.748704+0000","last_fullsized":"2024-08-31T06:45:19.748704+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'28","reported_seq":168,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:45.986932+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:45:45.986932+0000","last_peered":"2024-08-31T06:45:45.986932+0000","last_clean":"2024-08-31T06:45:45.986932+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:45:45.986932+0000","last_undegraded":"2024-08-31T06:45:45.986932+0000","last_fullsized":"2024-08-31T06:45:45.986932+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59762,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":116,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749286+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:45:19.749286+0000","last_peered":"2024-08-31T06:45:19.749286+0000","last_clean":"2024-08-31T06:45:19.749286+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:45:19.749286+0000","last_undegraded":"2024-08-31T06:45:19.749286+0000","last_fullsized":"2024-08-31T06:45:19.749286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752795+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:45:19.752795+0000","last_peered":"2024-08-31T06:45:19.752795+0000","last_clean":"2024-08-31T06:45:19.752795+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:45:19.752795+0000","last_undegraded":"2024-08-31T06:45:19.752795+0000","last_fullsized":"2024-08-31T06:45:19.752795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940209+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:45:19.940209+0000","last_peered":"2024-08-31T06:45:19.940209+0000","last_clean":"2024-08-31T06:45:19.940209+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:45:19.940209+0000","last_undegraded":"2024-08-31T06:45:19.940209+0000","last_fullsized":"2024-08-31T06:45:19.940209+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748495+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:45:19.748495+0000","last_peered":"2024-08-31T06:45:19.748495+0000","last_clean":"2024-08-31T06:45:19.748495+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:45:19.748495+0000","last_undegraded":"2024-08-31T06:45:19.748495+0000","last_fullsized":"2024-08-31T06:45:19.748495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752721+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:45:19.752721+0000","last_peered":"2024-08-31T06:45:19.752721+0000","last_clean":"2024-08-31T06:45:19.752721+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:45:19.752721+0000","last_undegraded":"2024-08-31T06:45:19.752721+0000","last_fullsized":"2024-08-31T06:45:19.752721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'4","reported_seq":85,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:45.759161+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:45:45.759161+0000","last_peered":"2024-08-31T06:45:45.759161+0000","last_clean":"2024-08-31T06:45:45.759161+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:45:45.759161+0000","last_undegraded":"2024-08-31T06:45:45.759161+0000","last_fullsized":"2024-08-31T06:45:45.759161+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752901+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:45:19.752901+0000","last_peered":"2024-08-31T06:45:19.752901+0000","last_clean":"2024-08-31T06:45:19.752901+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:45:19.752901+0000","last_undegraded":"2024-08-31T06:45:19.752901+0000","last_fullsized":"2024-08-31T06:45:19.752901+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748696+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:45:19.748696+0000","last_peered":"2024-08-31T06:45:19.748696+0000","last_clean":"2024-08-31T06:45:19.748696+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:45:19.748696+0000","last_undegraded":"2024-08-31T06:45:19.748696+0000","last_fullsized":"2024-08-31T06:45:19.748696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748334+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:45:19.748334+0000","last_peered":"2024-08-31T06:45:19.748334+0000","last_clean":"2024-08-31T06:45:19.748334+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:45:19.748334+0000","last_undegraded":"2024-08-31T06:45:19.748334+0000","last_fullsized":"2024-08-31T06:45:19.748334+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749698+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:45:19.749698+0000","last_peered":"2024-08-31T06:45:19.749698+0000","last_clean":"2024-08-31T06:45:19.749698+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:45:19.749698+0000","last_undegraded":"2024-08-31T06:45:19.749698+0000","last_fullsized":"2024-08-31T06:45:19.749698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941672+0000","last_change":"2024-08-31T06:45:19.941511+0000","last_active":"2024-08-31T06:45:19.941672+0000","last_peered":"2024-08-31T06:45:19.941672+0000","last_clean":"2024-08-31T06:45:19.941672+0000","last_became_active":"2024-08-31T06:45:19.940991+0000","last_became_peered":"2024-08-31T06:45:19.940991+0000","last_unstale":"2024-08-31T06:45:19.941672+0000","last_undegraded":"2024-08-31T06:45:19.941672+0000","last_fullsized":"2024-08-31T06:45:19.941672+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:25.268854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940677+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:45:19.940677+0000","last_peered":"2024-08-31T06:45:19.940677+0000","last_clean":"2024-08-31T06:45:19.940677+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:45:19.940677+0000","last_undegraded":"2024-08-31T06:45:19.940677+0000","last_fullsized":"2024-08-31T06:45:19.940677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753225+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:45:19.753225+0000","last_peered":"2024-08-31T06:45:19.753225+0000","last_clean":"2024-08-31T06:45:19.753225+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:45:19.753225+0000","last_undegraded":"2024-08-31T06:45:19.753225+0000","last_fullsized":"2024-08-31T06:45:19.753225+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748981+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:45:19.748981+0000","last_peered":"2024-08-31T06:45:19.748981+0000","last_clean":"2024-08-31T06:45:19.748981+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:45:19.748981+0000","last_undegraded":"2024-08-31T06:45:19.748981+0000","last_fullsized":"2024-08-31T06:45:19.748981+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752838+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:45:19.752838+0000","last_peered":"2024-08-31T06:45:19.752838+0000","last_clean":"2024-08-31T06:45:19.752838+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:45:19.752838+0000","last_undegraded":"2024-08-31T06:45:19.752838+0000","last_fullsized":"2024-08-31T06:45:19.752838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753167+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:45:19.753167+0000","last_peered":"2024-08-31T06:45:19.753167+0000","last_clean":"2024-08-31T06:45:19.753167+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:45:19.753167+0000","last_undegraded":"2024-08-31T06:45:19.753167+0000","last_fullsized":"2024-08-31T06:45:19.753167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753378+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:45:19.753378+0000","last_peered":"2024-08-31T06:45:19.753378+0000","last_clean":"2024-08-31T06:45:19.753378+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:45:19.753378+0000","last_undegraded":"2024-08-31T06:45:19.753378+0000","last_fullsized":"2024-08-31T06:45:19.753378+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753410+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:45:19.753410+0000","last_peered":"2024-08-31T06:45:19.753410+0000","last_clean":"2024-08-31T06:45:19.753410+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:45:19.753410+0000","last_undegraded":"2024-08-31T06:45:19.753410+0000","last_fullsized":"2024-08-31T06:45:19.753410+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941116+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:45:19.941116+0000","last_peered":"2024-08-31T06:45:19.941116+0000","last_clean":"2024-08-31T06:45:19.941116+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:45:19.941116+0000","last_undegraded":"2024-08-31T06:45:19.941116+0000","last_fullsized":"2024-08-31T06:45:19.941116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939492+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:45:19.939492+0000","last_peered":"2024-08-31T06:45:19.939492+0000","last_clean":"2024-08-31T06:45:19.939492+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:45:19.939492+0000","last_undegraded":"2024-08-31T06:45:19.939492+0000","last_fullsized":"2024-08-31T06:45:19.939492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753142+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:45:19.753142+0000","last_peered":"2024-08-31T06:45:19.753142+0000","last_clean":"2024-08-31T06:45:19.753142+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:45:19.753142+0000","last_undegraded":"2024-08-31T06:45:19.753142+0000","last_fullsized":"2024-08-31T06:45:19.753142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940176+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:45:19.940176+0000","last_peered":"2024-08-31T06:45:19.940176+0000","last_clean":"2024-08-31T06:45:19.940176+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:45:19.940176+0000","last_undegraded":"2024-08-31T06:45:19.940176+0000","last_fullsized":"2024-08-31T06:45:19.940176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:43.755359+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:45:43.755359+0000","last_peered":"2024-08-31T06:45:43.755359+0000","last_clean":"2024-08-31T06:45:43.755359+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:45:43.755359+0000","last_undegraded":"2024-08-31T06:45:43.755359+0000","last_fullsized":"2024-08-31T06:45:43.755359+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748160+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:45:19.748160+0000","last_peered":"2024-08-31T06:45:19.748160+0000","last_clean":"2024-08-31T06:45:19.748160+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:45:19.748160+0000","last_undegraded":"2024-08-31T06:45:19.748160+0000","last_fullsized":"2024-08-31T06:45:19.748160+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753337+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:45:19.753337+0000","last_peered":"2024-08-31T06:45:19.753337+0000","last_clean":"2024-08-31T06:45:19.753337+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:45:19.753337+0000","last_undegraded":"2024-08-31T06:45:19.753337+0000","last_fullsized":"2024-08-31T06:45:19.753337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.759702+0000","last_change":"2024-08-31T06:45:19.759585+0000","last_active":"2024-08-31T06:45:19.759702+0000","last_peered":"2024-08-31T06:45:19.759702+0000","last_clean":"2024-08-31T06:45:19.759702+0000","last_became_active":"2024-08-31T06:45:19.759026+0000","last_became_peered":"2024-08-31T06:45:19.759026+0000","last_unstale":"2024-08-31T06:45:19.759702+0000","last_undegraded":"2024-08-31T06:45:19.759702+0000","last_fullsized":"2024-08-31T06:45:19.759702+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:54.716259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754330+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:45:19.754330+0000","last_peered":"2024-08-31T06:45:19.754330+0000","last_clean":"2024-08-31T06:45:19.754330+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:45:19.754330+0000","last_undegraded":"2024-08-31T06:45:19.754330+0000","last_fullsized":"2024-08-31T06:45:19.754330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748638+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:45:19.748638+0000","last_peered":"2024-08-31T06:45:19.748638+0000","last_clean":"2024-08-31T06:45:19.748638+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:45:19.748638+0000","last_undegraded":"2024-08-31T06:45:19.748638+0000","last_fullsized":"2024-08-31T06:45:19.748638+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749624+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:45:19.749624+0000","last_peered":"2024-08-31T06:45:19.749624+0000","last_clean":"2024-08-31T06:45:19.749624+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:45:19.749624+0000","last_undegraded":"2024-08-31T06:45:19.749624+0000","last_fullsized":"2024-08-31T06:45:19.749624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940565+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:45:19.940565+0000","last_peered":"2024-08-31T06:45:19.940565+0000","last_clean":"2024-08-31T06:45:19.940565+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:45:19.940565+0000","last_undegraded":"2024-08-31T06:45:19.940565+0000","last_fullsized":"2024-08-31T06:45:19.940565+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'11","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756363+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:45:19.756363+0000","last_peered":"2024-08-31T06:45:19.756363+0000","last_clean":"2024-08-31T06:45:19.756363+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:45:19.756363+0000","last_undegraded":"2024-08-31T06:45:19.756363+0000","last_fullsized":"2024-08-31T06:45:19.756363+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939664+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:45:19.939664+0000","last_peered":"2024-08-31T06:45:19.939664+0000","last_clean":"2024-08-31T06:45:19.939664+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:45:19.939664+0000","last_undegraded":"2024-08-31T06:45:19.939664+0000","last_fullsized":"2024-08-31T06:45:19.939664+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941154+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:45:19.941154+0000","last_peered":"2024-08-31T06:45:19.941154+0000","last_clean":"2024-08-31T06:45:19.941154+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:45:19.941154+0000","last_undegraded":"2024-08-31T06:45:19.941154+0000","last_fullsized":"2024-08-31T06:45:19.941154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.942552+0000","last_change":"2024-08-31T06:45:19.942466+0000","last_active":"2024-08-31T06:45:19.942552+0000","last_peered":"2024-08-31T06:45:19.942552+0000","last_clean":"2024-08-31T06:45:19.942552+0000","last_became_active":"2024-08-31T06:45:19.941936+0000","last_became_peered":"2024-08-31T06:45:19.941936+0000","last_unstale":"2024-08-31T06:45:19.942552+0000","last_undegraded":"2024-08-31T06:45:19.942552+0000","last_fullsized":"2024-08-31T06:45:19.942552+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:25.406883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.761034+0000","last_change":"2024-08-31T06:45:19.760954+0000","last_active":"2024-08-31T06:45:19.761034+0000","last_peered":"2024-08-31T06:45:19.761034+0000","last_clean":"2024-08-31T06:45:19.761034+0000","last_became_active":"2024-08-31T06:45:19.754797+0000","last_became_peered":"2024-08-31T06:45:19.754797+0000","last_unstale":"2024-08-31T06:45:19.761034+0000","last_undegraded":"2024-08-31T06:45:19.761034+0000","last_fullsized":"2024-08-31T06:45:19.761034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:25.559400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748137+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:45:19.748137+0000","last_peered":"2024-08-31T06:45:19.748137+0000","last_clean":"2024-08-31T06:45:19.748137+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:45:19.748137+0000","last_undegraded":"2024-08-31T06:45:19.748137+0000","last_fullsized":"2024-08-31T06:45:19.748137+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939437+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:45:19.939437+0000","last_peered":"2024-08-31T06:45:19.939437+0000","last_clean":"2024-08-31T06:45:19.939437+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:45:19.939437+0000","last_undegraded":"2024-08-31T06:45:19.939437+0000","last_fullsized":"2024-08-31T06:45:19.939437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.745508+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:45:19.745508+0000","last_peered":"2024-08-31T06:45:19.745508+0000","last_clean":"2024-08-31T06:45:19.745508+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:45:19.745508+0000","last_undegraded":"2024-08-31T06:45:19.745508+0000","last_fullsized":"2024-08-31T06:45:19.745508+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751756+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:45:19.751756+0000","last_peered":"2024-08-31T06:45:19.751756+0000","last_clean":"2024-08-31T06:45:19.751756+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:45:19.751756+0000","last_undegraded":"2024-08-31T06:45:19.751756+0000","last_fullsized":"2024-08-31T06:45:19.751756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939714+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:45:19.939714+0000","last_peered":"2024-08-31T06:45:19.939714+0000","last_clean":"2024-08-31T06:45:19.939714+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:45:19.939714+0000","last_undegraded":"2024-08-31T06:45:19.939714+0000","last_fullsized":"2024-08-31T06:45:19.939714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753193+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:45:19.753193+0000","last_peered":"2024-08-31T06:45:19.753193+0000","last_clean":"2024-08-31T06:45:19.753193+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:45:19.753193+0000","last_undegraded":"2024-08-31T06:45:19.753193+0000","last_fullsized":"2024-08-31T06:45:19.753193+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756544+0000","last_change":"2024-08-31T06:45:19.756432+0000","last_active":"2024-08-31T06:45:19.756544+0000","last_peered":"2024-08-31T06:45:19.756544+0000","last_clean":"2024-08-31T06:45:19.756544+0000","last_became_active":"2024-08-31T06:45:19.751184+0000","last_became_peered":"2024-08-31T06:45:19.751184+0000","last_unstale":"2024-08-31T06:45:19.756544+0000","last_undegraded":"2024-08-31T06:45:19.756544+0000","last_fullsized":"2024-08-31T06:45:19.756544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:23.569829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748575+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:45:19.748575+0000","last_peered":"2024-08-31T06:45:19.748575+0000","last_clean":"2024-08-31T06:45:19.748575+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:45:19.748575+0000","last_undegraded":"2024-08-31T06:45:19.748575+0000","last_fullsized":"2024-08-31T06:45:19.748575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749443+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:45:19.749443+0000","last_peered":"2024-08-31T06:45:19.749443+0000","last_clean":"2024-08-31T06:45:19.749443+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:45:19.749443+0000","last_undegraded":"2024-08-31T06:45:19.749443+0000","last_fullsized":"2024-08-31T06:45:19.749443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753326+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:45:19.753326+0000","last_peered":"2024-08-31T06:45:19.753326+0000","last_clean":"2024-08-31T06:45:19.753326+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:45:19.753326+0000","last_undegraded":"2024-08-31T06:45:19.753326+0000","last_fullsized":"2024-08-31T06:45:19.753326+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939975+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:45:19.939975+0000","last_peered":"2024-08-31T06:45:19.939975+0000","last_clean":"2024-08-31T06:45:19.939975+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:45:19.939975+0000","last_undegraded":"2024-08-31T06:45:19.939975+0000","last_fullsized":"2024-08-31T06:45:19.939975+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939854+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:45:19.939854+0000","last_peered":"2024-08-31T06:45:19.939854+0000","last_clean":"2024-08-31T06:45:19.939854+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:45:19.939854+0000","last_undegraded":"2024-08-31T06:45:19.939854+0000","last_fullsized":"2024-08-31T06:45:19.939854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754818+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:45:19.754818+0000","last_peered":"2024-08-31T06:45:19.754818+0000","last_clean":"2024-08-31T06:45:19.754818+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:45:19.754818+0000","last_undegraded":"2024-08-31T06:45:19.754818+0000","last_fullsized":"2024-08-31T06:45:19.754818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64154,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":347,"num_read_kb":243,"num_write":163,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":192462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776155,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":409286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939679,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1527808,"data_stored":1060920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":409522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":409442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28436,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716716,"statfs":{"total":95995035648,"available":95965917184,"internally_reserved":0,"allocated":1441792,"data_stored":1001763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":408911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32608,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712544,"statfs":{"total":95995035648,"available":95961645056,"internally_reserved":0,"allocated":1454080,"data_stored":1001056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":410752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149761,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":851968,"data_stored":409222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378695,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":469194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542221,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36224,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708928,"statfs":{"total":95995035648,"available":95957942272,"internally_reserved":0,"allocated":897024,"data_stored":468466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":856064,"data_stored":410182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":60490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:45:52.241 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T06:45:52.241 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-31T06:45:52.241 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-31T06:45:52.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph health --format=json 2024-08-31T06:45:52.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:52 smithi066 ceph-mon[22244]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:52.568 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:52 smithi106 ceph-mon[22134]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:52.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:52 smithi037 ceph-mon[18612]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:52.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 -- 172.21.15.37:0/141758198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec109290 msgr2=0x7fabec1096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:52.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/141758198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec109290 0x7fabec1096a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009900 tx=0x7fabdc02a410 comp rx=0 tx=0).stop 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 -- 172.21.15.37:0/141758198 shutdown_connections 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/141758198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec109290 0x7fabec1096a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/141758198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec109be0 0x7fabec110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/141758198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabec103950 0x7fabec103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 -- 172.21.15.37:0/141758198 >> 172.21.15.37:0/141758198 conn(0x7fabec0ff3a0 msgr2=0x7fabec1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 -- 172.21.15.37:0/141758198 shutdown_connections 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.969+0000 7fabf3ca0640 1 -- 172.21.15.37:0/141758198 wait complete. 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf3ca0640 1 Processor -- start 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf3ca0640 1 -- start start 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf3ca0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec103950 0x7fabec0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf3ca0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabec109290 0x7fabec0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf3ca0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec109be0 0x7fabec075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf3ca0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabec113770 con 0x7fabec103950 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf3ca0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fabec1135f0 con 0x7fabec109be0 2024-08-31T06:45:52.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf3ca0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fabec1138f0 con 0x7fabec109290 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf1a3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec103950 0x7fabec0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf1a3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec103950 0x7fabec0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33120/0 (socket says 172.21.15.37:33120) 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf1a3c640 1 -- 172.21.15.37:0/778176509 learned_addr learned my addr 172.21.15.37:0/778176509 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf123b640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabec109290 0x7fabec0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.970+0000 7fabf223d640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec109be0 0x7fabec075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabf1a3c640 1 -- 172.21.15.37:0/778176509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabec109290 msgr2=0x7fabec0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabf1a3c640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabec109290 0x7fabec0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabf1a3c640 1 -- 172.21.15.37:0/778176509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec109be0 msgr2=0x7fabec075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:52.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabf1a3c640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec109be0 0x7fabec075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabf1a3c640 1 -- 172.21.15.37:0/778176509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec1a84a0 con 0x7fabec103950 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabf1a3c640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec103950 0x7fabec0754b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b4a0 tx=0x7fabe800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabe2ffd640 1 -- 172.21.15.37:0/778176509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8014070 con 0x7fabec103950 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec1a8790 con 0x7fabec103950 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabe2ffd640 1 -- 172.21.15.37:0/778176509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabe8010aa0 con 0x7fabec103950 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabe2ffd640 1 -- 172.21.15.37:0/778176509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8017b70 con 0x7fabec103950 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.971+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec1a8cd0 con 0x7fabec103950 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.972+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabec103d60 con 0x7fabec103950 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.974+0000 7fabe2ffd640 1 -- 172.21.15.37:0/778176509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fabe8017070 con 0x7fabec103950 2024-08-31T06:45:52.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.974+0000 7fabe2ffd640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fabd80b4c10 0x7fabd80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.974+0000 7fabf123b640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fabd80b4c10 0x7fabd80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.974+0000 7fabe2ffd640 1 -- 172.21.15.37:0/778176509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fabe80e4610 con 0x7fabec103950 2024-08-31T06:45:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.975+0000 7fabf123b640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fabd80b4c10 0x7fabd80b7120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fabdc005940 tx=0x7fabdc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:52.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:52.979+0000 7fabe2ffd640 1 -- 172.21.15.37:0/778176509 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fabe80aaeb0 con 0x7fabec103950 2024-08-31T06:45:53.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.208+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fabec02e430 con 0x7fabec103950 2024-08-31T06:45:53.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:53 smithi037 ceph-mon[18612]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:53.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.209+0000 7fabe2ffd640 1 -- 172.21.15.37:0/778176509 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fabe80af670 con 0x7fabec103950 2024-08-31T06:45:53.210 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:53.210 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.211+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fabd80b4c10 msgr2=0x7fabd80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.211+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fabd80b4c10 0x7fabd80b7120 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fabdc005940 tx=0x7fabdc0058d0 comp rx=0 tx=0).stop 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec103950 msgr2=0x7fabec0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec103950 0x7fabec0754b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fabe800b4a0 tx=0x7fabe800b960 comp rx=0 tx=0).stop 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 shutdown_connections 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fabd80b4c10 0x7fabd80b7120 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec109be0 0x7fabec075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fabec109290 0x7fabec0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 --2- 172.21.15.37:0/778176509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec103950 0x7fabec0754b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 >> 172.21.15.37:0/778176509 conn(0x7fabec0ff3a0 msgr2=0x7fabec1017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:53.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 shutdown_connections 2024-08-31T06:45:53.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:53.212+0000 7fabf3ca0640 1 -- 172.21.15.37:0/778176509 wait complete. 2024-08-31T06:45:53.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:53 smithi066 ceph-mon[22244]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:53.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:53 smithi106 ceph-mon[22134]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:45:53.836 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-31T06:45:53.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:45:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:54.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:54 smithi037 ceph-mon[18612]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:45:54.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:54 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/778176509' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T06:45:54.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:54 smithi066 ceph-mon[22244]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:45:54.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:54 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/778176509' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T06:45:54.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:54 smithi106 ceph-mon[22134]: pgmap v291: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:45:54.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:54 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/778176509' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-31T06:45:54.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 -- 172.21.15.37:0/2708683900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc103900 msgr2=0x7fa4dc103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:54.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 --2- 172.21.15.37:0/2708683900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc103900 0x7fa4dc103d10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009900 tx=0x7fa4d802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:54.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 -- 172.21.15.37:0/2708683900 shutdown_connections 2024-08-31T06:45:54.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 --2- 172.21.15.37:0/2708683900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc109b90 0x7fa4dc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 --2- 172.21.15.37:0/2708683900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc109240 0x7fa4dc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 --2- 172.21.15.37:0/2708683900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc103900 0x7fa4dc103d10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 -- 172.21.15.37:0/2708683900 >> 172.21.15.37:0/2708683900 conn(0x7fa4dc07b5f0 msgr2=0x7fa4dc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:54.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 -- 172.21.15.37:0/2708683900 shutdown_connections 2024-08-31T06:45:54.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.620+0000 7fa4e428f640 1 -- 172.21.15.37:0/2708683900 wait complete. 2024-08-31T06:45:54.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.621+0000 7fa4e428f640 1 Processor -- start 2024-08-31T06:45:54.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.621+0000 7fa4e428f640 1 -- start start 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.621+0000 7fa4e428f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc103900 0x7fa4dc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.621+0000 7fa4e428f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc109240 0x7fa4dc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.621+0000 7fa4e428f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc109b90 0x7fa4dc075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.621+0000 7fa4e428f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc113760 con 0x7fa4dc109b90 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.621+0000 7fa4e428f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1135e0 con 0x7fa4dc103900 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e428f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa4dc1138e0 con 0x7fa4dc109240 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc109b90 0x7fa4dc075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc109b90 0x7fa4dc075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60960/0 (socket says 172.21.15.37:60960) 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 -- 172.21.15.37:0/3018341215 learned_addr learned my addr 172.21.15.37:0/3018341215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e202b640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc103900 0x7fa4dc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e182a640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc109240 0x7fa4dc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:54.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 -- 172.21.15.37:0/3018341215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc109240 msgr2=0x7fa4dc0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:54.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc109240 0x7fa4dc0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 -- 172.21.15.37:0/3018341215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc103900 msgr2=0x7fa4dc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:54.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc103900 0x7fa4dc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 -- 172.21.15.37:0/3018341215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc1a8490 con 0x7fa4dc109b90 2024-08-31T06:45:54.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4e282c640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc109b90 0x7fa4dc075f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400b970 tx=0x7fa4d400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:54.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.622+0000 7fa4d37fe640 1 -- 172.21.15.37:0/3018341215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4019070 con 0x7fa4dc109b90 2024-08-31T06:45:54.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.623+0000 7fa4d37fe640 1 -- 172.21.15.37:0/3018341215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4d4014440 con 0x7fa4dc109b90 2024-08-31T06:45:54.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.623+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc1a8780 con 0x7fa4dc109b90 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.623+0000 7fa4d37fe640 1 -- 172.21.15.37:0/3018341215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40075d0 con 0x7fa4dc109b90 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.623+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4dc1a8cf0 con 0x7fa4dc109b90 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.624+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4dc103d10 con 0x7fa4dc109b90 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.626+0000 7fa4d37fe640 1 -- 172.21.15.37:0/3018341215 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa4d401c070 con 0x7fa4dc109b90 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.627+0000 7fa4d37fe640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4c80b4c10 0x7fa4c80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.627+0000 7fa4e202b640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4c80b4c10 0x7fa4c80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.627+0000 7fa4d37fe640 1 -- 172.21.15.37:0/3018341215 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa4d40e4da0 con 0x7fa4dc109b90 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.627+0000 7fa4e202b640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4c80b4c10 0x7fa4c80b7120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc076f00 tx=0x7fa4d80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:54.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.630+0000 7fa4d37fe640 1 -- 172.21.15.37:0/3018341215 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa4d40ab5e0 con 0x7fa4dc109b90 2024-08-31T06:45:54.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.858+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4dc0767b0 con 0x7fa4dc109b90 2024-08-31T06:45:54.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.858+0000 7fa4d37fe640 1 -- 172.21.15.37:0/3018341215 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7fa4d40b4170 con 0x7fa4dc109b90 2024-08-31T06:45:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:54.860 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"btime":"2024-08-31T06:44:54:657185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:44:54.319927+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24656,24695,24658]},"id":1}]} 2024-08-31T06:45:54.860 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.860+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4c80b4c10 msgr2=0x7fa4c80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.860+0000 7fa4e428f640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4c80b4c10 0x7fa4c80b7120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc076f00 tx=0x7fa4d80058d0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.860+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc109b90 msgr2=0x7fa4dc075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.860+0000 7fa4e428f640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc109b90 0x7fa4dc075f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400b970 tx=0x7fa4d400be30 comp rx=0 tx=0).stop 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.861+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 shutdown_connections 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.861+0000 7fa4e428f640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4c80b4c10 0x7fa4c80b7120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.861+0000 7fa4e428f640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4dc109b90 0x7fa4dc075f30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.861+0000 7fa4e428f640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4dc109240 0x7fa4dc0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.861+0000 7fa4e428f640 1 --2- 172.21.15.37:0/3018341215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4dc103900 0x7fa4dc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.861+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 >> 172.21.15.37:0/3018341215 conn(0x7fa4dc07b5f0 msgr2=0x7fa4dc107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.861+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 shutdown_connections 2024-08-31T06:45:54.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:54.861+0000 7fa4e428f640 1 -- 172.21.15.37:0/3018341215 wait complete. 2024-08-31T06:45:55.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:55 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3018341215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:55.518 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:55 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3018341215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:55.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:45:55.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:55 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3018341215' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 -- 172.21.15.37:0/2533547319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108ac0 msgr2=0x7ff2d010f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2533547319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108ac0 0x7ff2d010f2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8009ca0 tx=0x7ff2c802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 -- 172.21.15.37:0/2533547319 shutdown_connections 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2533547319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108ac0 0x7ff2d010f2f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2533547319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d0108170 0x7ff2d0108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2533547319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d0102880 0x7ff2d0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 -- 172.21.15.37:0/2533547319 >> 172.21.15.37:0/2533547319 conn(0x7ff2d0079500 msgr2=0x7ff2d0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 -- 172.21.15.37:0/2533547319 shutdown_connections 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.289+0000 7ff2d6034640 1 -- 172.21.15.37:0/2533547319 wait complete. 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.290+0000 7ff2d6034640 1 Processor -- start 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.290+0000 7ff2d6034640 1 -- start start 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2d6034640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d0102880 0x7ff2d0199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2d6034640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108170 0x7ff2d0199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:56.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2d6034640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d0108ac0 0x7ff2d019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2d6034640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d0112620 con 0x7ff2d0108170 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2d6034640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d01124a0 con 0x7ff2d0108ac0 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2d6034640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d01127a0 con 0x7ff2d0102880 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108170 0x7ff2d0199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108170 0x7ff2d0199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60976/0 (socket says 172.21.15.37:60976) 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2ceffd640 1 -- 172.21.15.37:0/2152941825 learned_addr learned my addr 172.21.15.37:0/2152941825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2cf7fe640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d0102880 0x7ff2d0199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2cffff640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d0108ac0 0x7ff2d019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2ceffd640 1 -- 172.21.15.37:0/2152941825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d0102880 msgr2=0x7ff2d0199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2ceffd640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d0102880 0x7ff2d0199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2ceffd640 1 -- 172.21.15.37:0/2152941825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d0108ac0 msgr2=0x7ff2d019e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2ceffd640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d0108ac0 0x7ff2d019e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.291+0000 7ff2ceffd640 1 -- 172.21.15.37:0/2152941825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d019efe0 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.292+0000 7ff2ceffd640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108170 0x7ff2d0199610 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800d770 tx=0x7ff2b800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.292+0000 7ff2ccff9640 1 -- 172.21.15.37:0/2152941825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8017070 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.292+0000 7ff2ccff9640 1 -- 172.21.15.37:0/2152941825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2b8009c30 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.292+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d019f2d0 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.292+0000 7ff2ccff9640 1 -- 172.21.15.37:0/2152941825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800f620 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.292+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d006b8e0 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.293+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2d0103ab0 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.296+0000 7ff2ccff9640 1 -- 172.21.15.37:0/2152941825 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff2b801a070 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.296+0000 7ff2ccff9640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff2bc0b6e20 0x7ff2bc0b9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.297+0000 7ff2cf7fe640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff2bc0b6e20 0x7ff2bc0b9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.297+0000 7ff2ccff9640 1 -- 172.21.15.37:0/2152941825 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ff2b80e4e70 con 0x7ff2d0108170 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.297+0000 7ff2cf7fe640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff2bc0b6e20 0x7ff2bc0b9330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0005d00 tx=0x7ff2c000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:56.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.300+0000 7ff2ccff9640 1 -- 172.21.15.37:0/2152941825 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff2b8009de0 con 0x7ff2d0108170 2024-08-31T06:45:56.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:56 smithi066 ceph-mon[22244]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.546+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2d0102c90 con 0x7ff2d0108170 2024-08-31T06:45:56.547 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:56 smithi037 ceph-mon[18612]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:56.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.547+0000 7ff2ccff9640 1 -- 172.21.15.37:0/2152941825 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7ff2b80ab6b0 con 0x7ff2d0108170 2024-08-31T06:45:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:56.549 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"btime":"2024-08-31T06:44:54:657185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:44:54.319927+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24656,24695,24658]},"id":1}]} 2024-08-31T06:45:56.549 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-08-31T06:45:56.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff2bc0b6e20 msgr2=0x7ff2bc0b9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:56.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff2bc0b6e20 0x7ff2bc0b9330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0005d00 tx=0x7ff2c000b410 comp rx=0 tx=0).stop 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108170 msgr2=0x7ff2d0199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108170 0x7ff2d0199610 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800d770 tx=0x7ff2b800dc30 comp rx=0 tx=0).stop 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 shutdown_connections 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff2bc0b6e20 0x7ff2bc0b9330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2d0108170 0x7ff2d0199610 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2d0108ac0 0x7ff2d019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 --2- 172.21.15.37:0/2152941825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2d0102880 0x7ff2d0199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.549+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 >> 172.21.15.37:0/2152941825 conn(0x7ff2d0079500 msgr2=0x7ff2d0105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.550+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 shutdown_connections 2024-08-31T06:45:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:56.550+0000 7ff2d6034640 1 -- 172.21.15.37:0/2152941825 wait complete. 2024-08-31T06:45:56.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:56 smithi106 ceph-mon[22134]: pgmap v292: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:45:57.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:45:57.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:57 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2152941825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:57.509 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:57.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:57 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2152941825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:57.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:57 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2152941825' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:45:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/357390995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 msgr2=0x7f6cc4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/357390995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 0x7f6cc4109650 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009900 tx=0x7f6cb802a410 comp rx=0 tx=0).stop 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/357390995 shutdown_connections 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/357390995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 0x7f6cc4109650 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/357390995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cc4109b90 0x7f6cc41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/357390995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc4103900 0x7f6cc4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/357390995 >> 172.21.15.37:0/357390995 conn(0x7f6cc407b5f0 msgr2=0x7f6cc407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/357390995 shutdown_connections 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.970+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/357390995 wait complete. 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc9ac1640 1 Processor -- start 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc9ac1640 1 -- start start 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc9ac1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cc4103900 0x7f6cc40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc9ac1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 0x7f6cc40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc9ac1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc4109b90 0x7f6cc4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc9ac1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc41137a0 con 0x7f6cc4109240 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc9ac1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4113620 con 0x7f6cc4109b90 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc9ac1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4113920 con 0x7f6cc4103900 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 0x7f6cc40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 0x7f6cc40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32770/0 (socket says 172.21.15.37:32770) 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.971+0000 7f6cc2ffd640 1 -- 172.21.15.37:0/891995710 learned_addr learned my addr 172.21.15.37:0/891995710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc37fe640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cc4103900 0x7f6cc40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc3fff640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc4109b90 0x7f6cc4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc2ffd640 1 -- 172.21.15.37:0/891995710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cc4103900 msgr2=0x7f6cc40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc2ffd640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cc4103900 0x7f6cc40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc2ffd640 1 -- 172.21.15.37:0/891995710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc4109b90 msgr2=0x7f6cc4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc2ffd640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc4109b90 0x7f6cc4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:57.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc2ffd640 1 -- 172.21.15.37:0/891995710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc41a85b0 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc2ffd640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 0x7f6cc40759f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8005940 tx=0x7f6cb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc0ff9640 1 -- 172.21.15.37:0/891995710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb803f030 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc0ff9640 1 -- 172.21.15.37:0/891995710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cb8003c90 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc41a8840 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc0ff9640 1 -- 172.21.15.37:0/891995710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8035070 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.972+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc41a8da0 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.973+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cc4103d90 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.975+0000 7f6cc0ff9640 1 -- 172.21.15.37:0/891995710 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f6cb8042030 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.976+0000 7f6cc0ff9640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6cac0b4c10 0x7f6cac0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.976+0000 7f6cc37fe640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6cac0b4c10 0x7f6cac0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.976+0000 7f6cc0ff9640 1 -- 172.21.15.37:0/891995710 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6cb8105cc0 con 0x7f6cc4109240 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.976+0000 7f6cc37fe640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6cac0b4c10 0x7f6cac0b7120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4076f00 tx=0x7f6cb4009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:57.979+0000 7f6cc0ff9640 1 -- 172.21.15.37:0/891995710 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6cb80ccbb0 con 0x7f6cc4109240 2024-08-31T06:45:58.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.165+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cc402e430 con 0x7f6cc4109240 2024-08-31T06:45:58.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.166+0000 7f6cc0ff9640 1 -- 172.21.15.37:0/891995710 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+23049 (secure 0 0 0) 0x7f6cb80cc4b0 con 0x7f6cc4109240 2024-08-31T06:45:58.168 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:58.168 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:45:19.740510+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.168+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6cac0b4c10 msgr2=0x7f6cac0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.168+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6cac0b4c10 0x7f6cac0b7120 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4076f00 tx=0x7f6cb4009110 comp rx=0 tx=0).stop 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.168+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 msgr2=0x7f6cc40759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.168+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 0x7f6cc40759f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8005940 tx=0x7f6cb80042f0 comp rx=0 tx=0).stop 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.169+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 shutdown_connections 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.169+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6cac0b4c10 0x7f6cac0b7120 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.169+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc4109240 0x7f6cc40759f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.169+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cc4109b90 0x7f6cc4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.169+0000 7f6cc9ac1640 1 --2- 172.21.15.37:0/891995710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6cc4103900 0x7f6cc40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.169+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 >> 172.21.15.37:0/891995710 conn(0x7f6cc407b5f0 msgr2=0x7f6cc4107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.169+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 shutdown_connections 2024-08-31T06:45:58.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:58.169+0000 7f6cc9ac1640 1 -- 172.21.15.37:0/891995710 wait complete. 2024-08-31T06:45:58.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:58 smithi037 ceph-mon[18612]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:45:58.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:58 smithi106 ceph-mon[22134]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:45:58.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:58 smithi066 ceph-mon[22244]: pgmap v293: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:45:58.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:45:59.097 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:45:59.497 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:45:59 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/891995710' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:59.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:45:59 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/891995710' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 -- 172.21.15.37:0/784213659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec102800 msgr2=0x7fc3ec102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/784213659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec102800 0x7fc3ec102c10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009900 tx=0x7fc3e002a410 comp rx=0 tx=0).stop 2024-08-31T06:45:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 -- 172.21.15.37:0/784213659 shutdown_connections 2024-08-31T06:45:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/784213659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3ec108a90 0x7fc3ec10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/784213659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3ec108140 0x7fc3ec108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/784213659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec102800 0x7fc3ec102c10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 -- 172.21.15.37:0/784213659 >> 172.21.15.37:0/784213659 conn(0x7fc3ec0794d0 msgr2=0x7fc3ec0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 -- 172.21.15.37:0/784213659 shutdown_connections 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.585+0000 7fc3f2c45640 1 -- 172.21.15.37:0/784213659 wait complete. 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f2c45640 1 Processor -- start 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f2c45640 1 -- start start 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f2c45640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3ec102800 0x7fc3ec10fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f2c45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec108140 0x7fc3ec110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f2c45640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3ec108a90 0x7fc3ec1107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f2c45640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec113790 con 0x7fc3ec108140 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f2c45640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec113610 con 0x7fc3ec108a90 2024-08-31T06:45:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f2c45640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec113910 con 0x7fc3ec102800 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec108140 0x7fc3ec110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3ebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec108140 0x7fc3ec110290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32780/0 (socket says 172.21.15.37:32780) 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3ebfff640 1 -- 172.21.15.37:0/1980812497 learned_addr learned my addr 172.21.15.37:0/1980812497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f11e2640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3ec108a90 0x7fc3ec1107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.586+0000 7fc3f09e1640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3ec102800 0x7fc3ec10fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3ebfff640 1 -- 172.21.15.37:0/1980812497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3ec102800 msgr2=0x7fc3ec10fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3ebfff640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3ec102800 0x7fc3ec10fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3ebfff640 1 -- 172.21.15.37:0/1980812497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3ec108a90 msgr2=0x7fc3ec1107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3ebfff640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3ec108a90 0x7fc3ec1107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3ebfff640 1 -- 172.21.15.37:0/1980812497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec1a8520 con 0x7fc3ec108140 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3ebfff640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec108140 0x7fc3ec110290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800b450 tx=0x7fc3d800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3e9ffb640 1 -- 172.21.15.37:0/1980812497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8015020 con 0x7fc3ec108140 2024-08-31T06:45:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3e9ffb640 1 -- 172.21.15.37:0/1980812497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3d8011d20 con 0x7fc3ec108140 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec1a8810 con 0x7fc3ec108140 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3e9ffb640 1 -- 172.21.15.37:0/1980812497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8010e10 con 0x7fc3ec108140 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.587+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ec1a8dd0 con 0x7fc3ec108140 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.588+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ec102c90 con 0x7fc3ec108140 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.590+0000 7fc3e9ffb640 1 -- 172.21.15.37:0/1980812497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fc3d8018020 con 0x7fc3ec108140 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.590+0000 7fc3e9ffb640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3dc0b4c10 0x7fc3dc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.591+0000 7fc3f09e1640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3dc0b4c10 0x7fc3dc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.591+0000 7fc3e9ffb640 1 -- 172.21.15.37:0/1980812497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc3d80e4e00 con 0x7fc3ec108140 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.591+0000 7fc3f09e1640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3dc0b4c10 0x7fc3dc0b7120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec1117a0 tx=0x7fc3e00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:45:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.595+0000 7fc3e9ffb640 1 -- 172.21.15.37:0/1980812497 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc3d801f020 con 0x7fc3ec108140 2024-08-31T06:45:59.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:45:59 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/891995710' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:45:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.816+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3ec02e430 con 0x7fc3ec108140 2024-08-31T06:45:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.817+0000 7fc3e9ffb640 1 -- 172.21.15.37:0/1980812497 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7fc3d800d040 con 0x7fc3ec108140 2024-08-31T06:45:59.819 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:45:59.819 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"btime":"2024-08-31T06:44:54:657185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:44:54.319927+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24656,24695,24658]},"id":1}]} 2024-08-31T06:45:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-08-31T06:45:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.819+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3dc0b4c10 msgr2=0x7fc3dc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.819+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3dc0b4c10 0x7fc3dc0b7120 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec1117a0 tx=0x7fc3e00058d0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.819+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec108140 msgr2=0x7fc3ec110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:45:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.819+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec108140 0x7fc3ec110290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800b450 tx=0x7fc3d800b910 comp rx=0 tx=0).stop 2024-08-31T06:45:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.820+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 shutdown_connections 2024-08-31T06:45:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.820+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc3dc0b4c10 0x7fc3dc0b7120 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.820+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ec108140 0x7fc3ec110290 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.820+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc3ec108a90 0x7fc3ec1107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.820+0000 7fc3f2c45640 1 --2- 172.21.15.37:0/1980812497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3ec102800 0x7fc3ec10fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:45:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.820+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 >> 172.21.15.37:0/1980812497 conn(0x7fc3ec0794d0 msgr2=0x7fc3ec101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:45:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.820+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 shutdown_connections 2024-08-31T06:45:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:45:59.820+0000 7fc3f2c45640 1 -- 172.21.15.37:0/1980812497 wait complete. 2024-08-31T06:46:00.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:00 smithi037 ceph-mon[18612]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:00.468 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:00 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1980812497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:00.498 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T06:44:43.326015+0000', 'modified': '2024-08-31T06:44:54.319927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24695, 'mds_1': 24658, 'mds_2': 24656}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24629': {'gid': 24629, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/298046856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 298046856}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 298046856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.106:6835/2636907745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 2636907745}, {'type': 'v1', 'addr': '172.21.15.106:6835', 'nonce': 2636907745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.106:6837/1095097353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6836', 'nonce': 1095097353}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 1095097353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.66:6837/3257187794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 3257187794}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 3257187794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24658': {'gid': 24658, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.106:6839/1806859517', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6838', 'nonce': 1806859517}, {'type': 'v1', 'addr': '172.21.15.106:6839', 'nonce': 1806859517}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.66:6839/2855667585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2855667585}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2855667585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24656, 24695, 24658]} 2024-08-31T06:46:00.499 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-31T06:46:00.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T06:46:00.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:00 smithi106 ceph-mon[22134]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:00.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:00 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1980812497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:00.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:00 smithi066 ceph-mon[22244]: pgmap v294: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:00.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:00 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1980812497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 -- 172.21.15.37:0/1886017106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 msgr2=0x7f6a6c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 --2- 172.21.15.37:0/1886017106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 0x7f6a6c1103c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009ca0 tx=0x7f6a6402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 -- 172.21.15.37:0/1886017106 shutdown_connections 2024-08-31T06:46:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 --2- 172.21.15.37:0/1886017106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 0x7f6a6c1103c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 --2- 172.21.15.37:0/1886017106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a6c109240 0x7f6a6c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 --2- 172.21.15.37:0/1886017106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c103900 0x7f6a6c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 -- 172.21.15.37:0/1886017106 >> 172.21.15.37:0/1886017106 conn(0x7f6a6c07b5f0 msgr2=0x7f6a6c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 -- 172.21.15.37:0/1886017106 shutdown_connections 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 -- 172.21.15.37:0/1886017106 wait complete. 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.230+0000 7f6a72df0640 1 Processor -- start 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a72df0640 1 -- start start 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a72df0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c103900 0x7f6a6c19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a72df0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a6c109240 0x7f6a6c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a72df0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 0x7f6a6c19f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a72df0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c113750 con 0x7f6a6c109b90 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a72df0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c1135d0 con 0x7f6a6c103900 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a72df0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6c1138d0 con 0x7f6a6c109240 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 0x7f6a6c19f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 0x7f6a6c19f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32804/0 (socket says 172.21.15.37:32804) 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 -- 172.21.15.37:0/3292658280 learned_addr learned my addr 172.21.15.37:0/3292658280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a6c109240 0x7f6a6c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c103900 0x7f6a6c19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 -- 172.21.15.37:0/3292658280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a6c109240 msgr2=0x7f6a6c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a6c109240 0x7f6a6c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 -- 172.21.15.37:0/3292658280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c103900 msgr2=0x7f6a6c19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c103900 0x7f6a6c19a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 -- 172.21.15.37:0/3292658280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6c1a0050 con 0x7f6a6c109b90 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c103900 0x7f6a6c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.231+0000 7f6a7138d640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 0x7f6a6c19f920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6a64005cc0 tx=0x7f6a64032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.232+0000 7f6a69ffb640 1 -- 172.21.15.37:0/3292658280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64032e00 con 0x7f6a6c109b90 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.232+0000 7f6a72df0640 1 -- 172.21.15.37:0/3292658280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6c1a02e0 con 0x7f6a6c109b90 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.232+0000 7f6a69ffb640 1 -- 172.21.15.37:0/3292658280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a640044d0 con 0x7f6a6c109b90 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.232+0000 7f6a69ffb640 1 -- 172.21.15.37:0/3292658280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64030b70 con 0x7f6a6c109b90 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.232+0000 7f6a72df0640 1 -- 172.21.15.37:0/3292658280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a6c1a6aa0 con 0x7f6a6c109b90 2024-08-31T06:46:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.234+0000 7f6a79365740 1 Processor -- start 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a69ffb640 1 -- 172.21.15.37:0/3292658280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f6a6404e440 con 0x7f6a6c109b90 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a79365740 1 -- start start 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a79365740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 0x55bad5d147b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a79365740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d14cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a79365740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad594e280 0x55bad5d15230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a79365740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bad5c8b3f0 con 0x55bad59460a0 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a79365740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bad5c7a980 con 0x55bad596ef60 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a79365740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bad5c7e930 con 0x55bad594e280 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a70b8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d14cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a70b8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d14cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32810/0 (socket says 172.21.15.37:32810) 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a70b8c640 1 -- 172.21.15.37:0/845339051 learned_addr learned my addr 172.21.15.37:0/845339051 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 0x55bad5d147b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad594e280 0x55bad5d15230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a70b8c640 1 -- 172.21.15.37:0/845339051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad594e280 msgr2=0x55bad5d15230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad594e280 0x55bad5d15230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.235+0000 7f6a70b8c640 1 -- 172.21.15.37:0/845339051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 msgr2=0x55bad5d147b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 0x55bad5d147b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a70b8c640 1 -- 172.21.15.37:0/845339051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bad59da540 con 0x55bad59460a0 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a69ffb640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6a5c0b4c10 0x7f6a5c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad594e280 0x55bad5d15230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d14cf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000bb70 tx=0x7f6a6000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7eca8248496c42 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6a5c0b4c10 0x7f6a5c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a69ffb640 1 -- 172.21.15.37:0/3292658280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6a641067a0 con 0x7f6a6c109b90 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a56ffd640 1 -- 172.21.15.37:0/845339051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60017620 con 0x55bad59460a0 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a56ffd640 1 -- 172.21.15.37:0/845339051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a60017c50 con 0x55bad59460a0 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.236+0000 7f6a56ffd640 1 -- 172.21.15.37:0/845339051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000fac0 con 0x55bad59460a0 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 -- 172.21.15.37:0/845339051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 msgr2=0x55bad5d14cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6a5c0b4c10 0x7f6a5c0b7120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c108300 tx=0x7f6a58004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d14cf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000bb70 tx=0x7f6a6000d710 comp rx=0 tx=0).stop 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 -- 172.21.15.37:0/845339051 shutdown_connections 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d14cf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad594e280 0x55bad5d15230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 --2- 172.21.15.37:0/845339051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 0x55bad5d147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 -- 172.21.15.37:0/845339051 >> 172.21.15.37:0/845339051 conn(0x55bad5963350 msgr2=0x55bad5d126a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 -- 172.21.15.37:0/845339051 shutdown_connections 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 -- 172.21.15.37:0/845339051 wait complete. 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 -- start start 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.237+0000 7f6a79365740 1 Processor -- start 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a79365740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d1fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a79365740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 0x55bad5d20320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a79365740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad596ef60 0x55bad5d20860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a79365740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bad5add5f0 con 0x55bad59460a0 2024-08-31T06:46:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a79365740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bad5c01600 con 0x55bad594e280 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a79365740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bad5d22f90 con 0x55bad596ef60 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a70b8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d1fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a79365740 10 client.0 _ll_register_callbacks cb 0x55bad5c27af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a70b8c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d1fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32812/0 (socket says 172.21.15.37:32812) 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a70b8c640 1 -- 172.21.15.37:0/3329077369 learned_addr learned my addr 172.21.15.37:0/3329077369 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a7138d640 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad596ef60 0x55bad5d20860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 0x55bad5d20320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a70b8c640 1 -- 172.21.15.37:0/3329077369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad596ef60 msgr2=0x55bad5d20860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad596ef60 0x55bad5d20860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a70b8c640 1 -- 172.21.15.37:0/3329077369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 msgr2=0x55bad5d20320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 0x55bad5d20320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.238+0000 7f6a70b8c640 1 -- 172.21.15.37:0/3329077369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bad5c3a7b0 con 0x55bad59460a0 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d1fde0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a60019040 tx=0x7f6a6000b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba0376238a82a6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3329077369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60026070 con 0x55bad59460a0 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3329077369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6a60017420 con 0x55bad59460a0 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 1 -- 172.21.15.37:0/3329077369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a60017c50 con 0x55bad59460a0 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3329077369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6a60032050 con 0x55bad59460a0 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 10 client.15219 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 1 -- 172.21.15.37:0/3329077369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bad5d2eb80 con 0x55bad59460a0 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3329077369 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a60017c50 con 0x55bad59460a0 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3329077369 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6a600227c0 con 0x55bad59460a0 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 10 client.15219 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 10 client.15219 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 20 client.15219 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bad592d8e0 0x55bad5d32250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 4 client.15219 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.239+0000 7f6a79365740 1 -- 172.21.15.37:0/3329077369 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bad5c8d340 con 0x55bad592d8e0 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.240+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bad592d8e0 0x55bad5d32250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.240+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bad592d8e0 0x55bad5d32250 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8865e39b10ee7342 server_cookie=ad88baff213949e7 in_seq=0 out_seq=0 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.240+0000 7f6a4bfff640 10 client.15219 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3329077369 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bad5c8d340 con 0x55bad592d8e0 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a4bfff640 10 client.15219 handle_command_reply: tid=0 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 client.15219 shutdown 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 -- 172.21.15.37:0/3329077369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 msgr2=0x55bad5d1fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d1fde0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a60019040 tx=0x7f6a6000b620 comp rx=0 tx=0).stop 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 -- 172.21.15.37:0/3329077369 shutdown_connections 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bad592d8e0 0x55bad5d32250 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad596ef60 0x55bad5d20860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 0x55bad5d20320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a4bfff640 0 client.15219 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 --2- 172.21.15.37:0/3329077369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad59460a0 0x55bad5d1fde0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.241+0000 7f6a79365740 1 -- 172.21.15.37:0/3329077369 >> 172.21.15.37:0/3329077369 conn(0x55bad5963350 msgr2=0x55bad5d17940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:01.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.242+0000 7f6a79365740 1 -- 172.21.15.37:0/3329077369 shutdown_connections 2024-08-31T06:46:01.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.242+0000 7f6a79365740 1 -- 172.21.15.37:0/3329077369 wait complete. 2024-08-31T06:46:01.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.242+0000 7f6a79365740 20 client.15219 trim_cache size 0 max 16384 2024-08-31T06:46:01.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a79365740 1 Processor -- start 2024-08-31T06:46:01.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a79365740 1 -- start start 2024-08-31T06:46:01.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a79365740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 0x55bad5d1af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a79365740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad594e280 0x55bad5d1b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a79365740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 0x55bad5d1e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a79365740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bad5d30590 con 0x55bad594e280 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a79365740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bad5d30c60 con 0x55bad596ef60 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a79365740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bad5d31330 con 0x55bad59460a0 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad594e280 0x55bad5d1b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad594e280 0x55bad5d1b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32826/0 (socket says 172.21.15.37:32826) 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a6bfff640 1 -- 172.21.15.37:0/3706988993 learned_addr learned my addr 172.21.15.37:0/3706988993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a6bfff640 1 -- 172.21.15.37:0/3706988993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 msgr2=0x55bad5d1af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3706988993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 0x55bad5d1af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a6bfff640 1 -- 172.21.15.37:0/3706988993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 msgr2=0x55bad5d1e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3706988993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 0x55bad5d1e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.260+0000 7f6a6bfff640 1 -- 172.21.15.37:0/3706988993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bad5d210a0 con 0x55bad594e280 2024-08-31T06:46:01.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3706988993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad594e280 0x55bad5d1b4d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55bad5d32ba0 tx=0x7f6a58015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbb7168b938e912 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a567fc640 1 -- 172.21.15.37:0/3706988993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58030640 con 0x55bad594e280 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a567fc640 1 -- 172.21.15.37:0/3706988993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a5801f880 con 0x55bad594e280 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a567fc640 1 -- 172.21.15.37:0/3706988993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5802f870 con 0x55bad594e280 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a79365740 1 -- 172.21.15.37:0/3706988993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad594e280 msgr2=0x55bad5d1b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a79365740 1 --2- 172.21.15.37:0/3706988993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad594e280 0x55bad5d1b4d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55bad5d32ba0 tx=0x7f6a58015000 comp rx=0 tx=0).stop 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a79365740 1 -- 172.21.15.37:0/3706988993 shutdown_connections 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a79365740 1 --2- 172.21.15.37:0/3706988993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad594e280 0x55bad5d1b4d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.261+0000 7f6a79365740 1 --2- 172.21.15.37:0/3706988993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad596ef60 0x55bad5d1e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 --2- 172.21.15.37:0/3706988993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 0x55bad5d1af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 -- 172.21.15.37:0/3706988993 >> 172.21.15.37:0/3706988993 conn(0x55bad5963350 msgr2=0x55bad5d0d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 -- 172.21.15.37:0/3706988993 shutdown_connections 2024-08-31T06:46:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 -- 172.21.15.37:0/3706988993 wait complete. 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 -- start start 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 Processor -- start 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 0x55bad5d3ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 0x55bad5d398f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.262+0000 7f6a79365740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad596ef60 0x55bad5d39e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a79365740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bad5d320d0 con 0x55bad596ef60 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a79365740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bad5d31a00 con 0x55bad594e280 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a79365740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bad5d327a0 con 0x55bad59460a0 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a79365740 10 client.0 _ll_register_callbacks cb 0x7f6a6000fc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad596ef60 0x55bad5d39e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad596ef60 0x55bad5d39e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32828/0 (socket says 172.21.15.37:32828) 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 -- 172.21.15.37:0/3658445993 learned_addr learned my addr 172.21.15.37:0/3658445993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 0x55bad5d3ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a6bfff640 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 0x55bad5d398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 -- 172.21.15.37:0/3658445993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 msgr2=0x55bad5d3ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 0x55bad5d3ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 -- 172.21.15.37:0/3658445993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 msgr2=0x55bad5d398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 0x55bad5d398f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 -- 172.21.15.37:0/3658445993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bad5d3a570 con 0x55bad596ef60 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 0x55bad5d3ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a7138d640 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad596ef60 0x55bad5d39e30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6a641040a0 tx=0x7f6a641044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ace3d44492b6a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3658445993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a640d1800 con 0x55bad596ef60 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3658445993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6a640c9220 con 0x55bad596ef60 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a79365740 1 -- 172.21.15.37:0/3658445993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a5801f880 con 0x55bad596ef60 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3658445993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6a64090050 con 0x55bad596ef60 2024-08-31T06:46:01.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.263+0000 7f6a79365740 10 client.15225 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a79365740 1 -- 172.21.15.37:0/3658445993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55bad5d9d720 con 0x55bad596ef60 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3658445993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a5801f880 con 0x55bad596ef60 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3658445993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6a640cd2a0 con 0x55bad596ef60 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a79365740 10 client.15225 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a79365740 10 client.15225 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a79365740 20 client.15225 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a79365740 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bad5902c90 0x55bad5da0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a79365740 4 client.15225 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a79365740 1 -- 172.21.15.37:0/3658445993 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "status"}) -- 0x55bad5c88de0 con 0x55bad5902c90 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.264+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bad5902c90 0x55bad5da0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a70b8c640 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bad5902c90 0x55bad5da0f00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b6c4073fa4625f84 server_cookie=512526fef7b31c8b in_seq=0 out_seq=0 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a4bfff640 10 client.15225 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a4bfff640 1 -- 172.21.15.37:0/3658445993 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bad5c88de0 con 0x55bad5902c90 2024-08-31T06:46:01.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a4bfff640 10 client.15225 handle_command_reply: tid=0 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 client.15225 shutdown 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 -- 172.21.15.37:0/3658445993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad596ef60 msgr2=0x55bad5d39e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad596ef60 0x55bad5d39e30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6a641040a0 tx=0x7f6a641044f0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 -- 172.21.15.37:0/3658445993 shutdown_connections 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bad596ef60 0x55bad5d39e30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bad5902c90 0x55bad5da0f00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bad594e280 0x55bad5d398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 --2- 172.21.15.37:0/3658445993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bad59460a0 0x55bad5d3ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a4bfff640 0 client.15225 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 -- 172.21.15.37:0/3658445993 >> 172.21.15.37:0/3658445993 conn(0x55bad5963350 msgr2=0x55bad5d1af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 -- 172.21.15.37:0/3658445993 shutdown_connections 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 1 -- 172.21.15.37:0/3658445993 wait complete. 2024-08-31T06:46:01.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.265+0000 7f6a79365740 20 client.15225 trim_cache size 0 max 16384 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24656, 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 69.618419328000002, 2024-08-31T06:46:01.272 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 24, 2024-08-31T06:46:01.273 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:46:01.273 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:46:01.273 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 100.139140899 2024-08-31T06:46:01.273 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:01.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 -- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6a5c0b4c10 msgr2=0x7f6a5c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6a5c0b4c10 0x7f6a5c0b7120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c108300 tx=0x7f6a58004730 comp rx=0 tx=0).stop 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 -- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 msgr2=0x7f6a6c19f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 0x7f6a6c19f920 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6a64005cc0 tx=0x7f6a64032a10 comp rx=0 tx=0).stop 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 -- 172.21.15.37:0/3292658280 shutdown_connections 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6a5c0b4c10 0x7f6a5c0b7120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a6c109b90 0x7f6a6c19f920 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a6c109240 0x7f6a6c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 --2- 172.21.15.37:0/3292658280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a6c103900 0x7f6a6c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 -- 172.21.15.37:0/3292658280 >> 172.21.15.37:0/3292658280 conn(0x7f6a6c07b5f0 msgr2=0x7f6a6c107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 -- 172.21.15.37:0/3292658280 shutdown_connections 2024-08-31T06:46:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:01.266+0000 7f6a72df0640 1 -- 172.21.15.37:0/3292658280 wait complete. 2024-08-31T06:46:01.466 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:01 smithi106 ceph-mon[22134]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:01.539 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:01 smithi066 ceph-mon[22244]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:01.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:01 smithi037 ceph-mon[18612]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:02.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T06:46:02.317 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 -- 172.21.15.37:0/1085609734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248103900 msgr2=0x7f2248103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 --2- 172.21.15.37:0/1085609734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248103900 0x7f2248103d10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2238009900 tx=0x7f223802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 -- 172.21.15.37:0/1085609734 shutdown_connections 2024-08-31T06:46:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 --2- 172.21.15.37:0/1085609734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2248109b90 0x7f22481103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 --2- 172.21.15.37:0/1085609734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2248109240 0x7f2248109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 --2- 172.21.15.37:0/1085609734 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248103900 0x7f2248103d10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 -- 172.21.15.37:0/1085609734 >> 172.21.15.37:0/1085609734 conn(0x7f224807b5f0 msgr2=0x7f224807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 -- 172.21.15.37:0/1085609734 shutdown_connections 2024-08-31T06:46:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.779+0000 7f224e6d6640 1 -- 172.21.15.37:0/1085609734 wait complete. 2024-08-31T06:46:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.780+0000 7f224e6d6640 1 Processor -- start 2024-08-31T06:46:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.780+0000 7f224e6d6640 1 -- start start 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224e6d6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2248103900 0x7f2248198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224e6d6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2248109240 0x7f2248199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224e6d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248109b90 0x7f224819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224e6d6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2248113700 con 0x7f2248109b90 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224e6d6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2248113580 con 0x7f2248103900 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224e6d6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2248113880 con 0x7f2248109240 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248109b90 0x7f224819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248109b90 0x7f224819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32842/0 (socket says 172.21.15.37:32842) 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 -- 172.21.15.37:0/2847399410 learned_addr learned my addr 172.21.15.37:0/2847399410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f2247fff640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2248103900 0x7f2248198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f22477fe640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2248109240 0x7f2248199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 -- 172.21.15.37:0/2847399410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2248109240 msgr2=0x7f2248199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2248109240 0x7f2248199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 -- 172.21.15.37:0/2847399410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2248103900 msgr2=0x7f2248198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2248103900 0x7f2248198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 -- 172.21.15.37:0/2847399410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22481a0170 con 0x7f2248109b90 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.781+0000 7f224cc73640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248109b90 0x7f224819fc30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f224000eb10 tx=0x7f224000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.782+0000 7f22457fa640 1 -- 172.21.15.37:0/2847399410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240004b20 con 0x7f2248109b90 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.782+0000 7f22457fa640 1 -- 172.21.15.37:0/2847399410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2240004cc0 con 0x7f2248109b90 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.782+0000 7f224e6d6640 1 -- 172.21.15.37:0/2847399410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22481a0460 con 0x7f2248109b90 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.782+0000 7f22457fa640 1 -- 172.21.15.37:0/2847399410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240010690 con 0x7f2248109b90 2024-08-31T06:46:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.782+0000 7f224e6d6640 1 -- 172.21.15.37:0/2847399410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22481a09a0 con 0x7f2248109b90 2024-08-31T06:46:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.784+0000 7f2254c4b740 1 Processor -- start 2024-08-31T06:46:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f22457fa640 1 -- 172.21.15.37:0/2847399410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f2240010830 con 0x7f2248109b90 2024-08-31T06:46:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f2254c4b740 1 -- start start 2024-08-31T06:46:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d8eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d51d0a0 0x561b5d8ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 0x561b5d8ec230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f2254c4b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b5d8623f0 con 0x561b5d545f60 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f2254c4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561b5d851980 con 0x561b5d51d0a0 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f2254c4b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561b5d855930 con 0x561b5d525280 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f22477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d8eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f22477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d8eb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32854/0 (socket says 172.21.15.37:32854) 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f22477fe640 1 -- 172.21.15.37:0/345309187 learned_addr learned my addr 172.21.15.37:0/345309187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f2247fff640 1 --2- 172.21.15.37:0/345309187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d51d0a0 0x561b5d8ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.785+0000 7f22457fa640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22300b4c40 0x7f22300b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f22477fe640 1 -- 172.21.15.37:0/345309187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 msgr2=0x561b5d8ec230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f22477fe640 1 --2- 172.21.15.37:0/345309187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 0x561b5d8ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f22477fe640 1 -- 172.21.15.37:0/345309187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d51d0a0 msgr2=0x561b5d8ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f22477fe640 1 --2- 172.21.15.37:0/345309187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d51d0a0 0x561b5d8ebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f22477fe640 1 -- 172.21.15.37:0/345309187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5d5b1540 con 0x561b5d545f60 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f224cc73640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22300b4c40 0x7f22300b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f22477fe640 1 --2- 172.21.15.37:0/345309187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d8eb7b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f223c00acb0 tx=0x7f223c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26ca22cea675057 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f22457fa640 1 -- 172.21.15.37:0/2847399410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f22400e5940 con 0x7f2248109b90 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f222e7fc640 1 -- 172.21.15.37:0/345309187 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c004220 con 0x561b5d545f60 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f222e7fc640 1 -- 172.21.15.37:0/345309187 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f223c0043c0 con 0x561b5d545f60 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f222e7fc640 1 -- 172.21.15.37:0/345309187 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c004cf0 con 0x561b5d545f60 2024-08-31T06:46:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.786+0000 7f224cc73640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22300b4c40 0x7f22300b7150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f224001c000 tx=0x7f22400795d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 -- 172.21.15.37:0/345309187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 msgr2=0x561b5d8eb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 --2- 172.21.15.37:0/345309187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d8eb7b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f223c00acb0 tx=0x7f223c00f790 comp rx=0 tx=0).stop 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 -- 172.21.15.37:0/345309187 shutdown_connections 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 --2- 172.21.15.37:0/345309187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 0x561b5d8ec230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 --2- 172.21.15.37:0/345309187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d51d0a0 0x561b5d8ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 --2- 172.21.15.37:0/345309187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d8eb7b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 -- 172.21.15.37:0/345309187 >> 172.21.15.37:0/345309187 conn(0x561b5d53a350 msgr2=0x561b5d8e96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 -- 172.21.15.37:0/345309187 shutdown_connections 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 -- 172.21.15.37:0/345309187 wait complete. 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.787+0000 7f2254c4b740 1 -- start start 2024-08-31T06:46:02.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2254c4b740 1 Processor -- start 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d51d0a0 0x561b5d8f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d903220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2254c4b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b5d6b45f0 con 0x561b5d545f60 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2254c4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561b5d7d8600 con 0x561b5d525280 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2254c4b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561b5d8f9f30 con 0x561b5d51d0a0 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2254c4b740 10 client.0 _ll_register_callbacks cb 0x561b5d7feaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f22477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d903220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f22477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d903220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32858/0 (socket says 172.21.15.37:32858) 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f22477fe640 1 -- 172.21.15.37:0/2755994108 learned_addr learned my addr 172.21.15.37:0/2755994108 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f22477fe640 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d51d0a0 0x561b5d8f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.788+0000 7f2247fff640 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22477fe640 1 -- 172.21.15.37:0/2755994108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d51d0a0 msgr2=0x561b5d8f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:02.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22477fe640 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d51d0a0 0x561b5d8f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22477fe640 1 -- 172.21.15.37:0/2755994108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 msgr2=0x561b5d8f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22477fe640 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22477fe640 1 -- 172.21.15.37:0/2755994108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5d8117b0 con 0x561b5d545f60 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22477fe640 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d903220 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f223c004910 tx=0x7f223c00afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149c65fdfd66cc37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22277fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22277fe640 1 -- 172.21.15.37:0/2755994108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c02e060 con 0x561b5d545f60 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22277fe640 1 -- 172.21.15.37:0/2755994108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f223c018440 con 0x561b5d545f60 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f2254c4b740 1 -- 172.21.15.37:0/2755994108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f223c0043c0 con 0x561b5d545f60 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22277fe640 1 -- 172.21.15.37:0/2755994108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f223c01c050 con 0x561b5d545f60 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f2254c4b740 10 client.15237 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f2254c4b740 1 -- 172.21.15.37:0/2755994108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561b5d905c70 con 0x561b5d545f60 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22277fe640 1 -- 172.21.15.37:0/2755994108 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f223c0043c0 con 0x561b5d545f60 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.789+0000 7f22277fe640 1 -- 172.21.15.37:0/2755994108 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f223c010530 con 0x561b5d545f60 2024-08-31T06:46:02.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f2254c4b740 10 client.15237 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f2254c4b740 10 client.15237 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f2254c4b740 20 client.15237 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f2254c4b740 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561b5d5048e0 0x561b5d909240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f2254c4b740 4 client.15237 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f2254c4b740 1 -- 172.21.15.37:0/2755994108 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b5d864340 con 0x561b5d5048e0 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f2247fff640 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561b5d5048e0 0x561b5d909240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f22277fe640 10 client.15237 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.790+0000 7f2247fff640 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561b5d5048e0 0x561b5d909240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=550b6fddef8e4e01 server_cookie=f880832a98487ad2 in_seq=0 out_seq=0 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f22277fe640 1 -- 172.21.15.37:0/2755994108 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b5d864340 con 0x561b5d5048e0 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f22277fe640 10 client.15237 handle_command_reply: tid=0 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 client.15237 shutdown 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 -- 172.21.15.37:0/2755994108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 msgr2=0x561b5d903220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d903220 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f223c004910 tx=0x7f223c00afd0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 -- 172.21.15.37:0/2755994108 shutdown_connections 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561b5d5048e0 0x561b5d909240 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d545f60 0x561b5d903220 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 --2- 172.21.15.37:0/2755994108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d51d0a0 0x561b5d8f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 -- 172.21.15.37:0/2755994108 >> 172.21.15.37:0/2755994108 conn(0x561b5d53a350 msgr2=0x561b5d8ee990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f22277fe640 0 client.15237 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 -- 172.21.15.37:0/2755994108 shutdown_connections 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.791+0000 7f2254c4b740 1 -- 172.21.15.37:0/2755994108 wait complete. 2024-08-31T06:46:02.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.792+0000 7f2254c4b740 20 client.15237 trim_cache size 0 max 16384 2024-08-31T06:46:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f2254c4b740 1 Processor -- start 2024-08-31T06:46:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f2254c4b740 1 -- start start 2024-08-31T06:46:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d903190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d545f60 0x561b5d8f2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f2254c4b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b5d907580 con 0x561b5d51d0a0 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f2254c4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561b5d907c50 con 0x561b5d525280 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f2254c4b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561b5d908320 con 0x561b5d545f60 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f22477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d903190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f22477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d903190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32862/0 (socket says 172.21.15.37:32862) 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.810+0000 7f22477fe640 1 -- 172.21.15.37:0/1451993660 learned_addr learned my addr 172.21.15.37:0/1451993660 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f2247fff640 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f22477fe640 1 -- 172.21.15.37:0/1451993660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d545f60 msgr2=0x561b5d8f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f22477fe640 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d545f60 0x561b5d8f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f22477fe640 1 -- 172.21.15.37:0/1451993660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 msgr2=0x561b5d8f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f22477fe640 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f22477fe640 1 -- 172.21.15.37:0/1451993660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5d504b10 con 0x561b5d51d0a0 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f2247fff640 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f22477fe640 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d903190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f223c000c00 tx=0x7f223c00aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c784b8ac96e10482 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f222dffb640 1 -- 172.21.15.37:0/1451993660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c02e040 con 0x561b5d51d0a0 2024-08-31T06:46:02.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f222dffb640 1 -- 172.21.15.37:0/1451993660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f223c005630 con 0x561b5d51d0a0 2024-08-31T06:46:02.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.811+0000 7f222dffb640 1 -- 172.21.15.37:0/1451993660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c0339d0 con 0x561b5d51d0a0 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 -- 172.21.15.37:0/1451993660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 msgr2=0x561b5d903190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d903190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f223c000c00 tx=0x7f223c00aa90 comp rx=0 tx=0).stop 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 -- 172.21.15.37:0/1451993660 shutdown_connections 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d545f60 0x561b5d8f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d525280 0x561b5d8f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 --2- 172.21.15.37:0/1451993660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d903190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 -- 172.21.15.37:0/1451993660 >> 172.21.15.37:0/1451993660 conn(0x561b5d53a350 msgr2=0x561b5d8e4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 -- 172.21.15.37:0/1451993660 shutdown_connections 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 -- 172.21.15.37:0/1451993660 wait complete. 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.812+0000 7f2254c4b740 1 -- start start 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2254c4b740 1 Processor -- start 2024-08-31T06:46:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d90aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 0x561b5d90b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2254c4b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d545f60 0x561b5d90fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2254c4b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b5d9090c0 con 0x561b5d51d0a0 2024-08-31T06:46:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2254c4b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561b5d9089f0 con 0x561b5d545f60 2024-08-31T06:46:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2254c4b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561b5d909790 con 0x561b5d525280 2024-08-31T06:46:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2254c4b740 10 client.0 _ll_register_callbacks cb 0x7f223c0050b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f22477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d90aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f22477fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d90aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32870/0 (socket says 172.21.15.37:32870) 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f22477fe640 1 -- 172.21.15.37:0/3770581000 learned_addr learned my addr 172.21.15.37:0/3770581000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.813+0000 7f2247fff640 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 0x561b5d90b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22477fe640 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d545f60 0x561b5d90fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22477fe640 1 -- 172.21.15.37:0/3770581000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 msgr2=0x561b5d90b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22477fe640 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 0x561b5d90b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22477fe640 1 -- 172.21.15.37:0/3770581000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d545f60 msgr2=0x561b5d90fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22477fe640 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d545f60 0x561b5d90fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22477fe640 1 -- 172.21.15.37:0/3770581000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5d910550 con 0x561b5d51d0a0 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22477fe640 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d90aa70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f223c004910 tx=0x7f223c00fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f672cb91fb69e75 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22277fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22277fe640 1 -- 172.21.15.37:0/3770581000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f223c02e040 con 0x561b5d51d0a0 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22277fe640 1 -- 172.21.15.37:0/3770581000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f223c033880 con 0x561b5d51d0a0 2024-08-31T06:46:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f2254c4b740 1 -- 172.21.15.37:0/3770581000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f223c005630 con 0x561b5d51d0a0 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22277fe640 1 -- 172.21.15.37:0/3770581000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f223c033a80 con 0x561b5d51d0a0 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f2254c4b740 10 client.15243 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f2254c4b740 1 -- 172.21.15.37:0/3770581000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561b5d911880 con 0x561b5d51d0a0 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.814+0000 7f22277fe640 1 -- 172.21.15.37:0/3770581000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f223c005630 con 0x561b5d51d0a0 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f22277fe640 1 -- 172.21.15.37:0/3770581000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f223c03b030 con 0x561b5d51d0a0 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f2254c4b740 10 client.15243 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f2254c4b740 10 client.15243 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f2254c4b740 20 client.15243 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f2254c4b740 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561b5d4d9c90 0x561b5d977240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f2254c4b740 4 client.15243 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f2254c4b740 1 -- 172.21.15.37:0/3770581000 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "status"}) -- 0x561b5d85fde0 con 0x561b5d4d9c90 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f2247fff640 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561b5d4d9c90 0x561b5d977240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f2247fff640 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561b5d4d9c90 0x561b5d977240 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1d2dc1e4d9729ac7 server_cookie=40286d60bba947cd in_seq=0 out_seq=0 2024-08-31T06:46:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f22277fe640 10 client.15243 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f22277fe640 1 -- 172.21.15.37:0/3770581000 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x561b5d85fde0 con 0x561b5d4d9c90 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.815+0000 7f22277fe640 10 client.15243 handle_command_reply: tid=0 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 client.15243 shutdown 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 -- 172.21.15.37:0/3770581000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 msgr2=0x561b5d90aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d90aa70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f223c004910 tx=0x7f223c00fcd0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 -- 172.21.15.37:0/3770581000 shutdown_connections 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561b5d4d9c90 0x561b5d977240 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561b5d545f60 0x561b5d90fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561b5d525280 0x561b5d90b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 --2- 172.21.15.37:0/3770581000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b5d51d0a0 0x561b5d90aa70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f22277fe640 0 client.15243 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 -- 172.21.15.37:0/3770581000 >> 172.21.15.37:0/3770581000 conn(0x561b5d53a350 msgr2=0x561b5d8f6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 -- 172.21.15.37:0/3770581000 shutdown_connections 2024-08-31T06:46:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 1 -- 172.21.15.37:0/3770581000 wait complete. 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f2254c4b740 20 client.15243 trim_cache size 0 max 16384 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24658, 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:46:02.823 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 72.174424406, 2024-08-31T06:46:02.824 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 24, 2024-08-31T06:46:02.824 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:46:02.824 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:46:02.824 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 99.115887864000001 2024-08-31T06:46:02.824 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:02.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f224e6d6640 1 -- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22300b4c40 msgr2=0x7f22300b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f224e6d6640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22300b4c40 0x7f22300b7150 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f224001c000 tx=0x7f22400795d0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f224e6d6640 1 -- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248109b90 msgr2=0x7f224819fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.816+0000 7f224e6d6640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248109b90 0x7f224819fc30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f224000eb10 tx=0x7f224000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.817+0000 7f224e6d6640 1 -- 172.21.15.37:0/2847399410 shutdown_connections 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.817+0000 7f224e6d6640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f22300b4c40 0x7f22300b7150 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.817+0000 7f224e6d6640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2248109b90 0x7f224819fc30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.817+0000 7f224e6d6640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2248109240 0x7f2248199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.817+0000 7f224e6d6640 1 --2- 172.21.15.37:0/2847399410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2248103900 0x7f2248198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.817+0000 7f224e6d6640 1 -- 172.21.15.37:0/2847399410 >> 172.21.15.37:0/2847399410 conn(0x7f224807b5f0 msgr2=0x7f2248107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.817+0000 7f224e6d6640 1 -- 172.21.15.37:0/2847399410 shutdown_connections 2024-08-31T06:46:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:02.817+0000 7f224e6d6640 1 -- 172.21.15.37:0/2847399410 wait complete. 2024-08-31T06:46:03.510 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:03 smithi037 ceph-mon[18612]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:46:03.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T06:46:03.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:03 smithi066 ceph-mon[22244]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:46:03.788 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:03.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:03 smithi106 ceph-mon[22134]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 -- 172.21.15.37:0/3251434033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1081f0 msgr2=0x7f902c108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 --2- 172.21.15.37:0/3251434033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1081f0 0x7f902c108600 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f901c009900 tx=0x7f901c02a410 comp rx=0 tx=0).stop 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 -- 172.21.15.37:0/3251434033 shutdown_connections 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 --2- 172.21.15.37:0/3251434033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1081f0 0x7f902c108600 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 --2- 172.21.15.37:0/3251434033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f902c108b40 0x7f902c10f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 --2- 172.21.15.37:0/3251434033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c1028b0 0x7f902c102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 -- 172.21.15.37:0/3251434033 >> 172.21.15.37:0/3251434033 conn(0x7f902c079470 msgr2=0x7f902c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 -- 172.21.15.37:0/3251434033 shutdown_connections 2024-08-31T06:46:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.396+0000 7f9033770640 1 -- 172.21.15.37:0/3251434033 wait complete. 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.397+0000 7f9033770640 1 Processor -- start 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.397+0000 7f9033770640 1 -- start start 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.397+0000 7f9033770640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1028b0 0x7f902c19a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.397+0000 7f9033770640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f902c1081f0 0x7f902c19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.397+0000 7f9033770640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c108b40 0x7f902c19fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.397+0000 7f9033770640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f902c112670 con 0x7f902c1028b0 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.397+0000 7f9033770640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1124f0 con 0x7f902c108b40 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.397+0000 7f9033770640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1127f0 con 0x7f902c1081f0 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1028b0 0x7f902c19a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1028b0 0x7f902c19a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33290/0 (socket says 172.21.15.37:33290) 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 -- 172.21.15.37:0/2315932288 learned_addr learned my addr 172.21.15.37:0/2315932288 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f9030d0b640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f902c1081f0 0x7f902c19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 -- 172.21.15.37:0/2315932288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f902c1081f0 msgr2=0x7f902c19a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f902c1081f0 0x7f902c19a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f9031d0d640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c108b40 0x7f902c19fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 -- 172.21.15.37:0/2315932288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c108b40 msgr2=0x7f902c19fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c108b40 0x7f902c19fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 -- 172.21.15.37:0/2315932288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c1a0180 con 0x7f902c1028b0 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f9030d0b640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f902c1081f0 0x7f902c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f9031d0d640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c108b40 0x7f902c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f903150c640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1028b0 0x7f902c19a2d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f902800c920 tx=0x7f902800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f90227fc640 1 -- 172.21.15.37:0/2315932288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028007c70 con 0x7f902c1028b0 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f90227fc640 1 -- 172.21.15.37:0/2315932288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9028007e10 con 0x7f902c1028b0 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f9033770640 1 -- 172.21.15.37:0/2315932288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c1a0470 con 0x7f902c1028b0 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f90227fc640 1 -- 172.21.15.37:0/2315932288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9028018710 con 0x7f902c1028b0 2024-08-31T06:46:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.398+0000 7f9033770640 1 -- 172.21.15.37:0/2315932288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c1a6c90 con 0x7f902c1028b0 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.401+0000 7f9039ce5740 1 Processor -- start 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.401+0000 7f9039ce5740 1 -- start start 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.401+0000 7f90227fc640 1 -- 172.21.15.37:0/2315932288 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f902800f450 con 0x7f902c1028b0 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 0x55cb321bf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df9280 0x55cb321c0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9039ce5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb321363f0 con 0x55cb31df10a0 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9039ce5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cb32125980 con 0x55cb31df9280 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9039ce5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55cb32129930 con 0x55cb31e19f60 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321bfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33304/0 (socket says 172.21.15.37:33304) 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 -- 172.21.15.37:0/3280772611 learned_addr learned my addr 172.21.15.37:0/3280772611 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9031d0d640 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 0x55cb321bf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df9280 0x55cb321c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 -- 172.21.15.37:0/3280772611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 msgr2=0x55cb321bf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 0x55cb321bf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 -- 172.21.15.37:0/3280772611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df9280 msgr2=0x55cb321c0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df9280 0x55cb321c0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 -- 172.21.15.37:0/3280772611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb31e85540 con 0x55cb31df10a0 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9031d0d640 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 0x55cb321bf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df9280 0x55cb321c0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f903150c640 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321bfcf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f90280e2e60 tx=0x7f90280ebd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5909c22dbb68715 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f90227fc640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90180b4c40 0x7f90180b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.402+0000 7f9031d0d640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90180b4c40 0x7f90180b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.403+0000 7f90177fe640 1 -- 172.21.15.37:0/3280772611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90280a7d00 con 0x55cb31df10a0 2024-08-31T06:46:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.403+0000 7f90227fc640 1 -- 172.21.15.37:0/2315932288 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f90280e5650 con 0x7f902c1028b0 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.403+0000 7f90177fe640 1 -- 172.21.15.37:0/3280772611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90280f2070 con 0x55cb31df10a0 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.403+0000 7f90177fe640 1 -- 172.21.15.37:0/3280772611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90280aa950 con 0x55cb31df10a0 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.403+0000 7f9039ce5740 1 -- 172.21.15.37:0/3280772611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 msgr2=0x55cb321bfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.403+0000 7f9031d0d640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90180b4c40 0x7f90180b7150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9024005fd0 tx=0x7f9024008450 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.403+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321bfcf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f90280e2e60 tx=0x7f90280ebd90 comp rx=0 tx=0).stop 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 -- 172.21.15.37:0/3280772611 shutdown_connections 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321bfcf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df9280 0x55cb321c0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3280772611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 0x55cb321bf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 -- 172.21.15.37:0/3280772611 >> 172.21.15.37:0/3280772611 conn(0x55cb31e0e350 msgr2=0x55cb321bd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 -- 172.21.15.37:0/3280772611 shutdown_connections 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 -- 172.21.15.37:0/3280772611 wait complete. 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 -- start start 2024-08-31T06:46:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.404+0000 7f9039ce5740 1 Processor -- start 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321cae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321d7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9039ce5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb31f885f0 con 0x55cb31df10a0 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9039ce5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cb320ac600 con 0x55cb31e19f60 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9039ce5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55cb321cdf90 con 0x55cb31df9280 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9039ce5740 10 client.0 _ll_register_callbacks cb 0x55cb320d2af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321cae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33316/0 (socket says 172.21.15.37:33316) 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 -- 172.21.15.37:0/3025611938 learned_addr learned my addr 172.21.15.37:0/3025611938 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9031d0d640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321d7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 -- 172.21.15.37:0/3025611938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 msgr2=0x55cb321cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 -- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 msgr2=0x55cb321d7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321d7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 -- 172.21.15.37:0/3025611938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb320e57b0 con 0x55cb31df10a0 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9031d0d640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321d7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f903150c640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321cae70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f902800fd80 tx=0x7f90280e9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f927fc89fbcd6f99 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9014ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.405+0000 7f9014ff9640 1 -- 172.21.15.37:0/3025611938 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90280ae070 con 0x55cb31df10a0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9014ff9640 1 -- 172.21.15.37:0/3025611938 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f90280e3170 con 0x55cb31df10a0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 1 -- 172.21.15.37:0/3025611938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90280f2070 con 0x55cb31df10a0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9014ff9640 1 -- 172.21.15.37:0/3025611938 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f90280ab5b0 con 0x55cb31df10a0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 10 client.15255 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 1 -- 172.21.15.37:0/3025611938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cb321d9c70 con 0x55cb31df10a0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9014ff9640 1 -- 172.21.15.37:0/3025611938 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90280f2070 con 0x55cb31df10a0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9014ff9640 1 -- 172.21.15.37:0/3025611938 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90280e5cd0 con 0x55cb31df10a0 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 10 client.15255 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 10 client.15255 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 20 client.15255 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb31dd88e0 0x55cb321dd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 4 client.15255 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.406+0000 7f9039ce5740 1 -- 172.21.15.37:0/3025611938 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb32138340 con 0x55cb31dd88e0 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.407+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb31dd88e0 0x55cb321dd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.407+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb31dd88e0 0x55cb321dd0d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fdd0e82f454f5db server_cookie=4d405b1ec33c4827 in_seq=0 out_seq=0 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.407+0000 7f9014ff9640 10 client.15255 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9014ff9640 1 -- 172.21.15.37:0/3025611938 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb32138340 con 0x55cb31dd88e0 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9014ff9640 10 client.15255 handle_command_reply: tid=0 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 client.15255 shutdown 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 -- 172.21.15.37:0/3025611938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 msgr2=0x55cb321cae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321cae70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f902800fd80 tx=0x7f90280e9000 comp rx=0 tx=0).stop 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 -- 172.21.15.37:0/3025611938 shutdown_connections 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb31dd88e0 0x55cb321dd0d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321d7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3025611938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321cae70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 -- 172.21.15.37:0/3025611938 >> 172.21.15.37:0/3025611938 conn(0x55cb31e0e350 msgr2=0x55cb321c2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9014ff9640 0 client.15255 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 -- 172.21.15.37:0/3025611938 shutdown_connections 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.408+0000 7f9039ce5740 1 -- 172.21.15.37:0/3025611938 wait complete. 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.409+0000 7f9039ce5740 20 client.15255 trim_cache size 0 max 16384 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9039ce5740 1 Processor -- start 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9039ce5740 1 -- start start 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df10a0 0x55cb321dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df9280 0x55cb321d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 0x55cb321cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9039ce5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb321db410 con 0x55cb31df9280 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9039ce5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cb321dbae0 con 0x55cb31df10a0 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9039ce5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55cb321dc1b0 con 0x55cb31e19f60 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df9280 0x55cb321d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df9280 0x55cb321d71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33328/0 (socket says 172.21.15.37:33328) 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 -- 172.21.15.37:0/2062425346 learned_addr learned my addr 172.21.15.37:0/2062425346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f903150c640 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df10a0 0x55cb321dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 -- 172.21.15.37:0/2062425346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 msgr2=0x55cb321cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 0x55cb321cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 -- 172.21.15.37:0/2062425346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df10a0 msgr2=0x55cb321dbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df10a0 0x55cb321dbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 -- 172.21.15.37:0/2062425346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb321b8a70 con 0x55cb31df9280 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f903150c640 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df10a0 0x55cb321dbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.427+0000 7f9030d0b640 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df9280 0x55cb321d71f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f901c005ab0 tx=0x7f901c02aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb060082c208b73 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9016ffd640 1 -- 172.21.15.37:0/2062425346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c049070 con 0x55cb31df9280 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9016ffd640 1 -- 172.21.15.37:0/2062425346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f901c005040 con 0x55cb31df9280 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9016ffd640 1 -- 172.21.15.37:0/2062425346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c035040 con 0x55cb31df9280 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9039ce5740 1 -- 172.21.15.37:0/2062425346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df9280 msgr2=0x55cb321d71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9039ce5740 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df9280 0x55cb321d71f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f901c005ab0 tx=0x7f901c02aa90 comp rx=0 tx=0).stop 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9039ce5740 1 -- 172.21.15.37:0/2062425346 shutdown_connections 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9039ce5740 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df9280 0x55cb321d71f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9039ce5740 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31e19f60 0x55cb321cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.428+0000 7f9039ce5740 1 --2- 172.21.15.37:0/2062425346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31df10a0 0x55cb321dbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.429+0000 7f9039ce5740 1 -- 172.21.15.37:0/2062425346 >> 172.21.15.37:0/2062425346 conn(0x55cb31e0e350 msgr2=0x55cb321c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.429+0000 7f9039ce5740 1 -- 172.21.15.37:0/2062425346 shutdown_connections 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.429+0000 7f9039ce5740 1 -- 172.21.15.37:0/2062425346 wait complete. 2024-08-31T06:46:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.429+0000 7f9039ce5740 1 -- start start 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.429+0000 7f9039ce5740 1 Processor -- start 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9039ce5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321dec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9039ce5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb321dcf50 con 0x55cb31df10a0 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9039ce5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cb321dc880 con 0x55cb31e19f60 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9039ce5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55cb321dd620 con 0x55cb31df9280 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9039ce5740 10 client.0 _ll_register_callbacks cb 0x7f90280076c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321e56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33332/0 (socket says 172.21.15.37:33332) 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 -- 172.21.15.37:0/3342176559 learned_addr learned my addr 172.21.15.37:0/3342176559 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9031d0d640 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321dec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 -- 172.21.15.37:0/3342176559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 msgr2=0x55cb321e5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321e5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 -- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 msgr2=0x55cb321dec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321dec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 -- 172.21.15.37:0/3342176559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb321df420 con 0x55cb31df10a0 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9031d0d640 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f903150c640 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321e56d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f90280a7ec0 tx=0x7f90280e33a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483a9a16ddcb5eb0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.430+0000 7f9014ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9014ff9640 1 -- 172.21.15.37:0/3342176559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90280ae070 con 0x55cb31df10a0 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9014ff9640 1 -- 172.21.15.37:0/3342176559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f90280b02f0 con 0x55cb31df10a0 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 1 -- 172.21.15.37:0/3342176559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f901c005040 con 0x55cb31df10a0 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9014ff9640 1 -- 172.21.15.37:0/3342176559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9028097030 con 0x55cb31df10a0 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 10 client.15261 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 1 -- 172.21.15.37:0/3342176559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55cb321e4d40 con 0x55cb31df10a0 2024-08-31T06:46:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9014ff9640 1 -- 172.21.15.37:0/3342176559 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f901c005040 con 0x55cb31df10a0 2024-08-31T06:46:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9014ff9640 1 -- 172.21.15.37:0/3342176559 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f90280930f0 con 0x55cb31df10a0 2024-08-31T06:46:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 10 client.15261 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 10 client.15261 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:46:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 20 client.15261 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb31dadc90 0x55cb3224b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 4 client.15261 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:46:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.431+0000 7f9039ce5740 1 -- 172.21.15.37:0/3342176559 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "status"}) -- 0x55cb32133de0 con 0x55cb31dadc90 2024-08-31T06:46:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.432+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb31dadc90 0x55cb3224b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:04.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.432+0000 7f9014ff9640 10 client.15261 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:04.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.432+0000 7f9030d0b640 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb31dadc90 0x55cb3224b640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a191aaabbe73cafe server_cookie=4761b336a0f40112 in_seq=0 out_seq=0 2024-08-31T06:46:04.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9014ff9640 1 -- 172.21.15.37:0/3342176559 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cb32133de0 con 0x55cb31dadc90 2024-08-31T06:46:04.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9014ff9640 10 client.15261 handle_command_reply: tid=0 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 client.15261 shutdown 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 -- 172.21.15.37:0/3342176559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 msgr2=0x55cb321e56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321e56d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f90280a7ec0 tx=0x7f90280e33a0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 -- 172.21.15.37:0/3342176559 shutdown_connections 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb31dadc90 0x55cb3224b640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb31e19f60 0x55cb321dec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb31df9280 0x55cb321e5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9014ff9640 0 client.15261 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 --2- 172.21.15.37:0/3342176559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb31df10a0 0x55cb321e56d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 -- 172.21.15.37:0/3342176559 >> 172.21.15.37:0/3342176559 conn(0x55cb31e0e350 msgr2=0x55cb321cac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 -- 172.21.15.37:0/3342176559 shutdown_connections 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 1 -- 172.21.15.37:0/3342176559 wait complete. 2024-08-31T06:46:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.433+0000 7f9039ce5740 20 client.15261 trim_cache size 0 max 16384 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24695, 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 80.785978518999997, 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 24, 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:46:04.451 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:46:04.452 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 91.861408327000007 2024-08-31T06:46:04.452 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:04.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 -- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90180b4c40 msgr2=0x7f90180b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90180b4c40 0x7f90180b7150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9024005fd0 tx=0x7f9024008450 comp rx=0 tx=0).stop 2024-08-31T06:46:04.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 -- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1028b0 msgr2=0x7f902c19a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:04.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1028b0 0x7f902c19a2d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f902800c920 tx=0x7f902800cde0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 -- 172.21.15.37:0/2315932288 shutdown_connections 2024-08-31T06:46:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90180b4c40 0x7f90180b7150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f902c108b40 0x7f902c19fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f902c1081f0 0x7f902c19a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 --2- 172.21.15.37:0/2315932288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f902c1028b0 0x7f902c19a2d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 -- 172.21.15.37:0/2315932288 >> 172.21.15.37:0/2315932288 conn(0x7f902c079470 msgr2=0x7f902c1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 -- 172.21.15.37:0/2315932288 shutdown_connections 2024-08-31T06:46:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:04.434+0000 7f9033770640 1 -- 172.21.15.37:0/2315932288 wait complete. 2024-08-31T06:46:05.122 INFO:tasks.cephadm:Setup complete, yielding 2024-08-31T06:46:05.122 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T06:46:05.132 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:46:05.132 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch status' 2024-08-31T06:46:05.385 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:05.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:05 smithi037 ceph-mon[18612]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:05.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:05 smithi066 ceph-mon[22244]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:05.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:05 smithi106 ceph-mon[22134]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.828+0000 7ff55bc9b640 1 -- 172.21.15.37:0/3282750699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109240 msgr2=0x7ff554109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.828+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/3282750699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109240 0x7ff554109650 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff544009900 tx=0x7ff54402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.828+0000 7ff55bc9b640 1 -- 172.21.15.37:0/3282750699 shutdown_connections 2024-08-31T06:46:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.828+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/3282750699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109240 0x7ff554109650 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.828+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/3282750699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff554109b90 0x7ff5541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.828+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/3282750699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff554103900 0x7ff554103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.828+0000 7ff55bc9b640 1 -- 172.21.15.37:0/3282750699 >> 172.21.15.37:0/3282750699 conn(0x7ff55407b5f0 msgr2=0x7ff55407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.829+0000 7ff55bc9b640 1 -- 172.21.15.37:0/3282750699 shutdown_connections 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.829+0000 7ff55bc9b640 1 -- 172.21.15.37:0/3282750699 wait complete. 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.829+0000 7ff55bc9b640 1 Processor -- start 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.829+0000 7ff55bc9b640 1 -- start start 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55bc9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff554103900 0x7ff55419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55bc9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff554109240 0x7ff55419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55bc9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109b90 0x7ff55419f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55bc9b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff554113700 con 0x7ff554109b90 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55bc9b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff554113580 con 0x7ff554109240 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55bc9b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff554113880 con 0x7ff554103900 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109b90 0x7ff55419f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109b90 0x7ff55419f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33352/0 (socket says 172.21.15.37:33352) 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 -- 172.21.15.37:0/723808452 learned_addr learned my addr 172.21.15.37:0/723808452 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff559a37640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff554103900 0x7ff55419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff559236640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff554109240 0x7ff55419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 -- 172.21.15.37:0/723808452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff554103900 msgr2=0x7ff55419a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff554103900 0x7ff55419a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 -- 172.21.15.37:0/723808452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff554109240 msgr2=0x7ff55419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff554109240 0x7ff55419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 -- 172.21.15.37:0/723808452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5541a0100 con 0x7ff554109b90 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff559236640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff554109240 0x7ff55419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55a238640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109b90 0x7ff55419f9d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00eaa0 tx=0x7ff54c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff54affd640 1 -- 172.21.15.37:0/723808452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c00cdb0 con 0x7ff554109b90 2024-08-31T06:46:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5541a03f0 con 0x7ff554109b90 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.830+0000 7ff54affd640 1 -- 172.21.15.37:0/723808452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff54c005020 con 0x7ff554109b90 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.831+0000 7ff54affd640 1 -- 172.21.15.37:0/723808452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0116d0 con 0x7ff554109b90 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.831+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5541a6b50 con 0x7ff554109b90 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.831+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff554103d10 con 0x7ff554109b90 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.833+0000 7ff54affd640 1 -- 172.21.15.37:0/723808452 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff54c0051d0 con 0x7ff554109b90 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.834+0000 7ff54affd640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff5400b4c10 0x7ff5400b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.834+0000 7ff559a37640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff5400b4c10 0x7ff5400b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.834+0000 7ff54affd640 1 -- 172.21.15.37:0/723808452 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ff54c0e5a20 con 0x7ff554109b90 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.834+0000 7ff559a37640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff5400b4c10 0x7ff5400b7120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff550005fd0 tx=0x7ff55000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:05.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:05.837+0000 7ff54affd640 1 -- 172.21.15.37:0/723808452 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff54c016030 con 0x7ff554109b90 2024-08-31T06:46:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.038+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff55410b990 con 0x7ff5400b4c10 2024-08-31T06:46:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.040+0000 7ff54affd640 1 -- 172.21.15.37:0/723808452 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff55410b990 con 0x7ff5400b4c10 2024-08-31T06:46:06.041 INFO:teuthology.orchestra.run.smithi037.stdout:Backend: cephadm 2024-08-31T06:46:06.041 INFO:teuthology.orchestra.run.smithi037.stdout:Available: Yes 2024-08-31T06:46:06.041 INFO:teuthology.orchestra.run.smithi037.stdout:Paused: No 2024-08-31T06:46:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff5400b4c10 msgr2=0x7ff5400b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff5400b4c10 0x7ff5400b7120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff550005fd0 tx=0x7ff55000b390 comp rx=0 tx=0).stop 2024-08-31T06:46:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109b90 msgr2=0x7ff55419f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109b90 0x7ff55419f9d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff54c00eaa0 tx=0x7ff54c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:46:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 shutdown_connections 2024-08-31T06:46:06.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff5400b4c10 0x7ff5400b7120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff554109b90 0x7ff55419f9d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff554109240 0x7ff55419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 --2- 172.21.15.37:0/723808452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff554103900 0x7ff55419a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 >> 172.21.15.37:0/723808452 conn(0x7ff55407b5f0 msgr2=0x7ff554105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 shutdown_connections 2024-08-31T06:46:06.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:06.042+0000 7ff55bc9b640 1 -- 172.21.15.37:0/723808452 wait complete. 2024-08-31T06:46:06.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:06 smithi037 ceph-mon[18612]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:06.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:06 smithi066 ceph-mon[22244]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:06.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-31T06:46:06.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:06 smithi106 ceph-mon[22134]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:06.945 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 -- 172.21.15.37:0/860676081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 msgr2=0x7f26fc10f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 --2- 172.21.15.37:0/860676081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 0x7f26fc10f340 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009ca0 tx=0x7f26f402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 -- 172.21.15.37:0/860676081 shutdown_connections 2024-08-31T06:46:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 --2- 172.21.15.37:0/860676081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 0x7f26fc10f340 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 --2- 172.21.15.37:0/860676081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26fc1081c0 0x7f26fc1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 --2- 172.21.15.37:0/860676081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26fc102880 0x7f26fc102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 -- 172.21.15.37:0/860676081 >> 172.21.15.37:0/860676081 conn(0x7f26fc079450 msgr2=0x7f26fc079860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 -- 172.21.15.37:0/860676081 shutdown_connections 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.419+0000 7f2703174640 1 -- 172.21.15.37:0/860676081 wait complete. 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2703174640 1 Processor -- start 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2703174640 1 -- start start 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2703174640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26fc102880 0x7f26fc199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2703174640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26fc1081c0 0x7f26fc1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2703174640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 0x7f26fc19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2703174640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc1126c0 con 0x7f26fc108b10 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2703174640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc112540 con 0x7f26fc1081c0 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2703174640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc112840 con 0x7f26fc102880 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.420+0000 7f2701711640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 0x7f26fc19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2701711640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 0x7f26fc19e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33376/0 (socket says 172.21.15.37:33376) 2024-08-31T06:46:07.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2701711640 1 -- 172.21.15.37:0/4200331103 learned_addr learned my addr 172.21.15.37:0/4200331103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2700f10640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26fc102880 0x7f26fc199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f26fbfff640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26fc1081c0 0x7f26fc1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2701711640 1 -- 172.21.15.37:0/4200331103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26fc102880 msgr2=0x7f26fc199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2701711640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26fc102880 0x7f26fc199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2701711640 1 -- 172.21.15.37:0/4200331103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26fc1081c0 msgr2=0x7f26fc1995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2701711640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26fc1081c0 0x7f26fc1995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2701711640 1 -- 172.21.15.37:0/4200331103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc19efc0 con 0x7f26fc108b10 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f26fbfff640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26fc1081c0 0x7f26fc1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2701711640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 0x7f26fc19e890 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f26f4005cc0 tx=0x7f26f4032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f26f9ffb640 1 -- 172.21.15.37:0/4200331103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4032e00 con 0x7f26fc108b10 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f26f9ffb640 1 -- 172.21.15.37:0/4200331103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26f40044d0 con 0x7f26fc108b10 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26fc19f250 con 0x7f26fc108b10 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f26f9ffb640 1 -- 172.21.15.37:0/4200331103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4030b70 con 0x7f26fc108b10 2024-08-31T06:46:07.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.421+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26fc1a5a10 con 0x7f26fc108b10 2024-08-31T06:46:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.422+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26fc103b00 con 0x7f26fc108b10 2024-08-31T06:46:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.424+0000 7f26f9ffb640 1 -- 172.21.15.37:0/4200331103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f26f4030d10 con 0x7f26fc108b10 2024-08-31T06:46:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.425+0000 7f26f9ffb640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26ec0b4c10 0x7f26ec0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.425+0000 7f2700f10640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26ec0b4c10 0x7f26ec0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.425+0000 7f26f9ffb640 1 -- 172.21.15.37:0/4200331103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f26f41068b0 con 0x7f26fc108b10 2024-08-31T06:46:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.425+0000 7f2700f10640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26ec0b4c10 0x7f26ec0b7120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26f000bbe0 tx=0x7f26f000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.428+0000 7f26f9ffb640 1 -- 172.21.15.37:0/4200331103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f26f40cd7a0 con 0x7f26fc108b10 2024-08-31T06:46:07.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:07 smithi037 ceph-mon[18612]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:46:07.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.627+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f26fc0635a0 con 0x7f26ec0b4c10 2024-08-31T06:46:07.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:07 smithi066 ceph-mon[22244]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:46:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.639+0000 7f26f9ffb640 1 -- 172.21.15.37:0/4200331103 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f26fc0635a0 con 0x7f26ec0b4c10 2024-08-31T06:46:07.640 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.a smithi037 running (98s) 18s ago 97s 86.4M - 19.3.0-4560-gd19e6118 79f4cde5e369 9f3a20e44d8d 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.b smithi066 running (95s) 28s ago 95s 94.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 e93d82a05c19 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.c smithi106 running (109s) 28s ago 109s 85.2M - 19.3.0-4560-gd19e6118 79f4cde5e369 a3afd8b272e8 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.d smithi037 running (116s) 18s ago 116s 81.7M - 19.3.0-4560-gd19e6118 79f4cde5e369 db60f1902013 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.e smithi066 running (114s) 28s ago 113s 84.1M - 19.3.0-4560-gd19e6118 79f4cde5e369 229e00a0a109 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.f smithi106 running (111s) 28s ago 111s 84.6M - 19.3.0-4560-gd19e6118 79f4cde5e369 3251a0d061b3 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.g smithi037 running (101s) 18s ago 101s 82.0M - 19.3.0-4560-gd19e6118 79f4cde5e369 0a980fe2706a 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.h smithi066 running (106s) 28s ago 106s 85.9M - 19.3.0-4560-gd19e6118 79f4cde5e369 3e711934342c 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.i smithi106 running (104s) 28s ago 103s 88.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 679d36093c90 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.j smithi037 running (2m) 18s ago 2m 81.0M - 19.3.0-4560-gd19e6118 79f4cde5e369 659bc555155f 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.k smithi066 running (2m) 28s ago 2m 84.5M - 19.3.0-4560-gd19e6118 79f4cde5e369 767bbb02c09c 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mds.l smithi106 running (2m) 28s ago 2m 81.3M - 19.3.0-4560-gd19e6118 79f4cde5e369 285bef8cfd45 2024-08-31T06:46:07.641 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.x smithi037 *:9283,8765 running (9m) 18s ago 9m 583M - 19.3.0-4560-gd19e6118 79f4cde5e369 ede2bad6208a 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.y smithi066 *:8443,8765 running (7m) 28s ago 7m 525M - 19.3.0-4560-gd19e6118 79f4cde5e369 a99c2b7d2d86 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.z smithi106 *:8443,8765 running (7m) 28s ago 7m 523M - 19.3.0-4560-gd19e6118 79f4cde5e369 d3a287e49e10 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a smithi037 running (9m) 18s ago 9m 118M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 e552e968c622 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b smithi066 running (8m) 28s ago 8m 109M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 2e7cea2798aa 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c smithi106 running (8m) 28s ago 8m 109M 2048M 19.3.0-4560-gd19e6118 79f4cde5e369 2a0cc1389358 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (6m) 18s ago 6m 126M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 7144e5345808 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi066 running (6m) 28s ago 6m 121M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 b7dd8c7d297a 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi106 running (6m) 28s ago 6m 115M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 d9bef30a4d8e 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi037 running (5m) 18s ago 5m 115M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 746585d73eeb 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi066 running (5m) 28s ago 5m 114M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 04c2c6b723ff 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi106 running (4m) 28s ago 4m 123M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 790717593c2d 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 smithi037 running (4m) 18s ago 4m 114M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 4880ffe2b978 2024-08-31T06:46:07.642 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 smithi066 running (4m) 28s ago 4m 116M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 52880b99c3b8 2024-08-31T06:46:07.643 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 smithi106 running (3m) 28s ago 3m 120M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 2b1aa06ef031 2024-08-31T06:46:07.643 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 smithi037 running (3m) 18s ago 3m 114M 4273M 19.3.0-4560-gd19e6118 79f4cde5e369 b8901635db20 2024-08-31T06:46:07.643 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 smithi066 running (2m) 28s ago 2m 116M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 ea5be2caaed1 2024-08-31T06:46:07.643 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 smithi106 running (2m) 28s ago 2m 111M 4272M 19.3.0-4560-gd19e6118 79f4cde5e369 3521f4707fa5 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26ec0b4c10 msgr2=0x7f26ec0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26ec0b4c10 0x7f26ec0b7120 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f26f000bbe0 tx=0x7f26f000b390 comp rx=0 tx=0).stop 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 msgr2=0x7f26fc19e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 0x7f26fc19e890 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f26f4005cc0 tx=0x7f26f4032a10 comp rx=0 tx=0).stop 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 shutdown_connections 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26ec0b4c10 0x7f26ec0b7120 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26fc108b10 0x7f26fc19e890 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26fc1081c0 0x7f26fc1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.641+0000 7f2703174640 1 --2- 172.21.15.37:0/4200331103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26fc102880 0x7f26fc199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.642+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 >> 172.21.15.37:0/4200331103 conn(0x7f26fc079450 msgr2=0x7f26fc1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.642+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 shutdown_connections 2024-08-31T06:46:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:07.642+0000 7f2703174640 1 -- 172.21.15.37:0/4200331103 wait complete. 2024-08-31T06:46:07.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:07 smithi106 ceph-mon[22134]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:46:08.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-31T06:46:08.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:08 smithi037 ceph-mon[18612]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:08.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:08 smithi066 ceph-mon[22244]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:08.656 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:08.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:08 smithi106 ceph-mon[22134]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 -- 172.21.15.37:0/3115602124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d01081f0 msgr2=0x7fe3d0108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3115602124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d01081f0 0x7fe3d0108600 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009900 tx=0x7fe3c402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 -- 172.21.15.37:0/3115602124 shutdown_connections 2024-08-31T06:46:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3115602124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d01081f0 0x7fe3d0108600 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3115602124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3d0108b40 0x7fe3d010f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3115602124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d01028b0 0x7fe3d0102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 -- 172.21.15.37:0/3115602124 >> 172.21.15.37:0/3115602124 conn(0x7fe3d0079470 msgr2=0x7fe3d0079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 -- 172.21.15.37:0/3115602124 shutdown_connections 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.129+0000 7fe3d6898640 1 -- 172.21.15.37:0/3115602124 wait complete. 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.130+0000 7fe3d6898640 1 Processor -- start 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.130+0000 7fe3d6898640 1 -- start start 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.130+0000 7fe3d6898640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3d01028b0 0x7fe3d019a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.130+0000 7fe3d6898640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d01081f0 0x7fe3d019a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.130+0000 7fe3d6898640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d0108b40 0x7fe3d019fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.130+0000 7fe3d6898640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01137d0 con 0x7fe3d0108b40 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d6898640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0113650 con 0x7fe3d01081f0 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d6898640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0113950 con 0x7fe3d01028b0 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d0108b40 0x7fe3d019fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d0108b40 0x7fe3d019fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33406/0 (socket says 172.21.15.37:33406) 2024-08-31T06:46:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 -- 172.21.15.37:0/3077961607 learned_addr learned my addr 172.21.15.37:0/3077961607 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3cf7fe640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d01081f0 0x7fe3d019a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3cffff640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3d01028b0 0x7fe3d019a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 -- 172.21.15.37:0/3077961607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3d01028b0 msgr2=0x7fe3d019a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3d01028b0 0x7fe3d019a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 -- 172.21.15.37:0/3077961607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d01081f0 msgr2=0x7fe3d019a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d01081f0 0x7fe3d019a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 -- 172.21.15.37:0/3077961607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d01a01b0 con 0x7fe3d0108b40 2024-08-31T06:46:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d4e35640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d0108b40 0x7fe3d019fa80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800eaa0 tx=0x7fe3c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3cd7fa640 1 -- 172.21.15.37:0/3077961607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800cdb0 con 0x7fe3d0108b40 2024-08-31T06:46:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d01a04a0 con 0x7fe3d0108b40 2024-08-31T06:46:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3cd7fa640 1 -- 172.21.15.37:0/3077961607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3c8005020 con 0x7fe3d0108b40 2024-08-31T06:46:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.131+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d01a6c00 con 0x7fe3d0108b40 2024-08-31T06:46:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.132+0000 7fe3cd7fa640 1 -- 172.21.15.37:0/3077961607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80116d0 con 0x7fe3d0108b40 2024-08-31T06:46:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.132+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d0102cc0 con 0x7fe3d0108b40 2024-08-31T06:46:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.134+0000 7fe3cd7fa640 1 -- 172.21.15.37:0/3077961607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fe3c8004a40 con 0x7fe3d0108b40 2024-08-31T06:46:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.135+0000 7fe3cd7fa640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3b80b4c10 0x7fe3b80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.135+0000 7fe3cffff640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3b80b4c10 0x7fe3b80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.135+0000 7fe3cd7fa640 1 -- 172.21.15.37:0/3077961607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe3c80e5940 con 0x7fe3d0108b40 2024-08-31T06:46:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.135+0000 7fe3cffff640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3b80b4c10 0x7fe3b80b7120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000bbe0 tx=0x7fe3c000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.138+0000 7fe3cd7fa640 1 -- 172.21.15.37:0/3077961607 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe3c8016030 con 0x7fe3d0108b40 2024-08-31T06:46:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.331+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fe3d00635a0 con 0x7fe3b80b4c10 2024-08-31T06:46:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.338+0000 7fe3cd7fa640 1 -- 172.21.15.37:0/3077961607 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fe3d00635a0 con 0x7fe3b80b4c10 2024-08-31T06:46:09.339 INFO:teuthology.orchestra.run.smithi037.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-31T06:46:09.340 INFO:teuthology.orchestra.run.smithi037.stdout:mds.all 12/12 30s ago 2m smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi066=b;smithi066=e;smithi066=h;smithi066=k;smithi106=c;smithi106=f;smithi106=i;smithi106=l;count:12 2024-08-31T06:46:09.340 INFO:teuthology.orchestra.run.smithi037.stdout:mgr 3/3 30s ago 7m smithi037=x;smithi066=y;smithi106=z;count:3 2024-08-31T06:46:09.340 INFO:teuthology.orchestra.run.smithi037.stdout:mon 3/3 30s ago 8m smithi037:172.21.15.37=a;smithi066:172.21.15.66=b;smithi106:172.21.15.106=c;count:3 2024-08-31T06:46:09.340 INFO:teuthology.orchestra.run.smithi037.stdout:osd 12 30s ago - 2024-08-31T06:46:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.340+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3b80b4c10 msgr2=0x7fe3b80b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.340+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3b80b4c10 0x7fe3b80b7120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000bbe0 tx=0x7fe3c000b390 comp rx=0 tx=0).stop 2024-08-31T06:46:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.340+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d0108b40 msgr2=0x7fe3d019fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.340+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d0108b40 0x7fe3d019fa80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe3c800eaa0 tx=0x7fe3c800ef60 comp rx=0 tx=0).stop 2024-08-31T06:46:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.340+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 shutdown_connections 2024-08-31T06:46:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.340+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3b80b4c10 0x7fe3b80b7120 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.340+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d0108b40 0x7fe3d019fa80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.340+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3d01081f0 0x7fe3d019a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.341+0000 7fe3d6898640 1 --2- 172.21.15.37:0/3077961607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3d01028b0 0x7fe3d019a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.341+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 >> 172.21.15.37:0/3077961607 conn(0x7fe3d0079470 msgr2=0x7fe3d01042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.341+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 shutdown_connections 2024-08-31T06:46:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:09.341+0000 7fe3d6898640 1 -- 172.21.15.37:0/3077961607 wait complete. 2024-08-31T06:46:09.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:09 smithi037 ceph-mon[18612]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:09.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:09 smithi066 ceph-mon[22244]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:09.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:09 smithi106 ceph-mon[22134]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:10.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-31T06:46:10.297 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:10.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:10 smithi037 ceph-mon[18612]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:10.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:10 smithi066 ceph-mon[22244]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 -- 172.21.15.37:0/2962042012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84102880 msgr2=0x7f5b84102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 --2- 172.21.15.37:0/2962042012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84102880 0x7f5b84102c90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009900 tx=0x7f5b7402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 -- 172.21.15.37:0/2962042012 shutdown_connections 2024-08-31T06:46:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 --2- 172.21.15.37:0/2962042012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b84108ac0 0x7f5b8410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 --2- 172.21.15.37:0/2962042012 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b84108170 0x7f5b84108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 --2- 172.21.15.37:0/2962042012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84102880 0x7f5b84102c90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 -- 172.21.15.37:0/2962042012 >> 172.21.15.37:0/2962042012 conn(0x7f5b84079500 msgr2=0x7f5b84079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:10.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 -- 172.21.15.37:0/2962042012 shutdown_connections 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 -- 172.21.15.37:0/2962042012 wait complete. 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.744+0000 7f5b89d53640 1 Processor -- start 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b89d53640 1 -- start start 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b89d53640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b84102880 0x7f5b8419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b89d53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b84108170 0x7f5b8419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b89d53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84108ac0 0x7f5b8419fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b89d53640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b841136f0 con 0x7f5b84108ac0 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b89d53640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5b84113570 con 0x7f5b84108170 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b89d53640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5b84113870 con 0x7f5b84102880 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b83fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84108ac0 0x7f5b8419fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b837fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b84102880 0x7f5b8419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b83fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84108ac0 0x7f5b8419fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33434/0 (socket says 172.21.15.37:33434) 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b83fff640 1 -- 172.21.15.37:0/220445067 learned_addr learned my addr 172.21.15.37:0/220445067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b82ffd640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b84108170 0x7f5b8419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.745+0000 7f5b83fff640 1 -- 172.21.15.37:0/220445067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b84102880 msgr2=0x7f5b8419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b83fff640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b84102880 0x7f5b8419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b83fff640 1 -- 172.21.15.37:0/220445067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b84108170 msgr2=0x7f5b8419a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b83fff640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b84108170 0x7f5b8419a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b83fff640 1 -- 172.21.15.37:0/220445067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b841a0150 con 0x7f5b84108ac0 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b837fe640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b84102880 0x7f5b8419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b83fff640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84108ac0 0x7f5b8419fa20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00eaa0 tx=0x7f5b7c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b80ff9640 1 -- 172.21.15.37:0/220445067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00cdb0 con 0x7f5b84108ac0 2024-08-31T06:46:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b841a0440 con 0x7f5b84108ac0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b80ff9640 1 -- 172.21.15.37:0/220445067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b7c005020 con 0x7f5b84108ac0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b80ff9640 1 -- 172.21.15.37:0/220445067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0116d0 con 0x7f5b84108ac0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.746+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b841a6ba0 con 0x7f5b84108ac0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.747+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b84103ab0 con 0x7f5b84108ac0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.748+0000 7f5b80ff9640 1 -- 172.21.15.37:0/220445067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f5b7c0051d0 con 0x7f5b84108ac0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.749+0000 7f5b80ff9640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b6c0b4c10 0x7f5b6c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.749+0000 7f5b837fe640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b6c0b4c10 0x7f5b6c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.749+0000 7f5b80ff9640 1 -- 172.21.15.37:0/220445067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f5b7c0e5530 con 0x7f5b84108ac0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.750+0000 7f5b837fe640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b6c0b4c10 0x7f5b6c0b7120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b740057c0 tx=0x7f5b740058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:10.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.754+0000 7f5b80ff9640 1 -- 172.21.15.37:0/220445067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5b7c016030 con 0x7f5b84108ac0 2024-08-31T06:46:10.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:10 smithi106 ceph-mon[22134]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:10.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.944+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5b840635a0 con 0x7f5b6c0b4c10 2024-08-31T06:46:10.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.945+0000 7f5b80ff9640 1 -- 172.21.15.37:0/220445067 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5b840635a0 con 0x7f5b6c0b4c10 2024-08-31T06:46:10.951 INFO:teuthology.orchestra.run.smithi037.stdout:HOST ADDR LABELS STATUS 2024-08-31T06:46:10.951 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 172.21.15.37 2024-08-31T06:46:10.951 INFO:teuthology.orchestra.run.smithi037.stdout:smithi066 172.21.15.66 2024-08-31T06:46:10.951 INFO:teuthology.orchestra.run.smithi037.stdout:smithi106 172.21.15.106 2024-08-31T06:46:10.951 INFO:teuthology.orchestra.run.smithi037.stdout:3 hosts in cluster 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b6c0b4c10 msgr2=0x7f5b6c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b6c0b4c10 0x7f5b6c0b7120 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5b740057c0 tx=0x7f5b740058d0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84108ac0 msgr2=0x7f5b8419fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84108ac0 0x7f5b8419fa20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00eaa0 tx=0x7f5b7c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 shutdown_connections 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5b6c0b4c10 0x7f5b6c0b7120 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b84108ac0 0x7f5b8419fa20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b84108170 0x7f5b8419a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 --2- 172.21.15.37:0/220445067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b84102880 0x7f5b8419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 >> 172.21.15.37:0/220445067 conn(0x7f5b84079500 msgr2=0x7f5b84101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 shutdown_connections 2024-08-31T06:46:10.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:10.948+0000 7f5b89d53640 1 -- 172.21.15.37:0/220445067 wait complete. 2024-08-31T06:46:11.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:11 smithi037 ceph-mon[18612]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:11.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:11 smithi037 ceph-mon[18612]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:11.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:11 smithi066 ceph-mon[22244]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:11.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:11 smithi066 ceph-mon[22244]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:11.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-31T06:46:11.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:11 smithi106 ceph-mon[22134]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:11.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:11 smithi106 ceph-mon[22134]: from='client.15285 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:11.905 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 -- 172.21.15.37:0/671183718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac105020 msgr2=0x7f4fac10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/671183718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac105020 0x7f4fac10d660 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c009900 tx=0x7f4f9c02a410 comp rx=0 tx=0).stop 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 -- 172.21.15.37:0/671183718 shutdown_connections 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/671183718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac105020 0x7f4fac10d660 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/671183718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac10dba0 0x7f4fac1100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/671183718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac1045f0 0x7f4fac104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 -- 172.21.15.37:0/671183718 >> 172.21.15.37:0/671183718 conn(0x7f4fac0794d0 msgr2=0x7f4fac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 -- 172.21.15.37:0/671183718 shutdown_connections 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.429+0000 7f4fb3b75640 1 -- 172.21.15.37:0/671183718 wait complete. 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.430+0000 7f4fb3b75640 1 Processor -- start 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.430+0000 7f4fb3b75640 1 -- start start 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.430+0000 7f4fb3b75640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac1045f0 0x7f4fac102500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.430+0000 7f4fb3b75640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac105020 0x7f4fac102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.430+0000 7f4fb3b75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac10dba0 0x7f4fac102f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.430+0000 7f4fb3b75640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1136b0 con 0x7f4fac10dba0 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.430+0000 7f4fb3b75640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac113530 con 0x7f4fac1045f0 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.430+0000 7f4fb3b75640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac113830 con 0x7f4fac105020 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac10dba0 0x7f4fac102f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac10dba0 0x7f4fac102f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33462/0 (socket says 172.21.15.37:33462) 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 -- 172.21.15.37:0/2485434211 learned_addr learned my addr 172.21.15.37:0/2485434211 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb1911640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac1045f0 0x7f4fac102500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb1110640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac105020 0x7f4fac102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 -- 172.21.15.37:0/2485434211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac105020 msgr2=0x7f4fac102a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac105020 0x7f4fac102a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 -- 172.21.15.37:0/2485434211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac1045f0 msgr2=0x7f4fac102500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac1045f0 0x7f4fac102500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 -- 172.21.15.37:0/2485434211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac1a8440 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb2112640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac10dba0 0x7f4fac102f80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400cad0 tx=0x7f4fa400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fa2ffd640 1 -- 172.21.15.37:0/2485434211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400ae20 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac1a8730 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fa2ffd640 1 -- 172.21.15.37:0/2485434211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fa4005020 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.431+0000 7f4fa2ffd640 1 -- 172.21.15.37:0/2485434211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400f6b0 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.432+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac1a8c40 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.433+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fac06bf20 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.434+0000 7f4fa2ffd640 1 -- 172.21.15.37:0/2485434211 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f4fa40051d0 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.435+0000 7f4fa2ffd640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4f980b4c10 0x7f4f980b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.435+0000 7f4fb1911640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4f980b4c10 0x7f4f980b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.435+0000 7f4fa2ffd640 1 -- 172.21.15.37:0/2485434211 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f4fa40e5720 con 0x7f4fac10dba0 2024-08-31T06:46:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.435+0000 7f4fb1911640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4f980b4c10 0x7f4f980b7120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4fac103f50 tx=0x7f4fa800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:12.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.439+0000 7f4fa2ffd640 1 -- 172.21.15.37:0/2485434211 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4fa4014030 con 0x7f4fac10dba0 2024-08-31T06:46:12.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.634+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4fac0635a0 con 0x7f4f980b4c10 2024-08-31T06:46:12.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.636+0000 7f4fa2ffd640 1 -- 172.21.15.37:0/2485434211 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f4fac0635a0 con 0x7f4f980b4c10 2024-08-31T06:46:12.637 INFO:teuthology.orchestra.run.smithi037.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-31T06:46:12.637 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-31T06:46:12.637 INFO:teuthology.orchestra.run.smithi037.stdout:smithi066 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53430091400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-31T06:46:12.637 INFO:teuthology.orchestra.run.smithi037.stdout:smithi106 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013R400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-31T06:46:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4f980b4c10 msgr2=0x7f4f980b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4f980b4c10 0x7f4f980b7120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4fac103f50 tx=0x7f4fa800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac10dba0 msgr2=0x7f4fac102f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac10dba0 0x7f4fac102f80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400cad0 tx=0x7f4fa400cf90 comp rx=0 tx=0).stop 2024-08-31T06:46:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 shutdown_connections 2024-08-31T06:46:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4f980b4c10 0x7f4f980b7120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fac10dba0 0x7f4fac102f80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fac105020 0x7f4fac102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 --2- 172.21.15.37:0/2485434211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fac1045f0 0x7f4fac102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 >> 172.21.15.37:0/2485434211 conn(0x7f4fac0794d0 msgr2=0x7f4fac0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 shutdown_connections 2024-08-31T06:46:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:12.638+0000 7f4fb3b75640 1 -- 172.21.15.37:0/2485434211 wait complete. 2024-08-31T06:46:13.284 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-31T06:46:13.292 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:46:13.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-31T06:46:13.545 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:13.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:13 smithi037 ceph-mon[18612]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:46:13.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:13 smithi037 ceph-mon[18612]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:13.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:13 smithi066 ceph-mon[22244]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:46:13.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:13 smithi066 ceph-mon[22244]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:13.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:13 smithi106 ceph-mon[22134]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:46:13.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:13 smithi106 ceph-mon[22134]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 -- 172.21.15.37:0/1154144968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 msgr2=0x7f7840102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 --2- 172.21.15.37:0/1154144968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 0x7f7840102c30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7830009900 tx=0x7f783002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 -- 172.21.15.37:0/1154144968 shutdown_connections 2024-08-31T06:46:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 --2- 172.21.15.37:0/1154144968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7840108ab0 0x7f784010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 --2- 172.21.15.37:0/1154144968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7840108160 0x7f7840108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 --2- 172.21.15.37:0/1154144968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 0x7f7840102c30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 -- 172.21.15.37:0/1154144968 >> 172.21.15.37:0/1154144968 conn(0x7f78400794e0 msgr2=0x7f78400798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 -- 172.21.15.37:0/1154144968 shutdown_connections 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.019+0000 7f784505e640 1 -- 172.21.15.37:0/1154144968 wait complete. 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.020+0000 7f784505e640 1 Processor -- start 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.020+0000 7f784505e640 1 -- start start 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.020+0000 7f784505e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 0x7f784019a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.020+0000 7f784505e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7840108160 0x7f784019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.020+0000 7f784505e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7840108ab0 0x7f784019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.020+0000 7f784505e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7840113730 con 0x7f7840102820 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.020+0000 7f784505e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f78401135b0 con 0x7f7840108160 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.020+0000 7f784505e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f78401138b0 con 0x7f7840108ab0 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 0x7f784019a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 0x7f784019a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33476/0 (socket says 172.21.15.37:33476) 2024-08-31T06:46:14.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 -- 172.21.15.37:0/3923327654 learned_addr learned my addr 172.21.15.37:0/3923327654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:14.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783e59c640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7840108160 0x7f784019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:14.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783f59e640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7840108ab0 0x7f784019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:14.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 -- 172.21.15.37:0/3923327654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7840108ab0 msgr2=0x7f784019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:14.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7840108ab0 0x7f784019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 -- 172.21.15.37:0/3923327654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7840108160 msgr2=0x7f784019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:14.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7840108160 0x7f784019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 -- 172.21.15.37:0/3923327654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78401a0030 con 0x7f7840102820 2024-08-31T06:46:14.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f783ed9d640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 0x7f784019a180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7830009a20 tx=0x7f7830004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:14.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f7837fff640 1 -- 172.21.15.37:0/3923327654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783003f030 con 0x7f7840102820 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f7837fff640 1 -- 172.21.15.37:0/3923327654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78300035f0 con 0x7f7840102820 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78401a02c0 con 0x7f7840102820 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f7837fff640 1 -- 172.21.15.37:0/3923327654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830035070 con 0x7f7840102820 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.021+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78401a6b40 con 0x7f7840102820 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.023+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7840103aa0 con 0x7f7840102820 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.024+0000 7f7837fff640 1 -- 172.21.15.37:0/3923327654 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f7830003aa0 con 0x7f7840102820 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.025+0000 7f7837fff640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f782c0b4c40 0x7f782c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.025+0000 7f783e59c640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f782c0b4c40 0x7f782c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.025+0000 7f7837fff640 1 -- 172.21.15.37:0/3923327654 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7830106330 con 0x7f7840102820 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.025+0000 7f783e59c640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f782c0b4c40 0x7f782c0b7150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7840100ae0 tx=0x7f782800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:14.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.028+0000 7f7837fff640 1 -- 172.21.15.37:0/3923327654 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f78300cd220 con 0x7f7840102820 2024-08-31T06:46:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.250+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7840102c30 con 0x7f7840102820 2024-08-31T06:46:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.250+0000 7f7837fff640 1 -- 172.21.15.37:0/3923327654 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3074 (secure 0 0 0) 0x7f78300ccb20 con 0x7f7840102820 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:e24 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:btime 2024-08-31T06:44:54:657185+0000 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 24 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-31T06:46:14.252 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-08-31T06:44:43.326015+0000 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-08-31T06:44:54.319927+0000 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 300 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 3 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:in 0,1,2 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24695,1=24658,2=24656} 2024-08-31T06:46:14.253 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 0 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24695 members: 24656,24695,24658 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b{0:24695} state up:active seq 4 addr [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c{0:24643} state up:standby-replay seq 1 addr [v2:172.21.15.106:6836/1095097353,v1:172.21.15.106:6837/1095097353] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.i{1:24658} state up:active seq 8 addr [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f{1:24637} state up:standby-replay seq 1 addr [v2:172.21.15.106:6834/2636907745,v1:172.21.15.106:6835/2636907745] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.h{2:24656} state up:active seq 9 addr [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.254 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e{2:24629} state up:standby-replay seq 1 addr [v2:172.21.15.66:6834/298046856,v1:172.21.15.66:6835/298046856] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.k{-1:14766} state up:standby seq 1 addr [v2:172.21.15.66:6832/305823266,v1:172.21.15.66:6833/305823266] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.j{-1:14772} state up:standby seq 1 addr [v2:172.21.15.37:6834/2503140035,v1:172.21.15.37:6835/2503140035] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d{-1:14784} state up:standby seq 1 addr [v2:172.21.15.37:6836/103394929,v1:172.21.15.37:6837/103394929] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.g{-1:14841} state up:standby seq 1 addr [v2:172.21.15.37:6838/4551184,v1:172.21.15.37:6839/4551184] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a{-1:14853} state up:standby seq 1 addr [v2:172.21.15.37:6840/407340451,v1:172.21.15.37:6841/407340451] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.255 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.l{-1:24601} state up:standby seq 1 addr [v2:172.21.15.106:6832/1558689933,v1:172.21.15.106:6833/1558689933] compat {c=[1],r=[1],i=[1fff]}] 2024-08-31T06:46:14.256 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-08-31T06:46:14.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.252+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f782c0b4c40 msgr2=0x7f782c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:14.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.252+0000 7f784505e640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f782c0b4c40 0x7f782c0b7150 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7840100ae0 tx=0x7f782800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.252+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 msgr2=0x7f784019a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:14.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.252+0000 7f784505e640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 0x7f784019a180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7830009a20 tx=0x7f7830004270 comp rx=0 tx=0).stop 2024-08-31T06:46:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.253+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 shutdown_connections 2024-08-31T06:46:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.253+0000 7f784505e640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f782c0b4c40 0x7f782c0b7150 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.253+0000 7f784505e640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7840108ab0 0x7f784019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.253+0000 7f784505e640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7840108160 0x7f784019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.253+0000 7f784505e640 1 --2- 172.21.15.37:0/3923327654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7840102820 0x7f784019a180 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.253+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 >> 172.21.15.37:0/3923327654 conn(0x7f78400794e0 msgr2=0x7f78401012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.253+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 shutdown_connections 2024-08-31T06:46:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:14.253+0000 7f784505e640 1 -- 172.21.15.37:0/3923327654 wait complete. 2024-08-31T06:46:14.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:14 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3923327654' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T06:46:14.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:14 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3923327654' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T06:46:14.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:14 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3923327654' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-31T06:46:14.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-31T06:46:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:15.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:15 smithi037 ceph-mon[18612]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:15.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:15 smithi066 ceph-mon[22244]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:15.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 -- 172.21.15.37:0/18141654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4109240 msgr2=0x7ff8c4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:15.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 --2- 172.21.15.37:0/18141654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4109240 0x7ff8c4109650 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009900 tx=0x7ff8b402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:15.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 -- 172.21.15.37:0/18141654 shutdown_connections 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 --2- 172.21.15.37:0/18141654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4109240 0x7ff8c4109650 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 --2- 172.21.15.37:0/18141654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8c4109b90 0x7ff8c41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 --2- 172.21.15.37:0/18141654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c4103900 0x7ff8c4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 -- 172.21.15.37:0/18141654 >> 172.21.15.37:0/18141654 conn(0x7ff8c407b5f0 msgr2=0x7ff8c407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 -- 172.21.15.37:0/18141654 shutdown_connections 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.726+0000 7ff8cba31640 1 -- 172.21.15.37:0/18141654 wait complete. 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8cba31640 1 Processor -- start 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8cba31640 1 -- start start 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8cba31640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4103900 0x7ff8c40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8cba31640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8c4109240 0x7ff8c40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8cba31640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c4109b90 0x7ff8c4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8cba31640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4113700 con 0x7ff8c4103900 2024-08-31T06:46:15.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8cba31640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4113580 con 0x7ff8c4109240 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8cba31640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4113880 con 0x7ff8c4109b90 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4103900 0x7ff8c40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4103900 0x7ff8c40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40676/0 (socket says 172.21.15.37:40676) 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 -- 172.21.15.37:0/1156089209 learned_addr learned my addr 172.21.15.37:0/1156089209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c9fce640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c4109b90 0x7ff8c4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c8fcc640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8c4109240 0x7ff8c40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 -- 172.21.15.37:0/1156089209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c4109b90 msgr2=0x7ff8c4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c4109b90 0x7ff8c4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 -- 172.21.15.37:0/1156089209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8c4109240 msgr2=0x7ff8c40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8c4109240 0x7ff8c40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 -- 172.21.15.37:0/1156089209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c41a8430 con 0x7ff8c4103900 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c9fce640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c4109b90 0x7ff8c4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.727+0000 7ff8c97cd640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4103900 0x7ff8c40754b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000d950 tx=0x7ff8c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.728+0000 7ff8ba7fc640 1 -- 172.21.15.37:0/1156089209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0017070 con 0x7ff8c4103900 2024-08-31T06:46:15.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.728+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c41a8720 con 0x7ff8c4103900 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.728+0000 7ff8ba7fc640 1 -- 172.21.15.37:0/1156089209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8c0009c30 con 0x7ff8c4103900 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.728+0000 7ff8ba7fc640 1 -- 172.21.15.37:0/1156089209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c000f620 con 0x7ff8c4103900 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.728+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c41a8cb0 con 0x7ff8c4103900 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.729+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c4103d10 con 0x7ff8c4103900 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.730+0000 7ff8ba7fc640 1 -- 172.21.15.37:0/1156089209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7ff8c0010460 con 0x7ff8c4103900 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.731+0000 7ff8ba7fc640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8b00b4c10 0x7ff8b00b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.731+0000 7ff8c8fcc640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8b00b4c10 0x7ff8b00b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.731+0000 7ff8ba7fc640 1 -- 172.21.15.37:0/1156089209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ff8c00e5180 con 0x7ff8c4103900 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.732+0000 7ff8c8fcc640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8b00b4c10 0x7ff8b00b7120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4006010 tx=0x7ff8b4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:15.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.736+0000 7ff8ba7fc640 1 -- 172.21.15.37:0/1156089209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ff8c00ac010 con 0x7ff8c4103900 2024-08-31T06:46:15.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:15 smithi106 ceph-mon[22134]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.923+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7ff8c402e430 con 0x7ff8c4103900 2024-08-31T06:46:15.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.924+0000 7ff8ba7fc640 1 -- 172.21.15.37:0/1156089209 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v76) ==== 56+0+5681 (secure 0 0 0) 0x7ff8c0009de0 con 0x7ff8c4103900 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 76 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-08-31T06:36:16.871510+0000 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-08-31T06:45:19.740510+0000 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 26 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client luminous 2024-08-31T06:46:15.925 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release squid 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 12 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 9 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/1467269550,v1:172.21.15.37:6803/1467269550] [v2:172.21.15.37:6804/1467269550,v1:172.21.15.37:6805/1467269550] exists,up ded8d651-8305-4924-9bde-2e31cc2d088b 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 14 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6800/2563390022,v1:172.21.15.66:6801/2563390022] [v2:172.21.15.66:6802/2563390022,v1:172.21.15.66:6803/2563390022] exists,up b0189860-11da-4ba3-8356-3fddf0991b0c 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 19 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6800/863127215,v1:172.21.15.106:6801/863127215] [v2:172.21.15.106:6802/863127215,v1:172.21.15.106:6803/863127215] exists,up 62bc8710-4647-4a53-8009-cc6ceb86e34a 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 26 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/2145517998,v1:172.21.15.37:6811/2145517998] [v2:172.21.15.37:6812/2145517998,v1:172.21.15.37:6813/2145517998] exists,up 1ed7aadd-17fe-413c-a360-6d43f4697865 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 up in weight 1 up_from 31 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6808/3848335265,v1:172.21.15.66:6809/3848335265] [v2:172.21.15.66:6810/3848335265,v1:172.21.15.66:6811/3848335265] exists,up 31f6e880-6ba2-491b-ace7-c98e9eab42b8 2024-08-31T06:46:15.926 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 up in weight 1 up_from 37 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6808/1132176908,v1:172.21.15.106:6809/1132176908] [v2:172.21.15.106:6810/1132176908,v1:172.21.15.106:6811/1132176908] exists,up 673f5b17-3d81-4124-a3c0-cde3e717639e 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 up in weight 1 up_from 42 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/1599298553,v1:172.21.15.37:6819/1599298553] [v2:172.21.15.37:6820/1599298553,v1:172.21.15.37:6821/1599298553] exists,up b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 up in weight 1 up_from 47 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6816/1684993072,v1:172.21.15.66:6817/1684993072] [v2:172.21.15.66:6818/1684993072,v1:172.21.15.66:6819/1684993072] exists,up 14c76b06-4472-44a9-8c2c-76f68ce298b4 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 up in weight 1 up_from 53 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6816/638315270,v1:172.21.15.106:6817/638315270] [v2:172.21.15.106:6818/638315270,v1:172.21.15.106:6819/638315270] exists,up bea2e85a-3910-4109-845e-556410d644b6 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 up in weight 1 up_from 58 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/2705884500,v1:172.21.15.37:6827/2705884500] [v2:172.21.15.37:6828/2705884500,v1:172.21.15.37:6829/2705884500] exists,up 5c4c51ea-50dc-4c66-b1d9-df31b57d49fc 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 up in weight 1 up_from 63 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.66:6824/2946007622,v1:172.21.15.66:6825/2946007622] [v2:172.21.15.66:6826/2946007622,v1:172.21.15.66:6827/2946007622] exists,up efb68c30-0c02-405f-a72f-27e68fafd2dd 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 up in weight 1 up_from 68 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.106:6824/2963314896,v1:172.21.15.106:6825/2963314896] [v2:172.21.15.106:6826/2963314896,v1:172.21.15.106:6827/2963314896] exists,up da1db38f-04d8-4166-bc6a-fe685341d706 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.8 [2,11] 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.1b [2,4] 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.1c [8,11] 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.3 [4,9] 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.6 [3,6] 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.e [5,9] 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.1b [4,8] 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.20 [5,9] 2024-08-31T06:46:15.927 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.3a [4,7] 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/3700278983 expires 2024-09-01T06:38:18.150139+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2470001977 expires 2024-09-01T06:36:48.914944+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/927770183 expires 2024-09-01T06:36:48.914944+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/927770183 expires 2024-09-01T06:36:48.914944+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2248986445 expires 2024-09-01T06:36:48.914944+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2568176479 expires 2024-09-01T06:37:14.112103+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1863763988 expires 2024-09-01T06:36:48.914944+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/1769436059 expires 2024-09-01T06:37:14.112103+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/1769436059 expires 2024-09-01T06:37:14.112103+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/644899001 expires 2024-09-01T06:37:14.112103+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3538486341 expires 2024-09-01T06:38:18.150139+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3404040012 expires 2024-09-01T06:38:18.150139+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2862953179 expires 2024-09-01T06:37:14.112103+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/3700278983 expires 2024-09-01T06:38:18.150139+0000 2024-08-31T06:46:15.928 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1887643079 expires 2024-09-01T06:38:18.150139+0000 2024-08-31T06:46:15.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8b00b4c10 msgr2=0x7ff8b00b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:15.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8b00b4c10 0x7ff8b00b7120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4006010 tx=0x7ff8b4000bc0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4103900 msgr2=0x7ff8c40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:15.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4103900 0x7ff8c40754b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000d950 tx=0x7ff8c000de10 comp rx=0 tx=0).stop 2024-08-31T06:46:15.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 shutdown_connections 2024-08-31T06:46:15.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8b00b4c10 0x7ff8b00b7120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8c4109b90 0x7ff8c4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8c4109240 0x7ff8c40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 --2- 172.21.15.37:0/1156089209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4103900 0x7ff8c40754b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:15.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 >> 172.21.15.37:0/1156089209 conn(0x7ff8c407b5f0 msgr2=0x7ff8c4105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:15.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 shutdown_connections 2024-08-31T06:46:15.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:15.927+0000 7ff8cba31640 1 -- 172.21.15.37:0/1156089209 wait complete. 2024-08-31T06:46:16.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:16 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1156089209' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T06:46:16.611 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-31T06:46:16.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:46:16.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:16 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1156089209' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T06:46:16.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:16 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1156089209' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-31T06:46:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 -- 172.21.15.37:0/2858817199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108140 msgr2=0x7fa504108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 --2- 172.21.15.37:0/2858817199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108140 0x7fa504108550 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009900 tx=0x7fa4f402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 -- 172.21.15.37:0/2858817199 shutdown_connections 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 --2- 172.21.15.37:0/2858817199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108140 0x7fa504108550 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 --2- 172.21.15.37:0/2858817199 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa504108a90 0x7fa50410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 --2- 172.21.15.37:0/2858817199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102800 0x7fa504102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 -- 172.21.15.37:0/2858817199 >> 172.21.15.37:0/2858817199 conn(0x7fa5040794d0 msgr2=0x7fa5040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 -- 172.21.15.37:0/2858817199 shutdown_connections 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.408+0000 7fa50c271640 1 -- 172.21.15.37:0/2858817199 wait complete. 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50c271640 1 Processor -- start 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50c271640 1 -- start start 2024-08-31T06:46:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50c271640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102800 0x7fa50419a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50c271640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa504108140 0x7fa50419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50c271640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108a90 0x7fa50419f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50c271640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa504112610 con 0x7fa504108a90 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50c271640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa504112490 con 0x7fa504102800 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50c271640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa504112790 con 0x7fa504108140 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.409+0000 7fa50a80e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108a90 0x7fa50419f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a80e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108a90 0x7fa50419f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40686/0 (socket says 172.21.15.37:40686) 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a80e640 1 -- 172.21.15.37:0/1411782095 learned_addr learned my addr 172.21.15.37:0/1411782095 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50980c640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa504108140 0x7fa50419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a00d640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102800 0x7fa50419a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a80e640 1 -- 172.21.15.37:0/1411782095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa504108140 msgr2=0x7fa50419a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a80e640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa504108140 0x7fa50419a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a80e640 1 -- 172.21.15.37:0/1411782095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102800 msgr2=0x7fa50419a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a80e640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102800 0x7fa50419a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a80e640 1 -- 172.21.15.37:0/1411782095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5041a0120 con 0x7fa504108a90 2024-08-31T06:46:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50a80e640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108a90 0x7fa50419f9f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00eaa0 tx=0x7fa4fc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa4fb7fe640 1 -- 172.21.15.37:0/1411782095 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc004d20 con 0x7fa504108a90 2024-08-31T06:46:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa4fb7fe640 1 -- 172.21.15.37:0/1411782095 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa4fc005020 con 0x7fa504108a90 2024-08-31T06:46:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5041a0410 con 0x7fa504108a90 2024-08-31T06:46:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa4fb7fe640 1 -- 172.21.15.37:0/1411782095 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0116d0 con 0x7fa504108a90 2024-08-31T06:46:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.410+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5041a6b70 con 0x7fa504108a90 2024-08-31T06:46:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.411+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa504102c10 con 0x7fa504108a90 2024-08-31T06:46:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.413+0000 7fa4fb7fe640 1 -- 172.21.15.37:0/1411782095 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7fa4fc0051d0 con 0x7fa504108a90 2024-08-31T06:46:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.414+0000 7fa4fb7fe640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4f00b4c90 0x7fa4f00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.414+0000 7fa50a00d640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4f00b4c90 0x7fa4f00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.414+0000 7fa4fb7fe640 1 -- 172.21.15.37:0/1411782095 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa4fc0e5890 con 0x7fa504108a90 2024-08-31T06:46:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.414+0000 7fa50a00d640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4f00b4c90 0x7fa4f00b71a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa500009990 tx=0x7fa500009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.417+0000 7fa4fb7fe640 1 -- 172.21.15.37:0/1411782095 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa4fc016030 con 0x7fa504108a90 2024-08-31T06:46:17.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:17 smithi037 ceph-mon[18612]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:46:17.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:17 smithi066 ceph-mon[22244]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:46:17.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.639+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa50419b2e0 con 0x7fa504108a90 2024-08-31T06:46:17.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.639+0000 7fa4fb7fe640 1 -- 172.21.15.37:0/1411782095 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7fa50419b2e0 con 0x7fa504108a90 2024-08-31T06:46:17.641 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:17.642 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"btime":"2024-08-31T06:44:54:657185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:44:54.319927+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24656,24695,24658]},"id":1}]} 2024-08-31T06:46:17.642 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-08-31T06:46:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4f00b4c90 msgr2=0x7fa4f00b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4f00b4c90 0x7fa4f00b71a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa500009990 tx=0x7fa500009110 comp rx=0 tx=0).stop 2024-08-31T06:46:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108a90 msgr2=0x7fa50419f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108a90 0x7fa50419f9f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00eaa0 tx=0x7fa4fc00eea0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 shutdown_connections 2024-08-31T06:46:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa4f00b4c90 0x7fa4f00b71a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa504108a90 0x7fa50419f9f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa504108140 0x7fa50419a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 --2- 172.21.15.37:0/1411782095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa504102800 0x7fa50419a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.641+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 >> 172.21.15.37:0/1411782095 conn(0x7fa5040794d0 msgr2=0x7fa50406b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.642+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 shutdown_connections 2024-08-31T06:46:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:17.642+0000 7fa50c271640 1 -- 172.21.15.37:0/1411782095 wait complete. 2024-08-31T06:46:17.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:17 smithi106 ceph-mon[22134]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:46:18.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:46:18.565 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:18.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:18 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1411782095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:18.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:18 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1411782095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:18.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:18 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1411782095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 -- 172.21.15.37:0/2622511917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364103900 msgr2=0x7f7364103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 --2- 172.21.15.37:0/2622511917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364103900 0x7f7364103d10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7354009900 tx=0x7f735402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 -- 172.21.15.37:0/2622511917 shutdown_connections 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 --2- 172.21.15.37:0/2622511917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7364109b90 0x7f73641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 --2- 172.21.15.37:0/2622511917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7364109240 0x7f7364109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 --2- 172.21.15.37:0/2622511917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364103900 0x7f7364103d10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 -- 172.21.15.37:0/2622511917 >> 172.21.15.37:0/2622511917 conn(0x7f736407b5f0 msgr2=0x7f736407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 -- 172.21.15.37:0/2622511917 shutdown_connections 2024-08-31T06:46:19.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 -- 172.21.15.37:0/2622511917 wait complete. 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.039+0000 7f736883b640 1 Processor -- start 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f736883b640 1 -- start start 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f736883b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7364103900 0x7f736419a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f736883b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7364109240 0x7f736419a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f736883b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364109b90 0x7f736419f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f736883b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7364113700 con 0x7f7364109b90 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f736883b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7364113580 con 0x7f7364109240 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f736883b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7364113880 con 0x7f7364103900 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364109b90 0x7f736419f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364109b90 0x7f736419f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40714/0 (socket says 172.21.15.37:40714) 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 -- 172.21.15.37:0/964318978 learned_addr learned my addr 172.21.15.37:0/964318978 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7361d9b640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7364109240 0x7f736419a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f736259c640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7364103900 0x7f736419a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 -- 172.21.15.37:0/964318978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7364103900 msgr2=0x7f736419a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:19.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7364103900 0x7f736419a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 -- 172.21.15.37:0/964318978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7364109240 msgr2=0x7f736419a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7364109240 0x7f736419a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 -- 172.21.15.37:0/964318978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73641a00c0 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.040+0000 7f7362d9d640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364109b90 0x7f736419f990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f735c00eaa0 tx=0x7f735c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.041+0000 7f73537fe640 1 -- 172.21.15.37:0/964318978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c00cdb0 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.041+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73641a03b0 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.041+0000 7f73537fe640 1 -- 172.21.15.37:0/964318978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f735c005020 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.041+0000 7f73537fe640 1 -- 172.21.15.37:0/964318978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735c0116d0 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.041+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73641a6b10 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.042+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7364103d10 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.044+0000 7f73537fe640 1 -- 172.21.15.37:0/964318978 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 21) ==== 152645+0+0 (secure 0 0 0) 0x7f735c004a40 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.044+0000 7f73537fe640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f734c0b4c10 0x7f734c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.044+0000 7f736259c640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f734c0b4c10 0x7f734c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.044+0000 7f73537fe640 1 -- 172.21.15.37:0/964318978 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f735c0e5970 con 0x7f7364109b90 2024-08-31T06:46:19.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.045+0000 7f736259c640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f734c0b4c10 0x7f734c0b7120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7354000c00 tx=0x7f7354009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:19.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.047+0000 7f73537fe640 1 -- 172.21.15.37:0/964318978 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f735c016030 con 0x7f7364109b90 2024-08-31T06:46:19.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.267+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f736419b280 con 0x7f7364109b90 2024-08-31T06:46:19.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.268+0000 7f73537fe640 1 -- 172.21.15.37:0/964318978 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7f736419b280 con 0x7f7364109b90 2024-08-31T06:46:19.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:19.270 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"btime":"2024-08-31T06:44:54:657185+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:44:54.319927+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24656,24695,24658]},"id":1}]} 2024-08-31T06:46:19.271 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-08-31T06:46:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f734c0b4c10 msgr2=0x7f734c0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f734c0b4c10 0x7f734c0b7120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7354000c00 tx=0x7f7354009680 comp rx=0 tx=0).stop 2024-08-31T06:46:19.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364109b90 msgr2=0x7f736419f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364109b90 0x7f736419f990 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f735c00eaa0 tx=0x7f735c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 shutdown_connections 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f734c0b4c10 0x7f734c0b7120 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7364109b90 0x7f736419f990 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7364109240 0x7f736419a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 --2- 172.21.15.37:0/964318978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7364103900 0x7f736419a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 >> 172.21.15.37:0/964318978 conn(0x7f736407b5f0 msgr2=0x7f7364107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 shutdown_connections 2024-08-31T06:46:19.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:19.270+0000 7f736883b640 1 -- 172.21.15.37:0/964318978 wait complete. 2024-08-31T06:46:19.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:19 smithi037 ceph-mon[18612]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:19.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:19 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/964318978' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:19.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:19 smithi066 ceph-mon[22244]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:19.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:19 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/964318978' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:19.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:19 smithi106 ceph-mon[22134]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:46:19.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:19 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/964318978' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:19.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:46:20.130 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 -- 172.21.15.37:0/559268283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 msgr2=0x7f54b4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 --2- 172.21.15.37:0/559268283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 0x7f54b4109650 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f549c009900 tx=0x7f549c02a410 comp rx=0 tx=0).stop 2024-08-31T06:46:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 -- 172.21.15.37:0/559268283 shutdown_connections 2024-08-31T06:46:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 --2- 172.21.15.37:0/559268283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 0x7f54b4109650 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 --2- 172.21.15.37:0/559268283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54b4109b90 0x7f54b41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 --2- 172.21.15.37:0/559268283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54b4103900 0x7f54b4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 -- 172.21.15.37:0/559268283 >> 172.21.15.37:0/559268283 conn(0x7f54b407b5f0 msgr2=0x7f54b407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 -- 172.21.15.37:0/559268283 shutdown_connections 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 -- 172.21.15.37:0/559268283 wait complete. 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.622+0000 7f54b98fd640 1 Processor -- start 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b98fd640 1 -- start start 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b98fd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54b4103900 0x7f54b419a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b98fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 0x7f54b419a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b98fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54b4109b90 0x7f54b419fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b98fd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54b4113720 con 0x7f54b4109240 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b98fd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41135a0 con 0x7f54b4109b90 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b98fd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f54b41138a0 con 0x7f54b4103900 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 0x7f54b419a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 0x7f54b419a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40736/0 (socket says 172.21.15.37:40736) 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b27fc640 1 -- 172.21.15.37:0/3537798753 learned_addr learned my addr 172.21.15.37:0/3537798753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b37fe640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54b4109b90 0x7f54b419fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.623+0000 7f54b2ffd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54b4103900 0x7f54b419a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b27fc640 1 -- 172.21.15.37:0/3537798753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54b4103900 msgr2=0x7f54b419a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b27fc640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54b4103900 0x7f54b419a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b27fc640 1 -- 172.21.15.37:0/3537798753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54b4109b90 msgr2=0x7f54b419fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b27fc640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54b4109b90 0x7f54b419fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b27fc640 1 -- 172.21.15.37:0/3537798753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b41a0160 con 0x7f54b4109240 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b27fc640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 0x7f54b419a790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f549c005940 tx=0x7f549c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b88fb640 1 -- 172.21.15.37:0/3537798753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c03f030 con 0x7f54b4109240 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b88fb640 1 -- 172.21.15.37:0/3537798753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f549c003a80 con 0x7f54b4109240 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b41a03f0 con 0x7f54b4109240 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b88fb640 1 -- 172.21.15.37:0/3537798753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c035070 con 0x7f54b4109240 2024-08-31T06:46:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.624+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b41a6bb0 con 0x7f54b4109240 2024-08-31T06:46:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.625+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b4103d10 con 0x7f54b4109240 2024-08-31T06:46:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.627+0000 7f54b88fb640 1 -- 172.21.15.37:0/3537798753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f549c042030 con 0x7f54b4109240 2024-08-31T06:46:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.628+0000 7f54b88fb640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f54a00b4c00 0x7f54a00b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.628+0000 7f54b2ffd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f54a00b4c00 0x7f54a00b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.628+0000 7f54b88fb640 1 -- 172.21.15.37:0/3537798753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f549c105b40 con 0x7f54b4109240 2024-08-31T06:46:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.628+0000 7f54b2ffd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f54a00b4c00 0x7f54a00b7110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009990 tx=0x7f54a4009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:20.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.631+0000 7f54b88fb640 1 -- 172.21.15.37:0/3537798753 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f549c0ccb30 con 0x7f54b4109240 2024-08-31T06:46:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.815+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54b410b960 con 0x7f54b4109240 2024-08-31T06:46:20.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.817+0000 7f54b88fb640 1 -- 172.21.15.37:0/3537798753 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+23049 (secure 0 0 0) 0x7f549c0cc430 con 0x7f54b4109240 2024-08-31T06:46:20.819 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:20.819 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:45:19.740510+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f54a00b4c00 msgr2=0x7f54a00b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f54a00b4c00 0x7f54a00b7110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009990 tx=0x7f54a4009110 comp rx=0 tx=0).stop 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 msgr2=0x7f54b419a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 0x7f54b419a790 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f549c005940 tx=0x7f549c0040e0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 shutdown_connections 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f54a00b4c00 0x7f54a00b7110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54b4109240 0x7f54b419a790 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54b4109b90 0x7f54b419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 --2- 172.21.15.37:0/3537798753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f54b4103900 0x7f54b419a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.819+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 >> 172.21.15.37:0/3537798753 conn(0x7f54b407b5f0 msgr2=0x7f54b4107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.820+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 shutdown_connections 2024-08-31T06:46:20.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:20.820+0000 7f54b98fd640 1 -- 172.21.15.37:0/3537798753 wait complete. 2024-08-31T06:46:21.529 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:21 smithi037 ceph-mon[18612]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:21.530 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:21 smithi037 ceph-mon[18612]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T06:46:21.530 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:21 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3537798753' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:21.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T06:44:43.326015+0000', 'modified': '2024-08-31T06:44:54.319927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24695, 'mds_1': 24658, 'mds_2': 24656}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24629': {'gid': 24629, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/298046856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 298046856}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 298046856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.106:6835/2636907745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 2636907745}, {'type': 'v1', 'addr': '172.21.15.106:6835', 'nonce': 2636907745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.106:6837/1095097353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6836', 'nonce': 1095097353}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 1095097353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.66:6837/3257187794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 3257187794}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 3257187794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24658': {'gid': 24658, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.106:6839/1806859517', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6838', 'nonce': 1806859517}, {'type': 'v1', 'addr': '172.21.15.106:6839', 'nonce': 1806859517}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.66:6839/2855667585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2855667585}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2855667585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24656, 24695, 24658]} 2024-08-31T06:46:21.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-31T06:46:21.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T06:46:21.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:21 smithi066 ceph-mon[22244]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:21.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:21 smithi066 ceph-mon[22244]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T06:46:21.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:21 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3537798753' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:21.810 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:21.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:21 smithi106 ceph-mon[22134]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:46:21.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:21 smithi106 ceph-mon[22134]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-08-31T06:46:21.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:21 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3537798753' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.298+0000 7f42bf3a3640 1 -- 172.21.15.37:0/3975079033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8109240 msgr2=0x7f42b8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.298+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/3975079033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8109240 0x7f42b8109650 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009900 tx=0x7f42a802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.298+0000 7f42bf3a3640 1 -- 172.21.15.37:0/3975079033 shutdown_connections 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.298+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/3975079033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8109240 0x7f42b8109650 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.298+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/3975079033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b8109b90 0x7f42b81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.298+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/3975079033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b8103900 0x7f42b8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.298+0000 7f42bf3a3640 1 -- 172.21.15.37:0/3975079033 >> 172.21.15.37:0/3975079033 conn(0x7f42b807b5f0 msgr2=0x7f42b807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.299+0000 7f42bf3a3640 1 -- 172.21.15.37:0/3975079033 shutdown_connections 2024-08-31T06:46:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.299+0000 7f42bf3a3640 1 -- 172.21.15.37:0/3975079033 wait complete. 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.299+0000 7f42bf3a3640 1 Processor -- start 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.299+0000 7f42bf3a3640 1 -- start start 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bf3a3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8103900 0x7f42b819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bf3a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b8109240 0x7f42b819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bf3a3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b8109b90 0x7f42b819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bf3a3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8113700 con 0x7f42b8103900 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bf3a3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8113580 con 0x7f42b8109240 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bf3a3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f42b8113880 con 0x7f42b8109b90 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8103900 0x7f42b819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8103900 0x7f42b819a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40758/0 (socket says 172.21.15.37:40758) 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 -- 172.21.15.37:0/2462318253 learned_addr learned my addr 172.21.15.37:0/2462318253 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bc93e640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b8109240 0x7f42b819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd940640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b8109b90 0x7f42b819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 -- 172.21.15.37:0/2462318253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b8109b90 msgr2=0x7f42b819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b8109b90 0x7f42b819fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 -- 172.21.15.37:0/2462318253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b8109240 msgr2=0x7f42b819a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b8109240 0x7f42b819a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 -- 172.21.15.37:0/2462318253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b81a00a0 con 0x7f42b8103900 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bc93e640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b8109240 0x7f42b819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bd13f640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8103900 0x7f42b819a1f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f42b400e9f0 tx=0x7f42b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42ae7fc640 1 -- 172.21.15.37:0/2462318253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b400cd80 con 0x7f42b8103900 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bf3a3640 1 -- 172.21.15.37:0/2462318253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b81a0390 con 0x7f42b8103900 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42ae7fc640 1 -- 172.21.15.37:0/2462318253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b40108c0 con 0x7f42b8103900 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42ae7fc640 1 -- 172.21.15.37:0/2462318253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b40187c0 con 0x7f42b8103900 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.300+0000 7f42bf3a3640 1 -- 172.21.15.37:0/2462318253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b81a6bb0 con 0x7f42b8103900 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.303+0000 7f42ae7fc640 1 -- 172.21.15.37:0/2462318253 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f42b4010430 con 0x7f42b8103900 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.303+0000 7f42c5918740 1 Processor -- start 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.303+0000 7f42c5918740 1 -- start start 2024-08-31T06:46:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42c5918740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 0x55ace5b4a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42c5918740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b4acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42c5918740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b4b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42c5918740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ace5ac13f0 con 0x55ace577c0a0 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42c5918740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ace5ab0980 con 0x55ace5784280 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42c5918740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ace5ab4930 con 0x55ace57a4f60 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd13f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b4acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd13f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b4acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40768/0 (socket says 172.21.15.37:40768) 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd13f640 1 -- 172.21.15.37:0/3393091100 learned_addr learned my addr 172.21.15.37:0/3393091100 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd940640 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 0x55ace5b4a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42ae7fc640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42a40b4bb0 0x7f42a40b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b4b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd940640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42a40b4bb0 0x7f42a40b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42ae7fc640 1 -- 172.21.15.37:0/2462318253 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f42b40e5750 con 0x7f42b8103900 2024-08-31T06:46:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd13f640 1 -- 172.21.15.37:0/3393091100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 msgr2=0x55ace5b4a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 0x55ace5b4a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd13f640 1 -- 172.21.15.37:0/3393091100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 msgr2=0x55ace5b4b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b4b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bd13f640 1 -- 172.21.15.37:0/3393091100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ace5810540 con 0x55ace577c0a0 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.304+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b4b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.305+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b4acf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f42b40a9310 tx=0x7f42b40a8090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298846013d376d30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.305+0000 7f42a37fe640 1 -- 172.21.15.37:0/3393091100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b40ac7a0 con 0x55ace577c0a0 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.305+0000 7f42a37fe640 1 -- 172.21.15.37:0/3393091100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b40ac0a0 con 0x55ace577c0a0 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.305+0000 7f42a37fe640 1 -- 172.21.15.37:0/3393091100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b40a7a10 con 0x55ace577c0a0 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.305+0000 7f42bd940640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42a40b4bb0 0x7f42a40b70c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f42b0014750 tx=0x7f42b0004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 -- 172.21.15.37:0/3393091100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 msgr2=0x55ace5b4acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b4acf0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f42b40a9310 tx=0x7f42b40a8090 comp rx=0 tx=0).stop 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 -- 172.21.15.37:0/3393091100 shutdown_connections 2024-08-31T06:46:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b4acf0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b4b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 --2- 172.21.15.37:0/3393091100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 0x55ace5b4a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 -- 172.21.15.37:0/3393091100 >> 172.21.15.37:0/3393091100 conn(0x55ace5799350 msgr2=0x55ace5b486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 -- 172.21.15.37:0/3393091100 shutdown_connections 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 -- 172.21.15.37:0/3393091100 wait complete. 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 -- start start 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.306+0000 7f42c5918740 1 Processor -- start 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42c5918740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b55e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42c5918740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42c5918740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace57a4f60 0x55ace5b62220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42c5918740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ace59135f0 con 0x55ace577c0a0 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42c5918740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ace5a37600 con 0x55ace57a4f60 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42c5918740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ace5b58f30 con 0x55ace5784280 2024-08-31T06:46:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b55e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42c5918740 10 client.0 _ll_register_callbacks cb 0x55ace5a5daf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b55e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40784/0 (socket says 172.21.15.37:40784) 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 -- 172.21.15.37:0/3260996605 learned_addr learned my addr 172.21.15.37:0/3260996605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd940640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace57a4f60 0x55ace5b62220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 -- 172.21.15.37:0/3260996605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 msgr2=0x55ace5b563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 -- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace57a4f60 msgr2=0x55ace5b62220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace57a4f60 0x55ace5b62220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 -- 172.21.15.37:0/3260996605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ace5a707b0 con 0x55ace577c0a0 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd940640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace57a4f60 0x55ace5b62220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b55e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f42b40e31c0 tx=0x7f42b40ab700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23386e3f8ebb0448 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3260996605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b40b53c0 con 0x55ace577c0a0 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42c5918740 1 -- 172.21.15.37:0/3260996605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b40ac0a0 con 0x55ace577c0a0 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.307+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3260996605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f42b40a7a10 con 0x55ace577c0a0 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.308+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3260996605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f42b40ac7a0 con 0x55ace577c0a0 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.308+0000 7f42c5918740 10 client.15333 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.308+0000 7f42c5918740 1 -- 172.21.15.37:0/3260996605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ace5b64c10 con 0x55ace577c0a0 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.308+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3260996605 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b40ac0a0 con 0x55ace577c0a0 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.308+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3260996605 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f42b40b1aa0 con 0x55ace577c0a0 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.308+0000 7f42c5918740 10 client.15333 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.309+0000 7f42c5918740 10 client.15333 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.309+0000 7f42c5918740 20 client.15333 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.309+0000 7f42c5918740 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55ace57638e0 0x55ace5b68200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.309+0000 7f42c5918740 4 client.15333 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.309+0000 7f42c5918740 1 -- 172.21.15.37:0/3260996605 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ace5ac3340 con 0x55ace57638e0 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.309+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55ace57638e0 0x55ace5b68200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.309+0000 7f42a0ff9640 10 client.15333 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.309+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55ace57638e0 0x55ace5b68200 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41829bc84579a99b server_cookie=e21a79efe81087ca in_seq=0 out_seq=0 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.310+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3260996605 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ace5ac3340 con 0x55ace57638e0 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.310+0000 7f42a0ff9640 10 client.15333 handle_command_reply: tid=0 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.310+0000 7f42c5918740 1 client.15333 shutdown 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 -- 172.21.15.37:0/3260996605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 msgr2=0x55ace5b55e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b55e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f42b40e31c0 tx=0x7f42b40ab700 comp rx=0 tx=0).stop 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 -- 172.21.15.37:0/3260996605 shutdown_connections 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55ace57638e0 0x55ace5b68200 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace57a4f60 0x55ace5b62220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42a0ff9640 0 client.15333 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 --2- 172.21.15.37:0/3260996605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b55e70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 -- 172.21.15.37:0/3260996605 >> 172.21.15.37:0/3260996605 conn(0x55ace5799350 msgr2=0x55ace5b4d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 -- 172.21.15.37:0/3260996605 shutdown_connections 2024-08-31T06:46:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 1 -- 172.21.15.37:0/3260996605 wait complete. 2024-08-31T06:46:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.311+0000 7f42c5918740 20 client.15333 trim_cache size 0 max 16384 2024-08-31T06:46:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.329+0000 7f42c5918740 1 Processor -- start 2024-08-31T06:46:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.329+0000 7f42c5918740 1 -- start start 2024-08-31T06:46:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42c5918740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace577c0a0 0x55ace5b56330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42c5918740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b62190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42c5918740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace57a4f60 0x55ace5b47cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42c5918740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ace5b66540 con 0x55ace57a4f60 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42c5918740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ace5b66c10 con 0x55ace577c0a0 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42c5918740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ace5b672e0 con 0x55ace5784280 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace57a4f60 0x55ace5b47cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace57a4f60 0x55ace5b47cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40786/0 (socket says 172.21.15.37:40786) 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 -- 172.21.15.37:0/233425572 learned_addr learned my addr 172.21.15.37:0/233425572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd13f640 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace577c0a0 0x55ace5b56330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bc93e640 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b62190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 -- 172.21.15.37:0/233425572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 msgr2=0x55ace5b62190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b62190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 -- 172.21.15.37:0/233425572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace577c0a0 msgr2=0x55ace5b56330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace577c0a0 0x55ace5b56330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 -- 172.21.15.37:0/233425572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ace5b4c660 con 0x55ace57a4f60 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd13f640 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace577c0a0 0x55ace5b56330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:22.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42bd940640 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace57a4f60 0x55ace5b47cf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f42b0011910 tx=0x7f42b00086d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2bd438f044e51a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42a2ffd640 1 -- 172.21.15.37:0/233425572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0023030 con 0x55ace57a4f60 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.330+0000 7f42a2ffd640 1 -- 172.21.15.37:0/233425572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b0019040 con 0x55ace57a4f60 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42a2ffd640 1 -- 172.21.15.37:0/233425572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b001fd20 con 0x55ace57a4f60 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 -- 172.21.15.37:0/233425572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace57a4f60 msgr2=0x55ace5b47cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace57a4f60 0x55ace5b47cf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f42b0011910 tx=0x7f42b00086d0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 -- 172.21.15.37:0/233425572 shutdown_connections 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace57a4f60 0x55ace5b47cf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace5784280 0x55ace5b62190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 --2- 172.21.15.37:0/233425572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace577c0a0 0x55ace5b56330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 -- 172.21.15.37:0/233425572 >> 172.21.15.37:0/233425572 conn(0x55ace5799350 msgr2=0x55ace5b55c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 -- 172.21.15.37:0/233425572 shutdown_connections 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.331+0000 7f42c5918740 1 -- 172.21.15.37:0/233425572 wait complete. 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.332+0000 7f42c5918740 1 -- start start 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.332+0000 7f42c5918740 1 Processor -- start 2024-08-31T06:46:22.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.332+0000 7f42c5918740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.332+0000 7f42c5918740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b69ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.332+0000 7f42c5918740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 0x55ace5b6a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.332+0000 7f42c5918740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ace5b68080 con 0x55ace577c0a0 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.332+0000 7f42c5918740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ace5b679b0 con 0x55ace5784280 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.332+0000 7f42c5918740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ace5b68750 con 0x55ace57a4f60 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42c5918740 10 client.0 _ll_register_callbacks cb 0x7f42b40ab630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b709c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40802/0 (socket says 172.21.15.37:40802) 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 -- 172.21.15.37:0/3686694140 learned_addr learned my addr 172.21.15.37:0/3686694140 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b69ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd940640 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 0x55ace5b6a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 -- 172.21.15.37:0/3686694140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 msgr2=0x55ace5b6a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 0x55ace5b6a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 -- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 msgr2=0x55ace5b69ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b69ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 -- 172.21.15.37:0/3686694140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ace5b6a940 con 0x55ace577c0a0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b69ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42bd13f640 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b709c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f42b40b1ec0 tx=0x7f42b40ab210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d324a58ec95cacc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3686694140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b40a7f60 con 0x55ace577c0a0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3686694140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f42b40a8690 con 0x55ace577c0a0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42c5918740 1 -- 172.21.15.37:0/3686694140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b0019040 con 0x55ace577c0a0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3686694140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f42b40aaf80 con 0x55ace577c0a0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42c5918740 10 client.15339 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.333+0000 7f42c5918740 1 -- 172.21.15.37:0/3686694140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ace5b70270 con 0x55ace577c0a0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3686694140 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b0019040 con 0x55ace577c0a0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3686694140 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f42b40970d0 con 0x55ace577c0a0 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42c5918740 10 client.15339 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42c5918740 10 client.15339 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:46:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42c5918740 20 client.15339 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42c5918740 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55ace5738c90 0x55ace5bd69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42c5918740 4 client.15339 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42c5918740 1 -- 172.21.15.37:0/3686694140 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "status"}) -- 0x55ace5abede0 con 0x55ace5738c90 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.334+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55ace5738c90 0x55ace5bd69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42bc93e640 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55ace5738c90 0x55ace5bd69b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d747bc3c7012cc4d server_cookie=2068dbca06c88aef in_seq=0 out_seq=0 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42a0ff9640 10 client.15339 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42a0ff9640 1 -- 172.21.15.37:0/3686694140 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55ace5abede0 con 0x55ace5738c90 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42a0ff9640 10 client.15339 handle_command_reply: tid=0 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 client.15339 shutdown 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 -- 172.21.15.37:0/3686694140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 msgr2=0x55ace5b709c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b709c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f42b40b1ec0 tx=0x7f42b40ab210 comp rx=0 tx=0).stop 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 -- 172.21.15.37:0/3686694140 shutdown_connections 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55ace5738c90 0x55ace5bd69b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ace57a4f60 0x55ace5b6a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ace5784280 0x55ace5b69ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 --2- 172.21.15.37:0/3686694140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ace577c0a0 0x55ace5b709c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42a0ff9640 0 client.15339 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 -- 172.21.15.37:0/3686694140 >> 172.21.15.37:0/3686694140 conn(0x55ace5799350 msgr2=0x55ace5b57320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 -- 172.21.15.37:0/3686694140 shutdown_connections 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 1 -- 172.21.15.37:0/3686694140 wait complete. 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.335+0000 7f42c5918740 20 client.15339 trim_cache size 0 max 16384 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24656, 2024-08-31T06:46:22.345 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 90.68937013, 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 24, 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 121.210090267 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 -- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42a40b4bb0 msgr2=0x7f42a40b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42a40b4bb0 0x7f42a40b70c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f42b0014750 tx=0x7f42b0004ab0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 -- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8103900 msgr2=0x7f42b819a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8103900 0x7f42b819a1f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f42b400e9f0 tx=0x7f42b400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 -- 172.21.15.37:0/2462318253 shutdown_connections 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42a40b4bb0 0x7f42a40b70c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42b8109b90 0x7f42b819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b8109240 0x7f42b819a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 --2- 172.21.15.37:0/2462318253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42b8103900 0x7f42b819a1f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 -- 172.21.15.37:0/2462318253 >> 172.21.15.37:0/2462318253 conn(0x7f42b807b5f0 msgr2=0x7f42b81053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 -- 172.21.15.37:0/2462318253 shutdown_connections 2024-08-31T06:46:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:22.336+0000 7f42bf3a3640 1 -- 172.21.15.37:0/2462318253 wait complete. 2024-08-31T06:46:23.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T06:46:23.422 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:23.535 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:23 smithi037 ceph-mon[18612]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T06:46:23.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:23 smithi066 ceph-mon[22244]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T06:46:23.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:23 smithi106 ceph-mon[22134]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-31T06:46:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 -- 172.21.15.37:0/2453438079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 msgr2=0x7f9310102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 --2- 172.21.15.37:0/2453438079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 0x7f9310102c90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9300009900 tx=0x7f930002a410 comp rx=0 tx=0).stop 2024-08-31T06:46:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 -- 172.21.15.37:0/2453438079 shutdown_connections 2024-08-31T06:46:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 --2- 172.21.15.37:0/2453438079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9310108ac0 0x7f931010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 --2- 172.21.15.37:0/2453438079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9310108170 0x7f9310108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 --2- 172.21.15.37:0/2453438079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 0x7f9310102c90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 -- 172.21.15.37:0/2453438079 >> 172.21.15.37:0/2453438079 conn(0x7f9310079500 msgr2=0x7f9310079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 -- 172.21.15.37:0/2453438079 shutdown_connections 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.888+0000 7f93165f3640 1 -- 172.21.15.37:0/2453438079 wait complete. 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.889+0000 7f93165f3640 1 Processor -- start 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.889+0000 7f93165f3640 1 -- start start 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.889+0000 7f93165f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 0x7f9310104020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.889+0000 7f93165f3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9310108170 0x7f9310104560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.889+0000 7f93165f3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9310108ac0 0x7f9310104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.889+0000 7f93165f3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93101125f0 con 0x7f9310102880 2024-08-31T06:46:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f93165f3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9310112470 con 0x7f9310108170 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f93165f3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9310112770 con 0x7f9310108ac0 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 0x7f9310104020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 0x7f9310104020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40814/0 (socket says 172.21.15.37:40814) 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 -- 172.21.15.37:0/3987232558 learned_addr learned my addr 172.21.15.37:0/3987232558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f9314b90640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9310108ac0 0x7f9310104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930f7fe640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9310108170 0x7f9310104560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 -- 172.21.15.37:0/3987232558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9310108ac0 msgr2=0x7f9310104aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9310108ac0 0x7f9310104aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 -- 172.21.15.37:0/3987232558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9310108170 msgr2=0x7f9310104560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9310108170 0x7f9310104560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 -- 172.21.15.37:0/3987232558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93101a8430 con 0x7f9310102880 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930f7fe640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9310108170 0x7f9310104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f9314b90640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9310108ac0 0x7f9310104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930ffff640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 0x7f9310104020 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9300009230 tx=0x7f9300004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930d7fa640 1 -- 172.21.15.37:0/3987232558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930003f030 con 0x7f9310102880 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f93165f3640 1 -- 172.21.15.37:0/3987232558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93101a86c0 con 0x7f9310102880 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930d7fa640 1 -- 172.21.15.37:0/3987232558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9300003a80 con 0x7f9310102880 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f930d7fa640 1 -- 172.21.15.37:0/3987232558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9300035070 con 0x7f9310102880 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.890+0000 7f93165f3640 1 -- 172.21.15.37:0/3987232558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93101a8bf0 con 0x7f9310102880 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.893+0000 7f931cb68740 1 Processor -- start 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f931cb68740 1 -- start start 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930d7fa640 1 -- 172.21.15.37:0/3987232558 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f9300042030 con 0x7f9310102880 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f931cb68740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905f2f60 0x5572909987b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f931cb68740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905ca0a0 0x557290998cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f931cb68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905d2280 0x557290999230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f931cb68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55729090f3f0 con 0x5572905d2280 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f931cb68740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5572908fe980 con 0x5572905ca0a0 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f931cb68740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557290902930 con 0x5572905f2f60 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905d2280 0x557290999230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905d2280 0x557290999230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40820/0 (socket says 172.21.15.37:40820) 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930f7fe640 1 -- 172.21.15.37:0/232549890 learned_addr learned my addr 172.21.15.37:0/232549890 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930ffff640 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905ca0a0 0x557290998cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f9314b90640 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905f2f60 0x5572909987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930f7fe640 1 -- 172.21.15.37:0/232549890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905f2f60 msgr2=0x5572909987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930f7fe640 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905f2f60 0x5572909987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930f7fe640 1 -- 172.21.15.37:0/232549890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905ca0a0 msgr2=0x557290998cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930f7fe640 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905ca0a0 0x557290998cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.894+0000 7f930f7fe640 1 -- 172.21.15.37:0/232549890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729065e540 con 0x5572905d2280 2024-08-31T06:46:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.895+0000 7f930f7fe640 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905d2280 0x557290999230 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f930400bb10 tx=0x7f930400d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2836c48126637cd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.895+0000 7f930d7fa640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92f80b4b80 0x7f92f80b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.895+0000 7f92f67fc640 1 -- 172.21.15.37:0/232549890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9304017420 con 0x5572905d2280 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.895+0000 7f92f67fc640 1 -- 172.21.15.37:0/232549890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9304017a50 con 0x5572905d2280 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.895+0000 7f92f67fc640 1 -- 172.21.15.37:0/232549890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930400f9e0 con 0x5572905d2280 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.895+0000 7f9314b90640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92f80b4b80 0x7f92f80b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.895+0000 7f930d7fa640 1 -- 172.21.15.37:0/3987232558 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9300105b10 con 0x7f9310102880 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 -- 172.21.15.37:0/232549890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905d2280 msgr2=0x557290999230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f9314b90640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92f80b4b80 0x7f92f80b7090 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9308005fd0 tx=0x7f9308009920 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905d2280 0x557290999230 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f930400bb10 tx=0x7f930400d340 comp rx=0 tx=0).stop 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 -- 172.21.15.37:0/232549890 shutdown_connections 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905d2280 0x557290999230 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905ca0a0 0x557290998cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 --2- 172.21.15.37:0/232549890 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905f2f60 0x5572909987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 -- 172.21.15.37:0/232549890 >> 172.21.15.37:0/232549890 conn(0x5572905e7350 msgr2=0x5572909966a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 -- 172.21.15.37:0/232549890 shutdown_connections 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 -- 172.21.15.37:0/232549890 wait complete. 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.896+0000 7f931cb68740 1 -- start start 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f931cb68740 1 Processor -- start 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f931cb68740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 0x5572909a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f931cb68740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 0x5572909a4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f931cb68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x5572909a4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f931cb68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572907615f0 con 0x5572905f2f60 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f931cb68740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557290885600 con 0x5572905d2280 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f931cb68740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5572909a6f90 con 0x5572905ca0a0 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f931cb68740 10 client.0 _ll_register_callbacks cb 0x5572908abaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x5572909a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x5572909a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40832/0 (socket says 172.21.15.37:40832) 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 -- 172.21.15.37:0/1419269157 learned_addr learned my addr 172.21.15.37:0/1419269157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f930ffff640 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 0x5572909a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f930f7fe640 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 0x5572909a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 -- 172.21.15.37:0/1419269157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 msgr2=0x5572909a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 0x5572909a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 -- 172.21.15.37:0/1419269157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 msgr2=0x5572909a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 0x5572909a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 -- 172.21.15.37:0/1419269157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572908be7b0 con 0x5572905f2f60 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f930f7fe640 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 0x5572909a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.897+0000 7f9314b90640 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x5572909a4860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9308009860 tx=0x7f9308004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42e7a8a5e27118c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f92ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1419269157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308023070 con 0x5572905f2f60 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1419269157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9308011b60 con 0x5572905f2f60 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 1 -- 172.21.15.37:0/1419269157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9304017a50 con 0x5572905f2f60 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1419269157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f930802f050 con 0x5572905f2f60 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 10 client.15351 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 1 -- 172.21.15.37:0/1419269157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5572909b2cd0 con 0x5572905f2f60 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1419269157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9304017a50 con 0x5572905f2f60 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1419269157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f930800f040 con 0x5572905f2f60 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 10 client.15351 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 10 client.15351 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 20 client.15351 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5572905b18e0 0x5572909b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 4 client.15351 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.898+0000 7f931cb68740 1 -- 172.21.15.37:0/1419269157 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557290911340 con 0x5572905b18e0 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.899+0000 7f930ffff640 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5572905b18e0 0x5572909b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.899+0000 7f930ffff640 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5572905b18e0 0x5572909b67c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=837f36f51be7943f server_cookie=706e474a6e5d769b in_seq=0 out_seq=0 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.899+0000 7f92ef7fe640 10 client.15351 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1419269157 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557290911340 con 0x5572905b18e0 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f92ef7fe640 10 client.15351 handle_command_reply: tid=0 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 client.15351 shutdown 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 -- 172.21.15.37:0/1419269157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 msgr2=0x5572909a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x5572909a4860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9308009860 tx=0x7f9308004ab0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 -- 172.21.15.37:0/1419269157 shutdown_connections 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5572905b18e0 0x5572909b67c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x5572909a4860 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 0x5572909a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f92ef7fe640 0 client.15351 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 --2- 172.21.15.37:0/1419269157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 0x5572909a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 -- 172.21.15.37:0/1419269157 >> 172.21.15.37:0/1419269157 conn(0x5572905e7350 msgr2=0x55729099b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 -- 172.21.15.37:0/1419269157 shutdown_connections 2024-08-31T06:46:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 1 -- 172.21.15.37:0/1419269157 wait complete. 2024-08-31T06:46:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.900+0000 7f931cb68740 20 client.15351 trim_cache size 0 max 16384 2024-08-31T06:46:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f931cb68740 1 Processor -- start 2024-08-31T06:46:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f931cb68740 1 -- start start 2024-08-31T06:46:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f931cb68740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 0x5572909a2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f931cb68740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 0x5572909a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f931cb68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x557290995cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f931cb68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572909b4b00 con 0x5572905f2f60 2024-08-31T06:46:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f931cb68740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5572909b51d0 con 0x5572905d2280 2024-08-31T06:46:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f931cb68740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5572909b58a0 con 0x5572905ca0a0 2024-08-31T06:46:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f9314b90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x557290995cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f9314b90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x557290995cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40844/0 (socket says 172.21.15.37:40844) 2024-08-31T06:46:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.919+0000 7f9314b90640 1 -- 172.21.15.37:0/263767401 learned_addr learned my addr 172.21.15.37:0/263767401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f9314b90640 1 -- 172.21.15.37:0/263767401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 msgr2=0x5572909a2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f9314b90640 1 --2- 172.21.15.37:0/263767401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 0x5572909a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f9314b90640 1 -- 172.21.15.37:0/263767401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 msgr2=0x5572909a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f9314b90640 1 --2- 172.21.15.37:0/263767401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 0x5572909a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f9314b90640 1 -- 172.21.15.37:0/263767401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572909a6500 con 0x5572905f2f60 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f9314b90640 1 --2- 172.21.15.37:0/263767401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x557290995cf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9308010bb0 tx=0x7f9308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f577e942510a42a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f92f5ffb640 1 -- 172.21.15.37:0/263767401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308023050 con 0x5572905f2f60 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f92f5ffb640 1 -- 172.21.15.37:0/263767401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93080276d0 con 0x5572905f2f60 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.920+0000 7f92f5ffb640 1 -- 172.21.15.37:0/263767401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308011c70 con 0x5572905f2f60 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 -- 172.21.15.37:0/263767401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 msgr2=0x557290995cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 --2- 172.21.15.37:0/263767401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x557290995cf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9308010bb0 tx=0x7f9308004a40 comp rx=0 tx=0).stop 2024-08-31T06:46:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 -- 172.21.15.37:0/263767401 shutdown_connections 2024-08-31T06:46:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 --2- 172.21.15.37:0/263767401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905f2f60 0x557290995cf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 --2- 172.21.15.37:0/263767401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905d2280 0x5572909a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 --2- 172.21.15.37:0/263767401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905ca0a0 0x5572909a2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 -- 172.21.15.37:0/263767401 >> 172.21.15.37:0/263767401 conn(0x5572905e7350 msgr2=0x5572909a3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 -- 172.21.15.37:0/263767401 shutdown_connections 2024-08-31T06:46:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 -- 172.21.15.37:0/263767401 wait complete. 2024-08-31T06:46:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.921+0000 7f931cb68740 1 -- start start 2024-08-31T06:46:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f931cb68740 1 Processor -- start 2024-08-31T06:46:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f931cb68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905ca0a0 0x5572909bf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f931cb68740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905d2280 0x5572909b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f931cb68740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905f2f60 0x5572909b9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f931cb68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572909b6640 con 0x5572905ca0a0 2024-08-31T06:46:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f931cb68740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5572909b5f70 con 0x5572905f2f60 2024-08-31T06:46:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f931cb68740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5572909b6d10 con 0x5572905d2280 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f931cb68740 10 client.0 _ll_register_callbacks cb 0x7f9308012490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905ca0a0 0x5572909bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905ca0a0 0x5572909bf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40858/0 (socket says 172.21.15.37:40858) 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930ffff640 1 -- 172.21.15.37:0/1038350431 learned_addr learned my addr 172.21.15.37:0/1038350431 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f9314b90640 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905f2f60 0x5572909b9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930f7fe640 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905d2280 0x5572909b97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930ffff640 1 -- 172.21.15.37:0/1038350431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905d2280 msgr2=0x5572909b97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930ffff640 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905d2280 0x5572909b97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930ffff640 1 -- 172.21.15.37:0/1038350431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905f2f60 msgr2=0x5572909b9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930ffff640 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905f2f60 0x5572909b9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f930ffff640 1 -- 172.21.15.37:0/1038350431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572909ba5a0 con 0x5572905ca0a0 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.922+0000 7f9314b90640 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905f2f60 0x5572909b9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f930ffff640 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905ca0a0 0x5572909bf340 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9300005f70 tx=0x7f9300009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d06de24c7b1263 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f92ef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1038350431 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930010b030 con 0x5572905ca0a0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1038350431 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f93000c8a50 con 0x5572905ca0a0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 1 -- 172.21.15.37:0/1038350431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93080276d0 con 0x5572905ca0a0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1038350431 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9300049040 con 0x5572905ca0a0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 10 client.15357 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 1 -- 172.21.15.37:0/1038350431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557290a22ca0 con 0x5572905ca0a0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1038350431 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f93080276d0 con 0x5572905ca0a0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1038350431 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f93000b5ce0 con 0x5572905ca0a0 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 10 client.15357 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 10 client.15357 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 20 client.15357 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x557290586c90 0x557290a26520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 4 client.15357 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.923+0000 7f931cb68740 1 -- 172.21.15.37:0/1038350431 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "status"}) -- 0x55729090cde0 con 0x557290586c90 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.924+0000 7f930f7fe640 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x557290586c90 0x557290a26520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.924+0000 7f930f7fe640 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x557290586c90 0x557290a26520 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9c4b226da09469c server_cookie=526137398f5dbe38 in_seq=0 out_seq=0 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.924+0000 7f92ef7fe640 10 client.15357 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.924+0000 7f92ef7fe640 1 -- 172.21.15.37:0/1038350431 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55729090cde0 con 0x557290586c90 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.924+0000 7f92ef7fe640 10 client.15357 handle_command_reply: tid=0 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.924+0000 7f931cb68740 1 client.15357 shutdown 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 -- 172.21.15.37:0/1038350431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905ca0a0 msgr2=0x5572909bf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905ca0a0 0x5572909bf340 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9300005f70 tx=0x7f9300009260 comp rx=0 tx=0).stop 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 -- 172.21.15.37:0/1038350431 shutdown_connections 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x557290586c90 0x557290a26520 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5572905f2f60 0x5572909b9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5572905d2280 0x5572909b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 --2- 172.21.15.37:0/1038350431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572905ca0a0 0x5572909bf340 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 -- 172.21.15.37:0/1038350431 >> 172.21.15.37:0/1038350431 conn(0x5572905e7350 msgr2=0x5572909a3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f92ef7fe640 0 client.15357 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 -- 172.21.15.37:0/1038350431 shutdown_connections 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 1 -- 172.21.15.37:0/1038350431 wait complete. 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.925+0000 7f931cb68740 20 client.15357 trim_cache size 0 max 16384 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24658, 2024-08-31T06:46:23.932 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:46:23.933 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:46:23.933 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:46:23.933 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 93.284275910000005, 2024-08-31T06:46:23.933 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 24, 2024-08-31T06:46:23.933 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:46:23.933 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:46:23.933 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 120.22574041 2024-08-31T06:46:23.933 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 -- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92f80b4b80 msgr2=0x7f92f80b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92f80b4b80 0x7f92f80b7090 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9308005fd0 tx=0x7f9308009920 comp rx=0 tx=0).stop 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 -- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 msgr2=0x7f9310104020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 0x7f9310104020 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9300009230 tx=0x7f9300004270 comp rx=0 tx=0).stop 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 -- 172.21.15.37:0/3987232558 shutdown_connections 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f92f80b4b80 0x7f92f80b7090 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9310108ac0 0x7f9310104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9310108170 0x7f9310104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 --2- 172.21.15.37:0/3987232558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9310102880 0x7f9310104020 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 -- 172.21.15.37:0/3987232558 >> 172.21.15.37:0/3987232558 conn(0x7f9310079500 msgr2=0x7f9310101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:23.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 -- 172.21.15.37:0/3987232558 shutdown_connections 2024-08-31T06:46:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:23.926+0000 7f93165f3640 1 -- 172.21.15.37:0/3987232558 wait complete. 2024-08-31T06:46:24.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T06:46:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 -- 172.21.15.37:0/2189621699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 msgr2=0x7ff904102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 --2- 172.21.15.37:0/2189621699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 0x7ff904102c10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009900 tx=0x7ff8f402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 -- 172.21.15.37:0/2189621699 shutdown_connections 2024-08-31T06:46:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 --2- 172.21.15.37:0/2189621699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff904108a90 0x7ff90410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 --2- 172.21.15.37:0/2189621699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff904108140 0x7ff904108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 --2- 172.21.15.37:0/2189621699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 0x7ff904102c10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 -- 172.21.15.37:0/2189621699 >> 172.21.15.37:0/2189621699 conn(0x7ff9040794d0 msgr2=0x7ff9040798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 -- 172.21.15.37:0/2189621699 shutdown_connections 2024-08-31T06:46:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.356+0000 7ff90a883640 1 -- 172.21.15.37:0/2189621699 wait complete. 2024-08-31T06:46:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.357+0000 7ff90a883640 1 Processor -- start 2024-08-31T06:46:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.357+0000 7ff90a883640 1 -- start start 2024-08-31T06:46:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff90a883640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 0x7ff90419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff90a883640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff904108140 0x7ff90419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff90a883640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff904108a90 0x7ff90419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff90a883640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9041125c0 con 0x7ff904102800 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff90a883640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff904112440 con 0x7ff904108140 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff90a883640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff904112740 con 0x7ff904108a90 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 0x7ff90419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 0x7ff90419a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40322/0 (socket says 172.21.15.37:40322) 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 -- 172.21.15.37:0/1674299701 learned_addr learned my addr 172.21.15.37:0/1674299701 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff9037fe640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff904108140 0x7ff90419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff908e20640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff904108a90 0x7ff90419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 -- 172.21.15.37:0/1674299701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff904108a90 msgr2=0x7ff90419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff904108a90 0x7ff90419f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 -- 172.21.15.37:0/1674299701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff904108140 msgr2=0x7ff90419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff904108140 0x7ff90419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 -- 172.21.15.37:0/1674299701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9041a00d0 con 0x7ff904102800 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff908e20640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff904108a90 0x7ff90419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.358+0000 7ff903fff640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 0x7ff90419a160 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009a20 tx=0x7ff8f4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.359+0000 7ff9017fa640 1 -- 172.21.15.37:0/1674299701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f403f030 con 0x7ff904102800 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.359+0000 7ff9017fa640 1 -- 172.21.15.37:0/1674299701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8f40035f0 con 0x7ff904102800 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.359+0000 7ff90a883640 1 -- 172.21.15.37:0/1674299701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9041a0360 con 0x7ff904102800 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.359+0000 7ff9017fa640 1 -- 172.21.15.37:0/1674299701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4035070 con 0x7ff904102800 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.359+0000 7ff90a883640 1 -- 172.21.15.37:0/1674299701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9041a6b20 con 0x7ff904102800 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.361+0000 7ff910df8740 1 Processor -- start 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff910df8740 1 -- start start 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff910df8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff910df8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff910df8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f8280 0x564e129bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff910df8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e129353f0 con 0x564e125f00a0 2024-08-31T06:46:25.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff910df8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e12924980 con 0x564e125f8280 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff910df8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564e12928930 con 0x564e12618f60 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff9017fa640 1 -- 172.21.15.37:0/1674299701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7ff8f4003aa0 con 0x7ff904102800 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff9037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f8280 0x564e129bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff903fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff9037fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f8280 0x564e129bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:38318/0 (socket says 172.21.15.37:38318) 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff9037fe640 1 -- 172.21.15.37:0/1707466104 learned_addr learned my addr 172.21.15.37:0/1707466104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.362+0000 7ff908e20640 1 --2- 172.21.15.37:0/1707466104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff9037fe640 1 -- 172.21.15.37:0/1707466104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 msgr2=0x564e129be7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff9037fe640 1 --2- 172.21.15.37:0/1707466104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129be7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff9037fe640 1 -- 172.21.15.37:0/1707466104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 msgr2=0x564e129becf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff9037fe640 1 --2- 172.21.15.37:0/1707466104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129becf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff9037fe640 1 -- 172.21.15.37:0/1707466104 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e12684540 con 0x564e125f8280 2024-08-31T06:46:25.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff9037fe640 1 --2- 172.21.15.37:0/1707466104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f8280 0x564e129bf230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800cb90 tx=0x7ff8f800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b11c0fce91184a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff9017fa640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8ec0b4b80 0x7ff8ec0b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff8ea7fc640 1 -- 172.21.15.37:0/1707466104 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8010630 con 0x564e125f8280 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff908e20640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8ec0b4b80 0x7ff8ec0b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff8ea7fc640 1 -- 172.21.15.37:0/1707466104 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8f8010c60 con 0x564e125f8280 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff8ea7fc640 1 -- 172.21.15.37:0/1707466104 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800fa30 con 0x564e125f8280 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.363+0000 7ff9017fa640 1 -- 172.21.15.37:0/1674299701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ff8f4105cb0 con 0x7ff904102800 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.364+0000 7ff910df8740 1 -- 172.21.15.37:0/1707466104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f8280 msgr2=0x564e129bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.364+0000 7ff908e20640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8ec0b4b80 0x7ff8ec0b7090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc005fd0 tx=0x7ff8fc008630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.364+0000 7ff910df8740 1 --2- 172.21.15.37:0/1707466104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f8280 0x564e129bf230 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800cb90 tx=0x7ff8f800e720 comp rx=0 tx=0).stop 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 -- 172.21.15.37:0/1707466104 shutdown_connections 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 --2- 172.21.15.37:0/1707466104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129becf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 --2- 172.21.15.37:0/1707466104 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f8280 0x564e129bf230 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 --2- 172.21.15.37:0/1707466104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129be7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 -- 172.21.15.37:0/1707466104 >> 172.21.15.37:0/1707466104 conn(0x564e1260d350 msgr2=0x564e129bc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 -- 172.21.15.37:0/1707466104 shutdown_connections 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 -- 172.21.15.37:0/1707466104 wait complete. 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 -- start start 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.365+0000 7ff910df8740 1 Processor -- start 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff910df8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff910df8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 0x564e129ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff910df8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e12618f60 0x564e129da5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff910df8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e127875f0 con 0x564e125f00a0 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff910df8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e128ab600 con 0x564e12618f60 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff910df8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564e129d1290 con 0x564e125f8280 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff910df8740 10 client.0 _ll_register_callbacks cb 0x564e128d1af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff903fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff903fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40340/0 (socket says 172.21.15.37:40340) 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff903fff640 1 -- 172.21.15.37:0/298086777 learned_addr learned my addr 172.21.15.37:0/298086777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff908e20640 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e12618f60 0x564e129da5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.366+0000 7ff9037fe640 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 0x564e129ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff903fff640 1 -- 172.21.15.37:0/298086777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 msgr2=0x564e129ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff903fff640 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 0x564e129ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff903fff640 1 -- 172.21.15.37:0/298086777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e12618f60 msgr2=0x564e129da5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff903fff640 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e12618f60 0x564e129da5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff903fff640 1 -- 172.21.15.37:0/298086777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e128e47b0 con 0x564e125f00a0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff903fff640 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129ce210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff8f41036d0 tx=0x7ff8f40cc490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9657c447ded1fa92 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff8e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff8e37fe640 1 -- 172.21.15.37:0/298086777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4049040 con 0x564e125f00a0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff910df8740 1 -- 172.21.15.37:0/298086777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8f8010c60 con 0x564e125f00a0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff8e37fe640 1 -- 172.21.15.37:0/298086777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ff8f40c8890 con 0x564e125f00a0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff8e37fe640 1 -- 172.21.15.37:0/298086777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff8f40cc110 con 0x564e125f00a0 2024-08-31T06:46:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff910df8740 10 client.15369 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff910df8740 1 -- 172.21.15.37:0/298086777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564e129dcfb0 con 0x564e125f00a0 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.367+0000 7ff8e37fe640 1 -- 172.21.15.37:0/298086777 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8f8010c60 con 0x564e125f00a0 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.368+0000 7ff8e37fe640 1 -- 172.21.15.37:0/298086777 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff8f40cc860 con 0x564e125f00a0 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.368+0000 7ff910df8740 10 client.15369 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.368+0000 7ff910df8740 10 client.15369 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.368+0000 7ff910df8740 20 client.15369 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.368+0000 7ff910df8740 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564e125d78e0 0x564e129e0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.368+0000 7ff910df8740 4 client.15369 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.368+0000 7ff910df8740 1 -- 172.21.15.37:0/298086777 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e12937340 con 0x564e125d78e0 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.368+0000 7ff9037fe640 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564e125d78e0 0x564e129e0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.369+0000 7ff8e37fe640 10 client.15369 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.369+0000 7ff9037fe640 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564e125d78e0 0x564e129e0aa0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc869031fab2a6bc server_cookie=d02d138bbe0b6ed9 in_seq=0 out_seq=0 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.369+0000 7ff8e37fe640 1 -- 172.21.15.37:0/298086777 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e12937340 con 0x564e125d78e0 2024-08-31T06:46:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.369+0000 7ff8e37fe640 10 client.15369 handle_command_reply: tid=0 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.369+0000 7ff910df8740 1 client.15369 shutdown 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 -- 172.21.15.37:0/298086777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 msgr2=0x564e129ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129ce210 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff8f41036d0 tx=0x7ff8f40cc490 comp rx=0 tx=0).stop 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 -- 172.21.15.37:0/298086777 shutdown_connections 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564e125d78e0 0x564e129e0aa0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e12618f60 0x564e129da5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 0x564e129ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff8e37fe640 0 client.15369 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 --2- 172.21.15.37:0/298086777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f00a0 0x564e129ce210 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 -- 172.21.15.37:0/298086777 >> 172.21.15.37:0/298086777 conn(0x564e1260d350 msgr2=0x564e129bace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 -- 172.21.15.37:0/298086777 shutdown_connections 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 1 -- 172.21.15.37:0/298086777 wait complete. 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.370+0000 7ff910df8740 20 client.15369 trim_cache size 0 max 16384 2024-08-31T06:46:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff910df8740 1 Processor -- start 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff910df8740 1 -- start start 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff910df8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 0x564e129da560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff910df8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 0x564e129de300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff910df8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12618f60 0x564e129de840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff910df8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e129dede0 con 0x564e12618f60 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff910df8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e129df4b0 con 0x564e125f00a0 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff910df8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564e129dfb80 con 0x564e125f8280 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff908e20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12618f60 0x564e129de840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff908e20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12618f60 0x564e129de840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40342/0 (socket says 172.21.15.37:40342) 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff908e20640 1 -- 172.21.15.37:0/2956475370 learned_addr learned my addr 172.21.15.37:0/2956475370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:25.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff9037fe640 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 0x564e129de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff903fff640 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 0x564e129da560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff908e20640 1 -- 172.21.15.37:0/2956475370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 msgr2=0x564e129de300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff908e20640 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 0x564e129de300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff908e20640 1 -- 172.21.15.37:0/2956475370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 msgr2=0x564e129da560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff908e20640 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 0x564e129da560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.389+0000 7ff908e20640 1 -- 172.21.15.37:0/2956475370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e129bcf90 con 0x564e12618f60 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.390+0000 7ff908e20640 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12618f60 0x564e129de840 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00e690 tx=0x7ff8fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5d1888f47a0415 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.390+0000 7ff8e9ffb640 1 -- 172.21.15.37:0/2956475370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc01ea90 con 0x564e12618f60 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.390+0000 7ff8e9ffb640 1 -- 172.21.15.37:0/2956475370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8fc01ec30 con 0x564e12618f60 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.390+0000 7ff8e9ffb640 1 -- 172.21.15.37:0/2956475370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc025390 con 0x564e12618f60 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 -- 172.21.15.37:0/2956475370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12618f60 msgr2=0x564e129de840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12618f60 0x564e129de840 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00e690 tx=0x7ff8fc013000 comp rx=0 tx=0).stop 2024-08-31T06:46:25.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 -- 172.21.15.37:0/2956475370 shutdown_connections 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e12618f60 0x564e129de840 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e125f8280 0x564e129de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 --2- 172.21.15.37:0/2956475370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 0x564e129da560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 -- 172.21.15.37:0/2956475370 >> 172.21.15.37:0/2956475370 conn(0x564e1260d350 msgr2=0x564e129b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 -- 172.21.15.37:0/2956475370 shutdown_connections 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 -- 172.21.15.37:0/2956475370 wait complete. 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 -- start start 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.391+0000 7ff910df8740 1 Processor -- start 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff910df8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 0x564e129e2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff910df8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f8280 0x564e129e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff910df8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff910df8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e129e0920 con 0x564e125f8280 2024-08-31T06:46:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff910df8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564e129e0250 con 0x564e125f00a0 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff910df8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564e129e0ff0 con 0x564e12618f60 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff910df8740 10 client.0 _ll_register_callbacks cb 0x7ff8f40c84c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff9037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f8280 0x564e129e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff9037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f8280 0x564e129e2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40358/0 (socket says 172.21.15.37:40358) 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff9037fe640 1 -- 172.21.15.37:0/378924010 learned_addr learned my addr 172.21.15.37:0/378924010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff903fff640 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 0x564e129e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff908e20640 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff9037fe640 1 -- 172.21.15.37:0/378924010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 msgr2=0x564e129e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff9037fe640 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129e79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff9037fe640 1 -- 172.21.15.37:0/378924010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 msgr2=0x564e129e2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff9037fe640 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 0x564e129e2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff9037fe640 1 -- 172.21.15.37:0/378924010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e129e7ff0 con 0x564e125f8280 2024-08-31T06:46:25.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.392+0000 7ff908e20640 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff9037fe640 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f8280 0x564e129e2a10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800ec20 tx=0x7ff8f800c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d5d33e10eb86c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff8e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff8e37fe640 1 -- 172.21.15.37:0/378924010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8005450 con 0x564e125f8280 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff8e37fe640 1 -- 172.21.15.37:0/378924010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ff8f80055f0 con 0x564e125f8280 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff910df8740 1 -- 172.21.15.37:0/378924010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8fc01ec30 con 0x564e125f8280 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff8e37fe640 1 -- 172.21.15.37:0/378924010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff8f803b050 con 0x564e125f8280 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff910df8740 10 client.15375 fetch_fsmap learned FSMap version 24 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff910df8740 1 -- 172.21.15.37:0/378924010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564e129e9400 con 0x564e125f8280 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff8e37fe640 1 -- 172.21.15.37:0/378924010 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8fc01ec30 con 0x564e125f8280 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff8e37fe640 1 -- 172.21.15.37:0/378924010 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff8f8004660 con 0x564e125f8280 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff910df8740 10 client.15375 fetch_fsmap finished waiting for FSMap version 24 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.393+0000 7ff910df8740 10 client.15375 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:46:25.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.394+0000 7ff910df8740 20 client.15375 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.394+0000 7ff910df8740 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564e125acc90 0x564e12a4ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.394+0000 7ff910df8740 4 client.15375 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.394+0000 7ff910df8740 1 -- 172.21.15.37:0/378924010 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "status"}) -- 0x564e12932de0 con 0x564e125acc90 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.394+0000 7ff903fff640 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564e125acc90 0x564e12a4ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.394+0000 7ff8e37fe640 10 client.15375 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.394+0000 7ff903fff640 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564e125acc90 0x564e12a4ece0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ccd564346819456 server_cookie=c8f2b3b3481fe95a in_seq=0 out_seq=0 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff8e37fe640 1 -- 172.21.15.37:0/378924010 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x564e12932de0 con 0x564e125acc90 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff8e37fe640 10 client.15375 handle_command_reply: tid=0 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 client.15375 shutdown 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 -- 172.21.15.37:0/378924010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f8280 msgr2=0x564e129e2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f8280 0x564e129e2a10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800ec20 tx=0x7ff8f800c460 comp rx=0 tx=0).stop 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 -- 172.21.15.37:0/378924010 shutdown_connections 2024-08-31T06:46:25.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564e125acc90 0x564e12a4ece0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e125f8280 0x564e129e2a10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564e12618f60 0x564e129e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff8e37fe640 0 client.15375 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 --2- 172.21.15.37:0/378924010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564e125f00a0 0x564e129e2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 -- 172.21.15.37:0/378924010 >> 172.21.15.37:0/378924010 conn(0x564e1260d350 msgr2=0x564e129b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 -- 172.21.15.37:0/378924010 shutdown_connections 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 1 -- 172.21.15.37:0/378924010 wait complete. 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.395+0000 7ff910df8740 20 client.15375 trim_cache size 0 max 16384 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:46:25.478 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24695, 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 101.749184003, 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 24, 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 74, 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 112.82461567 2024-08-31T06:46:25.479 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 -- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8ec0b4b80 msgr2=0x7ff8ec0b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8ec0b4b80 0x7ff8ec0b7090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc005fd0 tx=0x7ff8fc008630 comp rx=0 tx=0).stop 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 -- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 msgr2=0x7ff90419a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 0x7ff90419a160 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009a20 tx=0x7ff8f4004270 comp rx=0 tx=0).stop 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 -- 172.21.15.37:0/1674299701 shutdown_connections 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff8ec0b4b80 0x7ff8ec0b7090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff904108a90 0x7ff90419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff904108140 0x7ff90419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 --2- 172.21.15.37:0/1674299701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff904102800 0x7ff90419a160 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:25.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 -- 172.21.15.37:0/1674299701 >> 172.21.15.37:0/1674299701 conn(0x7ff9040794d0 msgr2=0x7ff9041018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:25.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 -- 172.21.15.37:0/1674299701 shutdown_connections 2024-08-31T06:46:25.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:25.396+0000 7ff90a883640 1 -- 172.21.15.37:0/1674299701 wait complete. 2024-08-31T06:46:25.545 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:25 smithi037 ceph-mon[18612]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T06:46:25.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:25 smithi066 ceph-mon[22244]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T06:46:25.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:25 smithi106 ceph-mon[22134]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T06:46:26.232 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-31T06:46:26.257 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-31T06:46:26.257 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-08-31T06:46:26.258 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-08-31T06:46:26.258 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-31T06:46:26.258 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:26.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:26.258 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-08-31T06:46:26.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:26.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-08-31T06:46:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-08-31T06:46:26.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T06:46:26.343 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-31T06:46:26.343 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-31T06:46:26.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs ls 2024-08-31T06:46:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 -- 172.21.15.37:0/355387031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68104f80 msgr2=0x7f6f68105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 --2- 172.21.15.37:0/355387031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68104f80 0x7f6f68105390 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009900 tx=0x7f6f5802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 -- 172.21.15.37:0/355387031 shutdown_connections 2024-08-31T06:46:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 --2- 172.21.15.37:0/355387031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f68104f80 0x7f6f68105390 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 --2- 172.21.15.37:0/355387031 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f681058d0 0x7f6f6810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 --2- 172.21.15.37:0/355387031 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f68102fb0 0x7f6f681033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 -- 172.21.15.37:0/355387031 >> 172.21.15.37:0/355387031 conn(0x7f6f68079d30 msgr2=0x7f6f6807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 -- 172.21.15.37:0/355387031 shutdown_connections 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.122+0000 7f6f70781640 1 -- 172.21.15.37:0/355387031 wait complete. 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f70781640 1 Processor -- start 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f70781640 1 -- start start 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f70781640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f68102fb0 0x7f6f6819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f70781640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f68104f80 0x7f6f6819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f70781640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f681058d0 0x7f6f6819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f70781640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f68113760 con 0x7f6f681058d0 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f70781640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6f681135e0 con 0x7f6f68102fb0 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f70781640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6f681138e0 con 0x7f6f68104f80 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6ed1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f681058d0 0x7f6f6819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6ed1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f681058d0 0x7f6f6819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40386/0 (socket says 172.21.15.37:40386) 2024-08-31T06:46:27.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6ed1e640 1 -- 172.21.15.37:0/611312696 learned_addr learned my addr 172.21.15.37:0/611312696 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6e51d640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f68102fb0 0x7f6f6819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6dd1c640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f68104f80 0x7f6f6819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6ed1e640 1 -- 172.21.15.37:0/611312696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f68104f80 msgr2=0x7f6f6819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6ed1e640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f68104f80 0x7f6f6819a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6ed1e640 1 -- 172.21.15.37:0/611312696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f68102fb0 msgr2=0x7f6f6819a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6ed1e640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f68102fb0 0x7f6f6819a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6ed1e640 1 -- 172.21.15.37:0/611312696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f681a0100 con 0x7f6f681058d0 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.123+0000 7f6f6e51d640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f68102fb0 0x7f6f6819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.124+0000 7f6f6ed1e640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f681058d0 0x7f6f6819f9d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b970 tx=0x7f6f6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.124+0000 7f6f5f7fe640 1 -- 172.21.15.37:0/611312696 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f60019070 con 0x7f6f681058d0 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.124+0000 7f6f5f7fe640 1 -- 172.21.15.37:0/611312696 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f60014440 con 0x7f6f681058d0 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.124+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f681a03f0 con 0x7f6f681058d0 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.124+0000 7f6f5f7fe640 1 -- 172.21.15.37:0/611312696 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f600075d0 con 0x7f6f681058d0 2024-08-31T06:46:27.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.124+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6810fce0 con 0x7f6f681058d0 2024-08-31T06:46:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.125+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f681033c0 con 0x7f6f681058d0 2024-08-31T06:46:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.127+0000 7f6f5f7fe640 1 -- 172.21.15.37:0/611312696 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f6f6001c070 con 0x7f6f681058d0 2024-08-31T06:46:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.128+0000 7f6f5f7fe640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f540b4c00 0x7f6f540b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.128+0000 7f6f6e51d640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f540b4c00 0x7f6f540b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.128+0000 7f6f5f7fe640 1 -- 172.21.15.37:0/611312696 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6f600e4be0 con 0x7f6f681058d0 2024-08-31T06:46:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.128+0000 7f6f6e51d640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f540b4c00 0x7f6f540b7110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f640058c0 tx=0x7f6f64005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:27.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.131+0000 7f6f5f7fe640 1 -- 172.21.15.37:0/611312696 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6f600abc30 con 0x7f6f681058d0 2024-08-31T06:46:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.362+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6f6819b2c0 con 0x7f6f681058d0 2024-08-31T06:46:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.362+0000 7f6f5f7fe640 1 -- 172.21.15.37:0/611312696 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f6f600b4170 con 0x7f6f681058d0 2024-08-31T06:46:27.365 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f540b4c00 msgr2=0x7f6f540b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f540b4c00 0x7f6f540b7110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f640058c0 tx=0x7f6f64005d30 comp rx=0 tx=0).stop 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f681058d0 msgr2=0x7f6f6819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f681058d0 0x7f6f6819f9d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b970 tx=0x7f6f6000be30 comp rx=0 tx=0).stop 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 shutdown_connections 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f540b4c00 0x7f6f540b7110 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f681058d0 0x7f6f6819f9d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f68104f80 0x7f6f6819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 --2- 172.21.15.37:0/611312696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f68102fb0 0x7f6f6819a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 >> 172.21.15.37:0/611312696 conn(0x7f6f68079d30 msgr2=0x7f6f68106290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 shutdown_connections 2024-08-31T06:46:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:27.365+0000 7f6f70781640 1 -- 172.21.15.37:0/611312696 wait complete. 2024-08-31T06:46:27.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:27 smithi106 ceph-mon[22134]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T06:46:27.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:27 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/611312696' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T06:46:27.836 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:27 smithi037 ceph-mon[18612]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T06:46:27.836 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:27 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/611312696' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T06:46:27.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:27 smithi066 ceph-mon[22244]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T06:46:27.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:27 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/611312696' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-31T06:46:28.214 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-31T06:46:28.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-31T06:46:28.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-08-31T06:46:28.215 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-31T06:46:28.215 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:28.215 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-31T06:46:28.215 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-31T06:46:28.215 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-31T06:46:28.215 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-31T06:46:28.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:28.215 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-08-31T06:46:28.234 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-31T06:46:28.234 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-31T06:46:28.234 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-08-31T06:46:28.234 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-31T06:46:28.234 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-08-31T06:46:28.234 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-31T06:46:28.234 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T06:46:28.234 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-31T06:46:28.235 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42135sec preferred_lft 42135sec 2024-08-31T06:46:28.236 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::e6b7:ba1:fe98:4c62/64 scope link noprefixroute 2024-08-31T06:46:28.236 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-31T06:46:28.236 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-31T06:46:28.236 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-08-31T06:46:28.236 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-08-31T06:46:28.236 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-31T06:46:28.236 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:46:28.236 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-31T06:46:28.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-08-31T06:46:28.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-08-31T06:46:28.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-08-31T06:46:28.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-31T06:46:28.237 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-31T06:46:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:46:28.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:46:28.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:28.439 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-31T06:46:28.465 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-08-31T06:46:28.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:28.467 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-08-31T06:46:28.538 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-08-31T06:46:28.538 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-31T06:46:28.538 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-31T06:46:28.538 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-31T06:46:28.538 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-31T06:46:28.539 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:46:28.539 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-31T06:46:28.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-31T06:46:28.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-31T06:46:28.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-31T06:46:28.539 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-31T06:46:28.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:46:28.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:46:28.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:28.830 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-08-31T06:46:28.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:28.847 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-08-31T06:46:28.901 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:46:28.901 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-31T06:46:28.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:46:28.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-31T06:46:28.901 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-31T06:46:28.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:46:29.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:46:29.018 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-31T06:46:29.019 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:46:29.019 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-31T06:46:29.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-31T06:46:29.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-31T06:46:29.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-31T06:46:29.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-31T06:46:29.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-31T06:46:29.019 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-31T06:46:29.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:46:29.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:46:29.142 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-31T06:46:29.142 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-31T06:46:29.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-08-31T06:46:29.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-08-31T06:46:29.142 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-31T06:46:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-31T06:46:29.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:46:29.225 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-08-31T06:46:29.225 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T06:46:29.225 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:29.240 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-31T06:46:29.240 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-31T06:46:29.240 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:29.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-08-31T06:46:29.362 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T06:46:29.418 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-08-31T06:46:29.418 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-08-31T06:46:29.418 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-08-31T06:46:29.418 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-08-31T06:46:29.418 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-08-31T06:46:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/6b7c0863b80cf8a325e7cc263bfea23e014120924e4b78d21c42a28e38c2c013/merged 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f382b8e5b7040078cbc28f42a531874bc79e62296b84b647ba7a7fa61aa01dda/merged 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:46:29.420 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d63f750a74668710906964fc4e652158003806f3fd6886b833c3c3642450e510/merged 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/8262479c0f4b91c5c31422829f6bd7ebcfc5e5fc6899a62dc289ab322c36df41/merged 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/562cd7ab317c5883f32ca0563ea9b7d697c6de1a6261a83e87a676f77ed2e51d/merged 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/32e41568a1d7622bf9ebedeabfe9c6414d828dfe5208e6cb45107c698cdfabcd/merged 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/460acfb570afb9205ad5e14bbe736aca6ff741b8c87636811fc9c3957cbdf767/merged 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/7af5b8222651147961ad3b1321a47a9c59306c981e4f193b891aae8b355affed/merged 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/ec06c6a909f1609a43ded7e06d3e5bfc21d0a36fe7f80b7d595b688482c7359b/merged 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/67d0e3cc4e0fb134dbbcc4424b9197fec6edc29c55e8eb899ba1ca5685644b88/merged 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:46:29.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:29.421 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-08-31T06:46:29.474 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-31T06:46:29.474 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/44e8f424-bdc4-40c2-8c72-f37d761e7a7b --client_fs=cephfs) 2024-08-31T06:46:29.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-08-31T06:46:29.541 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T06:46:29.598 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-08-31T06:46:29.598 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-08-31T06:46:29.598 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-08-31T06:46:29.598 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-08-31T06:46:29.598 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-08-31T06:46:29.599 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/6b7c0863b80cf8a325e7cc263bfea23e014120924e4b78d21c42a28e38c2c013/merged 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f382b8e5b7040078cbc28f42a531874bc79e62296b84b647ba7a7fa61aa01dda/merged 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:46:29.600 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d63f750a74668710906964fc4e652158003806f3fd6886b833c3c3642450e510/merged 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/8262479c0f4b91c5c31422829f6bd7ebcfc5e5fc6899a62dc289ab322c36df41/merged 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/562cd7ab317c5883f32ca0563ea9b7d697c6de1a6261a83e87a676f77ed2e51d/merged 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/32e41568a1d7622bf9ebedeabfe9c6414d828dfe5208e6cb45107c698cdfabcd/merged 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/460acfb570afb9205ad5e14bbe736aca6ff741b8c87636811fc9c3957cbdf767/merged 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/7af5b8222651147961ad3b1321a47a9c59306c981e4f193b891aae8b355affed/merged 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/ec06c6a909f1609a43ded7e06d3e5bfc21d0a36fe7f80b7d595b688482c7359b/merged 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/67d0e3cc4e0fb134dbbcc4424b9197fec6edc29c55e8eb899ba1ca5685644b88/merged 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:46:29.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:29.601 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-08-31T06:46:29.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2024-08-31T06:46:29.614+0000 7fc728b66480 -1 init, newargv = 0x7fc7180543b0 newargc=15 2024-08-31T06:46:29.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[73644]: starting ceph client 2024-08-31T06:46:29.633 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[73644]: starting fuse 2024-08-31T06:46:29.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:29 smithi106 ceph-mon[22134]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:46:29.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:29 smithi037 ceph-mon[18612]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:46:29.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:29 smithi066 ceph-mon[22244]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:46:30.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-08-31T06:46:30.765 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-08-31T06:46:30.825 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysusers.service 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-31T06:46:30.826 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/6b7c0863b80cf8a325e7cc263bfea23e014120924e4b78d21c42a28e38c2c013/merged 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f382b8e5b7040078cbc28f42a531874bc79e62296b84b647ba7a7fa61aa01dda/merged 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d63f750a74668710906964fc4e652158003806f3fd6886b833c3c3642450e510/merged 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/8262479c0f4b91c5c31422829f6bd7ebcfc5e5fc6899a62dc289ab322c36df41/merged 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/562cd7ab317c5883f32ca0563ea9b7d697c6de1a6261a83e87a676f77ed2e51d/merged 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/32e41568a1d7622bf9ebedeabfe9c6414d828dfe5208e6cb45107c698cdfabcd/merged 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/460acfb570afb9205ad5e14bbe736aca6ff741b8c87636811fc9c3957cbdf767/merged 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/7af5b8222651147961ad3b1321a47a9c59306c981e4f193b891aae8b355affed/merged 2024-08-31T06:46:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/ec06c6a909f1609a43ded7e06d3e5bfc21d0a36fe7f80b7d595b688482c7359b/merged 2024-08-31T06:46:30.828 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/67d0e3cc4e0fb134dbbcc4424b9197fec6edc29c55e8eb899ba1ca5685644b88/merged 2024-08-31T06:46:30.828 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-08-31T06:46:30.828 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:46:30.828 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:46:30.828 INFO:teuthology.orchestra.run.smithi037.stdout:/home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:30.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:30.829 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-08-31T06:46:30.887 INFO:teuthology.orchestra.run.smithi037.stdout:121 2024-08-31T06:46:30.887 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2024-08-31T06:46:30.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo stdin-killer -- python3 -c ' 2024-08-31T06:46:30.887 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2024-08-31T06:46:30.887 DEBUG:teuthology.orchestra.run.smithi037:> import re 2024-08-31T06:46:30.887 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-08-31T06:46:30.887 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2024-08-31T06:46:30.887 DEBUG:teuthology.orchestra.run.smithi037:> 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-31T06:46:30.888 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2024-08-31T06:46:30.889 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2024-08-31T06:46:30.889 DEBUG:teuthology.orchestra.run.smithi037:> return f 2024-08-31T06:46:30.889 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-31T06:46:30.889 DEBUG:teuthology.orchestra.run.smithi037:> 2024-08-31T06:46:30.889 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2024-08-31T06:46:30.889 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-08-31T06:46:31.013 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.73644.asok 2024-08-31T06:46:31.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-31T06:46:31.025 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.73644.asok 2024-08-31T06:46:31.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:31.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.73644.asok status 2024-08-31T06:46:31.172 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "d19e6118f7015f0047264006cb0c873528eb3ae6", 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.3.0-4560-gd19e6118 (d19e6118f7015f0047264006cb0c873528eb3ae6) squid (dev)", 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "73644", 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/volumes/qa/sv_0/44e8f424-bdc4-40c2-8c72-f37d761e7a7b" 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2024-08-31T06:46:31.173 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 15387, 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 15387 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2562615527 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:46:31.174 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2562615527 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.15387 192.168.0.1:0/2562615527", 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/2562615527", 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 5, 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 24, 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 76, 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2024-08-31T06:46:31.175 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2024-08-31T06:46:31.176 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2024-08-31T06:46:31.176 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:31.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:31.181 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2024-08-31T06:46:31.182 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:31.197 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2024-08-31T06:46:31.197 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:31.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:46:31.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:31.264 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T06:46:31.279 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T06:46:31.279 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:46:31.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-08-31T06:46:31.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 -- 172.21.15.37:0/2017123630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60108a00 msgr2=0x7fdc6010f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:31.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 --2- 172.21.15.37:0/2017123630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60108a00 0x7fdc6010f230 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009ca0 tx=0x7fdc5802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:31.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 -- 172.21.15.37:0/2017123630 shutdown_connections 2024-08-31T06:46:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 --2- 172.21.15.37:0/2017123630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60108a00 0x7fdc6010f230 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 --2- 172.21.15.37:0/2017123630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc601080b0 0x7fdc601084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 --2- 172.21.15.37:0/2017123630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc60102780 0x7fdc60102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 -- 172.21.15.37:0/2017123630 >> 172.21.15.37:0/2017123630 conn(0x7fdc600fe160 msgr2=0x7fdc601005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 -- 172.21.15.37:0/2017123630 shutdown_connections 2024-08-31T06:46:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 -- 172.21.15.37:0/2017123630 wait complete. 2024-08-31T06:46:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 Processor -- start 2024-08-31T06:46:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.415+0000 7fdc66e20640 1 -- start start 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc66e20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60102780 0x7fdc6019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc66e20640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc601080b0 0x7fdc6019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc66e20640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc60108a00 0x7fdc6019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc66e20640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc601125b0 con 0x7fdc60102780 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc66e20640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60112430 con 0x7fdc60108a00 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc66e20640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdc60112730 con 0x7fdc601080b0 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60102780 0x7fdc6019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60102780 0x7fdc6019aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40400/0 (socket says 172.21.15.37:40400) 2024-08-31T06:46:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 -- 172.21.15.37:0/3955996346 learned_addr learned my addr 172.21.15.37:0/3955996346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc5ffff640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc601080b0 0x7fdc6019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc653bd640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc60108a00 0x7fdc6019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 -- 172.21.15.37:0/3955996346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc601080b0 msgr2=0x7fdc6019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc601080b0 0x7fdc6019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 -- 172.21.15.37:0/3955996346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc60108a00 msgr2=0x7fdc6019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc60108a00 0x7fdc6019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 -- 172.21.15.37:0/3955996346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc601a61d0 con 0x7fdc60102780 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc653bd640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc60108a00 0x7fdc6019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc64bbc640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60102780 0x7fdc6019aec0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000d950 tx=0x7fdc5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc5dffb640 1 -- 172.21.15.37:0/3955996346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50017030 con 0x7fdc60102780 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc5dffb640 1 -- 172.21.15.37:0/3955996346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc50004020 con 0x7fdc60102780 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc601a64c0 con 0x7fdc60102780 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.416+0000 7fdc5dffb640 1 -- 172.21.15.37:0/3955996346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500055d0 con 0x7fdc60102780 2024-08-31T06:46:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.417+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc601a6a10 con 0x7fdc60102780 2024-08-31T06:46:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.418+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc60102b90 con 0x7fdc60102780 2024-08-31T06:46:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.419+0000 7fdc5dffb640 1 -- 172.21.15.37:0/3955996346 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fdc50009a30 con 0x7fdc60102780 2024-08-31T06:46:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.420+0000 7fdc5dffb640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc480b4b80 0x7fdc480b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.420+0000 7fdc5ffff640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc480b4b80 0x7fdc480b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.420+0000 7fdc5dffb640 1 -- 172.21.15.37:0/3955996346 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fdc500e4dd0 con 0x7fdc60102780 2024-08-31T06:46:31.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.420+0000 7fdc5ffff640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc480b4b80 0x7fdc480b7090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdc60100a00 tx=0x7fdc54005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.424+0000 7fdc5dffb640 1 -- 172.21.15.37:0/3955996346 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fdc500abdc0 con 0x7fdc60102780 2024-08-31T06:46:31.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:31 smithi037 ceph-mon[18612]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-31T06:46:31.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:31.652+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fdc6002e430 con 0x7fdc60102780 2024-08-31T06:46:31.689 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:31 smithi066 ceph-mon[22244]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-31T06:46:31.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:31 smithi106 ceph-mon[22134]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-31T06:46:32.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.399+0000 7fdc5dffb640 1 -- 172.21.15.37:0/3955996346 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fdc500ab6c0 con 0x7fdc60102780 2024-08-31T06:46:32.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc480b4b80 msgr2=0x7fdc480b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc480b4b80 0x7fdc480b7090 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdc60100a00 tx=0x7fdc54005f90 comp rx=0 tx=0).stop 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60102780 msgr2=0x7fdc6019aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60102780 0x7fdc6019aec0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000d950 tx=0x7fdc5000de10 comp rx=0 tx=0).stop 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 shutdown_connections 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc480b4b80 0x7fdc480b7090 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc60108a00 0x7fdc6019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc601080b0 0x7fdc6019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 --2- 172.21.15.37:0/3955996346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc60102780 0x7fdc6019aec0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.402+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 >> 172.21.15.37:0/3955996346 conn(0x7fdc600fe160 msgr2=0x7fdc601015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.403+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 shutdown_connections 2024-08-31T06:46:32.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.403+0000 7fdc66e20640 1 -- 172.21.15.37:0/3955996346 wait complete. 2024-08-31T06:46:32.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 -- 172.21.15.37:0/2243057003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 msgr2=0x7fcbe8102b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2243057003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 0x7fcbe8102b80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009900 tx=0x7fcbd802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 -- 172.21.15.37:0/2243057003 shutdown_connections 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2243057003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe81089f0 0x7fcbe810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2243057003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe81080a0 0x7fcbe81084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2243057003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 0x7fcbe8102b80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 -- 172.21.15.37:0/2243057003 >> 172.21.15.37:0/2243057003 conn(0x7fcbe80fe190 msgr2=0x7fcbe81005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 -- 172.21.15.37:0/2243057003 shutdown_connections 2024-08-31T06:46:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.534+0000 7fcbecd43640 1 -- 172.21.15.37:0/2243057003 wait complete. 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.535+0000 7fcbecd43640 1 Processor -- start 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.535+0000 7fcbecd43640 1 -- start start 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.535+0000 7fcbecd43640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 0x7fcbe819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.535+0000 7fcbecd43640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe81080a0 0x7fcbe819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.535+0000 7fcbecd43640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe81089f0 0x7fcbe819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.535+0000 7fcbecd43640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe8112570 con 0x7fcbe8102770 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.535+0000 7fcbecd43640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81123f0 con 0x7fcbe81089f0 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbecd43640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcbe81126f0 con 0x7fcbe81080a0 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 0x7fcbe819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 0x7fcbe819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40408/0 (socket says 172.21.15.37:40408) 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 -- 172.21.15.37:0/2929072042 learned_addr learned my addr 172.21.15.37:0/2929072042 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe5d9b640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe81080a0 0x7fcbe819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe6d9d640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe81089f0 0x7fcbe819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 -- 172.21.15.37:0/2929072042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe81080a0 msgr2=0x7fcbe819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe81080a0 0x7fcbe819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 -- 172.21.15.37:0/2929072042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe81089f0 msgr2=0x7fcbe819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe81089f0 0x7fcbe819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 -- 172.21.15.37:0/2929072042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbe81a61e0 con 0x7fcbe8102770 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe6d9d640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe81089f0 0x7fcbe819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbe659c640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 0x7fcbe819af20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009230 tx=0x7fcbd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbd77fe640 1 -- 172.21.15.37:0/2929072042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd803f030 con 0x7fcbe8102770 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbd77fe640 1 -- 172.21.15.37:0/2929072042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbd8003a80 con 0x7fcbe8102770 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbd77fe640 1 -- 172.21.15.37:0/2929072042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8035070 con 0x7fcbe8102770 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbe81a6470 con 0x7fcbe8102770 2024-08-31T06:46:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.536+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbe81a6960 con 0x7fcbe8102770 2024-08-31T06:46:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.537+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbe8102b80 con 0x7fcbe8102770 2024-08-31T06:46:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.539+0000 7fcbd77fe640 1 -- 172.21.15.37:0/2929072042 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fcbd8042030 con 0x7fcbe8102770 2024-08-31T06:46:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.540+0000 7fcbd77fe640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbd00b4b80 0x7fcbd00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.540+0000 7fcbe5d9b640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbd00b4b80 0x7fcbd00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.540+0000 7fcbd77fe640 1 -- 172.21.15.37:0/2929072042 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fcbd8105e20 con 0x7fcbe8102770 2024-08-31T06:46:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.540+0000 7fcbe5d9b640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbd00b4b80 0x7fcbd00b7090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8107cb0 tx=0x7fcbdc00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.543+0000 7fcbd77fe640 1 -- 172.21.15.37:0/2929072042 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcbd80cce70 con 0x7fcbe8102770 2024-08-31T06:46:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.758+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fcbe80635a0 con 0x7fcbd00b4b80 2024-08-31T06:46:32.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:32 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3955996346' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T06:46:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.780+0000 7fcbd77fe640 1 -- 172.21.15.37:0/2929072042 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7fcbe80635a0 con 0x7fcbd00b4b80 2024-08-31T06:46:32.782 INFO:teuthology.orchestra.run.smithi037.stdout:{} 2024-08-31T06:46:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbd00b4b80 msgr2=0x7fcbd00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbd00b4b80 0x7fcbd00b7090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8107cb0 tx=0x7fcbdc00b390 comp rx=0 tx=0).stop 2024-08-31T06:46:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 msgr2=0x7fcbe819af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 0x7fcbe819af20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8009230 tx=0x7fcbd8004270 comp rx=0 tx=0).stop 2024-08-31T06:46:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 shutdown_connections 2024-08-31T06:46:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbd00b4b80 0x7fcbd00b7090 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbe81089f0 0x7fcbe819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbe81080a0 0x7fcbe819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 --2- 172.21.15.37:0/2929072042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbe8102770 0x7fcbe819af20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 >> 172.21.15.37:0/2929072042 conn(0x7fcbe80fe190 msgr2=0x7fcbe81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 shutdown_connections 2024-08-31T06:46:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.783+0000 7fcbecd43640 1 -- 172.21.15.37:0/2929072042 wait complete. 2024-08-31T06:46:32.795 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-31T06:46:32.807 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-31T06:46:32.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T06:46:32.822 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:32 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3955996346' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T06:46:32.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:32 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3955996346' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 -- 172.21.15.37:0/2667497523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee40108090 msgr2=0x7fee401084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 --2- 172.21.15.37:0/2667497523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee40108090 0x7fee401084a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fee34009900 tx=0x7fee3402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 -- 172.21.15.37:0/2667497523 shutdown_connections 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 --2- 172.21.15.37:0/2667497523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee40108090 0x7fee401084a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 --2- 172.21.15.37:0/2667497523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee401089e0 0x7fee4010f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 --2- 172.21.15.37:0/2667497523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee40102760 0x7fee40102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 -- 172.21.15.37:0/2667497523 >> 172.21.15.37:0/2667497523 conn(0x7fee400fe160 msgr2=0x7fee401005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 -- 172.21.15.37:0/2667497523 shutdown_connections 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.932+0000 7fee45e20640 1 -- 172.21.15.37:0/2667497523 wait complete. 2024-08-31T06:46:32.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.933+0000 7fee45e20640 1 Processor -- start 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.933+0000 7fee45e20640 1 -- start start 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.933+0000 7fee45e20640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee40102760 0x7fee4019a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.933+0000 7fee45e20640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee40108090 0x7fee4019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.933+0000 7fee45e20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee401089e0 0x7fee4019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.933+0000 7fee45e20640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fee40113670 con 0x7fee401089e0 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.933+0000 7fee45e20640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fee401134f0 con 0x7fee40102760 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.933+0000 7fee45e20640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fee401137f0 con 0x7fee40108090 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee401089e0 0x7fee4019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee401089e0 0x7fee4019f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40456/0 (socket says 172.21.15.37:40456) 2024-08-31T06:46:32.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 -- 172.21.15.37:0/3294696515 learned_addr learned my addr 172.21.15.37:0/3294696515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3effd640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee40108090 0x7fee4019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3f7fe640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee40102760 0x7fee4019a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 -- 172.21.15.37:0/3294696515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee40108090 msgr2=0x7fee4019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee40108090 0x7fee4019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 -- 172.21.15.37:0/3294696515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee40102760 msgr2=0x7fee4019a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee40102760 0x7fee4019a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 -- 172.21.15.37:0/3294696515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee401a0020 con 0x7fee401089e0 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3ffff640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee401089e0 0x7fee4019f920 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fee3800eb10 tx=0x7fee3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3cff9640 1 -- 172.21.15.37:0/3294696515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38004b20 con 0x7fee401089e0 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3cff9640 1 -- 172.21.15.37:0/3294696515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee38004cc0 con 0x7fee401089e0 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee401a0310 con 0x7fee401089e0 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee3cff9640 1 -- 172.21.15.37:0/3294696515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee38010690 con 0x7fee401089e0 2024-08-31T06:46:32.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.934+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee401a6aa0 con 0x7fee401089e0 2024-08-31T06:46:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.935+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee401039d0 con 0x7fee401089e0 2024-08-31T06:46:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.937+0000 7fee3cff9640 1 -- 172.21.15.37:0/3294696515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fee38005000 con 0x7fee401089e0 2024-08-31T06:46:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.938+0000 7fee3cff9640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fee280b4b80 0x7fee280b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:32.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.938+0000 7fee3f7fe640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fee280b4b80 0x7fee280b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.938+0000 7fee3cff9640 1 -- 172.21.15.37:0/3294696515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fee380e5b40 con 0x7fee401089e0 2024-08-31T06:46:32.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.938+0000 7fee3f7fe640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fee280b4b80 0x7fee280b7090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee30005fd0 tx=0x7fee30005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:32.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:32.941+0000 7fee3cff9640 1 -- 172.21.15.37:0/3294696515 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fee38056130 con 0x7fee401089e0 2024-08-31T06:46:33.105 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:46:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:46:32.765+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:46:33.105 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:46:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:46:32.765+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:46:33.105 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:46:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:46:32.765+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:46:33.105 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:46:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:46:32.765+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:46:33.105 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:46:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:46:32.765+0000 7ff8eff13640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:46:33.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.129+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee40102b70 con 0x7fee401089e0 2024-08-31T06:46:33.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.131+0000 7fee3cff9640 1 -- 172.21.15.37:0/3294696515 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+23049 (secure 0 0 0) 0x7fee380acb30 con 0x7fee401089e0 2024-08-31T06:46:33.132 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:33.132 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:45:19.740510+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fee280b4b80 msgr2=0x7fee280b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fee280b4b80 0x7fee280b7090 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fee30005fd0 tx=0x7fee30005850 comp rx=0 tx=0).stop 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee401089e0 msgr2=0x7fee4019f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee401089e0 0x7fee4019f920 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fee3800eb10 tx=0x7fee3800c2d0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 shutdown_connections 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fee280b4b80 0x7fee280b7090 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee401089e0 0x7fee4019f920 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee40108090 0x7fee4019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.133+0000 7fee45e20640 1 --2- 172.21.15.37:0/3294696515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee40102760 0x7fee4019a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.134+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 >> 172.21.15.37:0/3294696515 conn(0x7fee400fe160 msgr2=0x7fee40107790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.134+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 shutdown_connections 2024-08-31T06:46:33.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.134+0000 7fee45e20640 1 -- 172.21.15.37:0/3294696515 wait complete. 2024-08-31T06:46:33.146 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T06:40:10.611808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T06:44:39.177728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T06:44:41.318390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T06:46:33.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T06:46:33.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.259+0000 7feebcebd640 1 -- 172.21.15.37:0/3552041143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb81089c0 msgr2=0x7feeb810f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.259+0000 7feebcebd640 1 --2- 172.21.15.37:0/3552041143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb81089c0 0x7feeb810f1f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009ca0 tx=0x7feeb002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 -- 172.21.15.37:0/3552041143 shutdown_connections 2024-08-31T06:46:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 --2- 172.21.15.37:0/3552041143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb81089c0 0x7feeb810f1f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 --2- 172.21.15.37:0/3552041143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeb8108070 0x7feeb8108480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 --2- 172.21.15.37:0/3552041143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb8102740 0x7feeb8102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 -- 172.21.15.37:0/3552041143 >> 172.21.15.37:0/3552041143 conn(0x7feeb80fe160 msgr2=0x7feeb81005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 -- 172.21.15.37:0/3552041143 shutdown_connections 2024-08-31T06:46:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 -- 172.21.15.37:0/3552041143 wait complete. 2024-08-31T06:46:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 Processor -- start 2024-08-31T06:46:33.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.260+0000 7feebcebd640 1 -- start start 2024-08-31T06:46:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feebcebd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb8102740 0x7feeb819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feebcebd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8108070 0x7feeb819b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feebcebd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeb81089c0 0x7feeb819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feebcebd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8112570 con 0x7feeb8108070 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feebcebd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feeb81123f0 con 0x7feeb81089c0 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feebcebd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feeb81126f0 con 0x7feeb8102740 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8108070 0x7feeb819b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8108070 0x7feeb819b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40482/0 (socket says 172.21.15.37:40482) 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 -- 172.21.15.37:0/2136468241 learned_addr learned my addr 172.21.15.37:0/2136468241 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb659c640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb8102740 0x7feeb819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb6d9d640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeb81089c0 0x7feeb819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 -- 172.21.15.37:0/2136468241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb8102740 msgr2=0x7feeb819ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb8102740 0x7feeb819ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 -- 172.21.15.37:0/2136468241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeb81089c0 msgr2=0x7feeb819b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeb81089c0 0x7feeb819b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 -- 172.21.15.37:0/2136468241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb81a60f0 con 0x7feeb8108070 2024-08-31T06:46:33.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.261+0000 7feeb5d9b640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8108070 0x7feeb819b3a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7feeac00e9f0 tx=0x7feeac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.262+0000 7feea77fe640 1 -- 172.21.15.37:0/2136468241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac00ccc0 con 0x7feeb8108070 2024-08-31T06:46:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.262+0000 7feea77fe640 1 -- 172.21.15.37:0/2136468241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feeac0108c0 con 0x7feeb8108070 2024-08-31T06:46:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.262+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb81a63e0 con 0x7feeb8108070 2024-08-31T06:46:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.262+0000 7feea77fe640 1 -- 172.21.15.37:0/2136468241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac018750 con 0x7feeb8108070 2024-08-31T06:46:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.262+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb81a6980 con 0x7feeb8108070 2024-08-31T06:46:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.263+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb81039b0 con 0x7feeb8108070 2024-08-31T06:46:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.264+0000 7feea77fe640 1 -- 172.21.15.37:0/2136468241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7feeac010430 con 0x7feeb8108070 2024-08-31T06:46:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.265+0000 7feea77fe640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feea00b4c00 0x7feea00b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.265+0000 7feeb659c640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feea00b4c00 0x7feea00b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.265+0000 7feea77fe640 1 -- 172.21.15.37:0/2136468241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7feeac0e55b0 con 0x7feeb8108070 2024-08-31T06:46:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.265+0000 7feeb659c640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feea00b4c00 0x7feea00b7110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feeb806c1a0 tx=0x7feea800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.269+0000 7feea77fe640 1 -- 172.21.15.37:0/2136468241 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7feeac0abf50 con 0x7feeb8108070 2024-08-31T06:46:33.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.456+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feeb802e430 con 0x7feeb8108070 2024-08-31T06:46:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.457+0000 7feea77fe640 1 -- 172.21.15.37:0/2136468241 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7feeac0b0710 con 0x7feeb8108070 2024-08-31T06:46:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-08-31T06:46:33.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feea00b4c00 msgr2=0x7feea00b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feea00b4c00 0x7feea00b7110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feeb806c1a0 tx=0x7feea800b390 comp rx=0 tx=0).stop 2024-08-31T06:46:33.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8108070 msgr2=0x7feeb819b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8108070 0x7feeb819b3a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7feeac00e9f0 tx=0x7feeac00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 shutdown_connections 2024-08-31T06:46:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feea00b4c00 0x7feea00b7110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8108070 0x7feeb819b3a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeb81089c0 0x7feeb819b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 --2- 172.21.15.37:0/2136468241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeb8102740 0x7feeb819ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 >> 172.21.15.37:0/2136468241 conn(0x7feeb80fe160 msgr2=0x7feeb8100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 shutdown_connections 2024-08-31T06:46:33.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.459+0000 7feebcebd640 1 -- 172.21.15.37:0/2136468241 wait complete. 2024-08-31T06:46:33.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T06:46:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 -- 172.21.15.37:0/1416734945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 msgr2=0x7fe9f410f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/1416734945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 0x7fe9f410f230 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec009ca0 tx=0x7fe9ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 -- 172.21.15.37:0/1416734945 shutdown_connections 2024-08-31T06:46:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/1416734945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 0x7fe9f410f230 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/1416734945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f41080b0 0x7fe9f41084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/1416734945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9f4102780 0x7fe9f4102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 -- 172.21.15.37:0/1416734945 >> 172.21.15.37:0/1416734945 conn(0x7fe9f40fe160 msgr2=0x7fe9f41005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 -- 172.21.15.37:0/1416734945 shutdown_connections 2024-08-31T06:46:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.584+0000 7fe9fb69b640 1 -- 172.21.15.37:0/1416734945 wait complete. 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9fb69b640 1 Processor -- start 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9fb69b640 1 -- start start 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9fb69b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9f4102780 0x7fe9f4199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9fb69b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f41080b0 0x7fe9f41995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9fb69b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 0x7fe9f419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9fb69b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f41125d0 con 0x7fe9f4108a00 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9fb69b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4112450 con 0x7fe9f4102780 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9fb69b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe9f4112750 con 0x7fe9f41080b0 2024-08-31T06:46:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9c38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 0x7fe9f419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9c38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 0x7fe9f419e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40488/0 (socket says 172.21.15.37:40488) 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9c38640 1 -- 172.21.15.37:0/103198941 learned_addr learned my addr 172.21.15.37:0/103198941 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9437640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9f4102780 0x7fe9f4199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f8c36640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f41080b0 0x7fe9f41995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9c38640 1 -- 172.21.15.37:0/103198941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f41080b0 msgr2=0x7fe9f41995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9c38640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f41080b0 0x7fe9f41995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9c38640 1 -- 172.21.15.37:0/103198941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9f4102780 msgr2=0x7fe9f4199050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9c38640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9f4102780 0x7fe9f4199050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f9c38640 1 -- 172.21.15.37:0/103198941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9f419ef80 con 0x7fe9f4108a00 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.585+0000 7fe9f8c36640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f41080b0 0x7fe9f41995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.586+0000 7fe9f9c38640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 0x7fe9f419e880 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec005cc0 tx=0x7fe9ec032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.586+0000 7fe9ea7fc640 1 -- 172.21.15.37:0/103198941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec032e00 con 0x7fe9f4108a00 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.586+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9f419f210 con 0x7fe9f4108a00 2024-08-31T06:46:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.586+0000 7fe9ea7fc640 1 -- 172.21.15.37:0/103198941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe9ec0044d0 con 0x7fe9f4108a00 2024-08-31T06:46:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.586+0000 7fe9ea7fc640 1 -- 172.21.15.37:0/103198941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec030b70 con 0x7fe9f4108a00 2024-08-31T06:46:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.586+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9f41a5a00 con 0x7fe9f4108a00 2024-08-31T06:46:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.587+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9f4102b90 con 0x7fe9f4108a00 2024-08-31T06:46:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.589+0000 7fe9ea7fc640 1 -- 172.21.15.37:0/103198941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7fe9ec030d10 con 0x7fe9f4108a00 2024-08-31T06:46:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.590+0000 7fe9ea7fc640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe9e00b4b80 0x7fe9e00b7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.590+0000 7fe9f9437640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe9e00b4b80 0x7fe9e00b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.590+0000 7fe9ea7fc640 1 -- 172.21.15.37:0/103198941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe9ec106770 con 0x7fe9f4108a00 2024-08-31T06:46:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.591+0000 7fe9f9437640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe9e00b4b80 0x7fe9e00b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0005d00 tx=0x7fe9f000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:33.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.593+0000 7fe9ea7fc640 1 -- 172.21.15.37:0/103198941 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fe9ec0cd760 con 0x7fe9f4108a00 2024-08-31T06:46:33.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.779+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe9f402e430 con 0x7fe9f4108a00 2024-08-31T06:46:33.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.779+0000 7fe9ea7fc640 1 -- 172.21.15.37:0/103198941 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) ==== 104+0+11 (secure 0 0 0) 0x7fe9ec0cd060 con 0x7fe9f4108a00 2024-08-31T06:46:33.780 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-08-31T06:46:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe9e00b4b80 msgr2=0x7fe9e00b7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe9e00b4b80 0x7fe9e00b7090 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0005d00 tx=0x7fe9f000b410 comp rx=0 tx=0).stop 2024-08-31T06:46:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 msgr2=0x7fe9f419e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 0x7fe9f419e880 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec005cc0 tx=0x7fe9ec032a10 comp rx=0 tx=0).stop 2024-08-31T06:46:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 shutdown_connections 2024-08-31T06:46:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe9e00b4b80 0x7fe9e00b7090 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9f4108a00 0x7fe9f419e880 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f41080b0 0x7fe9f41995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 --2- 172.21.15.37:0/103198941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9f4102780 0x7fe9f4199050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 >> 172.21.15.37:0/103198941 conn(0x7fe9f40fe160 msgr2=0x7fe9f406a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 shutdown_connections 2024-08-31T06:46:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.781+0000 7fe9fb69b640 1 -- 172.21.15.37:0/103198941 wait complete. 2024-08-31T06:46:33.792 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:33 smithi037 ceph-mon[18612]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-31T06:46:33.792 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:33 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3955996346' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T06:46:33.792 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:33 smithi037 ceph-mon[18612]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:46:33.792 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:33 smithi037 ceph-mon[18612]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:33.793 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:33 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3294696515' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:33.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T06:46:33.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:33 smithi106 ceph-mon[22134]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-31T06:46:33.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:33 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3955996346' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T06:46:33.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:33 smithi106 ceph-mon[22134]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:46:33.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:33 smithi106 ceph-mon[22134]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:33.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:33 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3294696515' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:33.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:33 smithi066 ceph-mon[22244]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-31T06:46:33.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:33 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3955996346' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-08-31T06:46:33.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:33 smithi066 ceph-mon[22244]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-08-31T06:46:33.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:33 smithi066 ceph-mon[22244]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:33.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:33 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3294696515' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 -- 172.21.15.37:0/2330055481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 msgr2=0x7f0b3c110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2330055481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 0x7f0b3c110340 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009ca0 tx=0x7f0b3402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 -- 172.21.15.37:0/2330055481 shutdown_connections 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2330055481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 0x7f0b3c110340 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2330055481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b3c105f60 0x7f0b3c106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2330055481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b3c101d80 0x7f0b3c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 -- 172.21.15.37:0/2330055481 >> 172.21.15.37:0/2330055481 conn(0x7f0b3c079bb0 msgr2=0x7f0b3c079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 -- 172.21.15.37:0/2330055481 shutdown_connections 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.906+0000 7f0b4379b640 1 -- 172.21.15.37:0/2330055481 wait complete. 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b4379b640 1 Processor -- start 2024-08-31T06:46:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b4379b640 1 -- start start 2024-08-31T06:46:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b4379b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b3c101d80 0x7f0b3c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b4379b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b3c105f60 0x7f0b3c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b4379b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 0x7f0b3c19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b4379b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c113720 con 0x7f0b3c1068b0 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b4379b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1135a0 con 0x7f0b3c105f60 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b4379b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1138a0 con 0x7f0b3c101d80 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b41d38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 0x7f0b3c19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b41d38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 0x7f0b3c19fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40500/0 (socket says 172.21.15.37:40500) 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b41d38640 1 -- 172.21.15.37:0/2451673813 learned_addr learned my addr 172.21.15.37:0/2451673813 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b40d36640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b3c105f60 0x7f0b3c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.907+0000 7f0b41537640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b3c101d80 0x7f0b3c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b41d38640 1 -- 172.21.15.37:0/2451673813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b3c101d80 msgr2=0x7f0b3c19a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b41d38640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b3c101d80 0x7f0b3c19a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b41d38640 1 -- 172.21.15.37:0/2451673813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b3c105f60 msgr2=0x7f0b3c19a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b41d38640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b3c105f60 0x7f0b3c19a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b41d38640 1 -- 172.21.15.37:0/2451673813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c1a0130 con 0x7f0b3c1068b0 2024-08-31T06:46:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b41d38640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 0x7f0b3c19fa30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005cc0 tx=0x7f0b34032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b327fc640 1 -- 172.21.15.37:0/2451673813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34032e00 con 0x7f0b3c1068b0 2024-08-31T06:46:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b327fc640 1 -- 172.21.15.37:0/2451673813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0b340044d0 con 0x7f0b3c1068b0 2024-08-31T06:46:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b327fc640 1 -- 172.21.15.37:0/2451673813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34030b70 con 0x7f0b3c1068b0 2024-08-31T06:46:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c1a03c0 con 0x7f0b3c1068b0 2024-08-31T06:46:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.908+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c1a6bb0 con 0x7f0b3c1068b0 2024-08-31T06:46:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.909+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3c102190 con 0x7f0b3c1068b0 2024-08-31T06:46:33.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.911+0000 7f0b327fc640 1 -- 172.21.15.37:0/2451673813 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) ==== 152594+0+0 (secure 0 0 0) 0x7f0b34030d10 con 0x7f0b3c1068b0 2024-08-31T06:46:33.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.911+0000 7f0b327fc640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0b280b4c00 0x7f0b280b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:33.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.911+0000 7f0b41537640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0b280b4c00 0x7f0b280b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:33.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.911+0000 7f0b327fc640 1 -- 172.21.15.37:0/2451673813 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0b34106690 con 0x7f0b3c1068b0 2024-08-31T06:46:33.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.912+0000 7f0b41537640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0b280b4c00 0x7f0b280b7110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c06b630 tx=0x7f0b38008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:33.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:33.914+0000 7f0b327fc640 1 -- 172.21.15.37:0/2451673813 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0b340cd6e0 con 0x7f0b3c1068b0 2024-08-31T06:46:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.102+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0b3c02e430 con 0x7f0b3c1068b0 2024-08-31T06:46:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.102+0000 7f0b327fc640 1 -- 172.21.15.37:0/2451673813 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) ==== 100+0+11 (secure 0 0 0) 0x7f0b340ccfe0 con 0x7f0b3c1068b0 2024-08-31T06:46:34.104 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.104+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0b280b4c00 msgr2=0x7f0b280b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.104+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0b280b4c00 0x7f0b280b7110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c06b630 tx=0x7f0b38008040 comp rx=0 tx=0).stop 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.104+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 msgr2=0x7f0b3c19fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.104+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 0x7f0b3c19fa30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005cc0 tx=0x7f0b34032a10 comp rx=0 tx=0).stop 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.105+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 shutdown_connections 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.105+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0b280b4c00 0x7f0b280b7110 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.105+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b3c1068b0 0x7f0b3c19fa30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.105+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b3c105f60 0x7f0b3c19a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.105+0000 7f0b4379b640 1 --2- 172.21.15.37:0/2451673813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0b3c101d80 0x7f0b3c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.105+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 >> 172.21.15.37:0/2451673813 conn(0x7f0b3c079bb0 msgr2=0x7f0b3c109340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.105+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 shutdown_connections 2024-08-31T06:46:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.105+0000 7f0b4379b640 1 -- 172.21.15.37:0/2451673813 wait complete. 2024-08-31T06:46:34.117 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-31T06:46:34.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:46:34.368 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:34.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:34 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2136468241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:34 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/103198941' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:34 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2451673813' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:34 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2136468241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:34 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/103198941' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:34 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2451673813' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:34 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2136468241' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:34 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/103198941' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:34 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2451673813' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:46:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.902+0000 7f5a5f40e640 1 -- 172.21.15.37:0/782784586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58109300 msgr2=0x7f5a58109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.902+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/782784586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58109300 0x7f5a58109710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5a48009900 tx=0x7f5a4802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.902+0000 7f5a5f40e640 1 -- 172.21.15.37:0/782784586 shutdown_connections 2024-08-31T06:46:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.902+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/782784586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58109300 0x7f5a58109710 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.902+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/782784586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a58109c50 0x7f5a58110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.902+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/782784586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a58101e20 0x7f5a58102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.902+0000 7f5a5f40e640 1 -- 172.21.15.37:0/782784586 >> 172.21.15.37:0/782784586 conn(0x7f5a58079c60 msgr2=0x7f5a5807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.903+0000 7f5a5f40e640 1 -- 172.21.15.37:0/782784586 shutdown_connections 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.903+0000 7f5a5f40e640 1 -- 172.21.15.37:0/782784586 wait complete. 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.903+0000 7f5a5f40e640 1 Processor -- start 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.903+0000 7f5a5f40e640 1 -- start start 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5f40e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58101e20 0x7f5a5819c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5f40e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a58109300 0x7f5a5819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5f40e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a58109c50 0x7f5a581a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5f40e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a581137c0 con 0x7f5a58101e20 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5f40e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5a58113640 con 0x7f5a58109c50 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5f40e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5a58113940 con 0x7f5a58109300 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58101e20 0x7f5a5819c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58101e20 0x7f5a5819c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32864/0 (socket says 172.21.15.37:32864) 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 -- 172.21.15.37:0/714889103 learned_addr learned my addr 172.21.15.37:0/714889103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5c9a9640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a58109300 0x7f5a5819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d9ab640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a58109c50 0x7f5a581a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 -- 172.21.15.37:0/714889103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a58109300 msgr2=0x7f5a5819c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a58109300 0x7f5a5819c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 -- 172.21.15.37:0/714889103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a58109c50 msgr2=0x7f5a581a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a58109c50 0x7f5a581a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 -- 172.21.15.37:0/714889103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a581a23a0 con 0x7f5a58101e20 2024-08-31T06:46:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a5d1aa640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58101e20 0x7f5a5819c430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400d950 tx=0x7f5a5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.904+0000 7f5a4e7fc640 1 -- 172.21.15.37:0/714889103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a54017030 con 0x7f5a58101e20 2024-08-31T06:46:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.905+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a581a2690 con 0x7f5a58101e20 2024-08-31T06:46:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.905+0000 7f5a4e7fc640 1 -- 172.21.15.37:0/714889103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5a54004020 con 0x7f5a58101e20 2024-08-31T06:46:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.905+0000 7f5a4e7fc640 1 -- 172.21.15.37:0/714889103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a540055d0 con 0x7f5a58101e20 2024-08-31T06:46:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.905+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a581a8df0 con 0x7f5a58101e20 2024-08-31T06:46:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.906+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a58102230 con 0x7f5a58101e20 2024-08-31T06:46:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.907+0000 7f5a4e7fc640 1 -- 172.21.15.37:0/714889103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f5a54009a30 con 0x7f5a58101e20 2024-08-31T06:46:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.908+0000 7f5a4e7fc640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5a440b4c10 0x7f5a440b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.908+0000 7f5a4e7fc640 1 -- 172.21.15.37:0/714889103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f5a540e54b0 con 0x7f5a58101e20 2024-08-31T06:46:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.908+0000 7f5a5c9a9640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5a440b4c10 0x7f5a440b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.909+0000 7f5a5c9a9640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5a440b4c10 0x7f5a440b7120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a48005940 tx=0x7f5a480058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:34.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:34.911+0000 7f5a4e7fc640 1 -- 172.21.15.37:0/714889103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5a540ac3a0 con 0x7f5a58101e20 2024-08-31T06:46:35.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.133+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a5819d560 con 0x7f5a58101e20 2024-08-31T06:46:35.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.134+0000 7f5a4e7fc640 1 -- 172.21.15.37:0/714889103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f5a5819d560 con 0x7f5a58101e20 2024-08-31T06:46:35.135 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:35.135 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:46:35.135 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:46:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5a440b4c10 msgr2=0x7f5a440b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5a440b4c10 0x7f5a440b7120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a48005940 tx=0x7f5a480058d0 comp rx=0 tx=0).stop 2024-08-31T06:46:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58101e20 msgr2=0x7f5a5819c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58101e20 0x7f5a5819c430 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400d950 tx=0x7f5a5400de10 comp rx=0 tx=0).stop 2024-08-31T06:46:35.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 shutdown_connections 2024-08-31T06:46:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5a440b4c10 0x7f5a440b7120 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a58109c50 0x7f5a581a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a58109300 0x7f5a5819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 --2- 172.21.15.37:0/714889103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a58101e20 0x7f5a5819c430 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 >> 172.21.15.37:0/714889103 conn(0x7f5a58079c60 msgr2=0x7f5a58107110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 shutdown_connections 2024-08-31T06:46:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:35.136+0000 7f5a5f40e640 1 -- 172.21.15.37:0/714889103 wait complete. 2024-08-31T06:46:35.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:35 smithi106 ceph-mon[22134]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T06:46:35.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:35 smithi106 ceph-mon[22134]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T06:46:35.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:35 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/714889103' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:35 smithi037 ceph-mon[18612]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T06:46:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:35 smithi037 ceph-mon[18612]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T06:46:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:35 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/714889103' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:35.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:35 smithi066 ceph-mon[22244]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-31T06:46:35.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:35 smithi066 ceph-mon[22244]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-08-31T06:46:35.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:35 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/714889103' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:36.050 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-31T06:46:36.050 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-31T06:46:36.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T06:46:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 -- 172.21.15.37:0/2954892618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208102560 msgr2=0x7f2208102970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 --2- 172.21.15.37:0/2954892618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208102560 0x7f2208102970 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2204009900 tx=0x7f220402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 -- 172.21.15.37:0/2954892618 shutdown_connections 2024-08-31T06:46:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 --2- 172.21.15.37:0/2954892618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f22081087e0 0x7f220810f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 --2- 172.21.15.37:0/2954892618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2208107e90 0x7f22081082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 --2- 172.21.15.37:0/2954892618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208102560 0x7f2208102970 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 -- 172.21.15.37:0/2954892618 >> 172.21.15.37:0/2954892618 conn(0x7f22080fdf80 msgr2=0x7f22081003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:36.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 -- 172.21.15.37:0/2954892618 shutdown_connections 2024-08-31T06:46:36.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.166+0000 7f220eb9d640 1 -- 172.21.15.37:0/2954892618 wait complete. 2024-08-31T06:46:36.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.167+0000 7f220eb9d640 1 Processor -- start 2024-08-31T06:46:36.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.167+0000 7f220eb9d640 1 -- start start 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.167+0000 7f220eb9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2208102560 0x7f2208198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.167+0000 7f220eb9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208107e90 0x7f2208199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.167+0000 7f220eb9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22081087e0 0x7f220819e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.167+0000 7f220eb9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22081123b0 con 0x7f2208107e90 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.167+0000 7f220eb9d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2208112230 con 0x7f22081087e0 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.167+0000 7f220eb9d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2208112530 con 0x7f2208102560 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208107e90 0x7f2208199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208107e90 0x7f2208199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32890/0 (socket says 172.21.15.37:32890) 2024-08-31T06:46:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 -- 172.21.15.37:0/877889759 learned_addr learned my addr 172.21.15.37:0/877889759 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220e39c640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22081087e0 0x7f220819e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220db9b640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2208102560 0x7f2208198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 -- 172.21.15.37:0/877889759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2208102560 msgr2=0x7f2208198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2208102560 0x7f2208198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 -- 172.21.15.37:0/877889759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22081087e0 msgr2=0x7f220819e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22081087e0 0x7f220819e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 -- 172.21.15.37:0/877889759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220819edc0 con 0x7f2208107e90 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220e39c640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22081087e0 0x7f220819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220d39a640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208107e90 0x7f2208199430 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00d740 tx=0x7f21fc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f21faffd640 1 -- 172.21.15.37:0/877889759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc017070 con 0x7f2208107e90 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f21faffd640 1 -- 172.21.15.37:0/877889759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21fc00de50 con 0x7f2208107e90 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f21faffd640 1 -- 172.21.15.37:0/877889759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00f620 con 0x7f2208107e90 2024-08-31T06:46:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220819f0b0 con 0x7f2208107e90 2024-08-31T06:46:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.168+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22081a5840 con 0x7f2208107e90 2024-08-31T06:46:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.169+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22081037d0 con 0x7f2208107e90 2024-08-31T06:46:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.171+0000 7f21faffd640 1 -- 172.21.15.37:0/877889759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f21fc01a070 con 0x7f2208107e90 2024-08-31T06:46:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.172+0000 7f21faffd640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f21f40b4c10 0x7f21f40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.172+0000 7f21faffd640 1 -- 172.21.15.37:0/877889759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f21fc0e4e00 con 0x7f2208107e90 2024-08-31T06:46:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.172+0000 7f220db9b640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f21f40b4c10 0x7f21f40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.172+0000 7f220db9b640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f21f40b4c10 0x7f21f40b7120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2204006010 tx=0x7f2204000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.175+0000 7f21faffd640 1 -- 172.21.15.37:0/877889759 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f21fc0abcf0 con 0x7f2208107e90 2024-08-31T06:46:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.359+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f22080635a0 con 0x7f21f40b4c10 2024-08-31T06:46:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.363+0000 7f21faffd640 1 -- 172.21.15.37:0/877889759 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258828 (secure 0 0 0) 0x7f22080635a0 con 0x7f21f40b4c10 2024-08-31T06:46:36.367 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:46:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f21f40b4c10 msgr2=0x7f21f40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f21f40b4c10 0x7f21f40b7120 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2204006010 tx=0x7f2204000bc0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208107e90 msgr2=0x7f2208199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208107e90 0x7f2208199430 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00d740 tx=0x7f21fc00dc00 comp rx=0 tx=0).stop 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 shutdown_connections 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f21f40b4c10 0x7f21f40b7120 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2208107e90 0x7f2208199430 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22081087e0 0x7f220819e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 --2- 172.21.15.37:0/877889759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2208102560 0x7f2208198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 >> 172.21.15.37:0/877889759 conn(0x7f22080fdf80 msgr2=0x7f22081003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 shutdown_connections 2024-08-31T06:46:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.366+0000 7f220eb9d640 1 -- 172.21.15.37:0/877889759 wait complete. 2024-08-31T06:46:36.378 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-08-31T06:46:36.272577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661471,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":725,"num_read_kb":473,"num_write":310,"num_write_kb":2282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":750,"ondisk_log_size":750,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365284,"kb_used_data":11876,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576540,"statfs":{"total":1151940427776,"available":1151566376960,"internally_reserved":0,"allocated":12161024,"data_stored":6885329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":53,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003050"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665746+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:46:18.665746+0000","last_peered":"2024-08-31T06:46:18.665746+0000","last_clean":"2024-08-31T06:46:18.665746+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:46:18.665746+0000","last_undegraded":"2024-08-31T06:46:18.665746+0000","last_fullsized":"2024-08-31T06:46:18.665746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659822+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:46:18.659822+0000","last_peered":"2024-08-31T06:46:18.659822+0000","last_clean":"2024-08-31T06:46:18.659822+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:46:18.659822+0000","last_undegraded":"2024-08-31T06:46:18.659822+0000","last_fullsized":"2024-08-31T06:46:18.659822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665290+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:46:18.665290+0000","last_peered":"2024-08-31T06:46:18.665290+0000","last_clean":"2024-08-31T06:46:18.665290+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:46:18.665290+0000","last_undegraded":"2024-08-31T06:46:18.665290+0000","last_fullsized":"2024-08-31T06:46:18.665290+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649973+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:46:18.649973+0000","last_peered":"2024-08-31T06:46:18.649973+0000","last_clean":"2024-08-31T06:46:18.649973+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:46:18.649973+0000","last_undegraded":"2024-08-31T06:46:18.649973+0000","last_fullsized":"2024-08-31T06:46:18.649973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640151+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:46:18.640151+0000","last_peered":"2024-08-31T06:46:18.640151+0000","last_clean":"2024-08-31T06:46:18.640151+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:46:18.640151+0000","last_undegraded":"2024-08-31T06:46:18.640151+0000","last_fullsized":"2024-08-31T06:46:18.640151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657815+0000","last_change":"2024-08-31T06:45:19.756707+0000","last_active":"2024-08-31T06:46:18.657815+0000","last_peered":"2024-08-31T06:46:18.657815+0000","last_clean":"2024-08-31T06:46:18.657815+0000","last_became_active":"2024-08-31T06:45:19.756086+0000","last_became_peered":"2024-08-31T06:45:19.756086+0000","last_unstale":"2024-08-31T06:46:18.657815+0000","last_undegraded":"2024-08-31T06:46:18.657815+0000","last_fullsized":"2024-08-31T06:46:18.657815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:44:24.147502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662767+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:46:18.662767+0000","last_peered":"2024-08-31T06:46:18.662767+0000","last_clean":"2024-08-31T06:46:18.662767+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:46:18.662767+0000","last_undegraded":"2024-08-31T06:46:18.662767+0000","last_fullsized":"2024-08-31T06:46:18.662767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.654017+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:46:18.654017+0000","last_peered":"2024-08-31T06:46:18.654017+0000","last_clean":"2024-08-31T06:46:18.654017+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:46:18.654017+0000","last_undegraded":"2024-08-31T06:46:18.654017+0000","last_fullsized":"2024-08-31T06:46:18.654017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671760+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:46:18.671760+0000","last_peered":"2024-08-31T06:46:18.671760+0000","last_clean":"2024-08-31T06:46:18.671760+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:46:18.671760+0000","last_undegraded":"2024-08-31T06:46:18.671760+0000","last_fullsized":"2024-08-31T06:46:18.671760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659726+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:46:18.659726+0000","last_peered":"2024-08-31T06:46:18.659726+0000","last_clean":"2024-08-31T06:46:18.659726+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:46:18.659726+0000","last_undegraded":"2024-08-31T06:46:18.659726+0000","last_fullsized":"2024-08-31T06:46:18.659726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.666910+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:46:18.666910+0000","last_peered":"2024-08-31T06:46:18.666910+0000","last_clean":"2024-08-31T06:46:18.666910+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:46:18.666910+0000","last_undegraded":"2024-08-31T06:46:18.666910+0000","last_fullsized":"2024-08-31T06:46:18.666910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649818+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:46:18.649818+0000","last_peered":"2024-08-31T06:46:18.649818+0000","last_clean":"2024-08-31T06:46:18.649818+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:46:18.649818+0000","last_undegraded":"2024-08-31T06:46:18.649818+0000","last_fullsized":"2024-08-31T06:46:18.649818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658630+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:46:18.658630+0000","last_peered":"2024-08-31T06:46:18.658630+0000","last_clean":"2024-08-31T06:46:18.658630+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:46:18.658630+0000","last_undegraded":"2024-08-31T06:46:18.658630+0000","last_fullsized":"2024-08-31T06:46:18.658630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656512+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:46:18.656512+0000","last_peered":"2024-08-31T06:46:18.656512+0000","last_clean":"2024-08-31T06:46:18.656512+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:46:18.656512+0000","last_undegraded":"2024-08-31T06:46:18.656512+0000","last_fullsized":"2024-08-31T06:46:18.656512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658480+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:46:18.658480+0000","last_peered":"2024-08-31T06:46:18.658480+0000","last_clean":"2024-08-31T06:46:18.658480+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:46:18.658480+0000","last_undegraded":"2024-08-31T06:46:18.658480+0000","last_fullsized":"2024-08-31T06:46:18.658480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672261+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:46:18.672261+0000","last_peered":"2024-08-31T06:46:18.672261+0000","last_clean":"2024-08-31T06:46:18.672261+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:46:18.672261+0000","last_undegraded":"2024-08-31T06:46:18.672261+0000","last_fullsized":"2024-08-31T06:46:18.672261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665677+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:46:18.665677+0000","last_peered":"2024-08-31T06:46:18.665677+0000","last_clean":"2024-08-31T06:46:18.665677+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:46:18.665677+0000","last_undegraded":"2024-08-31T06:46:18.665677+0000","last_fullsized":"2024-08-31T06:46:18.665677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658429+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:46:18.658429+0000","last_peered":"2024-08-31T06:46:18.658429+0000","last_clean":"2024-08-31T06:46:18.658429+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:46:18.658429+0000","last_undegraded":"2024-08-31T06:46:18.658429+0000","last_fullsized":"2024-08-31T06:46:18.658429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644995+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:46:18.644995+0000","last_peered":"2024-08-31T06:46:18.644995+0000","last_clean":"2024-08-31T06:46:18.644995+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:46:18.644995+0000","last_undegraded":"2024-08-31T06:46:18.644995+0000","last_fullsized":"2024-08-31T06:46:18.644995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653051+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:46:18.653051+0000","last_peered":"2024-08-31T06:46:18.653051+0000","last_clean":"2024-08-31T06:46:18.653051+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:46:18.653051+0000","last_undegraded":"2024-08-31T06:46:18.653051+0000","last_fullsized":"2024-08-31T06:46:18.653051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661106+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:46:18.661106+0000","last_peered":"2024-08-31T06:46:18.661106+0000","last_clean":"2024-08-31T06:46:18.661106+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:46:18.661106+0000","last_undegraded":"2024-08-31T06:46:18.661106+0000","last_fullsized":"2024-08-31T06:46:18.661106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.673097+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:46:18.673097+0000","last_peered":"2024-08-31T06:46:18.673097+0000","last_clean":"2024-08-31T06:46:18.673097+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:46:18.673097+0000","last_undegraded":"2024-08-31T06:46:18.673097+0000","last_fullsized":"2024-08-31T06:46:18.673097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638344+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:46:18.638344+0000","last_peered":"2024-08-31T06:46:18.638344+0000","last_clean":"2024-08-31T06:46:18.638344+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:46:18.638344+0000","last_undegraded":"2024-08-31T06:46:18.638344+0000","last_fullsized":"2024-08-31T06:46:18.638344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651434+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:46:18.651434+0000","last_peered":"2024-08-31T06:46:18.651434+0000","last_clean":"2024-08-31T06:46:18.651434+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:46:18.651434+0000","last_undegraded":"2024-08-31T06:46:18.651434+0000","last_fullsized":"2024-08-31T06:46:18.651434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638274+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:46:18.638274+0000","last_peered":"2024-08-31T06:46:18.638274+0000","last_clean":"2024-08-31T06:46:18.638274+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:46:18.638274+0000","last_undegraded":"2024-08-31T06:46:18.638274+0000","last_fullsized":"2024-08-31T06:46:18.638274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658774+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:46:18.658774+0000","last_peered":"2024-08-31T06:46:18.658774+0000","last_clean":"2024-08-31T06:46:18.658774+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:46:18.658774+0000","last_undegraded":"2024-08-31T06:46:18.658774+0000","last_fullsized":"2024-08-31T06:46:18.658774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637037+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:46:18.637037+0000","last_peered":"2024-08-31T06:46:18.637037+0000","last_clean":"2024-08-31T06:46:18.637037+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:46:18.637037+0000","last_undegraded":"2024-08-31T06:46:18.637037+0000","last_fullsized":"2024-08-31T06:46:18.637037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.645592+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:46:18.645592+0000","last_peered":"2024-08-31T06:46:18.645592+0000","last_clean":"2024-08-31T06:46:18.645592+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:46:18.645592+0000","last_undegraded":"2024-08-31T06:46:18.645592+0000","last_fullsized":"2024-08-31T06:46:18.645592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658756+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:46:18.658756+0000","last_peered":"2024-08-31T06:46:18.658756+0000","last_clean":"2024-08-31T06:46:18.658756+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:46:18.658756+0000","last_undegraded":"2024-08-31T06:46:18.658756+0000","last_fullsized":"2024-08-31T06:46:18.658756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647670+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:46:18.647670+0000","last_peered":"2024-08-31T06:46:18.647670+0000","last_clean":"2024-08-31T06:46:18.647670+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:46:18.647670+0000","last_undegraded":"2024-08-31T06:46:18.647670+0000","last_fullsized":"2024-08-31T06:46:18.647670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658511+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:46:18.658511+0000","last_peered":"2024-08-31T06:46:18.658511+0000","last_clean":"2024-08-31T06:46:18.658511+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:46:18.658511+0000","last_undegraded":"2024-08-31T06:46:18.658511+0000","last_fullsized":"2024-08-31T06:46:18.658511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647528+0000","last_change":"2024-08-31T06:45:19.754501+0000","last_active":"2024-08-31T06:46:18.647528+0000","last_peered":"2024-08-31T06:46:18.647528+0000","last_clean":"2024-08-31T06:46:18.647528+0000","last_became_active":"2024-08-31T06:45:19.754085+0000","last_became_peered":"2024-08-31T06:45:19.754085+0000","last_unstale":"2024-08-31T06:46:18.647528+0000","last_undegraded":"2024-08-31T06:46:18.647528+0000","last_fullsized":"2024-08-31T06:46:18.647528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:50:04.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637559+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:46:18.637559+0000","last_peered":"2024-08-31T06:46:18.637559+0000","last_clean":"2024-08-31T06:46:18.637559+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:46:18.637559+0000","last_undegraded":"2024-08-31T06:46:18.637559+0000","last_fullsized":"2024-08-31T06:46:18.637559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'8","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:31.070523+0000","last_change":"2024-08-31T06:45:19.947200+0000","last_active":"2024-08-31T06:46:31.070523+0000","last_peered":"2024-08-31T06:46:31.070523+0000","last_clean":"2024-08-31T06:46:31.070523+0000","last_became_active":"2024-08-31T06:45:19.942294+0000","last_became_peered":"2024-08-31T06:45:19.942294+0000","last_unstale":"2024-08-31T06:46:31.070523+0000","last_undegraded":"2024-08-31T06:46:31.070523+0000","last_fullsized":"2024-08-31T06:46:31.070523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:40.241862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651596+0000","last_change":"2024-08-31T06:45:19.942081+0000","last_active":"2024-08-31T06:46:18.651596+0000","last_peered":"2024-08-31T06:46:18.651596+0000","last_clean":"2024-08-31T06:46:18.651596+0000","last_became_active":"2024-08-31T06:45:19.941427+0000","last_became_peered":"2024-08-31T06:45:19.941427+0000","last_unstale":"2024-08-31T06:46:18.651596+0000","last_undegraded":"2024-08-31T06:46:18.651596+0000","last_fullsized":"2024-08-31T06:46:18.651596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:47.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749301+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:45:19.749301+0000","last_peered":"2024-08-31T06:45:19.749301+0000","last_clean":"2024-08-31T06:45:19.749301+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:45:19.749301+0000","last_undegraded":"2024-08-31T06:45:19.749301+0000","last_fullsized":"2024-08-31T06:45:19.749301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940290+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:45:19.940290+0000","last_peered":"2024-08-31T06:45:19.940290+0000","last_clean":"2024-08-31T06:45:19.940290+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:45:19.940290+0000","last_undegraded":"2024-08-31T06:45:19.940290+0000","last_fullsized":"2024-08-31T06:45:19.940290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639066+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:46:18.639066+0000","last_peered":"2024-08-31T06:46:18.639066+0000","last_clean":"2024-08-31T06:46:18.639066+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:46:18.639066+0000","last_undegraded":"2024-08-31T06:46:18.639066+0000","last_fullsized":"2024-08-31T06:46:18.639066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748301+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:45:19.748301+0000","last_peered":"2024-08-31T06:45:19.748301+0000","last_clean":"2024-08-31T06:45:19.748301+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:45:19.748301+0000","last_undegraded":"2024-08-31T06:45:19.748301+0000","last_fullsized":"2024-08-31T06:45:19.748301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656325+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:46:18.656325+0000","last_peered":"2024-08-31T06:46:18.656325+0000","last_clean":"2024-08-31T06:46:18.656325+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:46:18.656325+0000","last_undegraded":"2024-08-31T06:46:18.656325+0000","last_fullsized":"2024-08-31T06:46:18.656325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:35.077898+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:46:35.077898+0000","last_peered":"2024-08-31T06:46:35.077898+0000","last_clean":"2024-08-31T06:46:35.077898+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:46:35.077898+0000","last_undegraded":"2024-08-31T06:46:35.077898+0000","last_fullsized":"2024-08-31T06:46:35.077898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670727+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:46:18.670727+0000","last_peered":"2024-08-31T06:46:18.670727+0000","last_clean":"2024-08-31T06:46:18.670727+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:46:18.670727+0000","last_undegraded":"2024-08-31T06:46:18.670727+0000","last_fullsized":"2024-08-31T06:46:18.670727+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753069+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:45:19.753069+0000","last_peered":"2024-08-31T06:45:19.753069+0000","last_clean":"2024-08-31T06:45:19.753069+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:45:19.753069+0000","last_undegraded":"2024-08-31T06:45:19.753069+0000","last_fullsized":"2024-08-31T06:45:19.753069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659721+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:46:18.659721+0000","last_peered":"2024-08-31T06:46:18.659721+0000","last_clean":"2024-08-31T06:46:18.659721+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:46:18.659721+0000","last_undegraded":"2024-08-31T06:46:18.659721+0000","last_fullsized":"2024-08-31T06:46:18.659721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748845+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:45:19.748845+0000","last_peered":"2024-08-31T06:45:19.748845+0000","last_clean":"2024-08-31T06:45:19.748845+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:45:19.748845+0000","last_undegraded":"2024-08-31T06:45:19.748845+0000","last_fullsized":"2024-08-31T06:45:19.748845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672581+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:46:18.672581+0000","last_peered":"2024-08-31T06:46:18.672581+0000","last_clean":"2024-08-31T06:46:18.672581+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:46:18.672581+0000","last_undegraded":"2024-08-31T06:46:18.672581+0000","last_fullsized":"2024-08-31T06:46:18.672581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'34","reported_seq":277,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:36.079573+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:46:36.079573+0000","last_peered":"2024-08-31T06:46:36.079573+0000","last_clean":"2024-08-31T06:46:36.079573+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:46:36.079573+0000","last_undegraded":"2024-08-31T06:46:36.079573+0000","last_fullsized":"2024-08-31T06:46:36.079573+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":173,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660282+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:46:18.660282+0000","last_peered":"2024-08-31T06:46:18.660282+0000","last_clean":"2024-08-31T06:46:18.660282+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:46:18.660282+0000","last_undegraded":"2024-08-31T06:46:18.660282+0000","last_fullsized":"2024-08-31T06:46:18.660282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752795+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:45:19.752795+0000","last_peered":"2024-08-31T06:45:19.752795+0000","last_clean":"2024-08-31T06:45:19.752795+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:45:19.752795+0000","last_undegraded":"2024-08-31T06:45:19.752795+0000","last_fullsized":"2024-08-31T06:45:19.752795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660443+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:46:18.660443+0000","last_peered":"2024-08-31T06:46:18.660443+0000","last_clean":"2024-08-31T06:46:18.660443+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:46:18.660443+0000","last_undegraded":"2024-08-31T06:46:18.660443+0000","last_fullsized":"2024-08-31T06:46:18.660443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748495+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:45:19.748495+0000","last_peered":"2024-08-31T06:45:19.748495+0000","last_clean":"2024-08-31T06:45:19.748495+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:45:19.748495+0000","last_undegraded":"2024-08-31T06:45:19.748495+0000","last_fullsized":"2024-08-31T06:45:19.748495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661922+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:46:18.661922+0000","last_peered":"2024-08-31T06:46:18.661922+0000","last_clean":"2024-08-31T06:46:18.661922+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:46:18.661922+0000","last_undegraded":"2024-08-31T06:46:18.661922+0000","last_fullsized":"2024-08-31T06:46:18.661922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'6","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:30.843510+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:46:30.843510+0000","last_peered":"2024-08-31T06:46:30.843510+0000","last_clean":"2024-08-31T06:46:30.843510+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:46:30.843510+0000","last_undegraded":"2024-08-31T06:46:30.843510+0000","last_fullsized":"2024-08-31T06:46:30.843510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662079+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:46:18.662079+0000","last_peered":"2024-08-31T06:46:18.662079+0000","last_clean":"2024-08-31T06:46:18.662079+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:46:18.662079+0000","last_undegraded":"2024-08-31T06:46:18.662079+0000","last_fullsized":"2024-08-31T06:46:18.662079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748696+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:45:19.748696+0000","last_peered":"2024-08-31T06:45:19.748696+0000","last_clean":"2024-08-31T06:45:19.748696+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:45:19.748696+0000","last_undegraded":"2024-08-31T06:45:19.748696+0000","last_fullsized":"2024-08-31T06:45:19.748696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671183+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:46:18.671183+0000","last_peered":"2024-08-31T06:46:18.671183+0000","last_clean":"2024-08-31T06:46:18.671183+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:46:18.671183+0000","last_undegraded":"2024-08-31T06:46:18.671183+0000","last_fullsized":"2024-08-31T06:46:18.671183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749767+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:45:19.749767+0000","last_peered":"2024-08-31T06:45:19.749767+0000","last_clean":"2024-08-31T06:45:19.749767+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:45:19.749767+0000","last_undegraded":"2024-08-31T06:45:19.749767+0000","last_fullsized":"2024-08-31T06:45:19.749767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644774+0000","last_change":"2024-08-31T06:45:19.941511+0000","last_active":"2024-08-31T06:46:18.644774+0000","last_peered":"2024-08-31T06:46:18.644774+0000","last_clean":"2024-08-31T06:46:18.644774+0000","last_became_active":"2024-08-31T06:45:19.940991+0000","last_became_peered":"2024-08-31T06:45:19.940991+0000","last_unstale":"2024-08-31T06:46:18.644774+0000","last_undegraded":"2024-08-31T06:46:18.644774+0000","last_fullsized":"2024-08-31T06:46:18.644774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:25.268854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940677+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:45:19.940677+0000","last_peered":"2024-08-31T06:45:19.940677+0000","last_clean":"2024-08-31T06:45:19.940677+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:45:19.940677+0000","last_undegraded":"2024-08-31T06:45:19.940677+0000","last_fullsized":"2024-08-31T06:45:19.940677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662071+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:46:18.662071+0000","last_peered":"2024-08-31T06:46:18.662071+0000","last_clean":"2024-08-31T06:46:18.662071+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:46:18.662071+0000","last_undegraded":"2024-08-31T06:46:18.662071+0000","last_fullsized":"2024-08-31T06:46:18.662071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748981+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:45:19.748981+0000","last_peered":"2024-08-31T06:45:19.748981+0000","last_clean":"2024-08-31T06:45:19.748981+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:45:19.748981+0000","last_undegraded":"2024-08-31T06:45:19.748981+0000","last_fullsized":"2024-08-31T06:45:19.748981+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.663152+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:46:18.663152+0000","last_peered":"2024-08-31T06:46:18.663152+0000","last_clean":"2024-08-31T06:46:18.663152+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:46:18.663152+0000","last_undegraded":"2024-08-31T06:46:18.663152+0000","last_fullsized":"2024-08-31T06:46:18.663152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753167+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:45:19.753167+0000","last_peered":"2024-08-31T06:45:19.753167+0000","last_clean":"2024-08-31T06:45:19.753167+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:45:19.753167+0000","last_undegraded":"2024-08-31T06:45:19.753167+0000","last_fullsized":"2024-08-31T06:45:19.753167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.667685+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:46:18.667685+0000","last_peered":"2024-08-31T06:46:18.667685+0000","last_clean":"2024-08-31T06:46:18.667685+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:46:18.667685+0000","last_undegraded":"2024-08-31T06:46:18.667685+0000","last_fullsized":"2024-08-31T06:46:18.667685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753541+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:45:19.753541+0000","last_peered":"2024-08-31T06:45:19.753541+0000","last_clean":"2024-08-31T06:45:19.753541+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:45:19.753541+0000","last_undegraded":"2024-08-31T06:45:19.753541+0000","last_fullsized":"2024-08-31T06:45:19.753541+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941116+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:45:19.941116+0000","last_peered":"2024-08-31T06:45:19.941116+0000","last_clean":"2024-08-31T06:45:19.941116+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:45:19.941116+0000","last_undegraded":"2024-08-31T06:45:19.941116+0000","last_fullsized":"2024-08-31T06:45:19.941116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658466+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:46:18.658466+0000","last_peered":"2024-08-31T06:46:18.658466+0000","last_clean":"2024-08-31T06:46:18.658466+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:46:18.658466+0000","last_undegraded":"2024-08-31T06:46:18.658466+0000","last_fullsized":"2024-08-31T06:46:18.658466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753142+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:45:19.753142+0000","last_peered":"2024-08-31T06:45:19.753142+0000","last_clean":"2024-08-31T06:45:19.753142+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:45:19.753142+0000","last_undegraded":"2024-08-31T06:45:19.753142+0000","last_fullsized":"2024-08-31T06:45:19.753142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647034+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:46:18.647034+0000","last_peered":"2024-08-31T06:46:18.647034+0000","last_clean":"2024-08-31T06:46:18.647034+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:46:18.647034+0000","last_undegraded":"2024-08-31T06:46:18.647034+0000","last_fullsized":"2024-08-31T06:46:18.647034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:33.848145+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:46:33.848145+0000","last_peered":"2024-08-31T06:46:33.848145+0000","last_clean":"2024-08-31T06:46:33.848145+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:46:33.848145+0000","last_undegraded":"2024-08-31T06:46:33.848145+0000","last_fullsized":"2024-08-31T06:46:33.848145+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647481+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:46:18.647481+0000","last_peered":"2024-08-31T06:46:18.647481+0000","last_clean":"2024-08-31T06:46:18.647481+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:46:18.647481+0000","last_undegraded":"2024-08-31T06:46:18.647481+0000","last_fullsized":"2024-08-31T06:46:18.647481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753337+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:45:19.753337+0000","last_peered":"2024-08-31T06:45:19.753337+0000","last_clean":"2024-08-31T06:45:19.753337+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:45:19.753337+0000","last_undegraded":"2024-08-31T06:45:19.753337+0000","last_fullsized":"2024-08-31T06:45:19.753337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657118+0000","last_change":"2024-08-31T06:45:19.759585+0000","last_active":"2024-08-31T06:46:18.657118+0000","last_peered":"2024-08-31T06:46:18.657118+0000","last_clean":"2024-08-31T06:46:18.657118+0000","last_became_active":"2024-08-31T06:45:19.759026+0000","last_became_peered":"2024-08-31T06:45:19.759026+0000","last_unstale":"2024-08-31T06:46:18.657118+0000","last_undegraded":"2024-08-31T06:46:18.657118+0000","last_fullsized":"2024-08-31T06:46:18.657118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:54.716259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754330+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:45:19.754330+0000","last_peered":"2024-08-31T06:45:19.754330+0000","last_clean":"2024-08-31T06:45:19.754330+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:45:19.754330+0000","last_undegraded":"2024-08-31T06:45:19.754330+0000","last_fullsized":"2024-08-31T06:45:19.754330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656693+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:46:18.656693+0000","last_peered":"2024-08-31T06:46:18.656693+0000","last_clean":"2024-08-31T06:46:18.656693+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:46:18.656693+0000","last_undegraded":"2024-08-31T06:46:18.656693+0000","last_fullsized":"2024-08-31T06:46:18.656693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749624+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:45:19.749624+0000","last_peered":"2024-08-31T06:45:19.749624+0000","last_clean":"2024-08-31T06:45:19.749624+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:45:19.749624+0000","last_undegraded":"2024-08-31T06:45:19.749624+0000","last_fullsized":"2024-08-31T06:45:19.749624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640852+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:46:18.640852+0000","last_peered":"2024-08-31T06:46:18.640852+0000","last_clean":"2024-08-31T06:46:18.640852+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:46:18.640852+0000","last_undegraded":"2024-08-31T06:46:18.640852+0000","last_fullsized":"2024-08-31T06:46:18.640852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'14","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:29.666252+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:46:29.666252+0000","last_peered":"2024-08-31T06:46:29.666252+0000","last_clean":"2024-08-31T06:46:29.666252+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:46:29.666252+0000","last_undegraded":"2024-08-31T06:46:29.666252+0000","last_fullsized":"2024-08-31T06:46:29.666252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639289+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:46:18.639289+0000","last_peered":"2024-08-31T06:46:18.639289+0000","last_clean":"2024-08-31T06:46:18.639289+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:46:18.639289+0000","last_undegraded":"2024-08-31T06:46:18.639289+0000","last_fullsized":"2024-08-31T06:46:18.639289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941154+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:45:19.941154+0000","last_peered":"2024-08-31T06:45:19.941154+0000","last_clean":"2024-08-31T06:45:19.941154+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:45:19.941154+0000","last_undegraded":"2024-08-31T06:45:19.941154+0000","last_fullsized":"2024-08-31T06:45:19.941154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659568+0000","last_change":"2024-08-31T06:45:19.942466+0000","last_active":"2024-08-31T06:46:18.659568+0000","last_peered":"2024-08-31T06:46:18.659568+0000","last_clean":"2024-08-31T06:46:18.659568+0000","last_became_active":"2024-08-31T06:45:19.941936+0000","last_became_peered":"2024-08-31T06:45:19.941936+0000","last_unstale":"2024-08-31T06:46:18.659568+0000","last_undegraded":"2024-08-31T06:46:18.659568+0000","last_fullsized":"2024-08-31T06:46:18.659568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:25.406883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.761034+0000","last_change":"2024-08-31T06:45:19.760954+0000","last_active":"2024-08-31T06:45:19.761034+0000","last_peered":"2024-08-31T06:45:19.761034+0000","last_clean":"2024-08-31T06:45:19.761034+0000","last_became_active":"2024-08-31T06:45:19.754797+0000","last_became_peered":"2024-08-31T06:45:19.754797+0000","last_unstale":"2024-08-31T06:45:19.761034+0000","last_undegraded":"2024-08-31T06:45:19.761034+0000","last_fullsized":"2024-08-31T06:45:19.761034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:25.559400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.614619+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:46:18.614619+0000","last_peered":"2024-08-31T06:46:18.614619+0000","last_clean":"2024-08-31T06:46:18.614619+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:46:18.614619+0000","last_undegraded":"2024-08-31T06:46:18.614619+0000","last_fullsized":"2024-08-31T06:46:18.614619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939437+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:45:19.939437+0000","last_peered":"2024-08-31T06:45:19.939437+0000","last_clean":"2024-08-31T06:45:19.939437+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:45:19.939437+0000","last_undegraded":"2024-08-31T06:45:19.939437+0000","last_fullsized":"2024-08-31T06:45:19.939437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.646654+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:46:18.646654+0000","last_peered":"2024-08-31T06:46:18.646654+0000","last_clean":"2024-08-31T06:46:18.646654+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:46:18.646654+0000","last_undegraded":"2024-08-31T06:46:18.646654+0000","last_fullsized":"2024-08-31T06:46:18.646654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751817+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:45:19.751817+0000","last_peered":"2024-08-31T06:45:19.751817+0000","last_clean":"2024-08-31T06:45:19.751817+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:45:19.751817+0000","last_undegraded":"2024-08-31T06:45:19.751817+0000","last_fullsized":"2024-08-31T06:45:19.751817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651274+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:46:18.651274+0000","last_peered":"2024-08-31T06:46:18.651274+0000","last_clean":"2024-08-31T06:46:18.651274+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:46:18.651274+0000","last_undegraded":"2024-08-31T06:46:18.651274+0000","last_fullsized":"2024-08-31T06:46:18.651274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670609+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:46:18.670609+0000","last_peered":"2024-08-31T06:46:18.670609+0000","last_clean":"2024-08-31T06:46:18.670609+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:46:18.670609+0000","last_undegraded":"2024-08-31T06:46:18.670609+0000","last_fullsized":"2024-08-31T06:46:18.670609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671752+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:46:18.671752+0000","last_peered":"2024-08-31T06:46:18.671752+0000","last_clean":"2024-08-31T06:46:18.671752+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:46:18.671752+0000","last_undegraded":"2024-08-31T06:46:18.671752+0000","last_fullsized":"2024-08-31T06:46:18.671752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756544+0000","last_change":"2024-08-31T06:45:19.756432+0000","last_active":"2024-08-31T06:45:19.756544+0000","last_peered":"2024-08-31T06:45:19.756544+0000","last_clean":"2024-08-31T06:45:19.756544+0000","last_became_active":"2024-08-31T06:45:19.751184+0000","last_became_peered":"2024-08-31T06:45:19.751184+0000","last_unstale":"2024-08-31T06:45:19.756544+0000","last_undegraded":"2024-08-31T06:45:19.756544+0000","last_fullsized":"2024-08-31T06:45:19.756544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:23.569829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670996+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:46:18.670996+0000","last_peered":"2024-08-31T06:46:18.670996+0000","last_clean":"2024-08-31T06:46:18.670996+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:46:18.670996+0000","last_undegraded":"2024-08-31T06:46:18.670996+0000","last_fullsized":"2024-08-31T06:46:18.670996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749443+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:45:19.749443+0000","last_peered":"2024-08-31T06:45:19.749443+0000","last_clean":"2024-08-31T06:45:19.749443+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:45:19.749443+0000","last_undegraded":"2024-08-31T06:45:19.749443+0000","last_fullsized":"2024-08-31T06:45:19.749443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665231+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:46:18.665231+0000","last_peered":"2024-08-31T06:46:18.665231+0000","last_clean":"2024-08-31T06:46:18.665231+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:46:18.665231+0000","last_undegraded":"2024-08-31T06:46:18.665231+0000","last_fullsized":"2024-08-31T06:46:18.665231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939975+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:45:19.939975+0000","last_peered":"2024-08-31T06:45:19.939975+0000","last_clean":"2024-08-31T06:45:19.939975+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:45:19.939975+0000","last_undegraded":"2024-08-31T06:45:19.939975+0000","last_fullsized":"2024-08-31T06:45:19.939975+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653688+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:46:18.653688+0000","last_peered":"2024-08-31T06:46:18.653688+0000","last_clean":"2024-08-31T06:46:18.653688+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:46:18.653688+0000","last_undegraded":"2024-08-31T06:46:18.653688+0000","last_fullsized":"2024-08-31T06:46:18.653688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754818+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:45:19.754818+0000","last_peered":"2024-08-31T06:45:19.754818+0000","last_clean":"2024-08-31T06:45:19.754818+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:45:19.754818+0000","last_undegraded":"2024-08-31T06:45:19.754818+0000","last_fullsized":"2024-08-31T06:45:19.754818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70869,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":644,"num_read_kb":404,"num_write":185,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":213780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776164,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":409286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1067392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103214,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":409522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266740,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":409442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1441792,"data_stored":1003813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":408911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1454080,"data_stored":1001690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":412020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":409222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":474641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":469208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":410182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":65937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:46:36.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T06:46:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/2237109762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 msgr2=0x7fbb8410f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/2237109762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 0x7fbb8410f1d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009ca0 tx=0x7fbb7c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/2237109762 shutdown_connections 2024-08-31T06:46:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/2237109762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 0x7fbb8410f1d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/2237109762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb84108050 0x7fbb84108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/2237109762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb84102720 0x7fbb84102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/2237109762 >> 172.21.15.37:0/2237109762 conn(0x7fbb840fe120 msgr2=0x7fbb84100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/2237109762 shutdown_connections 2024-08-31T06:46:36.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.528+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/2237109762 wait complete. 2024-08-31T06:46:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8bf4a640 1 Processor -- start 2024-08-31T06:46:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8bf4a640 1 -- start start 2024-08-31T06:46:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8bf4a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb84102720 0x7fbb8419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8bf4a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb84108050 0x7fbb8419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8bf4a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 0x7fbb8419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8bf4a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbb84112570 con 0x7fbb841089a0 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8bf4a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbb841123f0 con 0x7fbb84102720 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8bf4a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbb841126f0 con 0x7fbb84108050 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8a4e7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 0x7fbb8419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8a4e7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 0x7fbb8419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32916/0 (socket says 172.21.15.37:32916) 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb8a4e7640 1 -- 172.21.15.37:0/4130018205 learned_addr learned my addr 172.21.15.37:0/4130018205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb894e5640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb84108050 0x7fbb8419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.529+0000 7fbb89ce6640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb84102720 0x7fbb8419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb8a4e7640 1 -- 172.21.15.37:0/4130018205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb84108050 msgr2=0x7fbb8419b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb8a4e7640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb84108050 0x7fbb8419b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb8a4e7640 1 -- 172.21.15.37:0/4130018205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb84102720 msgr2=0x7fbb8419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb8a4e7640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb84102720 0x7fbb8419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb8a4e7640 1 -- 172.21.15.37:0/4130018205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb841a6130 con 0x7fbb841089a0 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb8a4e7640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 0x7fbb8419b920 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c005e30 tx=0x7fbb7c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb7affd640 1 -- 172.21.15.37:0/4130018205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c032d10 con 0x7fbb841089a0 2024-08-31T06:46:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb7affd640 1 -- 172.21.15.37:0/4130018205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb7c032eb0 con 0x7fbb841089a0 2024-08-31T06:46:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb841a63c0 con 0x7fbb841089a0 2024-08-31T06:46:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb7affd640 1 -- 172.21.15.37:0/4130018205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c030b20 con 0x7fbb841089a0 2024-08-31T06:46:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.530+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb841a6960 con 0x7fbb841089a0 2024-08-31T06:46:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.531+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb84103990 con 0x7fbb841089a0 2024-08-31T06:46:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.533+0000 7fbb7affd640 1 -- 172.21.15.37:0/4130018205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7fbb7c030ce0 con 0x7fbb841089a0 2024-08-31T06:46:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.533+0000 7fbb7affd640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbb700b4c90 0x7fbb700b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.533+0000 7fbb7affd640 1 -- 172.21.15.37:0/4130018205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbb7c1065e0 con 0x7fbb841089a0 2024-08-31T06:46:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.533+0000 7fbb89ce6640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbb700b4c90 0x7fbb700b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.534+0000 7fbb89ce6640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbb700b4c90 0x7fbb700b71a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005fd0 tx=0x7fbb80005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.538+0000 7fbb7affd640 1 -- 172.21.15.37:0/4130018205 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbb7c0cd4d0 con 0x7fbb841089a0 2024-08-31T06:46:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.724+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb840635a0 con 0x7fbb700b4c90 2024-08-31T06:46:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.729+0000 7fbb7affd640 1 -- 172.21.15.37:0/4130018205 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258828 (secure 0 0 0) 0x7fbb840635a0 con 0x7fbb700b4c90 2024-08-31T06:46:36.732 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:36.733 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbb700b4c90 msgr2=0x7fbb700b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbb700b4c90 0x7fbb700b71a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbb80005fd0 tx=0x7fbb80005850 comp rx=0 tx=0).stop 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 msgr2=0x7fbb8419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 0x7fbb8419b920 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c005e30 tx=0x7fbb7c0093d0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 shutdown_connections 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbb700b4c90 0x7fbb700b71a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb841089a0 0x7fbb8419b920 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb84108050 0x7fbb8419b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 --2- 172.21.15.37:0/4130018205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb84102720 0x7fbb8419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 >> 172.21.15.37:0/4130018205 conn(0x7fbb840fe120 msgr2=0x7fbb84107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 shutdown_connections 2024-08-31T06:46:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.732+0000 7fbb8bf4a640 1 -- 172.21.15.37:0/4130018205 wait complete. 2024-08-31T06:46:36.744 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-08-31T06:46:36.272577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661471,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":725,"num_read_kb":473,"num_write":310,"num_write_kb":2282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":750,"ondisk_log_size":750,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365284,"kb_used_data":11876,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576540,"statfs":{"total":1151940427776,"available":1151566376960,"internally_reserved":0,"allocated":12161024,"data_stored":6885329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":53,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003050"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665746+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:46:18.665746+0000","last_peered":"2024-08-31T06:46:18.665746+0000","last_clean":"2024-08-31T06:46:18.665746+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:46:18.665746+0000","last_undegraded":"2024-08-31T06:46:18.665746+0000","last_fullsized":"2024-08-31T06:46:18.665746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659822+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:46:18.659822+0000","last_peered":"2024-08-31T06:46:18.659822+0000","last_clean":"2024-08-31T06:46:18.659822+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:46:18.659822+0000","last_undegraded":"2024-08-31T06:46:18.659822+0000","last_fullsized":"2024-08-31T06:46:18.659822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665290+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:46:18.665290+0000","last_peered":"2024-08-31T06:46:18.665290+0000","last_clean":"2024-08-31T06:46:18.665290+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:46:18.665290+0000","last_undegraded":"2024-08-31T06:46:18.665290+0000","last_fullsized":"2024-08-31T06:46:18.665290+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649973+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:46:18.649973+0000","last_peered":"2024-08-31T06:46:18.649973+0000","last_clean":"2024-08-31T06:46:18.649973+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:46:18.649973+0000","last_undegraded":"2024-08-31T06:46:18.649973+0000","last_fullsized":"2024-08-31T06:46:18.649973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640151+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:46:18.640151+0000","last_peered":"2024-08-31T06:46:18.640151+0000","last_clean":"2024-08-31T06:46:18.640151+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:46:18.640151+0000","last_undegraded":"2024-08-31T06:46:18.640151+0000","last_fullsized":"2024-08-31T06:46:18.640151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657815+0000","last_change":"2024-08-31T06:45:19.756707+0000","last_active":"2024-08-31T06:46:18.657815+0000","last_peered":"2024-08-31T06:46:18.657815+0000","last_clean":"2024-08-31T06:46:18.657815+0000","last_became_active":"2024-08-31T06:45:19.756086+0000","last_became_peered":"2024-08-31T06:45:19.756086+0000","last_unstale":"2024-08-31T06:46:18.657815+0000","last_undegraded":"2024-08-31T06:46:18.657815+0000","last_fullsized":"2024-08-31T06:46:18.657815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:44:24.147502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662767+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:46:18.662767+0000","last_peered":"2024-08-31T06:46:18.662767+0000","last_clean":"2024-08-31T06:46:18.662767+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:46:18.662767+0000","last_undegraded":"2024-08-31T06:46:18.662767+0000","last_fullsized":"2024-08-31T06:46:18.662767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.654017+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:46:18.654017+0000","last_peered":"2024-08-31T06:46:18.654017+0000","last_clean":"2024-08-31T06:46:18.654017+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:46:18.654017+0000","last_undegraded":"2024-08-31T06:46:18.654017+0000","last_fullsized":"2024-08-31T06:46:18.654017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671760+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:46:18.671760+0000","last_peered":"2024-08-31T06:46:18.671760+0000","last_clean":"2024-08-31T06:46:18.671760+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:46:18.671760+0000","last_undegraded":"2024-08-31T06:46:18.671760+0000","last_fullsized":"2024-08-31T06:46:18.671760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659726+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:46:18.659726+0000","last_peered":"2024-08-31T06:46:18.659726+0000","last_clean":"2024-08-31T06:46:18.659726+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:46:18.659726+0000","last_undegraded":"2024-08-31T06:46:18.659726+0000","last_fullsized":"2024-08-31T06:46:18.659726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.666910+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:46:18.666910+0000","last_peered":"2024-08-31T06:46:18.666910+0000","last_clean":"2024-08-31T06:46:18.666910+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:46:18.666910+0000","last_undegraded":"2024-08-31T06:46:18.666910+0000","last_fullsized":"2024-08-31T06:46:18.666910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649818+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:46:18.649818+0000","last_peered":"2024-08-31T06:46:18.649818+0000","last_clean":"2024-08-31T06:46:18.649818+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:46:18.649818+0000","last_undegraded":"2024-08-31T06:46:18.649818+0000","last_fullsized":"2024-08-31T06:46:18.649818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658630+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:46:18.658630+0000","last_peered":"2024-08-31T06:46:18.658630+0000","last_clean":"2024-08-31T06:46:18.658630+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:46:18.658630+0000","last_undegraded":"2024-08-31T06:46:18.658630+0000","last_fullsized":"2024-08-31T06:46:18.658630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656512+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:46:18.656512+0000","last_peered":"2024-08-31T06:46:18.656512+0000","last_clean":"2024-08-31T06:46:18.656512+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:46:18.656512+0000","last_undegraded":"2024-08-31T06:46:18.656512+0000","last_fullsized":"2024-08-31T06:46:18.656512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658480+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:46:18.658480+0000","last_peered":"2024-08-31T06:46:18.658480+0000","last_clean":"2024-08-31T06:46:18.658480+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:46:18.658480+0000","last_undegraded":"2024-08-31T06:46:18.658480+0000","last_fullsized":"2024-08-31T06:46:18.658480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672261+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:46:18.672261+0000","last_peered":"2024-08-31T06:46:18.672261+0000","last_clean":"2024-08-31T06:46:18.672261+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:46:18.672261+0000","last_undegraded":"2024-08-31T06:46:18.672261+0000","last_fullsized":"2024-08-31T06:46:18.672261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665677+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:46:18.665677+0000","last_peered":"2024-08-31T06:46:18.665677+0000","last_clean":"2024-08-31T06:46:18.665677+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:46:18.665677+0000","last_undegraded":"2024-08-31T06:46:18.665677+0000","last_fullsized":"2024-08-31T06:46:18.665677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658429+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:46:18.658429+0000","last_peered":"2024-08-31T06:46:18.658429+0000","last_clean":"2024-08-31T06:46:18.658429+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:46:18.658429+0000","last_undegraded":"2024-08-31T06:46:18.658429+0000","last_fullsized":"2024-08-31T06:46:18.658429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644995+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:46:18.644995+0000","last_peered":"2024-08-31T06:46:18.644995+0000","last_clean":"2024-08-31T06:46:18.644995+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:46:18.644995+0000","last_undegraded":"2024-08-31T06:46:18.644995+0000","last_fullsized":"2024-08-31T06:46:18.644995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653051+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:46:18.653051+0000","last_peered":"2024-08-31T06:46:18.653051+0000","last_clean":"2024-08-31T06:46:18.653051+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:46:18.653051+0000","last_undegraded":"2024-08-31T06:46:18.653051+0000","last_fullsized":"2024-08-31T06:46:18.653051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661106+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:46:18.661106+0000","last_peered":"2024-08-31T06:46:18.661106+0000","last_clean":"2024-08-31T06:46:18.661106+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:46:18.661106+0000","last_undegraded":"2024-08-31T06:46:18.661106+0000","last_fullsized":"2024-08-31T06:46:18.661106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.673097+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:46:18.673097+0000","last_peered":"2024-08-31T06:46:18.673097+0000","last_clean":"2024-08-31T06:46:18.673097+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:46:18.673097+0000","last_undegraded":"2024-08-31T06:46:18.673097+0000","last_fullsized":"2024-08-31T06:46:18.673097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638344+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:46:18.638344+0000","last_peered":"2024-08-31T06:46:18.638344+0000","last_clean":"2024-08-31T06:46:18.638344+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:46:18.638344+0000","last_undegraded":"2024-08-31T06:46:18.638344+0000","last_fullsized":"2024-08-31T06:46:18.638344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651434+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:46:18.651434+0000","last_peered":"2024-08-31T06:46:18.651434+0000","last_clean":"2024-08-31T06:46:18.651434+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:46:18.651434+0000","last_undegraded":"2024-08-31T06:46:18.651434+0000","last_fullsized":"2024-08-31T06:46:18.651434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638274+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:46:18.638274+0000","last_peered":"2024-08-31T06:46:18.638274+0000","last_clean":"2024-08-31T06:46:18.638274+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:46:18.638274+0000","last_undegraded":"2024-08-31T06:46:18.638274+0000","last_fullsized":"2024-08-31T06:46:18.638274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658774+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:46:18.658774+0000","last_peered":"2024-08-31T06:46:18.658774+0000","last_clean":"2024-08-31T06:46:18.658774+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:46:18.658774+0000","last_undegraded":"2024-08-31T06:46:18.658774+0000","last_fullsized":"2024-08-31T06:46:18.658774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637037+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:46:18.637037+0000","last_peered":"2024-08-31T06:46:18.637037+0000","last_clean":"2024-08-31T06:46:18.637037+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:46:18.637037+0000","last_undegraded":"2024-08-31T06:46:18.637037+0000","last_fullsized":"2024-08-31T06:46:18.637037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.645592+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:46:18.645592+0000","last_peered":"2024-08-31T06:46:18.645592+0000","last_clean":"2024-08-31T06:46:18.645592+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:46:18.645592+0000","last_undegraded":"2024-08-31T06:46:18.645592+0000","last_fullsized":"2024-08-31T06:46:18.645592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658756+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:46:18.658756+0000","last_peered":"2024-08-31T06:46:18.658756+0000","last_clean":"2024-08-31T06:46:18.658756+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:46:18.658756+0000","last_undegraded":"2024-08-31T06:46:18.658756+0000","last_fullsized":"2024-08-31T06:46:18.658756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647670+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:46:18.647670+0000","last_peered":"2024-08-31T06:46:18.647670+0000","last_clean":"2024-08-31T06:46:18.647670+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:46:18.647670+0000","last_undegraded":"2024-08-31T06:46:18.647670+0000","last_fullsized":"2024-08-31T06:46:18.647670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658511+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:46:18.658511+0000","last_peered":"2024-08-31T06:46:18.658511+0000","last_clean":"2024-08-31T06:46:18.658511+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:46:18.658511+0000","last_undegraded":"2024-08-31T06:46:18.658511+0000","last_fullsized":"2024-08-31T06:46:18.658511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647528+0000","last_change":"2024-08-31T06:45:19.754501+0000","last_active":"2024-08-31T06:46:18.647528+0000","last_peered":"2024-08-31T06:46:18.647528+0000","last_clean":"2024-08-31T06:46:18.647528+0000","last_became_active":"2024-08-31T06:45:19.754085+0000","last_became_peered":"2024-08-31T06:45:19.754085+0000","last_unstale":"2024-08-31T06:46:18.647528+0000","last_undegraded":"2024-08-31T06:46:18.647528+0000","last_fullsized":"2024-08-31T06:46:18.647528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:50:04.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637559+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:46:18.637559+0000","last_peered":"2024-08-31T06:46:18.637559+0000","last_clean":"2024-08-31T06:46:18.637559+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:46:18.637559+0000","last_undegraded":"2024-08-31T06:46:18.637559+0000","last_fullsized":"2024-08-31T06:46:18.637559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'8","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:31.070523+0000","last_change":"2024-08-31T06:45:19.947200+0000","last_active":"2024-08-31T06:46:31.070523+0000","last_peered":"2024-08-31T06:46:31.070523+0000","last_clean":"2024-08-31T06:46:31.070523+0000","last_became_active":"2024-08-31T06:45:19.942294+0000","last_became_peered":"2024-08-31T06:45:19.942294+0000","last_unstale":"2024-08-31T06:46:31.070523+0000","last_undegraded":"2024-08-31T06:46:31.070523+0000","last_fullsized":"2024-08-31T06:46:31.070523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:40.241862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651596+0000","last_change":"2024-08-31T06:45:19.942081+0000","last_active":"2024-08-31T06:46:18.651596+0000","last_peered":"2024-08-31T06:46:18.651596+0000","last_clean":"2024-08-31T06:46:18.651596+0000","last_became_active":"2024-08-31T06:45:19.941427+0000","last_became_peered":"2024-08-31T06:45:19.941427+0000","last_unstale":"2024-08-31T06:46:18.651596+0000","last_undegraded":"2024-08-31T06:46:18.651596+0000","last_fullsized":"2024-08-31T06:46:18.651596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:47.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749301+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:45:19.749301+0000","last_peered":"2024-08-31T06:45:19.749301+0000","last_clean":"2024-08-31T06:45:19.749301+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:45:19.749301+0000","last_undegraded":"2024-08-31T06:45:19.749301+0000","last_fullsized":"2024-08-31T06:45:19.749301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940290+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:45:19.940290+0000","last_peered":"2024-08-31T06:45:19.940290+0000","last_clean":"2024-08-31T06:45:19.940290+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:45:19.940290+0000","last_undegraded":"2024-08-31T06:45:19.940290+0000","last_fullsized":"2024-08-31T06:45:19.940290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639066+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:46:18.639066+0000","last_peered":"2024-08-31T06:46:18.639066+0000","last_clean":"2024-08-31T06:46:18.639066+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:46:18.639066+0000","last_undegraded":"2024-08-31T06:46:18.639066+0000","last_fullsized":"2024-08-31T06:46:18.639066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748301+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:45:19.748301+0000","last_peered":"2024-08-31T06:45:19.748301+0000","last_clean":"2024-08-31T06:45:19.748301+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:45:19.748301+0000","last_undegraded":"2024-08-31T06:45:19.748301+0000","last_fullsized":"2024-08-31T06:45:19.748301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656325+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:46:18.656325+0000","last_peered":"2024-08-31T06:46:18.656325+0000","last_clean":"2024-08-31T06:46:18.656325+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:46:18.656325+0000","last_undegraded":"2024-08-31T06:46:18.656325+0000","last_fullsized":"2024-08-31T06:46:18.656325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:35.077898+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:46:35.077898+0000","last_peered":"2024-08-31T06:46:35.077898+0000","last_clean":"2024-08-31T06:46:35.077898+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:46:35.077898+0000","last_undegraded":"2024-08-31T06:46:35.077898+0000","last_fullsized":"2024-08-31T06:46:35.077898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670727+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:46:18.670727+0000","last_peered":"2024-08-31T06:46:18.670727+0000","last_clean":"2024-08-31T06:46:18.670727+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:46:18.670727+0000","last_undegraded":"2024-08-31T06:46:18.670727+0000","last_fullsized":"2024-08-31T06:46:18.670727+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753069+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:45:19.753069+0000","last_peered":"2024-08-31T06:45:19.753069+0000","last_clean":"2024-08-31T06:45:19.753069+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:45:19.753069+0000","last_undegraded":"2024-08-31T06:45:19.753069+0000","last_fullsized":"2024-08-31T06:45:19.753069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659721+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:46:18.659721+0000","last_peered":"2024-08-31T06:46:18.659721+0000","last_clean":"2024-08-31T06:46:18.659721+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:46:18.659721+0000","last_undegraded":"2024-08-31T06:46:18.659721+0000","last_fullsized":"2024-08-31T06:46:18.659721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748845+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:45:19.748845+0000","last_peered":"2024-08-31T06:45:19.748845+0000","last_clean":"2024-08-31T06:45:19.748845+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:45:19.748845+0000","last_undegraded":"2024-08-31T06:45:19.748845+0000","last_fullsized":"2024-08-31T06:45:19.748845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672581+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:46:18.672581+0000","last_peered":"2024-08-31T06:46:18.672581+0000","last_clean":"2024-08-31T06:46:18.672581+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:46:18.672581+0000","last_undegraded":"2024-08-31T06:46:18.672581+0000","last_fullsized":"2024-08-31T06:46:18.672581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'34","reported_seq":277,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:36.079573+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:46:36.079573+0000","last_peered":"2024-08-31T06:46:36.079573+0000","last_clean":"2024-08-31T06:46:36.079573+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:46:36.079573+0000","last_undegraded":"2024-08-31T06:46:36.079573+0000","last_fullsized":"2024-08-31T06:46:36.079573+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":173,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660282+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:46:18.660282+0000","last_peered":"2024-08-31T06:46:18.660282+0000","last_clean":"2024-08-31T06:46:18.660282+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:46:18.660282+0000","last_undegraded":"2024-08-31T06:46:18.660282+0000","last_fullsized":"2024-08-31T06:46:18.660282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752795+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:45:19.752795+0000","last_peered":"2024-08-31T06:45:19.752795+0000","last_clean":"2024-08-31T06:45:19.752795+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:45:19.752795+0000","last_undegraded":"2024-08-31T06:45:19.752795+0000","last_fullsized":"2024-08-31T06:45:19.752795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660443+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:46:18.660443+0000","last_peered":"2024-08-31T06:46:18.660443+0000","last_clean":"2024-08-31T06:46:18.660443+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:46:18.660443+0000","last_undegraded":"2024-08-31T06:46:18.660443+0000","last_fullsized":"2024-08-31T06:46:18.660443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748495+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:45:19.748495+0000","last_peered":"2024-08-31T06:45:19.748495+0000","last_clean":"2024-08-31T06:45:19.748495+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:45:19.748495+0000","last_undegraded":"2024-08-31T06:45:19.748495+0000","last_fullsized":"2024-08-31T06:45:19.748495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661922+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:46:18.661922+0000","last_peered":"2024-08-31T06:46:18.661922+0000","last_clean":"2024-08-31T06:46:18.661922+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:46:18.661922+0000","last_undegraded":"2024-08-31T06:46:18.661922+0000","last_fullsized":"2024-08-31T06:46:18.661922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'6","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:30.843510+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:46:30.843510+0000","last_peered":"2024-08-31T06:46:30.843510+0000","last_clean":"2024-08-31T06:46:30.843510+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:46:30.843510+0000","last_undegraded":"2024-08-31T06:46:30.843510+0000","last_fullsized":"2024-08-31T06:46:30.843510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662079+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:46:18.662079+0000","last_peered":"2024-08-31T06:46:18.662079+0000","last_clean":"2024-08-31T06:46:18.662079+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:46:18.662079+0000","last_undegraded":"2024-08-31T06:46:18.662079+0000","last_fullsized":"2024-08-31T06:46:18.662079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748696+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:45:19.748696+0000","last_peered":"2024-08-31T06:45:19.748696+0000","last_clean":"2024-08-31T06:45:19.748696+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:45:19.748696+0000","last_undegraded":"2024-08-31T06:45:19.748696+0000","last_fullsized":"2024-08-31T06:45:19.748696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671183+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:46:18.671183+0000","last_peered":"2024-08-31T06:46:18.671183+0000","last_clean":"2024-08-31T06:46:18.671183+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:46:18.671183+0000","last_undegraded":"2024-08-31T06:46:18.671183+0000","last_fullsized":"2024-08-31T06:46:18.671183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749767+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:45:19.749767+0000","last_peered":"2024-08-31T06:45:19.749767+0000","last_clean":"2024-08-31T06:45:19.749767+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:45:19.749767+0000","last_undegraded":"2024-08-31T06:45:19.749767+0000","last_fullsized":"2024-08-31T06:45:19.749767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644774+0000","last_change":"2024-08-31T06:45:19.941511+0000","last_active":"2024-08-31T06:46:18.644774+0000","last_peered":"2024-08-31T06:46:18.644774+0000","last_clean":"2024-08-31T06:46:18.644774+0000","last_became_active":"2024-08-31T06:45:19.940991+0000","last_became_peered":"2024-08-31T06:45:19.940991+0000","last_unstale":"2024-08-31T06:46:18.644774+0000","last_undegraded":"2024-08-31T06:46:18.644774+0000","last_fullsized":"2024-08-31T06:46:18.644774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:25.268854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940677+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:45:19.940677+0000","last_peered":"2024-08-31T06:45:19.940677+0000","last_clean":"2024-08-31T06:45:19.940677+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:45:19.940677+0000","last_undegraded":"2024-08-31T06:45:19.940677+0000","last_fullsized":"2024-08-31T06:45:19.940677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662071+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:46:18.662071+0000","last_peered":"2024-08-31T06:46:18.662071+0000","last_clean":"2024-08-31T06:46:18.662071+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:46:18.662071+0000","last_undegraded":"2024-08-31T06:46:18.662071+0000","last_fullsized":"2024-08-31T06:46:18.662071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748981+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:45:19.748981+0000","last_peered":"2024-08-31T06:45:19.748981+0000","last_clean":"2024-08-31T06:45:19.748981+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:45:19.748981+0000","last_undegraded":"2024-08-31T06:45:19.748981+0000","last_fullsized":"2024-08-31T06:45:19.748981+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.663152+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:46:18.663152+0000","last_peered":"2024-08-31T06:46:18.663152+0000","last_clean":"2024-08-31T06:46:18.663152+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:46:18.663152+0000","last_undegraded":"2024-08-31T06:46:18.663152+0000","last_fullsized":"2024-08-31T06:46:18.663152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753167+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:45:19.753167+0000","last_peered":"2024-08-31T06:45:19.753167+0000","last_clean":"2024-08-31T06:45:19.753167+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:45:19.753167+0000","last_undegraded":"2024-08-31T06:45:19.753167+0000","last_fullsized":"2024-08-31T06:45:19.753167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.667685+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:46:18.667685+0000","last_peered":"2024-08-31T06:46:18.667685+0000","last_clean":"2024-08-31T06:46:18.667685+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:46:18.667685+0000","last_undegraded":"2024-08-31T06:46:18.667685+0000","last_fullsized":"2024-08-31T06:46:18.667685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753541+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:45:19.753541+0000","last_peered":"2024-08-31T06:45:19.753541+0000","last_clean":"2024-08-31T06:45:19.753541+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:45:19.753541+0000","last_undegraded":"2024-08-31T06:45:19.753541+0000","last_fullsized":"2024-08-31T06:45:19.753541+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941116+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:45:19.941116+0000","last_peered":"2024-08-31T06:45:19.941116+0000","last_clean":"2024-08-31T06:45:19.941116+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:45:19.941116+0000","last_undegraded":"2024-08-31T06:45:19.941116+0000","last_fullsized":"2024-08-31T06:45:19.941116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658466+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:46:18.658466+0000","last_peered":"2024-08-31T06:46:18.658466+0000","last_clean":"2024-08-31T06:46:18.658466+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:46:18.658466+0000","last_undegraded":"2024-08-31T06:46:18.658466+0000","last_fullsized":"2024-08-31T06:46:18.658466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753142+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:45:19.753142+0000","last_peered":"2024-08-31T06:45:19.753142+0000","last_clean":"2024-08-31T06:45:19.753142+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:45:19.753142+0000","last_undegraded":"2024-08-31T06:45:19.753142+0000","last_fullsized":"2024-08-31T06:45:19.753142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647034+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:46:18.647034+0000","last_peered":"2024-08-31T06:46:18.647034+0000","last_clean":"2024-08-31T06:46:18.647034+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:46:18.647034+0000","last_undegraded":"2024-08-31T06:46:18.647034+0000","last_fullsized":"2024-08-31T06:46:18.647034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:33.848145+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:46:33.848145+0000","last_peered":"2024-08-31T06:46:33.848145+0000","last_clean":"2024-08-31T06:46:33.848145+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:46:33.848145+0000","last_undegraded":"2024-08-31T06:46:33.848145+0000","last_fullsized":"2024-08-31T06:46:33.848145+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647481+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:46:18.647481+0000","last_peered":"2024-08-31T06:46:18.647481+0000","last_clean":"2024-08-31T06:46:18.647481+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:46:18.647481+0000","last_undegraded":"2024-08-31T06:46:18.647481+0000","last_fullsized":"2024-08-31T06:46:18.647481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753337+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:45:19.753337+0000","last_peered":"2024-08-31T06:45:19.753337+0000","last_clean":"2024-08-31T06:45:19.753337+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:45:19.753337+0000","last_undegraded":"2024-08-31T06:45:19.753337+0000","last_fullsized":"2024-08-31T06:45:19.753337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657118+0000","last_change":"2024-08-31T06:45:19.759585+0000","last_active":"2024-08-31T06:46:18.657118+0000","last_peered":"2024-08-31T06:46:18.657118+0000","last_clean":"2024-08-31T06:46:18.657118+0000","last_became_active":"2024-08-31T06:45:19.759026+0000","last_became_peered":"2024-08-31T06:45:19.759026+0000","last_unstale":"2024-08-31T06:46:18.657118+0000","last_undegraded":"2024-08-31T06:46:18.657118+0000","last_fullsized":"2024-08-31T06:46:18.657118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:54.716259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754330+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:45:19.754330+0000","last_peered":"2024-08-31T06:45:19.754330+0000","last_clean":"2024-08-31T06:45:19.754330+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:45:19.754330+0000","last_undegraded":"2024-08-31T06:45:19.754330+0000","last_fullsized":"2024-08-31T06:45:19.754330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656693+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:46:18.656693+0000","last_peered":"2024-08-31T06:46:18.656693+0000","last_clean":"2024-08-31T06:46:18.656693+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:46:18.656693+0000","last_undegraded":"2024-08-31T06:46:18.656693+0000","last_fullsized":"2024-08-31T06:46:18.656693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749624+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:45:19.749624+0000","last_peered":"2024-08-31T06:45:19.749624+0000","last_clean":"2024-08-31T06:45:19.749624+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:45:19.749624+0000","last_undegraded":"2024-08-31T06:45:19.749624+0000","last_fullsized":"2024-08-31T06:45:19.749624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640852+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:46:18.640852+0000","last_peered":"2024-08-31T06:46:18.640852+0000","last_clean":"2024-08-31T06:46:18.640852+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:46:18.640852+0000","last_undegraded":"2024-08-31T06:46:18.640852+0000","last_fullsized":"2024-08-31T06:46:18.640852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'14","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:29.666252+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:46:29.666252+0000","last_peered":"2024-08-31T06:46:29.666252+0000","last_clean":"2024-08-31T06:46:29.666252+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:46:29.666252+0000","last_undegraded":"2024-08-31T06:46:29.666252+0000","last_fullsized":"2024-08-31T06:46:29.666252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639289+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:46:18.639289+0000","last_peered":"2024-08-31T06:46:18.639289+0000","last_clean":"2024-08-31T06:46:18.639289+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:46:18.639289+0000","last_undegraded":"2024-08-31T06:46:18.639289+0000","last_fullsized":"2024-08-31T06:46:18.639289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941154+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:45:19.941154+0000","last_peered":"2024-08-31T06:45:19.941154+0000","last_clean":"2024-08-31T06:45:19.941154+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:45:19.941154+0000","last_undegraded":"2024-08-31T06:45:19.941154+0000","last_fullsized":"2024-08-31T06:45:19.941154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659568+0000","last_change":"2024-08-31T06:45:19.942466+0000","last_active":"2024-08-31T06:46:18.659568+0000","last_peered":"2024-08-31T06:46:18.659568+0000","last_clean":"2024-08-31T06:46:18.659568+0000","last_became_active":"2024-08-31T06:45:19.941936+0000","last_became_peered":"2024-08-31T06:45:19.941936+0000","last_unstale":"2024-08-31T06:46:18.659568+0000","last_undegraded":"2024-08-31T06:46:18.659568+0000","last_fullsized":"2024-08-31T06:46:18.659568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:25.406883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.761034+0000","last_change":"2024-08-31T06:45:19.760954+0000","last_active":"2024-08-31T06:45:19.761034+0000","last_peered":"2024-08-31T06:45:19.761034+0000","last_clean":"2024-08-31T06:45:19.761034+0000","last_became_active":"2024-08-31T06:45:19.754797+0000","last_became_peered":"2024-08-31T06:45:19.754797+0000","last_unstale":"2024-08-31T06:45:19.761034+0000","last_undegraded":"2024-08-31T06:45:19.761034+0000","last_fullsized":"2024-08-31T06:45:19.761034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:25.559400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.614619+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:46:18.614619+0000","last_peered":"2024-08-31T06:46:18.614619+0000","last_clean":"2024-08-31T06:46:18.614619+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:46:18.614619+0000","last_undegraded":"2024-08-31T06:46:18.614619+0000","last_fullsized":"2024-08-31T06:46:18.614619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939437+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:45:19.939437+0000","last_peered":"2024-08-31T06:45:19.939437+0000","last_clean":"2024-08-31T06:45:19.939437+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:45:19.939437+0000","last_undegraded":"2024-08-31T06:45:19.939437+0000","last_fullsized":"2024-08-31T06:45:19.939437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.646654+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:46:18.646654+0000","last_peered":"2024-08-31T06:46:18.646654+0000","last_clean":"2024-08-31T06:46:18.646654+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:46:18.646654+0000","last_undegraded":"2024-08-31T06:46:18.646654+0000","last_fullsized":"2024-08-31T06:46:18.646654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751817+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:45:19.751817+0000","last_peered":"2024-08-31T06:45:19.751817+0000","last_clean":"2024-08-31T06:45:19.751817+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:45:19.751817+0000","last_undegraded":"2024-08-31T06:45:19.751817+0000","last_fullsized":"2024-08-31T06:45:19.751817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651274+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:46:18.651274+0000","last_peered":"2024-08-31T06:46:18.651274+0000","last_clean":"2024-08-31T06:46:18.651274+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:46:18.651274+0000","last_undegraded":"2024-08-31T06:46:18.651274+0000","last_fullsized":"2024-08-31T06:46:18.651274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670609+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:46:18.670609+0000","last_peered":"2024-08-31T06:46:18.670609+0000","last_clean":"2024-08-31T06:46:18.670609+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:46:18.670609+0000","last_undegraded":"2024-08-31T06:46:18.670609+0000","last_fullsized":"2024-08-31T06:46:18.670609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671752+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:46:18.671752+0000","last_peered":"2024-08-31T06:46:18.671752+0000","last_clean":"2024-08-31T06:46:18.671752+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:46:18.671752+0000","last_undegraded":"2024-08-31T06:46:18.671752+0000","last_fullsized":"2024-08-31T06:46:18.671752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756544+0000","last_change":"2024-08-31T06:45:19.756432+0000","last_active":"2024-08-31T06:45:19.756544+0000","last_peered":"2024-08-31T06:45:19.756544+0000","last_clean":"2024-08-31T06:45:19.756544+0000","last_became_active":"2024-08-31T06:45:19.751184+0000","last_became_peered":"2024-08-31T06:45:19.751184+0000","last_unstale":"2024-08-31T06:45:19.756544+0000","last_undegraded":"2024-08-31T06:45:19.756544+0000","last_fullsized":"2024-08-31T06:45:19.756544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:23.569829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670996+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:46:18.670996+0000","last_peered":"2024-08-31T06:46:18.670996+0000","last_clean":"2024-08-31T06:46:18.670996+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:46:18.670996+0000","last_undegraded":"2024-08-31T06:46:18.670996+0000","last_fullsized":"2024-08-31T06:46:18.670996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749443+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:45:19.749443+0000","last_peered":"2024-08-31T06:45:19.749443+0000","last_clean":"2024-08-31T06:45:19.749443+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:45:19.749443+0000","last_undegraded":"2024-08-31T06:45:19.749443+0000","last_fullsized":"2024-08-31T06:45:19.749443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665231+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:46:18.665231+0000","last_peered":"2024-08-31T06:46:18.665231+0000","last_clean":"2024-08-31T06:46:18.665231+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:46:18.665231+0000","last_undegraded":"2024-08-31T06:46:18.665231+0000","last_fullsized":"2024-08-31T06:46:18.665231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939975+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:45:19.939975+0000","last_peered":"2024-08-31T06:45:19.939975+0000","last_clean":"2024-08-31T06:45:19.939975+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:45:19.939975+0000","last_undegraded":"2024-08-31T06:45:19.939975+0000","last_fullsized":"2024-08-31T06:45:19.939975+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653688+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:46:18.653688+0000","last_peered":"2024-08-31T06:46:18.653688+0000","last_clean":"2024-08-31T06:46:18.653688+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:46:18.653688+0000","last_undegraded":"2024-08-31T06:46:18.653688+0000","last_fullsized":"2024-08-31T06:46:18.653688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754818+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:45:19.754818+0000","last_peered":"2024-08-31T06:45:19.754818+0000","last_clean":"2024-08-31T06:45:19.754818+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:45:19.754818+0000","last_undegraded":"2024-08-31T06:45:19.754818+0000","last_fullsized":"2024-08-31T06:45:19.754818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70869,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":644,"num_read_kb":404,"num_write":185,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":213780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776164,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":409286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1067392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103214,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":409522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266740,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":409442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1441792,"data_stored":1003813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":408911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1454080,"data_stored":1001690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":412020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":409222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":474641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":469208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":410182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":65937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:46:36.748 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-31T06:46:36.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 -- 172.21.15.37:0/4129938452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa8102720 msgr2=0x7fafa8102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 --2- 172.21.15.37:0/4129938452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa8102720 0x7fafa8102b30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7faf98009900 tx=0x7faf9802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 -- 172.21.15.37:0/4129938452 shutdown_connections 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 --2- 172.21.15.37:0/4129938452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa81089a0 0x7fafa810f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 --2- 172.21.15.37:0/4129938452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa8108050 0x7fafa8108460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 --2- 172.21.15.37:0/4129938452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa8102720 0x7fafa8102b30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 -- 172.21.15.37:0/4129938452 >> 172.21.15.37:0/4129938452 conn(0x7fafa80fe120 msgr2=0x7fafa8100570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 -- 172.21.15.37:0/4129938452 shutdown_connections 2024-08-31T06:46:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.895+0000 7fafad170640 1 -- 172.21.15.37:0/4129938452 wait complete. 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafad170640 1 Processor -- start 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafad170640 1 -- start start 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafad170640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa8102720 0x7fafa8198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafad170640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa8108050 0x7fafa8199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafad170640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa81089a0 0x7fafa819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafad170640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fafa8112520 con 0x7fafa81089a0 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafad170640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fafa81123a0 con 0x7fafa8108050 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafad170640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fafa81126a0 con 0x7fafa8102720 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafa759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa81089a0 0x7fafa819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafa759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa81089a0 0x7fafa819e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32930/0 (socket says 172.21.15.37:32930) 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafa759e640 1 -- 172.21.15.37:0/863934396 learned_addr learned my addr 172.21.15.37:0/863934396 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafa659c640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa8108050 0x7fafa8199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.896+0000 7fafa6d9d640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa8102720 0x7fafa8198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafa759e640 1 -- 172.21.15.37:0/863934396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa8102720 msgr2=0x7fafa8198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafa759e640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa8102720 0x7fafa8198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafa759e640 1 -- 172.21.15.37:0/863934396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa8108050 msgr2=0x7fafa8199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafa759e640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa8108050 0x7fafa8199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafa759e640 1 -- 172.21.15.37:0/863934396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa819eef0 con 0x7fafa81089a0 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafa6d9d640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa8102720 0x7fafa8198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafa759e640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa81089a0 0x7fafa819e7f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fafa000eaa0 tx=0x7fafa000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7faf8ffff640 1 -- 172.21.15.37:0/863934396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa000cdb0 con 0x7fafa81089a0 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa819f1e0 con 0x7fafa81089a0 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7faf8ffff640 1 -- 172.21.15.37:0/863934396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafa0005020 con 0x7fafa81089a0 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7faf8ffff640 1 -- 172.21.15.37:0/863934396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa00116d0 con 0x7fafa81089a0 2024-08-31T06:46:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.897+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa81a5970 con 0x7fafa81089a0 2024-08-31T06:46:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.898+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa8103990 con 0x7fafa81089a0 2024-08-31T06:46:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.901+0000 7faf8ffff640 1 -- 172.21.15.37:0/863934396 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7fafa00051d0 con 0x7fafa81089a0 2024-08-31T06:46:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.901+0000 7faf8ffff640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faf900b4c10 0x7faf900b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.901+0000 7faf8ffff640 1 -- 172.21.15.37:0/863934396 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fafa00e5980 con 0x7fafa81089a0 2024-08-31T06:46:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.901+0000 7fafa6d9d640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faf900b4c10 0x7faf900b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.902+0000 7fafa6d9d640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faf900b4c10 0x7faf900b7120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf98000c00 tx=0x7faf98005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:36.904+0000 7faf8ffff640 1 -- 172.21.15.37:0/863934396 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fafa0016030 con 0x7fafa81089a0 2024-08-31T06:46:37.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.087+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafa80635a0 con 0x7faf900b4c10 2024-08-31T06:46:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.091+0000 7faf8ffff640 1 -- 172.21.15.37:0/863934396 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258828 (secure 0 0 0) 0x7fafa80635a0 con 0x7faf900b4c10 2024-08-31T06:46:37.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:46:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.094+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faf900b4c10 msgr2=0x7faf900b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.094+0000 7fafad170640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faf900b4c10 0x7faf900b7120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf98000c00 tx=0x7faf98005a20 comp rx=0 tx=0).stop 2024-08-31T06:46:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.094+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa81089a0 msgr2=0x7fafa819e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.094+0000 7fafad170640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa81089a0 0x7fafa819e7f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fafa000eaa0 tx=0x7fafa000ef60 comp rx=0 tx=0).stop 2024-08-31T06:46:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.094+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 shutdown_connections 2024-08-31T06:46:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.095+0000 7fafad170640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7faf900b4c10 0x7faf900b7120 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.095+0000 7fafad170640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa81089a0 0x7fafa819e7f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.095+0000 7fafad170640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa8108050 0x7fafa8199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.095+0000 7fafad170640 1 --2- 172.21.15.37:0/863934396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa8102720 0x7fafa8198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.095+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 >> 172.21.15.37:0/863934396 conn(0x7fafa80fe120 msgr2=0x7fafa8100540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.095+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 shutdown_connections 2024-08-31T06:46:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.095+0000 7fafad170640 1 -- 172.21.15.37:0/863934396 wait complete. 2024-08-31T06:46:37.107 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-08-31T06:46:36.272577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661471,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":725,"num_read_kb":473,"num_write":310,"num_write_kb":2282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":750,"ondisk_log_size":750,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":365284,"kb_used_data":11876,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124576540,"statfs":{"total":1151940427776,"available":1151566376960,"internally_reserved":0,"allocated":12161024,"data_stored":6885329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":53,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003050"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665746+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:46:18.665746+0000","last_peered":"2024-08-31T06:46:18.665746+0000","last_clean":"2024-08-31T06:46:18.665746+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:46:18.665746+0000","last_undegraded":"2024-08-31T06:46:18.665746+0000","last_fullsized":"2024-08-31T06:46:18.665746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659822+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:46:18.659822+0000","last_peered":"2024-08-31T06:46:18.659822+0000","last_clean":"2024-08-31T06:46:18.659822+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:46:18.659822+0000","last_undegraded":"2024-08-31T06:46:18.659822+0000","last_fullsized":"2024-08-31T06:46:18.659822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665290+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:46:18.665290+0000","last_peered":"2024-08-31T06:46:18.665290+0000","last_clean":"2024-08-31T06:46:18.665290+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:46:18.665290+0000","last_undegraded":"2024-08-31T06:46:18.665290+0000","last_fullsized":"2024-08-31T06:46:18.665290+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649973+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:46:18.649973+0000","last_peered":"2024-08-31T06:46:18.649973+0000","last_clean":"2024-08-31T06:46:18.649973+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:46:18.649973+0000","last_undegraded":"2024-08-31T06:46:18.649973+0000","last_fullsized":"2024-08-31T06:46:18.649973+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640151+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:46:18.640151+0000","last_peered":"2024-08-31T06:46:18.640151+0000","last_clean":"2024-08-31T06:46:18.640151+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:46:18.640151+0000","last_undegraded":"2024-08-31T06:46:18.640151+0000","last_fullsized":"2024-08-31T06:46:18.640151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657815+0000","last_change":"2024-08-31T06:45:19.756707+0000","last_active":"2024-08-31T06:46:18.657815+0000","last_peered":"2024-08-31T06:46:18.657815+0000","last_clean":"2024-08-31T06:46:18.657815+0000","last_became_active":"2024-08-31T06:45:19.756086+0000","last_became_peered":"2024-08-31T06:45:19.756086+0000","last_unstale":"2024-08-31T06:46:18.657815+0000","last_undegraded":"2024-08-31T06:46:18.657815+0000","last_fullsized":"2024-08-31T06:46:18.657815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:44:24.147502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662767+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:46:18.662767+0000","last_peered":"2024-08-31T06:46:18.662767+0000","last_clean":"2024-08-31T06:46:18.662767+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:46:18.662767+0000","last_undegraded":"2024-08-31T06:46:18.662767+0000","last_fullsized":"2024-08-31T06:46:18.662767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.654017+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:46:18.654017+0000","last_peered":"2024-08-31T06:46:18.654017+0000","last_clean":"2024-08-31T06:46:18.654017+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:46:18.654017+0000","last_undegraded":"2024-08-31T06:46:18.654017+0000","last_fullsized":"2024-08-31T06:46:18.654017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671760+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:46:18.671760+0000","last_peered":"2024-08-31T06:46:18.671760+0000","last_clean":"2024-08-31T06:46:18.671760+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:46:18.671760+0000","last_undegraded":"2024-08-31T06:46:18.671760+0000","last_fullsized":"2024-08-31T06:46:18.671760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659726+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:46:18.659726+0000","last_peered":"2024-08-31T06:46:18.659726+0000","last_clean":"2024-08-31T06:46:18.659726+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:46:18.659726+0000","last_undegraded":"2024-08-31T06:46:18.659726+0000","last_fullsized":"2024-08-31T06:46:18.659726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.666910+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:46:18.666910+0000","last_peered":"2024-08-31T06:46:18.666910+0000","last_clean":"2024-08-31T06:46:18.666910+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:46:18.666910+0000","last_undegraded":"2024-08-31T06:46:18.666910+0000","last_fullsized":"2024-08-31T06:46:18.666910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649818+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:46:18.649818+0000","last_peered":"2024-08-31T06:46:18.649818+0000","last_clean":"2024-08-31T06:46:18.649818+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:46:18.649818+0000","last_undegraded":"2024-08-31T06:46:18.649818+0000","last_fullsized":"2024-08-31T06:46:18.649818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658630+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:46:18.658630+0000","last_peered":"2024-08-31T06:46:18.658630+0000","last_clean":"2024-08-31T06:46:18.658630+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:46:18.658630+0000","last_undegraded":"2024-08-31T06:46:18.658630+0000","last_fullsized":"2024-08-31T06:46:18.658630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656512+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:46:18.656512+0000","last_peered":"2024-08-31T06:46:18.656512+0000","last_clean":"2024-08-31T06:46:18.656512+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:46:18.656512+0000","last_undegraded":"2024-08-31T06:46:18.656512+0000","last_fullsized":"2024-08-31T06:46:18.656512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658480+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:46:18.658480+0000","last_peered":"2024-08-31T06:46:18.658480+0000","last_clean":"2024-08-31T06:46:18.658480+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:46:18.658480+0000","last_undegraded":"2024-08-31T06:46:18.658480+0000","last_fullsized":"2024-08-31T06:46:18.658480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672261+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:46:18.672261+0000","last_peered":"2024-08-31T06:46:18.672261+0000","last_clean":"2024-08-31T06:46:18.672261+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:46:18.672261+0000","last_undegraded":"2024-08-31T06:46:18.672261+0000","last_fullsized":"2024-08-31T06:46:18.672261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665677+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:46:18.665677+0000","last_peered":"2024-08-31T06:46:18.665677+0000","last_clean":"2024-08-31T06:46:18.665677+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:46:18.665677+0000","last_undegraded":"2024-08-31T06:46:18.665677+0000","last_fullsized":"2024-08-31T06:46:18.665677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658429+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:46:18.658429+0000","last_peered":"2024-08-31T06:46:18.658429+0000","last_clean":"2024-08-31T06:46:18.658429+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:46:18.658429+0000","last_undegraded":"2024-08-31T06:46:18.658429+0000","last_fullsized":"2024-08-31T06:46:18.658429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644995+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:46:18.644995+0000","last_peered":"2024-08-31T06:46:18.644995+0000","last_clean":"2024-08-31T06:46:18.644995+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:46:18.644995+0000","last_undegraded":"2024-08-31T06:46:18.644995+0000","last_fullsized":"2024-08-31T06:46:18.644995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653051+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:46:18.653051+0000","last_peered":"2024-08-31T06:46:18.653051+0000","last_clean":"2024-08-31T06:46:18.653051+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:46:18.653051+0000","last_undegraded":"2024-08-31T06:46:18.653051+0000","last_fullsized":"2024-08-31T06:46:18.653051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661106+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:46:18.661106+0000","last_peered":"2024-08-31T06:46:18.661106+0000","last_clean":"2024-08-31T06:46:18.661106+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:46:18.661106+0000","last_undegraded":"2024-08-31T06:46:18.661106+0000","last_fullsized":"2024-08-31T06:46:18.661106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.673097+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:46:18.673097+0000","last_peered":"2024-08-31T06:46:18.673097+0000","last_clean":"2024-08-31T06:46:18.673097+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:46:18.673097+0000","last_undegraded":"2024-08-31T06:46:18.673097+0000","last_fullsized":"2024-08-31T06:46:18.673097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638344+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:46:18.638344+0000","last_peered":"2024-08-31T06:46:18.638344+0000","last_clean":"2024-08-31T06:46:18.638344+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:46:18.638344+0000","last_undegraded":"2024-08-31T06:46:18.638344+0000","last_fullsized":"2024-08-31T06:46:18.638344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651434+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:46:18.651434+0000","last_peered":"2024-08-31T06:46:18.651434+0000","last_clean":"2024-08-31T06:46:18.651434+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:46:18.651434+0000","last_undegraded":"2024-08-31T06:46:18.651434+0000","last_fullsized":"2024-08-31T06:46:18.651434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638274+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:46:18.638274+0000","last_peered":"2024-08-31T06:46:18.638274+0000","last_clean":"2024-08-31T06:46:18.638274+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:46:18.638274+0000","last_undegraded":"2024-08-31T06:46:18.638274+0000","last_fullsized":"2024-08-31T06:46:18.638274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658774+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:46:18.658774+0000","last_peered":"2024-08-31T06:46:18.658774+0000","last_clean":"2024-08-31T06:46:18.658774+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:46:18.658774+0000","last_undegraded":"2024-08-31T06:46:18.658774+0000","last_fullsized":"2024-08-31T06:46:18.658774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637037+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:46:18.637037+0000","last_peered":"2024-08-31T06:46:18.637037+0000","last_clean":"2024-08-31T06:46:18.637037+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:46:18.637037+0000","last_undegraded":"2024-08-31T06:46:18.637037+0000","last_fullsized":"2024-08-31T06:46:18.637037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.645592+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:46:18.645592+0000","last_peered":"2024-08-31T06:46:18.645592+0000","last_clean":"2024-08-31T06:46:18.645592+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:46:18.645592+0000","last_undegraded":"2024-08-31T06:46:18.645592+0000","last_fullsized":"2024-08-31T06:46:18.645592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658756+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:46:18.658756+0000","last_peered":"2024-08-31T06:46:18.658756+0000","last_clean":"2024-08-31T06:46:18.658756+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:46:18.658756+0000","last_undegraded":"2024-08-31T06:46:18.658756+0000","last_fullsized":"2024-08-31T06:46:18.658756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647670+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:46:18.647670+0000","last_peered":"2024-08-31T06:46:18.647670+0000","last_clean":"2024-08-31T06:46:18.647670+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:46:18.647670+0000","last_undegraded":"2024-08-31T06:46:18.647670+0000","last_fullsized":"2024-08-31T06:46:18.647670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658511+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:46:18.658511+0000","last_peered":"2024-08-31T06:46:18.658511+0000","last_clean":"2024-08-31T06:46:18.658511+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:46:18.658511+0000","last_undegraded":"2024-08-31T06:46:18.658511+0000","last_fullsized":"2024-08-31T06:46:18.658511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647528+0000","last_change":"2024-08-31T06:45:19.754501+0000","last_active":"2024-08-31T06:46:18.647528+0000","last_peered":"2024-08-31T06:46:18.647528+0000","last_clean":"2024-08-31T06:46:18.647528+0000","last_became_active":"2024-08-31T06:45:19.754085+0000","last_became_peered":"2024-08-31T06:45:19.754085+0000","last_unstale":"2024-08-31T06:46:18.647528+0000","last_undegraded":"2024-08-31T06:46:18.647528+0000","last_fullsized":"2024-08-31T06:46:18.647528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:50:04.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637559+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:46:18.637559+0000","last_peered":"2024-08-31T06:46:18.637559+0000","last_clean":"2024-08-31T06:46:18.637559+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:46:18.637559+0000","last_undegraded":"2024-08-31T06:46:18.637559+0000","last_fullsized":"2024-08-31T06:46:18.637559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'8","reported_seq":149,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:31.070523+0000","last_change":"2024-08-31T06:45:19.947200+0000","last_active":"2024-08-31T06:46:31.070523+0000","last_peered":"2024-08-31T06:46:31.070523+0000","last_clean":"2024-08-31T06:46:31.070523+0000","last_became_active":"2024-08-31T06:45:19.942294+0000","last_became_peered":"2024-08-31T06:45:19.942294+0000","last_unstale":"2024-08-31T06:46:31.070523+0000","last_undegraded":"2024-08-31T06:46:31.070523+0000","last_fullsized":"2024-08-31T06:46:31.070523+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:40.241862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651596+0000","last_change":"2024-08-31T06:45:19.942081+0000","last_active":"2024-08-31T06:46:18.651596+0000","last_peered":"2024-08-31T06:46:18.651596+0000","last_clean":"2024-08-31T06:46:18.651596+0000","last_became_active":"2024-08-31T06:45:19.941427+0000","last_became_peered":"2024-08-31T06:45:19.941427+0000","last_unstale":"2024-08-31T06:46:18.651596+0000","last_undegraded":"2024-08-31T06:46:18.651596+0000","last_fullsized":"2024-08-31T06:46:18.651596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:47.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749301+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:45:19.749301+0000","last_peered":"2024-08-31T06:45:19.749301+0000","last_clean":"2024-08-31T06:45:19.749301+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:45:19.749301+0000","last_undegraded":"2024-08-31T06:45:19.749301+0000","last_fullsized":"2024-08-31T06:45:19.749301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940290+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:45:19.940290+0000","last_peered":"2024-08-31T06:45:19.940290+0000","last_clean":"2024-08-31T06:45:19.940290+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:45:19.940290+0000","last_undegraded":"2024-08-31T06:45:19.940290+0000","last_fullsized":"2024-08-31T06:45:19.940290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639066+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:46:18.639066+0000","last_peered":"2024-08-31T06:46:18.639066+0000","last_clean":"2024-08-31T06:46:18.639066+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:46:18.639066+0000","last_undegraded":"2024-08-31T06:46:18.639066+0000","last_fullsized":"2024-08-31T06:46:18.639066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748301+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:45:19.748301+0000","last_peered":"2024-08-31T06:45:19.748301+0000","last_clean":"2024-08-31T06:45:19.748301+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:45:19.748301+0000","last_undegraded":"2024-08-31T06:45:19.748301+0000","last_fullsized":"2024-08-31T06:45:19.748301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656325+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:46:18.656325+0000","last_peered":"2024-08-31T06:46:18.656325+0000","last_clean":"2024-08-31T06:46:18.656325+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:46:18.656325+0000","last_undegraded":"2024-08-31T06:46:18.656325+0000","last_fullsized":"2024-08-31T06:46:18.656325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:35.077898+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:46:35.077898+0000","last_peered":"2024-08-31T06:46:35.077898+0000","last_clean":"2024-08-31T06:46:35.077898+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:46:35.077898+0000","last_undegraded":"2024-08-31T06:46:35.077898+0000","last_fullsized":"2024-08-31T06:46:35.077898+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670727+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:46:18.670727+0000","last_peered":"2024-08-31T06:46:18.670727+0000","last_clean":"2024-08-31T06:46:18.670727+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:46:18.670727+0000","last_undegraded":"2024-08-31T06:46:18.670727+0000","last_fullsized":"2024-08-31T06:46:18.670727+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753069+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:45:19.753069+0000","last_peered":"2024-08-31T06:45:19.753069+0000","last_clean":"2024-08-31T06:45:19.753069+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:45:19.753069+0000","last_undegraded":"2024-08-31T06:45:19.753069+0000","last_fullsized":"2024-08-31T06:45:19.753069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659721+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:46:18.659721+0000","last_peered":"2024-08-31T06:46:18.659721+0000","last_clean":"2024-08-31T06:46:18.659721+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:46:18.659721+0000","last_undegraded":"2024-08-31T06:46:18.659721+0000","last_fullsized":"2024-08-31T06:46:18.659721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748845+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:45:19.748845+0000","last_peered":"2024-08-31T06:45:19.748845+0000","last_clean":"2024-08-31T06:45:19.748845+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:45:19.748845+0000","last_undegraded":"2024-08-31T06:45:19.748845+0000","last_fullsized":"2024-08-31T06:45:19.748845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672581+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:46:18.672581+0000","last_peered":"2024-08-31T06:46:18.672581+0000","last_clean":"2024-08-31T06:46:18.672581+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:46:18.672581+0000","last_undegraded":"2024-08-31T06:46:18.672581+0000","last_fullsized":"2024-08-31T06:46:18.672581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'34","reported_seq":277,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:36.079573+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:46:36.079573+0000","last_peered":"2024-08-31T06:46:36.079573+0000","last_clean":"2024-08-31T06:46:36.079573+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:46:36.079573+0000","last_undegraded":"2024-08-31T06:46:36.079573+0000","last_fullsized":"2024-08-31T06:46:36.079573+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65209,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":173,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660282+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:46:18.660282+0000","last_peered":"2024-08-31T06:46:18.660282+0000","last_clean":"2024-08-31T06:46:18.660282+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:46:18.660282+0000","last_undegraded":"2024-08-31T06:46:18.660282+0000","last_fullsized":"2024-08-31T06:46:18.660282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752795+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:45:19.752795+0000","last_peered":"2024-08-31T06:45:19.752795+0000","last_clean":"2024-08-31T06:45:19.752795+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:45:19.752795+0000","last_undegraded":"2024-08-31T06:45:19.752795+0000","last_fullsized":"2024-08-31T06:45:19.752795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660443+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:46:18.660443+0000","last_peered":"2024-08-31T06:46:18.660443+0000","last_clean":"2024-08-31T06:46:18.660443+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:46:18.660443+0000","last_undegraded":"2024-08-31T06:46:18.660443+0000","last_fullsized":"2024-08-31T06:46:18.660443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748495+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:45:19.748495+0000","last_peered":"2024-08-31T06:45:19.748495+0000","last_clean":"2024-08-31T06:45:19.748495+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:45:19.748495+0000","last_undegraded":"2024-08-31T06:45:19.748495+0000","last_fullsized":"2024-08-31T06:45:19.748495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661922+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:46:18.661922+0000","last_peered":"2024-08-31T06:46:18.661922+0000","last_clean":"2024-08-31T06:46:18.661922+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:46:18.661922+0000","last_undegraded":"2024-08-31T06:46:18.661922+0000","last_fullsized":"2024-08-31T06:46:18.661922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'6","reported_seq":134,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:30.843510+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:46:30.843510+0000","last_peered":"2024-08-31T06:46:30.843510+0000","last_clean":"2024-08-31T06:46:30.843510+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:46:30.843510+0000","last_undegraded":"2024-08-31T06:46:30.843510+0000","last_fullsized":"2024-08-31T06:46:30.843510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662079+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:46:18.662079+0000","last_peered":"2024-08-31T06:46:18.662079+0000","last_clean":"2024-08-31T06:46:18.662079+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:46:18.662079+0000","last_undegraded":"2024-08-31T06:46:18.662079+0000","last_fullsized":"2024-08-31T06:46:18.662079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748696+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:45:19.748696+0000","last_peered":"2024-08-31T06:45:19.748696+0000","last_clean":"2024-08-31T06:45:19.748696+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:45:19.748696+0000","last_undegraded":"2024-08-31T06:45:19.748696+0000","last_fullsized":"2024-08-31T06:45:19.748696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671183+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:46:18.671183+0000","last_peered":"2024-08-31T06:46:18.671183+0000","last_clean":"2024-08-31T06:46:18.671183+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:46:18.671183+0000","last_undegraded":"2024-08-31T06:46:18.671183+0000","last_fullsized":"2024-08-31T06:46:18.671183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749767+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:45:19.749767+0000","last_peered":"2024-08-31T06:45:19.749767+0000","last_clean":"2024-08-31T06:45:19.749767+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:45:19.749767+0000","last_undegraded":"2024-08-31T06:45:19.749767+0000","last_fullsized":"2024-08-31T06:45:19.749767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644774+0000","last_change":"2024-08-31T06:45:19.941511+0000","last_active":"2024-08-31T06:46:18.644774+0000","last_peered":"2024-08-31T06:46:18.644774+0000","last_clean":"2024-08-31T06:46:18.644774+0000","last_became_active":"2024-08-31T06:45:19.940991+0000","last_became_peered":"2024-08-31T06:45:19.940991+0000","last_unstale":"2024-08-31T06:46:18.644774+0000","last_undegraded":"2024-08-31T06:46:18.644774+0000","last_fullsized":"2024-08-31T06:46:18.644774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:25.268854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940677+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:45:19.940677+0000","last_peered":"2024-08-31T06:45:19.940677+0000","last_clean":"2024-08-31T06:45:19.940677+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:45:19.940677+0000","last_undegraded":"2024-08-31T06:45:19.940677+0000","last_fullsized":"2024-08-31T06:45:19.940677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662071+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:46:18.662071+0000","last_peered":"2024-08-31T06:46:18.662071+0000","last_clean":"2024-08-31T06:46:18.662071+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:46:18.662071+0000","last_undegraded":"2024-08-31T06:46:18.662071+0000","last_fullsized":"2024-08-31T06:46:18.662071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748981+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:45:19.748981+0000","last_peered":"2024-08-31T06:45:19.748981+0000","last_clean":"2024-08-31T06:45:19.748981+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:45:19.748981+0000","last_undegraded":"2024-08-31T06:45:19.748981+0000","last_fullsized":"2024-08-31T06:45:19.748981+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.663152+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:46:18.663152+0000","last_peered":"2024-08-31T06:46:18.663152+0000","last_clean":"2024-08-31T06:46:18.663152+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:46:18.663152+0000","last_undegraded":"2024-08-31T06:46:18.663152+0000","last_fullsized":"2024-08-31T06:46:18.663152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753167+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:45:19.753167+0000","last_peered":"2024-08-31T06:45:19.753167+0000","last_clean":"2024-08-31T06:45:19.753167+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:45:19.753167+0000","last_undegraded":"2024-08-31T06:45:19.753167+0000","last_fullsized":"2024-08-31T06:45:19.753167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.667685+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:46:18.667685+0000","last_peered":"2024-08-31T06:46:18.667685+0000","last_clean":"2024-08-31T06:46:18.667685+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:46:18.667685+0000","last_undegraded":"2024-08-31T06:46:18.667685+0000","last_fullsized":"2024-08-31T06:46:18.667685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753541+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:45:19.753541+0000","last_peered":"2024-08-31T06:45:19.753541+0000","last_clean":"2024-08-31T06:45:19.753541+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:45:19.753541+0000","last_undegraded":"2024-08-31T06:45:19.753541+0000","last_fullsized":"2024-08-31T06:45:19.753541+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941116+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:45:19.941116+0000","last_peered":"2024-08-31T06:45:19.941116+0000","last_clean":"2024-08-31T06:45:19.941116+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:45:19.941116+0000","last_undegraded":"2024-08-31T06:45:19.941116+0000","last_fullsized":"2024-08-31T06:45:19.941116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658466+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:46:18.658466+0000","last_peered":"2024-08-31T06:46:18.658466+0000","last_clean":"2024-08-31T06:46:18.658466+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:46:18.658466+0000","last_undegraded":"2024-08-31T06:46:18.658466+0000","last_fullsized":"2024-08-31T06:46:18.658466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753142+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:45:19.753142+0000","last_peered":"2024-08-31T06:45:19.753142+0000","last_clean":"2024-08-31T06:45:19.753142+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:45:19.753142+0000","last_undegraded":"2024-08-31T06:45:19.753142+0000","last_fullsized":"2024-08-31T06:45:19.753142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647034+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:46:18.647034+0000","last_peered":"2024-08-31T06:46:18.647034+0000","last_clean":"2024-08-31T06:46:18.647034+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:46:18.647034+0000","last_undegraded":"2024-08-31T06:46:18.647034+0000","last_fullsized":"2024-08-31T06:46:18.647034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":131,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:33.848145+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:46:33.848145+0000","last_peered":"2024-08-31T06:46:33.848145+0000","last_clean":"2024-08-31T06:46:33.848145+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:46:33.848145+0000","last_undegraded":"2024-08-31T06:46:33.848145+0000","last_fullsized":"2024-08-31T06:46:33.848145+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647481+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:46:18.647481+0000","last_peered":"2024-08-31T06:46:18.647481+0000","last_clean":"2024-08-31T06:46:18.647481+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:46:18.647481+0000","last_undegraded":"2024-08-31T06:46:18.647481+0000","last_fullsized":"2024-08-31T06:46:18.647481+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753337+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:45:19.753337+0000","last_peered":"2024-08-31T06:45:19.753337+0000","last_clean":"2024-08-31T06:45:19.753337+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:45:19.753337+0000","last_undegraded":"2024-08-31T06:45:19.753337+0000","last_fullsized":"2024-08-31T06:45:19.753337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657118+0000","last_change":"2024-08-31T06:45:19.759585+0000","last_active":"2024-08-31T06:46:18.657118+0000","last_peered":"2024-08-31T06:46:18.657118+0000","last_clean":"2024-08-31T06:46:18.657118+0000","last_became_active":"2024-08-31T06:45:19.759026+0000","last_became_peered":"2024-08-31T06:45:19.759026+0000","last_unstale":"2024-08-31T06:46:18.657118+0000","last_undegraded":"2024-08-31T06:46:18.657118+0000","last_fullsized":"2024-08-31T06:46:18.657118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:54.716259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754330+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:45:19.754330+0000","last_peered":"2024-08-31T06:45:19.754330+0000","last_clean":"2024-08-31T06:45:19.754330+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:45:19.754330+0000","last_undegraded":"2024-08-31T06:45:19.754330+0000","last_fullsized":"2024-08-31T06:45:19.754330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656693+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:46:18.656693+0000","last_peered":"2024-08-31T06:46:18.656693+0000","last_clean":"2024-08-31T06:46:18.656693+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:46:18.656693+0000","last_undegraded":"2024-08-31T06:46:18.656693+0000","last_fullsized":"2024-08-31T06:46:18.656693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749624+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:45:19.749624+0000","last_peered":"2024-08-31T06:45:19.749624+0000","last_clean":"2024-08-31T06:45:19.749624+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:45:19.749624+0000","last_undegraded":"2024-08-31T06:45:19.749624+0000","last_fullsized":"2024-08-31T06:45:19.749624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640852+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:46:18.640852+0000","last_peered":"2024-08-31T06:46:18.640852+0000","last_clean":"2024-08-31T06:46:18.640852+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:46:18.640852+0000","last_undegraded":"2024-08-31T06:46:18.640852+0000","last_fullsized":"2024-08-31T06:46:18.640852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'14","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:29.666252+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:46:29.666252+0000","last_peered":"2024-08-31T06:46:29.666252+0000","last_clean":"2024-08-31T06:46:29.666252+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:46:29.666252+0000","last_undegraded":"2024-08-31T06:46:29.666252+0000","last_fullsized":"2024-08-31T06:46:29.666252+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639289+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:46:18.639289+0000","last_peered":"2024-08-31T06:46:18.639289+0000","last_clean":"2024-08-31T06:46:18.639289+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:46:18.639289+0000","last_undegraded":"2024-08-31T06:46:18.639289+0000","last_fullsized":"2024-08-31T06:46:18.639289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941154+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:45:19.941154+0000","last_peered":"2024-08-31T06:45:19.941154+0000","last_clean":"2024-08-31T06:45:19.941154+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:45:19.941154+0000","last_undegraded":"2024-08-31T06:45:19.941154+0000","last_fullsized":"2024-08-31T06:45:19.941154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659568+0000","last_change":"2024-08-31T06:45:19.942466+0000","last_active":"2024-08-31T06:46:18.659568+0000","last_peered":"2024-08-31T06:46:18.659568+0000","last_clean":"2024-08-31T06:46:18.659568+0000","last_became_active":"2024-08-31T06:45:19.941936+0000","last_became_peered":"2024-08-31T06:45:19.941936+0000","last_unstale":"2024-08-31T06:46:18.659568+0000","last_undegraded":"2024-08-31T06:46:18.659568+0000","last_fullsized":"2024-08-31T06:46:18.659568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:25.406883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.761034+0000","last_change":"2024-08-31T06:45:19.760954+0000","last_active":"2024-08-31T06:45:19.761034+0000","last_peered":"2024-08-31T06:45:19.761034+0000","last_clean":"2024-08-31T06:45:19.761034+0000","last_became_active":"2024-08-31T06:45:19.754797+0000","last_became_peered":"2024-08-31T06:45:19.754797+0000","last_unstale":"2024-08-31T06:45:19.761034+0000","last_undegraded":"2024-08-31T06:45:19.761034+0000","last_fullsized":"2024-08-31T06:45:19.761034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:25.559400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.614619+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:46:18.614619+0000","last_peered":"2024-08-31T06:46:18.614619+0000","last_clean":"2024-08-31T06:46:18.614619+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:46:18.614619+0000","last_undegraded":"2024-08-31T06:46:18.614619+0000","last_fullsized":"2024-08-31T06:46:18.614619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939437+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:45:19.939437+0000","last_peered":"2024-08-31T06:45:19.939437+0000","last_clean":"2024-08-31T06:45:19.939437+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:45:19.939437+0000","last_undegraded":"2024-08-31T06:45:19.939437+0000","last_fullsized":"2024-08-31T06:45:19.939437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.646654+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:46:18.646654+0000","last_peered":"2024-08-31T06:46:18.646654+0000","last_clean":"2024-08-31T06:46:18.646654+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:46:18.646654+0000","last_undegraded":"2024-08-31T06:46:18.646654+0000","last_fullsized":"2024-08-31T06:46:18.646654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751817+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:45:19.751817+0000","last_peered":"2024-08-31T06:45:19.751817+0000","last_clean":"2024-08-31T06:45:19.751817+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:45:19.751817+0000","last_undegraded":"2024-08-31T06:45:19.751817+0000","last_fullsized":"2024-08-31T06:45:19.751817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651274+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:46:18.651274+0000","last_peered":"2024-08-31T06:46:18.651274+0000","last_clean":"2024-08-31T06:46:18.651274+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:46:18.651274+0000","last_undegraded":"2024-08-31T06:46:18.651274+0000","last_fullsized":"2024-08-31T06:46:18.651274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670609+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:46:18.670609+0000","last_peered":"2024-08-31T06:46:18.670609+0000","last_clean":"2024-08-31T06:46:18.670609+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:46:18.670609+0000","last_undegraded":"2024-08-31T06:46:18.670609+0000","last_fullsized":"2024-08-31T06:46:18.670609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671752+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:46:18.671752+0000","last_peered":"2024-08-31T06:46:18.671752+0000","last_clean":"2024-08-31T06:46:18.671752+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:46:18.671752+0000","last_undegraded":"2024-08-31T06:46:18.671752+0000","last_fullsized":"2024-08-31T06:46:18.671752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756544+0000","last_change":"2024-08-31T06:45:19.756432+0000","last_active":"2024-08-31T06:45:19.756544+0000","last_peered":"2024-08-31T06:45:19.756544+0000","last_clean":"2024-08-31T06:45:19.756544+0000","last_became_active":"2024-08-31T06:45:19.751184+0000","last_became_peered":"2024-08-31T06:45:19.751184+0000","last_unstale":"2024-08-31T06:45:19.756544+0000","last_undegraded":"2024-08-31T06:45:19.756544+0000","last_fullsized":"2024-08-31T06:45:19.756544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:23.569829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670996+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:46:18.670996+0000","last_peered":"2024-08-31T06:46:18.670996+0000","last_clean":"2024-08-31T06:46:18.670996+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:46:18.670996+0000","last_undegraded":"2024-08-31T06:46:18.670996+0000","last_fullsized":"2024-08-31T06:46:18.670996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749443+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:45:19.749443+0000","last_peered":"2024-08-31T06:45:19.749443+0000","last_clean":"2024-08-31T06:45:19.749443+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:45:19.749443+0000","last_undegraded":"2024-08-31T06:45:19.749443+0000","last_fullsized":"2024-08-31T06:45:19.749443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665231+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:46:18.665231+0000","last_peered":"2024-08-31T06:46:18.665231+0000","last_clean":"2024-08-31T06:46:18.665231+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:46:18.665231+0000","last_undegraded":"2024-08-31T06:46:18.665231+0000","last_fullsized":"2024-08-31T06:46:18.665231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939975+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:45:19.939975+0000","last_peered":"2024-08-31T06:45:19.939975+0000","last_clean":"2024-08-31T06:45:19.939975+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:45:19.939975+0000","last_undegraded":"2024-08-31T06:45:19.939975+0000","last_fullsized":"2024-08-31T06:45:19.939975+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653688+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:46:18.653688+0000","last_peered":"2024-08-31T06:46:18.653688+0000","last_clean":"2024-08-31T06:46:18.653688+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:46:18.653688+0000","last_undegraded":"2024-08-31T06:46:18.653688+0000","last_fullsized":"2024-08-31T06:46:18.653688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754818+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:45:19.754818+0000","last_peered":"2024-08-31T06:45:19.754818+0000","last_clean":"2024-08-31T06:45:19.754818+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:45:19.754818+0000","last_undegraded":"2024-08-31T06:45:19.754818+0000","last_fullsized":"2024-08-31T06:45:19.754818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70869,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":644,"num_read_kb":404,"num_write":185,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":213780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776164,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":409286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939689,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1067392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103214,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":409522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266740,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":409442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1441792,"data_stored":1003813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":408911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790018,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36764,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708388,"statfs":{"total":95995035648,"available":95957389312,"internally_reserved":0,"allocated":1454080,"data_stored":1001690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":412020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149770,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":409222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378704,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":474641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542230,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36220,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708932,"statfs":{"total":95995035648,"available":95957946368,"internally_reserved":0,"allocated":897024,"data_stored":469208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":410182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":65937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:46:37.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:46:37.396 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:37.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:37 smithi037 ceph-mon[18612]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-08-31T06:46:37.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:37 smithi037 ceph-mon[18612]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:37.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:37 smithi037 ceph-mon[18612]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:37.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:37 smithi037 ceph-mon[18612]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/3697072418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 msgr2=0x7f7c941103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/3697072418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 0x7f7c941103c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009ca0 tx=0x7f7c8c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/3697072418 shutdown_connections 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/3697072418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 0x7f7c941103c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/3697072418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c94109240 0x7f7c94109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/3697072418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c94103900 0x7f7c94103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/3697072418 >> 172.21.15.37:0/3697072418 conn(0x7f7c9407b5f0 msgr2=0x7f7c9407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/3697072418 shutdown_connections 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/3697072418 wait complete. 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.883+0000 7f7c9a8d6640 1 Processor -- start 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c9a8d6640 1 -- start start 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c9a8d6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c94103900 0x7f7c9419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c9a8d6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c94109240 0x7f7c9419c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:37.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c9a8d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 0x7f7c941a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c9a8d6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c941137b0 con 0x7f7c94109b90 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c9a8d6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c94113630 con 0x7f7c94109240 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c9a8d6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7c94113930 con 0x7f7c94103900 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c98e73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 0x7f7c941a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c98e73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 0x7f7c941a1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32956/0 (socket says 172.21.15.37:32956) 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c98e73640 1 -- 172.21.15.37:0/1103799497 learned_addr learned my addr 172.21.15.37:0/1103799497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c937fe640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c94109240 0x7f7c9419c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c93fff640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c94103900 0x7f7c9419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c98e73640 1 -- 172.21.15.37:0/1103799497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c94103900 msgr2=0x7f7c9419c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:37.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c98e73640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c94103900 0x7f7c9419c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c98e73640 1 -- 172.21.15.37:0/1103799497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c94109240 msgr2=0x7f7c9419c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c98e73640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c94109240 0x7f7c9419c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.884+0000 7f7c98e73640 1 -- 172.21.15.37:0/1103799497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c941a2250 con 0x7f7c94109b90 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.885+0000 7f7c98e73640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 0x7f7c941a1be0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c005cc0 tx=0x7f7c8c032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.885+0000 7f7c917fa640 1 -- 172.21.15.37:0/1103799497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c004040 con 0x7f7c94109b90 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.885+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c941a24e0 con 0x7f7c94109b90 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.885+0000 7f7c917fa640 1 -- 172.21.15.37:0/1103799497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c8c004670 con 0x7f7c94109b90 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.885+0000 7f7c917fa640 1 -- 172.21.15.37:0/1103799497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c030cc0 con 0x7f7c94109b90 2024-08-31T06:46:37.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.885+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c941a8d60 con 0x7f7c94109b90 2024-08-31T06:46:37.890 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:37 smithi066 ceph-mon[22244]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-08-31T06:46:37.890 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:37 smithi066 ceph-mon[22244]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:37.890 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:37 smithi066 ceph-mon[22244]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:37.890 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:37 smithi066 ceph-mon[22244]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.886+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c94103d10 con 0x7f7c94109b90 2024-08-31T06:46:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.888+0000 7f7c917fa640 1 -- 172.21.15.37:0/1103799497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f7c8c0041e0 con 0x7f7c94109b90 2024-08-31T06:46:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.888+0000 7f7c917fa640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c7c0b4c40 0x7f7c7c0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.889+0000 7f7c93fff640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c7c0b4c40 0x7f7c7c0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.889+0000 7f7c917fa640 1 -- 172.21.15.37:0/1103799497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7c8c106960 con 0x7f7c94109b90 2024-08-31T06:46:37.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.889+0000 7f7c93fff640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c7c0b4c40 0x7f7c7c0b7150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009990 tx=0x7f7c84009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:37.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:37.893+0000 7f7c917fa640 1 -- 172.21.15.37:0/1103799497 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7c8c0cd910 con 0x7f7c94109b90 2024-08-31T06:46:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:37 smithi106 ceph-mon[22134]: pgmap v313: 97 pgs: 97 active+clean; 646 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-08-31T06:46:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:37 smithi106 ceph-mon[22134]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:37 smithi106 ceph-mon[22134]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:37 smithi106 ceph-mon[22134]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.117+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c9419d4d0 con 0x7f7c94109b90 2024-08-31T06:46:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.118+0000 7f7c917fa640 1 -- 172.21.15.37:0/1103799497 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f7c9419d4d0 con 0x7f7c94109b90 2024-08-31T06:46:38.119 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:38.119 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:46:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:46:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c7c0b4c40 msgr2=0x7f7c7c0b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c7c0b4c40 0x7f7c7c0b7150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c84009990 tx=0x7f7c84009110 comp rx=0 tx=0).stop 2024-08-31T06:46:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 msgr2=0x7f7c941a1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 0x7f7c941a1be0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c005cc0 tx=0x7f7c8c032c40 comp rx=0 tx=0).stop 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 shutdown_connections 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c7c0b4c40 0x7f7c7c0b7150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c94109b90 0x7f7c941a1be0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c94109240 0x7f7c9419c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 --2- 172.21.15.37:0/1103799497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c94103900 0x7f7c9419c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.120+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 >> 172.21.15.37:0/1103799497 conn(0x7f7c9407b5f0 msgr2=0x7f7c94107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.121+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 shutdown_connections 2024-08-31T06:46:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:38.121+0000 7f7c9a8d6640 1 -- 172.21.15.37:0/1103799497 wait complete. 2024-08-31T06:46:38.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:38 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1103799497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:38.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:46:38.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:38 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1103799497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:39.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:38 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1103799497' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:39.141 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 -- 172.21.15.37:0/1835940505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c103900 msgr2=0x7f992c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 --2- 172.21.15.37:0/1835940505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c103900 0x7f992c103d10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9928009900 tx=0x7f992802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:39.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 -- 172.21.15.37:0/1835940505 shutdown_connections 2024-08-31T06:46:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 --2- 172.21.15.37:0/1835940505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f992c109b90 0x7f992c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 --2- 172.21.15.37:0/1835940505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f992c109240 0x7f992c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 --2- 172.21.15.37:0/1835940505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c103900 0x7f992c103d10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 -- 172.21.15.37:0/1835940505 >> 172.21.15.37:0/1835940505 conn(0x7f992c07b5f0 msgr2=0x7f992c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 -- 172.21.15.37:0/1835940505 shutdown_connections 2024-08-31T06:46:39.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 -- 172.21.15.37:0/1835940505 wait complete. 2024-08-31T06:46:39.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.634+0000 7f9934482640 1 Processor -- start 2024-08-31T06:46:39.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9934482640 1 -- start start 2024-08-31T06:46:39.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9934482640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f992c103900 0x7f992c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:39.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9934482640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c109240 0x7f992c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:39.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9934482640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f992c109b90 0x7f992c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:39.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9934482640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f992c113700 con 0x7f992c109240 2024-08-31T06:46:39.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9934482640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f992c113580 con 0x7f992c103900 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9934482640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f992c113880 con 0x7f992c109b90 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9931a1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c109240 0x7f992c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9931a1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c109240 0x7f992c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32978/0 (socket says 172.21.15.37:32978) 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9931a1d640 1 -- 172.21.15.37:0/644731217 learned_addr learned my addr 172.21.15.37:0/644731217 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f993221e640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f992c103900 0x7f992c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9932a1f640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f992c109b90 0x7f992c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9931a1d640 1 -- 172.21.15.37:0/644731217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f992c109b90 msgr2=0x7f992c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9931a1d640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f992c109b90 0x7f992c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9931a1d640 1 -- 172.21.15.37:0/644731217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f992c103900 msgr2=0x7f992c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9931a1d640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f992c103900 0x7f992c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.635+0000 7f9931a1d640 1 -- 172.21.15.37:0/644731217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992c1a8410 con 0x7f992c109240 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.636+0000 7f9931a1d640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c109240 0x7f992c0759f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f991c00e9c0 tx=0x7f991c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:39.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.636+0000 7f99237fe640 1 -- 172.21.15.37:0/644731217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c00ccc0 con 0x7f992c109240 2024-08-31T06:46:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.636+0000 7f99237fe640 1 -- 172.21.15.37:0/644731217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f991c0054b0 con 0x7f992c109240 2024-08-31T06:46:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.636+0000 7f99237fe640 1 -- 172.21.15.37:0/644731217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991c010430 con 0x7f992c109240 2024-08-31T06:46:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.636+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992c1a8700 con 0x7f992c109240 2024-08-31T06:46:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.636+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f992c1a8bf0 con 0x7f992c109240 2024-08-31T06:46:39.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.637+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f992c103d10 con 0x7f992c109240 2024-08-31T06:46:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.638+0000 7f99237fe640 1 -- 172.21.15.37:0/644731217 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f991c004f20 con 0x7f992c109240 2024-08-31T06:46:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.639+0000 7f99237fe640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99180b4c10 0x7f99180b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.639+0000 7f993221e640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99180b4c10 0x7f99180b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.639+0000 7f99237fe640 1 -- 172.21.15.37:0/644731217 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f991c0e5750 con 0x7f992c109240 2024-08-31T06:46:39.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.640+0000 7f993221e640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99180b4c10 0x7f99180b7120 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f992c076f00 tx=0x7f99280058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:39.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.643+0000 7f99237fe640 1 -- 172.21.15.37:0/644731217 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f991c0ac640 con 0x7f992c109240 2024-08-31T06:46:39.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.830+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f992c10b3d0 con 0x7f992c109240 2024-08-31T06:46:39.832 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:39 smithi037 ceph-mon[18612]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T06:46:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.832+0000 7f99237fe640 1 -- 172.21.15.37:0/644731217 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+23049 (secure 0 0 0) 0x7f991c0abf40 con 0x7f992c109240 2024-08-31T06:46:39.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:39.833 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:45:19.740510+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:46:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99180b4c10 msgr2=0x7f99180b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99180b4c10 0x7f99180b7120 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f992c076f00 tx=0x7f99280058d0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c109240 msgr2=0x7f992c0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c109240 0x7f992c0759f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f991c00e9c0 tx=0x7f991c00ee80 comp rx=0 tx=0).stop 2024-08-31T06:46:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 shutdown_connections 2024-08-31T06:46:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f99180b4c10 0x7f99180b7120 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992c109240 0x7f992c0759f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f992c109b90 0x7f992c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 --2- 172.21.15.37:0/644731217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f992c103900 0x7f992c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 >> 172.21.15.37:0/644731217 conn(0x7f992c07b5f0 msgr2=0x7f992c107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 shutdown_connections 2024-08-31T06:46:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:39.834+0000 7f9934482640 1 -- 172.21.15.37:0/644731217 wait complete. 2024-08-31T06:46:39.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:39 smithi066 ceph-mon[22244]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T06:46:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:39 smithi106 ceph-mon[22134]: pgmap v314: 97 pgs: 97 active+clean; 647 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T06:46:40.568 DEBUG:tasks.fwd_scrub:Yielding 2024-08-31T06:46:40.569 INFO:teuthology.run_tasks:Running task exec... 2024-08-31T06:46:40.582 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T06:46:40.582 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:46:40.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-08-31T06:46:40.583 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-31T06:46:40.583 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:46:40.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:46:40.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 -- 172.21.15.37:0/2521265864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98108080 msgr2=0x7f5e98108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:40.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2521265864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98108080 0x7f5e98108490 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009900 tx=0x7f5e8002a410 comp rx=0 tx=0).stop 2024-08-31T06:46:40.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 -- 172.21.15.37:0/2521265864 shutdown_connections 2024-08-31T06:46:40.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2521265864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e98108080 0x7f5e98108490 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:40.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2521265864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e981089d0 0x7f5e9810f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2521265864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e98102750 0x7f5e98102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 -- 172.21.15.37:0/2521265864 >> 172.21.15.37:0/2521265864 conn(0x7f5e9807a4e0 msgr2=0x7f5e9807a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 -- 172.21.15.37:0/2521265864 shutdown_connections 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.700+0000 7f5e9d562640 1 -- 172.21.15.37:0/2521265864 wait complete. 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e9d562640 1 Processor -- start 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e9d562640 1 -- start start 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e9d562640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e98102750 0x7f5e9819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e9d562640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e98108080 0x7f5e9819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e9d562640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981089d0 0x7f5e9819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e9d562640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5e981124f0 con 0x7f5e981089d0 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e9d562640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98112370 con 0x7f5e98102750 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e9d562640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5e98112670 con 0x7f5e98108080 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981089d0 0x7f5e9819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:40.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981089d0 0x7f5e9819f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33004/0 (socket says 172.21.15.37:33004) 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e977fe640 1 -- 172.21.15.37:0/2138567699 learned_addr learned my addr 172.21.15.37:0/2138567699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e8ffff640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e98108080 0x7f5e9819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.701+0000 7f5e96ffd640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e98102750 0x7f5e9819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e977fe640 1 -- 172.21.15.37:0/2138567699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e98108080 msgr2=0x7f5e9819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e977fe640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e98108080 0x7f5e9819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e977fe640 1 -- 172.21.15.37:0/2138567699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e98102750 msgr2=0x7f5e9819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e977fe640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e98102750 0x7f5e9819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e977fe640 1 -- 172.21.15.37:0/2138567699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e981a0040 con 0x7f5e981089d0 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e977fe640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981089d0 0x7f5e9819f9d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000eaa0 tx=0x7f5e9000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e94ff9640 1 -- 172.21.15.37:0/2138567699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90004d20 con 0x7f5e981089d0 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e981a0330 con 0x7f5e981089d0 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e94ff9640 1 -- 172.21.15.37:0/2138567699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e90005020 con 0x7f5e981089d0 2024-08-31T06:46:40.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e94ff9640 1 -- 172.21.15.37:0/2138567699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e900116d0 con 0x7f5e981089d0 2024-08-31T06:46:40.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.702+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e981a0800 con 0x7f5e981089d0 2024-08-31T06:46:40.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.703+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e98102b60 con 0x7f5e981089d0 2024-08-31T06:46:40.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.706+0000 7f5e94ff9640 1 -- 172.21.15.37:0/2138567699 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f5e900051d0 con 0x7f5e981089d0 2024-08-31T06:46:40.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.707+0000 7f5e94ff9640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e840b4c10 0x7f5e840b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:40.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.707+0000 7f5e94ff9640 1 -- 172.21.15.37:0/2138567699 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f5e900e58d0 con 0x7f5e981089d0 2024-08-31T06:46:40.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.707+0000 7f5e96ffd640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e840b4c10 0x7f5e840b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:40.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.707+0000 7f5e96ffd640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e840b4c10 0x7f5e840b7120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800abe0 tx=0x7f5e8800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:40.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.710+0000 7f5e94ff9640 1 -- 172.21.15.37:0/2138567699 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5e981a0800 con 0x7f5e981089d0 2024-08-31T06:46:40.843 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:40.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:40 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/644731217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:40.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:40 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/644731217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:40.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:40.928+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5e980635a0 con 0x7f5e840b4c10 2024-08-31T06:46:41.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:40 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/644731217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:41.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.099+0000 7f5e94ff9640 1 -- 172.21.15.37:0/2138567699 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5e980635a0 con 0x7f5e840b4c10 2024-08-31T06:46:41.100 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path / 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e840b4c10 msgr2=0x7f5e840b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e840b4c10 0x7f5e840b7120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800abe0 tx=0x7f5e8800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981089d0 msgr2=0x7f5e9819f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981089d0 0x7f5e9819f9d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5e9000eaa0 tx=0x7f5e9000eea0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 shutdown_connections 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5e840b4c10 0x7f5e840b7120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e981089d0 0x7f5e9819f9d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e98108080 0x7f5e9819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 --2- 172.21.15.37:0/2138567699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e98102750 0x7f5e9819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 >> 172.21.15.37:0/2138567699 conn(0x7f5e9807a4e0 msgr2=0x7f5e981018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.101+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 shutdown_connections 2024-08-31T06:46:41.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.102+0000 7f5e9d562640 1 -- 172.21.15.37:0/2138567699 wait complete. 2024-08-31T06:46:41.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-08-31T06:46:41.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 -- 172.21.15.37:0/2581913369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81025c0 msgr2=0x7f44b8112250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 --2- 172.21.15.37:0/2581913369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81025c0 0x7f44b8112250 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009ca0 tx=0x7f44b002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 -- 172.21.15.37:0/2581913369 shutdown_connections 2024-08-31T06:46:41.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 --2- 172.21.15.37:0/2581913369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81025c0 0x7f44b8112250 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 --2- 172.21.15.37:0/2581913369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44b8101af0 0x7f44b8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 --2- 172.21.15.37:0/2581913369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44b81043a0 0x7f44b81047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 -- 172.21.15.37:0/2581913369 >> 172.21.15.37:0/2581913369 conn(0x7f44b8079aa0 msgr2=0x7f44b8079ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 -- 172.21.15.37:0/2581913369 shutdown_connections 2024-08-31T06:46:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 -- 172.21.15.37:0/2581913369 wait complete. 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.231+0000 7f44bf80e640 1 Processor -- start 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bf80e640 1 -- start start 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bf80e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44b8101af0 0x7f44b819c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bf80e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44b81025c0 0x7f44b819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bf80e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81043a0 0x7f44b81a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bf80e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44b81158c0 con 0x7f44b81043a0 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bf80e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44b8115740 con 0x7f44b8101af0 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bf80e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f44b8115a40 con 0x7f44b81025c0 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81043a0 0x7f44b81a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81043a0 0x7f44b81a1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33038/0 (socket says 172.21.15.37:33038) 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 -- 172.21.15.37:0/3968910803 learned_addr learned my addr 172.21.15.37:0/3968910803 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bd5aa640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44b8101af0 0x7f44b819c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bcda9640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44b81025c0 0x7f44b819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 -- 172.21.15.37:0/3968910803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44b81025c0 msgr2=0x7f44b819c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44b81025c0 0x7f44b819c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 -- 172.21.15.37:0/3968910803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44b8101af0 msgr2=0x7f44b819c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44b8101af0 0x7f44b819c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 -- 172.21.15.37:0/3968910803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b81a2250 con 0x7f44b81043a0 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bcda9640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44b81025c0 0x7f44b819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.232+0000 7f44bddab640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81043a0 0x7f44b81a1b50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f44b0005e30 tx=0x7f44b00093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.233+0000 7f44aa7fc640 1 -- 172.21.15.37:0/3968910803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0032d10 con 0x7f44b81043a0 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.233+0000 7f44aa7fc640 1 -- 172.21.15.37:0/3968910803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44b0032eb0 con 0x7f44b81043a0 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.233+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b81a24e0 con 0x7f44b81043a0 2024-08-31T06:46:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.233+0000 7f44aa7fc640 1 -- 172.21.15.37:0/3968910803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b0030b20 con 0x7f44b81043a0 2024-08-31T06:46:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.233+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b81a8cd0 con 0x7f44b81043a0 2024-08-31T06:46:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.234+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b8101f00 con 0x7f44b81043a0 2024-08-31T06:46:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.235+0000 7f44aa7fc640 1 -- 172.21.15.37:0/3968910803 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f44b0030cc0 con 0x7f44b81043a0 2024-08-31T06:46:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.236+0000 7f44aa7fc640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44a40b4c90 0x7f44a40b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.236+0000 7f44aa7fc640 1 -- 172.21.15.37:0/3968910803 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f44b0106790 con 0x7f44b81043a0 2024-08-31T06:46:41.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.236+0000 7f44bd5aa640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44a40b4c90 0x7f44a40b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.236+0000 7f44bd5aa640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44a40b4c90 0x7f44a40b71a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f44b4005fd0 tx=0x7f44b4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.239+0000 7f44aa7fc640 1 -- 172.21.15.37:0/3968910803 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f44b00cd680 con 0x7f44b81043a0 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 -- 172.21.15.37:0/147350479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109bd0 msgr2=0x7f39c4110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 --2- 172.21.15.37:0/147350479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109bd0 0x7f39c4110400 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009ca0 tx=0x7f39bc02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 -- 172.21.15.37:0/147350479 shutdown_connections 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 --2- 172.21.15.37:0/147350479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109bd0 0x7f39c4110400 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 --2- 172.21.15.37:0/147350479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39c4109280 0x7f39c4109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 --2- 172.21.15.37:0/147350479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39c4103940 0x7f39c4103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 -- 172.21.15.37:0/147350479 >> 172.21.15.37:0/147350479 conn(0x7f39c40ff3d0 msgr2=0x7f39c4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 -- 172.21.15.37:0/147350479 shutdown_connections 2024-08-31T06:46:41.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 -- 172.21.15.37:0/147350479 wait complete. 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.339+0000 7f39cae54640 1 Processor -- start 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39cae54640 1 -- start start 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39cae54640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39c4103940 0x7f39c40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39cae54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109280 0x7f39c40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39cae54640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39c4109bd0 0x7f39c4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39cae54640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39c4113790 con 0x7f39c4109280 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39cae54640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39c4113610 con 0x7f39c4109bd0 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39cae54640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f39c4113910 con 0x7f39c4103940 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109280 0x7f39c40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109280 0x7f39c40759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33066/0 (socket says 172.21.15.37:33066) 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c3fff640 1 -- 172.21.15.37:0/1870780863 learned_addr learned my addr 172.21.15.37:0/1870780863 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39c4103940 0x7f39c40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c93f1640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39c4109bd0 0x7f39c4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c3fff640 1 -- 172.21.15.37:0/1870780863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39c4103940 msgr2=0x7f39c40754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c3fff640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39c4103940 0x7f39c40754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c3fff640 1 -- 172.21.15.37:0/1870780863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39c4109bd0 msgr2=0x7f39c4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c3fff640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39c4109bd0 0x7f39c4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.340+0000 7f39c3fff640 1 -- 172.21.15.37:0/1870780863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c41a83e0 con 0x7f39c4109280 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.341+0000 7f39c3fff640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109280 0x7f39c40759f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f39b000e9c0 tx=0x7f39b000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.341+0000 7f39c1ffb640 1 -- 172.21.15.37:0/1870780863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b000ccc0 con 0x7f39c4109280 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.341+0000 7f39cae54640 1 -- 172.21.15.37:0/1870780863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c41a86d0 con 0x7f39c4109280 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.341+0000 7f39c1ffb640 1 -- 172.21.15.37:0/1870780863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39b00054b0 con 0x7f39c4109280 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.341+0000 7f39c1ffb640 1 -- 172.21.15.37:0/1870780863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0010430 con 0x7f39c4109280 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.341+0000 7f39cae54640 1 -- 172.21.15.37:0/1870780863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c41a8c10 con 0x7f39c4109280 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39d13c9740 1 Processor -- start 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39d13c9740 1 -- start start 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 0x555fa916c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39d13c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555fa90e15f0 con 0x555fa8dc5350 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39d13c9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555fa90d0b80 con 0x555fa8da4670 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39d13c9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x555fa90d4b30 con 0x555fa8d9c490 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39c93f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39c93f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33082/0 (socket says 172.21.15.37:33082) 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39c93f1640 1 -- 172.21.15.37:0/3045343985 learned_addr learned my addr 172.21.15.37:0/3045343985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.344+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39c8bf0640 1 -- 172.21.15.37:0/3045343985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 msgr2=0x555fa916c200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 0x555fa916c200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39c8bf0640 1 -- 172.21.15.37:0/3045343985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 msgr2=0x555fa916b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39c8bf0640 1 -- 172.21.15.37:0/3045343985 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fa8e30930 con 0x555fa8d9c490 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39c93f1640 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916bcc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39b8005d00 tx=0x7f39b80107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66cbe70b0e2d1bde server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39aeffd640 1 -- 172.21.15.37:0/3045343985 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8004220 con 0x555fa8d9c490 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39aeffd640 1 -- 172.21.15.37:0/3045343985 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39b800be20 con 0x555fa8d9c490 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39c1ffb640 1 -- 172.21.15.37:0/1870780863 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f39b0004f20 con 0x7f39c4109280 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.345+0000 7f39aeffd640 1 -- 172.21.15.37:0/3045343985 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80116a0 con 0x555fa8d9c490 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39c1ffb640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f39b40b4c10 0x7f39b40b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39d13c9740 1 -- 172.21.15.37:0/3045343985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 msgr2=0x555fa916bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39d13c9740 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916bcc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39b8005d00 tx=0x7f39b80107a0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39c93f1640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f39b40b4c10 0x7f39b40b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39d13c9740 1 -- 172.21.15.37:0/3045343985 shutdown_connections 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39c1ffb640 1 -- 172.21.15.37:0/1870780863 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f39b00e57b0 con 0x7f39c4109280 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39d13c9740 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 0x555fa916c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39d13c9740 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916bcc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39d13c9740 1 --2- 172.21.15.37:0/3045343985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.346+0000 7f39d13c9740 1 -- 172.21.15.37:0/3045343985 >> 172.21.15.37:0/3045343985 conn(0x555fa8db9740 msgr2=0x555fa9169670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.347+0000 7f39d13c9740 1 -- 172.21.15.37:0/3045343985 shutdown_connections 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.347+0000 7f39d13c9740 1 -- 172.21.15.37:0/3045343985 wait complete. 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.347+0000 7f39c93f1640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f39b40b4c10 0x7f39b40b7120 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0094e0 tx=0x7f39bc005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.347+0000 7f39d13c9740 1 -- start start 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.347+0000 7f39d13c9740 1 Processor -- start 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa9177040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8da4670 0x555fa9177620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8dc5350 0x555fa9183280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39d13c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555fa8f33890 con 0x555fa8da4670 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39d13c9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555fa9057790 con 0x555fa8d9c490 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39d13c9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x555fa9179f60 con 0x555fa8dc5350 2024-08-31T06:46:41.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39d13c9740 10 client.0 _ll_register_callbacks cb 0x555fa8ddcba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8da4670 0x555fa9177620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8da4670 0x555fa9177620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33098/0 (socket says 172.21.15.37:33098) 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 -- 172.21.15.37:0/1961441925 learned_addr learned my addr 172.21.15.37:0/1961441925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c93f1640 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8dc5350 0x555fa9183280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa9177040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 -- 172.21.15.37:0/1961441925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8dc5350 msgr2=0x555fa9183280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8dc5350 0x555fa9183280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 -- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 msgr2=0x555fa9177040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa9177040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 -- 172.21.15.37:0/1961441925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fa908ef30 con 0x555fa8da4670 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa9177040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39c3fff640 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8da4670 0x555fa9177620 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f39b00a9210 tx=0x7f39b000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90f4008ec307c54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.348+0000 7f39a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:41.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39a3fff640 1 -- 172.21.15.37:0/1961441925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00d2030 con 0x555fa8da4670 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39a3fff640 1 -- 172.21.15.37:0/1961441925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f39b0005210 con 0x555fa8da4670 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 1 -- 172.21.15.37:0/1961441925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39b800be20 con 0x555fa8da4670 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39a3fff640 1 -- 172.21.15.37:0/1961441925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f39b00b0810 con 0x555fa8da4670 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 10 client.15495 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 1 -- 172.21.15.37:0/1961441925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fa9185eb0 con 0x555fa8da4670 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39a3fff640 1 -- 172.21.15.37:0/1961441925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39b800be20 con 0x555fa8da4670 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39a3fff640 1 -- 172.21.15.37:0/1961441925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f39b00b0360 con 0x555fa8da4670 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 10 client.15495 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 10 client.15495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 20 client.15495 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555fa8d83cd0 0x555fa91893c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 4 client.15495 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.349+0000 7f39d13c9740 1 -- 172.21.15.37:0/1961441925 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fa90e3540 con 0x555fa8d83cd0 2024-08-31T06:46:41.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.350+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555fa8d83cd0 0x555fa91893c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.350+0000 7f39a3fff640 10 client.15495 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.350+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555fa8d83cd0 0x555fa91893c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a66dc0f645839c6 server_cookie=61820f223d587217 in_seq=0 out_seq=0 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39a3fff640 1 -- 172.21.15.37:0/1961441925 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555fa90e3540 con 0x555fa8d83cd0 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39a3fff640 10 client.15495 handle_command_reply: tid=0 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 client.15495 shutdown 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 -- 172.21.15.37:0/1961441925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8da4670 msgr2=0x555fa9177620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8da4670 0x555fa9177620 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f39b00a9210 tx=0x7f39b000cf20 comp rx=0 tx=0).stop 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 -- 172.21.15.37:0/1961441925 shutdown_connections 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555fa8d83cd0 0x555fa91893c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8da4670 0x555fa9177620 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8dc5350 0x555fa9183280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39a3fff640 0 client.15495 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 --2- 172.21.15.37:0/1961441925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa9177040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.351+0000 7f39d13c9740 1 -- 172.21.15.37:0/1961441925 >> 172.21.15.37:0/1961441925 conn(0x555fa8db9740 msgr2=0x555fa916e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.352+0000 7f39d13c9740 1 -- 172.21.15.37:0/1961441925 shutdown_connections 2024-08-31T06:46:41.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.352+0000 7f39d13c9740 1 -- 172.21.15.37:0/1961441925 wait complete. 2024-08-31T06:46:41.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.352+0000 7f39d13c9740 20 client.15495 trim_cache size 0 max 16384 2024-08-31T06:46:41.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.370+0000 7f39d13c9740 1 Processor -- start 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.370+0000 7f39d13c9740 1 -- start start 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.370+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.370+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 0x555fa91727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.370+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.370+0000 7f39d13c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39c41b3df0 con 0x555fa8dc5350 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.370+0000 7f39d13c9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39c41b16c0 con 0x555fa8da4670 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.370+0000 7f39d13c9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f39c41af510 con 0x555fa8d9c490 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33104/0 (socket says 172.21.15.37:33104) 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 -- 172.21.15.37:0/2141656578 learned_addr learned my addr 172.21.15.37:0/2141656578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c3fff640 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 0x555fa91727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 -- 172.21.15.37:0/2141656578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 msgr2=0x555fa916f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 -- 172.21.15.37:0/2141656578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 msgr2=0x555fa91727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 0x555fa91727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 -- 172.21.15.37:0/2141656578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fa9175fa0 con 0x555fa8dc5350 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.371+0000 7f39c93f1640 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916cec0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f39bc005e30 tx=0x7f39bc041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b772adbcb77d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.372+0000 7f39ae7fc640 1 -- 172.21.15.37:0/2141656578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc031980 con 0x555fa8dc5350 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.372+0000 7f39ae7fc640 1 -- 172.21.15.37:0/2141656578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39bc036040 con 0x555fa8dc5350 2024-08-31T06:46:41.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.372+0000 7f39ae7fc640 1 -- 172.21.15.37:0/2141656578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0047c0 con 0x555fa8dc5350 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.372+0000 7f39d13c9740 1 -- 172.21.15.37:0/2141656578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 msgr2=0x555fa916cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.372+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916cec0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f39bc005e30 tx=0x7f39bc041000 comp rx=0 tx=0).stop 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 -- 172.21.15.37:0/2141656578 shutdown_connections 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa916cec0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8da4670 0x555fa91727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2141656578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8d9c490 0x555fa916f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 -- 172.21.15.37:0/2141656578 >> 172.21.15.37:0/2141656578 conn(0x555fa8db9740 msgr2=0x555fa916c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 -- 172.21.15.37:0/2141656578 shutdown_connections 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 -- 172.21.15.37:0/2141656578 wait complete. 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 -- start start 2024-08-31T06:46:41.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.373+0000 7f39d13c9740 1 Processor -- start 2024-08-31T06:46:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa917c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8da4670 0x555fa917c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39d13c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa917cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39d13c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39c41afb80 con 0x555fa8dc5350 2024-08-31T06:46:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39d13c9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f39c41b0ff0 con 0x555fa8d9c490 2024-08-31T06:46:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39d13c9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f39c41b0250 con 0x555fa8da4670 2024-08-31T06:46:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39d13c9740 10 client.0 _ll_register_callbacks cb 0x7f39b00096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:41.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8da4670 0x555fa917c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c8bf0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa917c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c93f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa917cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8da4670 0x555fa917c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:58830/0 (socket says 172.21.15.37:58830) 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c3fff640 1 -- 172.21.15.37:0/2827639989 learned_addr learned my addr 172.21.15.37:0/2827639989 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c93f1640 1 -- 172.21.15.37:0/2827639989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8da4670 msgr2=0x555fa917c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c93f1640 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8da4670 0x555fa917c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c93f1640 1 -- 172.21.15.37:0/2827639989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 msgr2=0x555fa917c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c93f1640 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa917c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c93f1640 1 -- 172.21.15.37:0/2827639989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fa91f3db0 con 0x555fa8dc5350 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c3fff640 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8da4670 0x555fa917c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.374+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa917c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39c93f1640 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa917cd00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009a60 tx=0x7f39bc004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6274852a186d19 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39a3fff640 1 -- 172.21.15.37:0/2827639989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc031980 con 0x555fa8dc5350 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39a3fff640 1 -- 172.21.15.37:0/2827639989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f39bc031b20 con 0x555fa8dc5350 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39d13c9740 1 -- 172.21.15.37:0/2827639989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39bc036040 con 0x555fa8dc5350 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39a3fff640 1 -- 172.21.15.37:0/2827639989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f39bc031d20 con 0x555fa8dc5350 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39d13c9740 10 client.15501 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39d13c9740 1 -- 172.21.15.37:0/2827639989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fa91f5070 con 0x555fa8dc5350 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39a3fff640 1 -- 172.21.15.37:0/2827639989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f39bc036040 con 0x555fa8dc5350 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.375+0000 7f39a3fff640 1 -- 172.21.15.37:0/2827639989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f39bc030ac0 con 0x555fa8dc5350 2024-08-31T06:46:41.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.376+0000 7f39d13c9740 10 client.15501 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.376+0000 7f39d13c9740 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:46:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.376+0000 7f39d13c9740 20 client.15501 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.376+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555fa8d59080 0x555fa91f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.376+0000 7f39d13c9740 4 client.15501 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:46:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.376+0000 7f39d13c9740 1 -- 172.21.15.37:0/2827639989 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555fa90defe0 con 0x555fa8d59080 2024-08-31T06:46:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.376+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555fa8d59080 0x555fa91f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.376+0000 7f39a3fff640 10 client.15501 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:41.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.377+0000 7f39c8bf0640 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555fa8d59080 0x555fa91f77f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1ea523db5d4f825 server_cookie=163052e9a465cc68 in_seq=0 out_seq=0 2024-08-31T06:46:41.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.378+0000 7f39a3fff640 1 -- 172.21.15.37:0/2827639989 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555fa90defe0 con 0x555fa8d59080 2024-08-31T06:46:41.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.378+0000 7f39a3fff640 10 client.15501 handle_command_reply: tid=0 2024-08-31T06:46:41.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.378+0000 7f39d13c9740 1 client.15501 shutdown 2024-08-31T06:46:41.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 -- 172.21.15.37:0/2827639989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 msgr2=0x555fa917cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa917cd00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009a60 tx=0x7f39bc004080 comp rx=0 tx=0).stop 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 -- 172.21.15.37:0/2827639989 shutdown_connections 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555fa8d59080 0x555fa91f77f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555fa8dc5350 0x555fa917cd00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555fa8da4670 0x555fa917c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 --2- 172.21.15.37:0/2827639989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555fa8d9c490 0x555fa917c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 -- 172.21.15.37:0/2827639989 >> 172.21.15.37:0/2827639989 conn(0x555fa8db9740 msgr2=0x555fa916f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39a3fff640 0 client.15501 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 -- 172.21.15.37:0/2827639989 shutdown_connections 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 1 -- 172.21.15.37:0/2827639989 wait complete. 2024-08-31T06:46:41.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.379+0000 7f39d13c9740 20 client.15501 trim_cache size 0 max 16384 2024-08-31T06:46:41.386 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:46:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d", 2024-08-31T06:46:41.386 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:46:41.386 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:41.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 -- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f39b40b4c10 msgr2=0x7f39b40b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f39b40b4c10 0x7f39b40b7120 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0094e0 tx=0x7f39bc005c50 comp rx=0 tx=0).stop 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 -- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109280 msgr2=0x7f39c40759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109280 0x7f39c40759f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f39b000e9c0 tx=0x7f39b000ee80 comp rx=0 tx=0).stop 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 -- 172.21.15.37:0/1870780863 shutdown_connections 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f39b40b4c10 0x7f39b40b7120 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c4109280 0x7f39c40759f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39c4109bd0 0x7f39c4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 --2- 172.21.15.37:0/1870780863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f39c4103940 0x7f39c40754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 -- 172.21.15.37:0/1870780863 >> 172.21.15.37:0/1870780863 conn(0x7f39c40ff3d0 msgr2=0x7f39c41017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 -- 172.21.15.37:0/1870780863 shutdown_connections 2024-08-31T06:46:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.380+0000 7f39cae54640 1 -- 172.21.15.37:0/1870780863 wait complete. 2024-08-31T06:46:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.458+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f44b80635a0 con 0x7f44a40b4c90 2024-08-31T06:46:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.523+0000 7f44aa7fc640 1 -- 172.21.15.37:0/3968910803 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f44b80635a0 con 0x7f44a40b4c90 2024-08-31T06:46:41.525 INFO:teuthology.orchestra.run.smithi037.stdout:Retention added to path / 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.525+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44a40b4c90 msgr2=0x7f44a40b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.525+0000 7f44bf80e640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44a40b4c90 0x7f44a40b71a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f44b4005fd0 tx=0x7f44b4005850 comp rx=0 tx=0).stop 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.525+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81043a0 msgr2=0x7f44b81a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.525+0000 7f44bf80e640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81043a0 0x7f44b81a1b50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f44b0005e30 tx=0x7f44b00093d0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.526+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 shutdown_connections 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.526+0000 7f44bf80e640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44a40b4c90 0x7f44a40b71a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.526+0000 7f44bf80e640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b81043a0 0x7f44b81a1b50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.526+0000 7f44bf80e640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44b81025c0 0x7f44b819c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.526+0000 7f44bf80e640 1 --2- 172.21.15.37:0/3968910803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44b8101af0 0x7f44b819c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.526+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 >> 172.21.15.37:0/3968910803 conn(0x7f44b8079aa0 msgr2=0x7f44b80ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.526+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 shutdown_connections 2024-08-31T06:46:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.526+0000 7f44bf80e640 1 -- 172.21.15.37:0/3968910803 wait complete. 2024-08-31T06:46:41.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-31T06:46:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.652+0000 7f40e93e6640 1 -- 172.21.15.37:0/2603925080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4101f20 msgr2=0x7f40e4102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.652+0000 7f40e93e6640 1 --2- 172.21.15.37:0/2603925080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4101f20 0x7f40e4102330 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009900 tx=0x7f40d402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.652+0000 7f40e93e6640 1 -- 172.21.15.37:0/2603925080 shutdown_connections 2024-08-31T06:46:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.652+0000 7f40e93e6640 1 --2- 172.21.15.37:0/2603925080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e41081a0 0x7f40e410e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.653+0000 7f40e93e6640 1 --2- 172.21.15.37:0/2603925080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40e4107850 0x7f40e4107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.653+0000 7f40e93e6640 1 --2- 172.21.15.37:0/2603925080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4101f20 0x7f40e4102330 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.653+0000 7f40e93e6640 1 -- 172.21.15.37:0/2603925080 >> 172.21.15.37:0/2603925080 conn(0x7f40e4079c30 msgr2=0x7f40e407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.653+0000 7f40e93e6640 1 -- 172.21.15.37:0/2603925080 shutdown_connections 2024-08-31T06:46:41.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.653+0000 7f40e93e6640 1 -- 172.21.15.37:0/2603925080 wait complete. 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.654+0000 7f40e93e6640 1 Processor -- start 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.654+0000 7f40e93e6640 1 -- start start 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.654+0000 7f40e93e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40e4101f20 0x7f40e41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.654+0000 7f40e93e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4107850 0x7f40e4199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.654+0000 7f40e93e6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e41081a0 0x7f40e419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.654+0000 7f40e93e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4111d10 con 0x7f40e4107850 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.654+0000 7f40e93e6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4111b90 con 0x7f40e4101f20 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.654+0000 7f40e93e6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4111e90 con 0x7f40e41081a0 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4107850 0x7f40e4199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4107850 0x7f40e4199d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33132/0 (socket says 172.21.15.37:33132) 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 -- 172.21.15.37:0/3294061735 learned_addr learned my addr 172.21.15.37:0/3294061735 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e2ffd640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40e4101f20 0x7f40e41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e37fe640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e41081a0 0x7f40e419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 -- 172.21.15.37:0/3294061735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e41081a0 msgr2=0x7f40e419c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e41081a0 0x7f40e419c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 -- 172.21.15.37:0/3294061735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40e4101f20 msgr2=0x7f40e41997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40e4101f20 0x7f40e41997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 -- 172.21.15.37:0/3294061735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e419cd80 con 0x7f40e4107850 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e27fc640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4107850 0x7f40e4199d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f40d800c8c0 tx=0x7f40d800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40cbfff640 1 -- 172.21.15.37:0/3294061735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8007bb0 con 0x7f40e4107850 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e419d070 con 0x7f40e4107850 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40cbfff640 1 -- 172.21.15.37:0/3294061735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d8007d50 con 0x7f40e4107850 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40cbfff640 1 -- 172.21.15.37:0/3294061735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8018660 con 0x7f40e4107850 2024-08-31T06:46:41.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.655+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e41a5a80 con 0x7f40e4107850 2024-08-31T06:46:41.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.657+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e4102330 con 0x7f40e4107850 2024-08-31T06:46:41.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.658+0000 7f40cbfff640 1 -- 172.21.15.37:0/3294061735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f40d800f450 con 0x7f40e4107850 2024-08-31T06:46:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.659+0000 7f40cbfff640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40cc0b4c10 0x7f40cc0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.659+0000 7f40e2ffd640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40cc0b4c10 0x7f40cc0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.659+0000 7f40cbfff640 1 -- 172.21.15.37:0/3294061735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f40d80e5540 con 0x7f40e4107850 2024-08-31T06:46:41.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.660+0000 7f40e2ffd640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40cc0b4c10 0x7f40cc0b7120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f40d40057c0 tx=0x7f40d40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:41.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.664+0000 7f40cbfff640 1 -- 172.21.15.37:0/3294061735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f40d8014030 con 0x7f40e4107850 2024-08-31T06:46:41.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:41 smithi037 ceph-mon[18612]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T06:46:41.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:41 smithi037 ceph-mon[18612]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:41.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.873+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f40e40635a0 con 0x7f40cc0b4c10 2024-08-31T06:46:41.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.880+0000 7f40cbfff640 1 -- 172.21.15.37:0/3294061735 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f40e40635a0 con 0x7f40cc0b4c10 2024-08-31T06:46:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-31T00:00:00", "created": "2024-08-31T06:46:40", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-08-31T06:46:41.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40cc0b4c10 msgr2=0x7f40cc0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40cc0b4c10 0x7f40cc0b7120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f40d40057c0 tx=0x7f40d40058d0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4107850 msgr2=0x7f40e4199d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4107850 0x7f40e4199d80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f40d800c8c0 tx=0x7f40d800cd80 comp rx=0 tx=0).stop 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 shutdown_connections 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40cc0b4c10 0x7f40cc0b7120 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e4107850 0x7f40e4199d80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e41081a0 0x7f40e419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 --2- 172.21.15.37:0/3294061735 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40e4101f20 0x7f40e41997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 >> 172.21.15.37:0/3294061735 conn(0x7f40e4079c30 msgr2=0x7f40e41059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.882+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 shutdown_connections 2024-08-31T06:46:41.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:41.883+0000 7f40e93e6640 1 -- 172.21.15.37:0/3294061735 wait complete. 2024-08-31T06:46:41.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:41 smithi066 ceph-mon[22244]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T06:46:41.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:41 smithi066 ceph-mon[22244]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:41.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-31T06:46:42.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 -- 172.21.15.37:0/1220597860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10108080 msgr2=0x7f7e10108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1220597860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10108080 0x7f7e10108490 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009900 tx=0x7f7dfc02a410 comp rx=0 tx=0).stop 2024-08-31T06:46:42.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 -- 172.21.15.37:0/1220597860 shutdown_connections 2024-08-31T06:46:42.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1220597860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10108080 0x7f7e10108490 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1220597860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e101089d0 0x7f7e1010f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1220597860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e10102750 0x7f7e10102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 -- 172.21.15.37:0/1220597860 >> 172.21.15.37:0/1220597860 conn(0x7f7e1007a4e0 msgr2=0x7f7e1007a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:42.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 -- 172.21.15.37:0/1220597860 shutdown_connections 2024-08-31T06:46:42.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 -- 172.21.15.37:0/1220597860 wait complete. 2024-08-31T06:46:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 Processor -- start 2024-08-31T06:46:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.010+0000 7f7e16fba640 1 -- start start 2024-08-31T06:46:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e16fba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10102750 0x7f7e1010fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e16fba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e10108080 0x7f7e10110220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e16fba640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e101089d0 0x7f7e10110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e16fba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7e10113660 con 0x7f7e10102750 2024-08-31T06:46:42.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e16fba640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101134e0 con 0x7f7e10108080 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e16fba640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7e101137e0 con 0x7f7e101089d0 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10102750 0x7f7e1010fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10102750 0x7f7e1010fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33150/0 (socket says 172.21.15.37:33150) 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 -- 172.21.15.37:0/1497641253 learned_addr learned my addr 172.21.15.37:0/1497641253 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e15557640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e101089d0 0x7f7e10110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e0ffff640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e10108080 0x7f7e10110220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 -- 172.21.15.37:0/1497641253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e101089d0 msgr2=0x7f7e10110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e101089d0 0x7f7e10110760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 -- 172.21.15.37:0/1497641253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e10108080 msgr2=0x7f7e10110220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e10108080 0x7f7e10110220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 -- 172.21.15.37:0/1497641253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e101a83d0 con 0x7f7e10102750 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e0ffff640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e10108080 0x7f7e10110220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:42.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.011+0000 7f7e14d56640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10102750 0x7f7e1010fce0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e9f0 tx=0x7f7e0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.012+0000 7f7e0dffb640 1 -- 172.21.15.37:0/1497641253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400cd80 con 0x7f7e10102750 2024-08-31T06:46:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.012+0000 7f7e0dffb640 1 -- 172.21.15.37:0/1497641253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e040108c0 con 0x7f7e10102750 2024-08-31T06:46:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.012+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e101a86c0 con 0x7f7e10102750 2024-08-31T06:46:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.012+0000 7f7e0dffb640 1 -- 172.21.15.37:0/1497641253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040187c0 con 0x7f7e10102750 2024-08-31T06:46:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.012+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e101a8c10 con 0x7f7e10102750 2024-08-31T06:46:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.013+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e10102b60 con 0x7f7e10102750 2024-08-31T06:46:42.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.016+0000 7f7e0dffb640 1 -- 172.21.15.37:0/1497641253 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) ==== 152645+0+0 (secure 0 0 0) 0x7f7e04010430 con 0x7f7e10102750 2024-08-31T06:46:42.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.017+0000 7f7e0dffb640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7e000b4c40 0x7f7e000b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.017+0000 7f7e0ffff640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7e000b4c40 0x7f7e000b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.017+0000 7f7e0dffb640 1 -- 172.21.15.37:0/1497641253 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7e040e5d10 con 0x7f7e10102750 2024-08-31T06:46:42.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.017+0000 7f7e0ffff640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7e000b4c40 0x7f7e000b7150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc006010 tx=0x7f7dfc000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:42.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.020+0000 7f7e0dffb640 1 -- 172.21.15.37:0/1497641253 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7e040acba0 con 0x7f7e10102750 2024-08-31T06:46:42.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:41 smithi106 ceph-mon[22134]: pgmap v315: 97 pgs: 97 active+clean; 647 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-08-31T06:46:42.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:41 smithi106 ceph-mon[22134]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:42.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:46:42.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.232+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f7e100635a0 con 0x7f7e000b4c40 2024-08-31T06:46:42.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.240+0000 7f7e0dffb640 1 -- 172.21.15.37:0/1497641253 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f7e100635a0 con 0x7f7e000b4c40 2024-08-31T06:46:42.241 INFO:teuthology.orchestra.run.smithi037.stdout:/ 1m 6m3h 2024-08-31T06:46:42.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7e000b4c40 msgr2=0x7f7e000b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7e000b4c40 0x7f7e000b7150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc006010 tx=0x7f7dfc000bc0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10102750 msgr2=0x7f7e1010fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10102750 0x7f7e1010fce0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400e9f0 tx=0x7f7e0400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 shutdown_connections 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7e000b4c40 0x7f7e000b7150 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e101089d0 0x7f7e10110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e10108080 0x7f7e10110220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 --2- 172.21.15.37:0/1497641253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e10102750 0x7f7e1010fce0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 >> 172.21.15.37:0/1497641253 conn(0x7f7e1007a4e0 msgr2=0x7f7e10104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 shutdown_connections 2024-08-31T06:46:42.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.242+0000 7f7e16fba640 1 -- 172.21.15.37:0/1497641253 wait complete. 2024-08-31T06:46:42.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-08-31T06:46:42.281 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-08-31T06:46:42.318 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-31T06:46:42.354 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:46:42.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-31T06:46:42.356 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-31T06:46:42.369 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-31T06:46:42.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:46:42.372 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:42.762 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:42 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:46:42.763 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:42 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:46:42.763 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:42 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:46:42.763 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:42 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:46:42.763 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:42 smithi037 ceph-mon[18612]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:42.763 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:42 smithi037 ceph-mon[18612]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:42.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:42 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:46:42.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:42 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:46:42.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:42 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:46:42.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:42 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:46:42.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:42 smithi066 ceph-mon[22244]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:42.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:42 smithi066 ceph-mon[22244]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:42.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 -- 172.21.15.37:0/3749079360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140103900 msgr2=0x7fd140103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3749079360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140103900 0x7fd140103d10 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd130009900 tx=0x7fd13002a410 comp rx=0 tx=0).stop 2024-08-31T06:46:42.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 -- 172.21.15.37:0/3749079360 shutdown_connections 2024-08-31T06:46:42.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3749079360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd140109b90 0x7fd1401103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3749079360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd140109240 0x7fd140109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3749079360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140103900 0x7fd140103d10 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 -- 172.21.15.37:0/3749079360 >> 172.21.15.37:0/3749079360 conn(0x7fd14007b5f0 msgr2=0x7fd14007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 -- 172.21.15.37:0/3749079360 shutdown_connections 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 -- 172.21.15.37:0/3749079360 wait complete. 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 Processor -- start 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.855+0000 7fd1464ca640 1 -- start start 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd1464ca640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd140103900 0x7fd14019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd1464ca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd140109240 0x7fd14019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd1464ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140109b90 0x7fd14019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd1464ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd140113700 con 0x7fd140109b90 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd1464ca640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd140113580 con 0x7fd140109240 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd1464ca640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd140113880 con 0x7fd140103900 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd144a67640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140109b90 0x7fd14019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd144a67640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140109b90 0x7fd14019f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33166/0 (socket says 172.21.15.37:33166) 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd144a67640 1 -- 172.21.15.37:0/3083551203 learned_addr learned my addr 172.21.15.37:0/3083551203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd140109240 0x7fd14019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd13ffff640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd140103900 0x7fd14019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd144a67640 1 -- 172.21.15.37:0/3083551203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd140103900 msgr2=0x7fd14019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd144a67640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd140103900 0x7fd14019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd144a67640 1 -- 172.21.15.37:0/3083551203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd140109240 msgr2=0x7fd14019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd144a67640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd140109240 0x7fd14019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd144a67640 1 -- 172.21.15.37:0/3083551203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1401a00a0 con 0x7fd140109b90 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.856+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd140109240 0x7fd14019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.857+0000 7fd144a67640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140109b90 0x7fd14019f970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd13800eaa0 tx=0x7fd13800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.857+0000 7fd13d7fa640 1 -- 172.21.15.37:0/3083551203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13800cdb0 con 0x7fd140109b90 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.857+0000 7fd1464ca640 1 -- 172.21.15.37:0/3083551203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1401a0390 con 0x7fd140109b90 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.857+0000 7fd13d7fa640 1 -- 172.21.15.37:0/3083551203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd138005020 con 0x7fd140109b90 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.857+0000 7fd13d7fa640 1 -- 172.21.15.37:0/3083551203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1380116d0 con 0x7fd140109b90 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.857+0000 7fd1464ca640 1 -- 172.21.15.37:0/3083551203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1401a6af0 con 0x7fd140109b90 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.860+0000 7fd14ca3f740 1 Processor -- start 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.860+0000 7fd13d7fa640 1 -- 172.21.15.37:0/3083551203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7fd138004a40 con 0x7fd140109b90 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.860+0000 7fd14ca3f740 1 -- start start 2024-08-31T06:46:42.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.860+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd4730e070 0x55dd476b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472e51b0 0x55dd476b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472ed390 0x55dd476b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dd4762a630 con 0x55dd472e51b0 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd47619bc0 con 0x55dd4730e070 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dd4761db70 con 0x55dd472ed390 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472e51b0 0x55dd476b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472e51b0 0x55dd476b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33176/0 (socket says 172.21.15.37:33176) 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 -- 172.21.15.37:0/66149261 learned_addr learned my addr 172.21.15.37:0/66149261 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13d7fa640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd1280b4ca0 0x7fd1280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472ed390 0x55dd476b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd4730e070 0x55dd476b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 -- 172.21.15.37:0/66149261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472ed390 msgr2=0x55dd476b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13d7fa640 1 -- 172.21.15.37:0/3083551203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd1380e5750 con 0x7fd140109b90 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472ed390 0x55dd476b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd144a67640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd1280b4ca0 0x7fd1280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 -- 172.21.15.37:0/66149261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd4730e070 msgr2=0x55dd476b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd4730e070 0x55dd476b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 -- 172.21.15.37:0/66149261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd47379650 con 0x55dd472e51b0 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472ed390 0x55dd476b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.861+0000 7fd13ffff640 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472e51b0 0x55dd476b3800 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd130009900 tx=0x7fd130032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fd92513d2e75de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.862+0000 7fd1267fc640 1 -- 172.21.15.37:0/66149261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13003f070 con 0x55dd472e51b0 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.862+0000 7fd144a67640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd1280b4ca0 0x7fd1280b71b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1380e2f40 tx=0x7fd138093040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:42.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.862+0000 7fd1267fc640 1 -- 172.21.15.37:0/66149261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd130004030 con 0x55dd472e51b0 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.862+0000 7fd1267fc640 1 -- 172.21.15.37:0/66149261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130035070 con 0x55dd472e51b0 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 -- 172.21.15.37:0/66149261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472e51b0 msgr2=0x55dd476b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472e51b0 0x55dd476b3800 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd130009900 tx=0x7fd130032ba0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 -- 172.21.15.37:0/66149261 shutdown_connections 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472e51b0 0x55dd476b3800 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472ed390 0x55dd476b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/66149261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd4730e070 0x55dd476b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 -- 172.21.15.37:0/66149261 >> 172.21.15.37:0/66149261 conn(0x55dd47302460 msgr2=0x55dd476b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 -- 172.21.15.37:0/66149261 shutdown_connections 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 -- 172.21.15.37:0/66149261 wait complete. 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 -- start start 2024-08-31T06:46:42.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.863+0000 7fd14ca3f740 1 Processor -- start 2024-08-31T06:46:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472e51b0 0x55dd476c2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472ed390 0x55dd476c3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd4730e070 0x55dd476cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dd4747c700 con 0x55dd4730e070 2024-08-31T06:46:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dd475a0700 con 0x55dd472ed390 2024-08-31T06:46:42.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dd476c5da0 con 0x55dd472e51b0 2024-08-31T06:46:42.928 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d", 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:46:42.929 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:46:42.930 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:46:42.930 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:46:42.930 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:46:42.930 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:46:42.930 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:46:42.930 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:42.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd14ca3f740 10 client.0 _ll_register_callbacks cb 0x55dd475cfdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:42.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd4730e070 0x55dd476cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd4730e070 0x55dd476cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33188/0 (socket says 172.21.15.37:33188) 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 -- 172.21.15.37:0/1965512386 learned_addr learned my addr 172.21.15.37:0/1965512386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13ffff640 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472ed390 0x55dd476c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472e51b0 0x55dd476c2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 -- 172.21.15.37:0/1965512386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472e51b0 msgr2=0x55dd476c2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472e51b0 0x55dd476c2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 -- 172.21.15.37:0/1965512386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472ed390 msgr2=0x55dd476c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472ed390 0x55dd476c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 -- 172.21.15.37:0/1965512386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd475d98b0 con 0x55dd4730e070 2024-08-31T06:46:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd4730e070 0x55dd476cf100 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c6d0 tx=0x7fd134004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2913c40afd08f99d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd11f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.864+0000 7fd11f7fe640 1 -- 172.21.15.37:0/1965512386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13400cce0 con 0x55dd4730e070 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd11f7fe640 1 -- 172.21.15.37:0/1965512386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd134004030 con 0x55dd4730e070 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 1 -- 172.21.15.37:0/1965512386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd130004030 con 0x55dd4730e070 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd11f7fe640 1 -- 172.21.15.37:0/1965512386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd134026050 con 0x55dd4730e070 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 10 client.15525 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 1 -- 172.21.15.37:0/1965512386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dd476d1c00 con 0x55dd4730e070 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd11f7fe640 1 -- 172.21.15.37:0/1965512386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd130004030 con 0x55dd4730e070 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd11f7fe640 1 -- 172.21.15.37:0/1965512386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd134003cb0 con 0x55dd4730e070 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 10 client.15525 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 10 client.15525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 20 client.15525 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:42.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dd472cc9f0 0x55dd476d50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 4 client.15525 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.865+0000 7fd14ca3f740 1 -- 172.21.15.37:0/1965512386 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd4762c580 con 0x55dd472cc9f0 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.866+0000 7fd13ffff640 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dd472cc9f0 0x55dd476d50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.866+0000 7fd13ffff640 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dd472cc9f0 0x55dd476d50b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40749042c785036f server_cookie=1cb59595b8095e76 in_seq=0 out_seq=0 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.866+0000 7fd11f7fe640 10 client.15525 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd11f7fe640 1 -- 172.21.15.37:0/1965512386 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dd4762c580 con 0x55dd472cc9f0 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd11f7fe640 10 client.15525 handle_command_reply: tid=0 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 client.15525 shutdown 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 -- 172.21.15.37:0/1965512386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd4730e070 msgr2=0x55dd476cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd4730e070 0x55dd476cf100 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c6d0 tx=0x7fd134004730 comp rx=0 tx=0).stop 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 -- 172.21.15.37:0/1965512386 shutdown_connections 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dd472cc9f0 0x55dd476d50b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd4730e070 0x55dd476cf100 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472ed390 0x55dd476c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd11f7fe640 0 client.15525 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/1965512386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd472e51b0 0x55dd476c2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 -- 172.21.15.37:0/1965512386 >> 172.21.15.37:0/1965512386 conn(0x55dd47302460 msgr2=0x55dd476b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 -- 172.21.15.37:0/1965512386 shutdown_connections 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.867+0000 7fd14ca3f740 1 -- 172.21.15.37:0/1965512386 wait complete. 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.868+0000 7fd14ca3f740 20 client.15525 trim_cache size 0 max 16384 2024-08-31T06:46:42.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd14ca3f740 1 Processor -- start 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd14ca3f740 1 -- start start 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 0x55dd476b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1401afa10 con 0x55dd472cc9f0 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1401ad2e0 con 0x55dd472e51b0 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd1401ab130 con 0x55dd47302460 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd13ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd13ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33196/0 (socket says 172.21.15.37:33196) 2024-08-31T06:46:42.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd13ffff640 1 -- 172.21.15.37:0/313114489 learned_addr learned my addr 172.21.15.37:0/313114489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:42.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.885+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 0x55dd476b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd13ffff640 1 -- 172.21.15.37:0/313114489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 msgr2=0x55dd476b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:42.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd13ffff640 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 0x55dd476b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd13ffff640 1 -- 172.21.15.37:0/313114489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 msgr2=0x55dd476c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:42.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd13ffff640 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd13ffff640 1 -- 172.21.15.37:0/313114489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd476b6080 con 0x55dd472cc9f0 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd13ffff640 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cf000 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd130009900 tx=0x7fd130031930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f16c38582cf8a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd125ffb640 1 -- 172.21.15.37:0/313114489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd130035030 con 0x55dd472cc9f0 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd125ffb640 1 -- 172.21.15.37:0/313114489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd130031a20 con 0x55dd472cc9f0 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.886+0000 7fd125ffb640 1 -- 172.21.15.37:0/313114489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13003f040 con 0x55dd472cc9f0 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 -- 172.21.15.37:0/313114489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 msgr2=0x55dd476cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cf000 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fd130009900 tx=0x7fd130031930 comp rx=0 tx=0).stop 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 -- 172.21.15.37:0/313114489 shutdown_connections 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cf000 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/313114489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 0x55dd476b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 -- 172.21.15.37:0/313114489 >> 172.21.15.37:0/313114489 conn(0x55dd476be790 msgr2=0x55dd476b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:42.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 -- 172.21.15.37:0/313114489 shutdown_connections 2024-08-31T06:46:42.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 -- 172.21.15.37:0/313114489 wait complete. 2024-08-31T06:46:42.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.887+0000 7fd14ca3f740 1 -- start start 2024-08-31T06:46:42.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd14ca3f740 1 Processor -- start 2024-08-31T06:46:42.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd14ca3f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 0x55dd476c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1401ab7a0 con 0x55dd472cc9f0 2024-08-31T06:46:42.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1401acc10 con 0x55dd472e51b0 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd14ca3f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd1401abe70 con 0x55dd47302460 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd14ca3f740 10 client.0 _ll_register_callbacks cb 0x7fd134012a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33198/0 (socket says 172.21.15.37:33198) 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 -- 172.21.15.37:0/3509883497 learned_addr learned my addr 172.21.15.37:0/3509883497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 0x55dd476c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13ffff640 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 -- 172.21.15.37:0/3509883497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 msgr2=0x55dd476c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:42.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 0x55dd476c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 -- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 msgr2=0x55dd476c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13f7fe640 1 -- 172.21.15.37:0/3509883497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd476c89e0 con 0x55dd472cc9f0 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.888+0000 7fd13ffff640 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd13f7fe640 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cb850 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c6d0 tx=0x7fd134004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed164b32f0f09b12 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd11f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd11f7fe640 1 -- 172.21.15.37:0/3509883497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd134004030 con 0x55dd472cc9f0 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 1 -- 172.21.15.37:0/3509883497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd130031a20 con 0x55dd472cc9f0 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd11f7fe640 1 -- 172.21.15.37:0/3509883497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd1340041d0 con 0x55dd472cc9f0 2024-08-31T06:46:42.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd11f7fe640 1 -- 172.21.15.37:0/3509883497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd13403c050 con 0x55dd472cc9f0 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 10 client.15531 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 1 -- 172.21.15.37:0/3509883497 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dd47740990 con 0x55dd472cc9f0 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd11f7fe640 1 -- 172.21.15.37:0/3509883497 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd130031a20 con 0x55dd472cc9f0 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd11f7fe640 1 -- 172.21.15.37:0/3509883497 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd134003710 con 0x55dd472cc9f0 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 10 client.15531 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 10 client.15531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 20 client.15531 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dd472ed390 0x55dd477430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 4 client.15531 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.889+0000 7fd14ca3f740 1 -- 172.21.15.37:0/3509883497 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dd47628020 con 0x55dd472ed390 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.890+0000 7fd13ffff640 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dd472ed390 0x55dd477430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.890+0000 7fd13ffff640 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dd472ed390 0x55dd477430c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad559bf1698e674c server_cookie=8ab3cd1f99f2c36c in_seq=0 out_seq=0 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.890+0000 7fd11f7fe640 10 client.15531 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.890+0000 7fd11f7fe640 1 -- 172.21.15.37:0/3509883497 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55dd47628020 con 0x55dd472ed390 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.890+0000 7fd11f7fe640 10 client.15531 handle_command_reply: tid=0 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.890+0000 7fd14ca3f740 1 client.15531 shutdown 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 -- 172.21.15.37:0/3509883497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 msgr2=0x55dd476cb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cb850 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fd13400c6d0 tx=0x7fd134004730 comp rx=0 tx=0).stop 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 -- 172.21.15.37:0/3509883497 shutdown_connections 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dd472ed390 0x55dd477430c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dd47302460 0x55dd476c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dd472e51b0 0x55dd476c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd11f7fe640 0 client.15531 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 --2- 172.21.15.37:0/3509883497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dd472cc9f0 0x55dd476cb850 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 -- 172.21.15.37:0/3509883497 >> 172.21.15.37:0/3509883497 conn(0x55dd476be790 msgr2=0x55dd476b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 -- 172.21.15.37:0/3509883497 shutdown_connections 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 1 -- 172.21.15.37:0/3509883497 wait complete. 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd14ca3f740 20 client.15531 trim_cache size 0 max 16384 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 -- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd1280b4ca0 msgr2=0x7fd1280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd1280b4ca0 0x7fd1280b71b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd1380e2f40 tx=0x7fd138093040 comp rx=0 tx=0).stop 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 -- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140109b90 msgr2=0x7fd14019f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140109b90 0x7fd14019f970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd13800eaa0 tx=0x7fd13800ef60 comp rx=0 tx=0).stop 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 -- 172.21.15.37:0/3083551203 shutdown_connections 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd1280b4ca0 0x7fd1280b71b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd140109b90 0x7fd14019f970 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd140109240 0x7fd14019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.891+0000 7fd1464ca640 1 --2- 172.21.15.37:0/3083551203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd140103900 0x7fd14019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:42.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.892+0000 7fd1464ca640 1 -- 172.21.15.37:0/3083551203 >> 172.21.15.37:0/3083551203 conn(0x7fd14007b5f0 msgr2=0x7fd140107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:42.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.892+0000 7fd1464ca640 1 -- 172.21.15.37:0/3083551203 shutdown_connections 2024-08-31T06:46:42.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:42.892+0000 7fd1464ca640 1 -- 172.21.15.37:0/3083551203 wait complete. 2024-08-31T06:46:43.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:42 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:46:43.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:42 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:46:43.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:42 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:46:43.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:42 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:46:43.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:42 smithi106 ceph-mon[22134]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:43.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:42 smithi106 ceph-mon[22134]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:43.646 INFO:tasks.cephfs.filesystem:scrub status for tag:0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d - {'path': '/', 'tag': '0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d', 'options': 'recursive,force'} 2024-08-31T06:46:43.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:43 smithi037 ceph-mon[18612]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:43.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:43 smithi037 ceph-mon[18612]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 165 KiB/s wr, 30 op/s 2024-08-31T06:46:43.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:43 smithi037 ceph-mon[18612]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-08-31T06:46:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:43 smithi066 ceph-mon[22244]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:43 smithi066 ceph-mon[22244]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 165 KiB/s wr, 30 op/s 2024-08-31T06:46:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:43 smithi066 ceph-mon[22244]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-08-31T06:46:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:43 smithi106 ceph-mon[22134]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:46:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:43 smithi106 ceph-mon[22134]: pgmap v316: 97 pgs: 97 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 165 KiB/s wr, 30 op/s 2024-08-31T06:46:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:43 smithi106 ceph-mon[22134]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-08-31T06:46:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 -- 172.21.15.37:0/3267034957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 msgr2=0x7f83f8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/3267034957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 0x7f83f8109650 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009900 tx=0x7f83e002a410 comp rx=0 tx=0).stop 2024-08-31T06:46:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 -- 172.21.15.37:0/3267034957 shutdown_connections 2024-08-31T06:46:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/3267034957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 0x7f83f8109650 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/3267034957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8109b90 0x7f83f81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/3267034957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8103900 0x7f83f8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 -- 172.21.15.37:0/3267034957 >> 172.21.15.37:0/3267034957 conn(0x7f83f807b5f0 msgr2=0x7f83f807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 -- 172.21.15.37:0/3267034957 shutdown_connections 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.203+0000 7f83fe1fa640 1 -- 172.21.15.37:0/3267034957 wait complete. 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83fe1fa640 1 Processor -- start 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83fe1fa640 1 -- start start 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83fe1fa640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8103900 0x7f83f80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83fe1fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 0x7f83f80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83fe1fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8109b90 0x7f83f8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:44.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83fe1fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113700 con 0x7f83f8109240 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83fe1fa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113580 con 0x7f83f8109b90 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83fe1fa640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113880 con 0x7f83f8103900 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83eeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 0x7f83f80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83f77fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8103900 0x7f83f80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83eeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 0x7f83f80759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49508/0 (socket says 172.21.15.37:49508) 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.204+0000 7f83eeffd640 1 -- 172.21.15.37:0/4235571538 learned_addr learned my addr 172.21.15.37:0/4235571538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83f7fff640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8109b90 0x7f83f8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83eeffd640 1 -- 172.21.15.37:0/4235571538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8103900 msgr2=0x7f83f80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83eeffd640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8103900 0x7f83f80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83eeffd640 1 -- 172.21.15.37:0/4235571538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8109b90 msgr2=0x7f83f8075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83eeffd640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8109b90 0x7f83f8075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83eeffd640 1 -- 172.21.15.37:0/4235571538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f81a83e0 con 0x7f83f8109240 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83f77fe640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8103900 0x7f83f80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83eeffd640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 0x7f83f80759f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f83e0005940 tx=0x7f83e00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83f57fa640 1 -- 172.21.15.37:0/4235571538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e003f030 con 0x7f83f8109240 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83f57fa640 1 -- 172.21.15.37:0/4235571538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83e0003a80 con 0x7f83f8109240 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f81a8670 con 0x7f83f8109240 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83f57fa640 1 -- 172.21.15.37:0/4235571538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0035070 con 0x7f83f8109240 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.205+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f81a8b50 con 0x7f83f8109240 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.207+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f8103d10 con 0x7f83f8109240 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.208+0000 7f83f57fa640 1 -- 172.21.15.37:0/4235571538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f83e0042030 con 0x7f83f8109240 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.209+0000 7f83f57fa640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e40b4ca0 0x7f83e40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:44.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.209+0000 7f83f77fe640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e40b4ca0 0x7f83e40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:44.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.209+0000 7f83f57fa640 1 -- 172.21.15.37:0/4235571538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f83e0105e40 con 0x7f83f8109240 2024-08-31T06:46:44.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.210+0000 7f83f77fe640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e40b4ca0 0x7f83e40b71b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83f8076f00 tx=0x7f83e800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:44.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.214+0000 7f83f57fa640 1 -- 172.21.15.37:0/4235571538 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f83e00ccc70 con 0x7f83f8109240 2024-08-31T06:46:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.395+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83f80635a0 con 0x7f83e40b4ca0 2024-08-31T06:46:44.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.400+0000 7f83f57fa640 1 -- 172.21.15.37:0/4235571538 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258884 (secure 0 0 0) 0x7f83f80635a0 con 0x7f83e40b4ca0 2024-08-31T06:46:44.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.402+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e40b4ca0 msgr2=0x7f83e40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.402+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e40b4ca0 0x7f83e40b71b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f83f8076f00 tx=0x7f83e800b390 comp rx=0 tx=0).stop 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 msgr2=0x7f83f80759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 0x7f83f80759f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f83e0005940 tx=0x7f83e00040e0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 shutdown_connections 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e40b4ca0 0x7f83e40b71b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109240 0x7f83f80759f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8109b90 0x7f83f8075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 --2- 172.21.15.37:0/4235571538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8103900 0x7f83f80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 >> 172.21.15.37:0/4235571538 conn(0x7f83f807b5f0 msgr2=0x7f83f8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 shutdown_connections 2024-08-31T06:46:44.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:44.403+0000 7f83fe1fa640 1 -- 172.21.15.37:0/4235571538 wait complete. 2024-08-31T06:46:45.112 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-08-31T06:46:44.274949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1451765,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":889,"num_read_kb":600,"num_write":450,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":852,"ondisk_log_size":852,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366580,"kb_used_data":13052,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575244,"statfs":{"total":1151940427776,"available":1151565049856,"internally_reserved":0,"allocated":13365248,"data_stored":8079535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":794999,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":147,"num_write":146,"num_write_kb":1974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003352"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665746+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:46:18.665746+0000","last_peered":"2024-08-31T06:46:18.665746+0000","last_clean":"2024-08-31T06:46:18.665746+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:46:18.665746+0000","last_undegraded":"2024-08-31T06:46:18.665746+0000","last_fullsized":"2024-08-31T06:46:18.665746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659822+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:46:18.659822+0000","last_peered":"2024-08-31T06:46:18.659822+0000","last_clean":"2024-08-31T06:46:18.659822+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:46:18.659822+0000","last_undegraded":"2024-08-31T06:46:18.659822+0000","last_fullsized":"2024-08-31T06:46:18.659822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665290+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:46:18.665290+0000","last_peered":"2024-08-31T06:46:18.665290+0000","last_clean":"2024-08-31T06:46:18.665290+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:46:18.665290+0000","last_undegraded":"2024-08-31T06:46:18.665290+0000","last_fullsized":"2024-08-31T06:46:18.665290+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.650100+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:46:18.650100+0000","last_peered":"2024-08-31T06:46:18.650100+0000","last_clean":"2024-08-31T06:46:18.650100+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:46:18.650100+0000","last_undegraded":"2024-08-31T06:46:18.650100+0000","last_fullsized":"2024-08-31T06:46:18.650100+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640151+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:46:18.640151+0000","last_peered":"2024-08-31T06:46:18.640151+0000","last_clean":"2024-08-31T06:46:18.640151+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:46:18.640151+0000","last_undegraded":"2024-08-31T06:46:18.640151+0000","last_fullsized":"2024-08-31T06:46:18.640151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657815+0000","last_change":"2024-08-31T06:45:19.756707+0000","last_active":"2024-08-31T06:46:18.657815+0000","last_peered":"2024-08-31T06:46:18.657815+0000","last_clean":"2024-08-31T06:46:18.657815+0000","last_became_active":"2024-08-31T06:45:19.756086+0000","last_became_peered":"2024-08-31T06:45:19.756086+0000","last_unstale":"2024-08-31T06:46:18.657815+0000","last_undegraded":"2024-08-31T06:46:18.657815+0000","last_fullsized":"2024-08-31T06:46:18.657815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:44:24.147502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662767+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:46:18.662767+0000","last_peered":"2024-08-31T06:46:18.662767+0000","last_clean":"2024-08-31T06:46:18.662767+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:46:18.662767+0000","last_undegraded":"2024-08-31T06:46:18.662767+0000","last_fullsized":"2024-08-31T06:46:18.662767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.654017+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:46:18.654017+0000","last_peered":"2024-08-31T06:46:18.654017+0000","last_clean":"2024-08-31T06:46:18.654017+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:46:18.654017+0000","last_undegraded":"2024-08-31T06:46:18.654017+0000","last_fullsized":"2024-08-31T06:46:18.654017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671760+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:46:18.671760+0000","last_peered":"2024-08-31T06:46:18.671760+0000","last_clean":"2024-08-31T06:46:18.671760+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:46:18.671760+0000","last_undegraded":"2024-08-31T06:46:18.671760+0000","last_fullsized":"2024-08-31T06:46:18.671760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659726+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:46:18.659726+0000","last_peered":"2024-08-31T06:46:18.659726+0000","last_clean":"2024-08-31T06:46:18.659726+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:46:18.659726+0000","last_undegraded":"2024-08-31T06:46:18.659726+0000","last_fullsized":"2024-08-31T06:46:18.659726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.666910+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:46:18.666910+0000","last_peered":"2024-08-31T06:46:18.666910+0000","last_clean":"2024-08-31T06:46:18.666910+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:46:18.666910+0000","last_undegraded":"2024-08-31T06:46:18.666910+0000","last_fullsized":"2024-08-31T06:46:18.666910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649818+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:46:18.649818+0000","last_peered":"2024-08-31T06:46:18.649818+0000","last_clean":"2024-08-31T06:46:18.649818+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:46:18.649818+0000","last_undegraded":"2024-08-31T06:46:18.649818+0000","last_fullsized":"2024-08-31T06:46:18.649818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658630+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:46:18.658630+0000","last_peered":"2024-08-31T06:46:18.658630+0000","last_clean":"2024-08-31T06:46:18.658630+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:46:18.658630+0000","last_undegraded":"2024-08-31T06:46:18.658630+0000","last_fullsized":"2024-08-31T06:46:18.658630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656512+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:46:18.656512+0000","last_peered":"2024-08-31T06:46:18.656512+0000","last_clean":"2024-08-31T06:46:18.656512+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:46:18.656512+0000","last_undegraded":"2024-08-31T06:46:18.656512+0000","last_fullsized":"2024-08-31T06:46:18.656512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658480+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:46:18.658480+0000","last_peered":"2024-08-31T06:46:18.658480+0000","last_clean":"2024-08-31T06:46:18.658480+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:46:18.658480+0000","last_undegraded":"2024-08-31T06:46:18.658480+0000","last_fullsized":"2024-08-31T06:46:18.658480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672261+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:46:18.672261+0000","last_peered":"2024-08-31T06:46:18.672261+0000","last_clean":"2024-08-31T06:46:18.672261+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:46:18.672261+0000","last_undegraded":"2024-08-31T06:46:18.672261+0000","last_fullsized":"2024-08-31T06:46:18.672261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665677+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:46:18.665677+0000","last_peered":"2024-08-31T06:46:18.665677+0000","last_clean":"2024-08-31T06:46:18.665677+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:46:18.665677+0000","last_undegraded":"2024-08-31T06:46:18.665677+0000","last_fullsized":"2024-08-31T06:46:18.665677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658429+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:46:18.658429+0000","last_peered":"2024-08-31T06:46:18.658429+0000","last_clean":"2024-08-31T06:46:18.658429+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:46:18.658429+0000","last_undegraded":"2024-08-31T06:46:18.658429+0000","last_fullsized":"2024-08-31T06:46:18.658429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644995+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:46:18.644995+0000","last_peered":"2024-08-31T06:46:18.644995+0000","last_clean":"2024-08-31T06:46:18.644995+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:46:18.644995+0000","last_undegraded":"2024-08-31T06:46:18.644995+0000","last_fullsized":"2024-08-31T06:46:18.644995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653051+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:46:18.653051+0000","last_peered":"2024-08-31T06:46:18.653051+0000","last_clean":"2024-08-31T06:46:18.653051+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:46:18.653051+0000","last_undegraded":"2024-08-31T06:46:18.653051+0000","last_fullsized":"2024-08-31T06:46:18.653051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661106+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:46:18.661106+0000","last_peered":"2024-08-31T06:46:18.661106+0000","last_clean":"2024-08-31T06:46:18.661106+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:46:18.661106+0000","last_undegraded":"2024-08-31T06:46:18.661106+0000","last_fullsized":"2024-08-31T06:46:18.661106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.673097+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:46:18.673097+0000","last_peered":"2024-08-31T06:46:18.673097+0000","last_clean":"2024-08-31T06:46:18.673097+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:46:18.673097+0000","last_undegraded":"2024-08-31T06:46:18.673097+0000","last_fullsized":"2024-08-31T06:46:18.673097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638344+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:46:18.638344+0000","last_peered":"2024-08-31T06:46:18.638344+0000","last_clean":"2024-08-31T06:46:18.638344+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:46:18.638344+0000","last_undegraded":"2024-08-31T06:46:18.638344+0000","last_fullsized":"2024-08-31T06:46:18.638344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651434+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:46:18.651434+0000","last_peered":"2024-08-31T06:46:18.651434+0000","last_clean":"2024-08-31T06:46:18.651434+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:46:18.651434+0000","last_undegraded":"2024-08-31T06:46:18.651434+0000","last_fullsized":"2024-08-31T06:46:18.651434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638274+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:46:18.638274+0000","last_peered":"2024-08-31T06:46:18.638274+0000","last_clean":"2024-08-31T06:46:18.638274+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:46:18.638274+0000","last_undegraded":"2024-08-31T06:46:18.638274+0000","last_fullsized":"2024-08-31T06:46:18.638274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658774+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:46:18.658774+0000","last_peered":"2024-08-31T06:46:18.658774+0000","last_clean":"2024-08-31T06:46:18.658774+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:46:18.658774+0000","last_undegraded":"2024-08-31T06:46:18.658774+0000","last_fullsized":"2024-08-31T06:46:18.658774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637037+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:46:18.637037+0000","last_peered":"2024-08-31T06:46:18.637037+0000","last_clean":"2024-08-31T06:46:18.637037+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:46:18.637037+0000","last_undegraded":"2024-08-31T06:46:18.637037+0000","last_fullsized":"2024-08-31T06:46:18.637037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.645592+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:46:18.645592+0000","last_peered":"2024-08-31T06:46:18.645592+0000","last_clean":"2024-08-31T06:46:18.645592+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:46:18.645592+0000","last_undegraded":"2024-08-31T06:46:18.645592+0000","last_fullsized":"2024-08-31T06:46:18.645592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658756+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:46:18.658756+0000","last_peered":"2024-08-31T06:46:18.658756+0000","last_clean":"2024-08-31T06:46:18.658756+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:46:18.658756+0000","last_undegraded":"2024-08-31T06:46:18.658756+0000","last_fullsized":"2024-08-31T06:46:18.658756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647670+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:46:18.647670+0000","last_peered":"2024-08-31T06:46:18.647670+0000","last_clean":"2024-08-31T06:46:18.647670+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:46:18.647670+0000","last_undegraded":"2024-08-31T06:46:18.647670+0000","last_fullsized":"2024-08-31T06:46:18.647670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658511+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:46:18.658511+0000","last_peered":"2024-08-31T06:46:18.658511+0000","last_clean":"2024-08-31T06:46:18.658511+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:46:18.658511+0000","last_undegraded":"2024-08-31T06:46:18.658511+0000","last_fullsized":"2024-08-31T06:46:18.658511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647528+0000","last_change":"2024-08-31T06:45:19.754501+0000","last_active":"2024-08-31T06:46:18.647528+0000","last_peered":"2024-08-31T06:46:18.647528+0000","last_clean":"2024-08-31T06:46:18.647528+0000","last_became_active":"2024-08-31T06:45:19.754085+0000","last_became_peered":"2024-08-31T06:45:19.754085+0000","last_unstale":"2024-08-31T06:46:18.647528+0000","last_undegraded":"2024-08-31T06:46:18.647528+0000","last_fullsized":"2024-08-31T06:46:18.647528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:50:04.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637559+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:46:18.637559+0000","last_peered":"2024-08-31T06:46:18.637559+0000","last_clean":"2024-08-31T06:46:18.637559+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:46:18.637559+0000","last_undegraded":"2024-08-31T06:46:18.637559+0000","last_fullsized":"2024-08-31T06:46:18.637559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'9","reported_seq":161,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.089011+0000","last_change":"2024-08-31T06:45:19.947200+0000","last_active":"2024-08-31T06:46:41.089011+0000","last_peered":"2024-08-31T06:46:41.089011+0000","last_clean":"2024-08-31T06:46:41.089011+0000","last_became_active":"2024-08-31T06:45:19.942294+0000","last_became_peered":"2024-08-31T06:45:19.942294+0000","last_unstale":"2024-08-31T06:46:41.089011+0000","last_undegraded":"2024-08-31T06:46:41.089011+0000","last_fullsized":"2024-08-31T06:46:41.089011+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:40.241862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651596+0000","last_change":"2024-08-31T06:45:19.942081+0000","last_active":"2024-08-31T06:46:18.651596+0000","last_peered":"2024-08-31T06:46:18.651596+0000","last_clean":"2024-08-31T06:46:18.651596+0000","last_became_active":"2024-08-31T06:45:19.941427+0000","last_became_peered":"2024-08-31T06:45:19.941427+0000","last_unstale":"2024-08-31T06:46:18.651596+0000","last_undegraded":"2024-08-31T06:46:18.651596+0000","last_fullsized":"2024-08-31T06:46:18.651596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:47.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749301+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:45:19.749301+0000","last_peered":"2024-08-31T06:45:19.749301+0000","last_clean":"2024-08-31T06:45:19.749301+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:45:19.749301+0000","last_undegraded":"2024-08-31T06:45:19.749301+0000","last_fullsized":"2024-08-31T06:45:19.749301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940290+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:45:19.940290+0000","last_peered":"2024-08-31T06:45:19.940290+0000","last_clean":"2024-08-31T06:45:19.940290+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:45:19.940290+0000","last_undegraded":"2024-08-31T06:45:19.940290+0000","last_fullsized":"2024-08-31T06:45:19.940290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639066+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:46:18.639066+0000","last_peered":"2024-08-31T06:46:18.639066+0000","last_clean":"2024-08-31T06:46:18.639066+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:46:18.639066+0000","last_undegraded":"2024-08-31T06:46:18.639066+0000","last_fullsized":"2024-08-31T06:46:18.639066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748301+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:45:19.748301+0000","last_peered":"2024-08-31T06:45:19.748301+0000","last_clean":"2024-08-31T06:45:19.748301+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:45:19.748301+0000","last_undegraded":"2024-08-31T06:45:19.748301+0000","last_fullsized":"2024-08-31T06:45:19.748301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656325+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:46:18.656325+0000","last_peered":"2024-08-31T06:46:18.656325+0000","last_clean":"2024-08-31T06:46:18.656325+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:46:18.656325+0000","last_undegraded":"2024-08-31T06:46:18.656325+0000","last_fullsized":"2024-08-31T06:46:18.656325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:40.086917+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:46:40.086917+0000","last_peered":"2024-08-31T06:46:40.086917+0000","last_clean":"2024-08-31T06:46:40.086917+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:46:40.086917+0000","last_undegraded":"2024-08-31T06:46:40.086917+0000","last_fullsized":"2024-08-31T06:46:40.086917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670727+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:46:18.670727+0000","last_peered":"2024-08-31T06:46:18.670727+0000","last_clean":"2024-08-31T06:46:18.670727+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:46:18.670727+0000","last_undegraded":"2024-08-31T06:46:18.670727+0000","last_fullsized":"2024-08-31T06:46:18.670727+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753069+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:45:19.753069+0000","last_peered":"2024-08-31T06:45:19.753069+0000","last_clean":"2024-08-31T06:45:19.753069+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:45:19.753069+0000","last_undegraded":"2024-08-31T06:45:19.753069+0000","last_fullsized":"2024-08-31T06:45:19.753069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659721+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:46:18.659721+0000","last_peered":"2024-08-31T06:46:18.659721+0000","last_clean":"2024-08-31T06:46:18.659721+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:46:18.659721+0000","last_undegraded":"2024-08-31T06:46:18.659721+0000","last_fullsized":"2024-08-31T06:46:18.659721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748845+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:45:19.748845+0000","last_peered":"2024-08-31T06:45:19.748845+0000","last_clean":"2024-08-31T06:45:19.748845+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:45:19.748845+0000","last_undegraded":"2024-08-31T06:45:19.748845+0000","last_fullsized":"2024-08-31T06:45:19.748845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672581+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:46:18.672581+0000","last_peered":"2024-08-31T06:46:18.672581+0000","last_clean":"2024-08-31T06:46:18.672581+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:46:18.672581+0000","last_undegraded":"2024-08-31T06:46:18.672581+0000","last_fullsized":"2024-08-31T06:46:18.672581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":290,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.088348+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:46:41.088348+0000","last_peered":"2024-08-31T06:46:41.088348+0000","last_clean":"2024-08-31T06:46:41.088348+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:46:41.088348+0000","last_undegraded":"2024-08-31T06:46:41.088348+0000","last_fullsized":"2024-08-31T06:46:41.088348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67729,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":231,"num_read_kb":181,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660282+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:46:18.660282+0000","last_peered":"2024-08-31T06:46:18.660282+0000","last_clean":"2024-08-31T06:46:18.660282+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:46:18.660282+0000","last_undegraded":"2024-08-31T06:46:18.660282+0000","last_fullsized":"2024-08-31T06:46:18.660282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752795+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:45:19.752795+0000","last_peered":"2024-08-31T06:45:19.752795+0000","last_clean":"2024-08-31T06:45:19.752795+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:45:19.752795+0000","last_undegraded":"2024-08-31T06:45:19.752795+0000","last_fullsized":"2024-08-31T06:45:19.752795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660443+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:46:18.660443+0000","last_peered":"2024-08-31T06:46:18.660443+0000","last_clean":"2024-08-31T06:46:18.660443+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:46:18.660443+0000","last_undegraded":"2024-08-31T06:46:18.660443+0000","last_fullsized":"2024-08-31T06:46:18.660443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748495+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:45:19.748495+0000","last_peered":"2024-08-31T06:45:19.748495+0000","last_clean":"2024-08-31T06:45:19.748495+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:45:19.748495+0000","last_undegraded":"2024-08-31T06:45:19.748495+0000","last_fullsized":"2024-08-31T06:45:19.748495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661922+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:46:18.661922+0000","last_peered":"2024-08-31T06:46:18.661922+0000","last_clean":"2024-08-31T06:46:18.661922+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:46:18.661922+0000","last_undegraded":"2024-08-31T06:46:18.661922+0000","last_fullsized":"2024-08-31T06:46:18.661922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'7","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:40.860230+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:46:40.860230+0000","last_peered":"2024-08-31T06:46:40.860230+0000","last_clean":"2024-08-31T06:46:40.860230+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:46:40.860230+0000","last_undegraded":"2024-08-31T06:46:40.860230+0000","last_fullsized":"2024-08-31T06:46:40.860230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":7,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662079+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:46:18.662079+0000","last_peered":"2024-08-31T06:46:18.662079+0000","last_clean":"2024-08-31T06:46:18.662079+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:46:18.662079+0000","last_undegraded":"2024-08-31T06:46:18.662079+0000","last_fullsized":"2024-08-31T06:46:18.662079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748696+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:45:19.748696+0000","last_peered":"2024-08-31T06:45:19.748696+0000","last_clean":"2024-08-31T06:45:19.748696+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:45:19.748696+0000","last_undegraded":"2024-08-31T06:45:19.748696+0000","last_fullsized":"2024-08-31T06:45:19.748696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671183+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:46:18.671183+0000","last_peered":"2024-08-31T06:46:18.671183+0000","last_clean":"2024-08-31T06:46:18.671183+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:46:18.671183+0000","last_undegraded":"2024-08-31T06:46:18.671183+0000","last_fullsized":"2024-08-31T06:46:18.671183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749767+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:45:19.749767+0000","last_peered":"2024-08-31T06:45:19.749767+0000","last_clean":"2024-08-31T06:45:19.749767+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:45:19.749767+0000","last_undegraded":"2024-08-31T06:45:19.749767+0000","last_fullsized":"2024-08-31T06:45:19.749767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644774+0000","last_change":"2024-08-31T06:45:19.941511+0000","last_active":"2024-08-31T06:46:18.644774+0000","last_peered":"2024-08-31T06:46:18.644774+0000","last_clean":"2024-08-31T06:46:18.644774+0000","last_became_active":"2024-08-31T06:45:19.940991+0000","last_became_peered":"2024-08-31T06:45:19.940991+0000","last_unstale":"2024-08-31T06:46:18.644774+0000","last_undegraded":"2024-08-31T06:46:18.644774+0000","last_fullsized":"2024-08-31T06:46:18.644774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:25.268854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940677+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:45:19.940677+0000","last_peered":"2024-08-31T06:45:19.940677+0000","last_clean":"2024-08-31T06:45:19.940677+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:45:19.940677+0000","last_undegraded":"2024-08-31T06:45:19.940677+0000","last_fullsized":"2024-08-31T06:45:19.940677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662071+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:46:18.662071+0000","last_peered":"2024-08-31T06:46:18.662071+0000","last_clean":"2024-08-31T06:46:18.662071+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:46:18.662071+0000","last_undegraded":"2024-08-31T06:46:18.662071+0000","last_fullsized":"2024-08-31T06:46:18.662071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'60","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.521443+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:46:41.521443+0000","last_peered":"2024-08-31T06:46:41.521443+0000","last_clean":"2024-08-31T06:46:41.521443+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:46:41.521443+0000","last_undegraded":"2024-08-31T06:46:41.521443+0000","last_fullsized":"2024-08-31T06:46:41.521443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.663152+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:46:18.663152+0000","last_peered":"2024-08-31T06:46:18.663152+0000","last_clean":"2024-08-31T06:46:18.663152+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:46:18.663152+0000","last_undegraded":"2024-08-31T06:46:18.663152+0000","last_fullsized":"2024-08-31T06:46:18.663152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753167+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:45:19.753167+0000","last_peered":"2024-08-31T06:45:19.753167+0000","last_clean":"2024-08-31T06:45:19.753167+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:45:19.753167+0000","last_undegraded":"2024-08-31T06:45:19.753167+0000","last_fullsized":"2024-08-31T06:45:19.753167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.667685+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:46:18.667685+0000","last_peered":"2024-08-31T06:46:18.667685+0000","last_clean":"2024-08-31T06:46:18.667685+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:46:18.667685+0000","last_undegraded":"2024-08-31T06:46:18.667685+0000","last_fullsized":"2024-08-31T06:46:18.667685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753541+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:45:19.753541+0000","last_peered":"2024-08-31T06:45:19.753541+0000","last_clean":"2024-08-31T06:45:19.753541+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:45:19.753541+0000","last_undegraded":"2024-08-31T06:45:19.753541+0000","last_fullsized":"2024-08-31T06:45:19.753541+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941116+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:45:19.941116+0000","last_peered":"2024-08-31T06:45:19.941116+0000","last_clean":"2024-08-31T06:45:19.941116+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:45:19.941116+0000","last_undegraded":"2024-08-31T06:45:19.941116+0000","last_fullsized":"2024-08-31T06:45:19.941116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658466+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:46:18.658466+0000","last_peered":"2024-08-31T06:46:18.658466+0000","last_clean":"2024-08-31T06:46:18.658466+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:46:18.658466+0000","last_undegraded":"2024-08-31T06:46:18.658466+0000","last_fullsized":"2024-08-31T06:46:18.658466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753349+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:45:19.753349+0000","last_peered":"2024-08-31T06:45:19.753349+0000","last_clean":"2024-08-31T06:45:19.753349+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:45:19.753349+0000","last_undegraded":"2024-08-31T06:45:19.753349+0000","last_fullsized":"2024-08-31T06:45:19.753349+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647034+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:46:18.647034+0000","last_peered":"2024-08-31T06:46:18.647034+0000","last_clean":"2024-08-31T06:46:18.647034+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:46:18.647034+0000","last_undegraded":"2024-08-31T06:46:18.647034+0000","last_fullsized":"2024-08-31T06:46:18.647034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:38.856696+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:46:38.856696+0000","last_peered":"2024-08-31T06:46:38.856696+0000","last_clean":"2024-08-31T06:46:38.856696+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:46:38.856696+0000","last_undegraded":"2024-08-31T06:46:38.856696+0000","last_fullsized":"2024-08-31T06:46:38.856696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647947+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:46:18.647947+0000","last_peered":"2024-08-31T06:46:18.647947+0000","last_clean":"2024-08-31T06:46:18.647947+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:46:18.647947+0000","last_undegraded":"2024-08-31T06:46:18.647947+0000","last_fullsized":"2024-08-31T06:46:18.647947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753337+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:45:19.753337+0000","last_peered":"2024-08-31T06:45:19.753337+0000","last_clean":"2024-08-31T06:45:19.753337+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:45:19.753337+0000","last_undegraded":"2024-08-31T06:45:19.753337+0000","last_fullsized":"2024-08-31T06:45:19.753337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657118+0000","last_change":"2024-08-31T06:45:19.759585+0000","last_active":"2024-08-31T06:46:18.657118+0000","last_peered":"2024-08-31T06:46:18.657118+0000","last_clean":"2024-08-31T06:46:18.657118+0000","last_became_active":"2024-08-31T06:45:19.759026+0000","last_became_peered":"2024-08-31T06:45:19.759026+0000","last_unstale":"2024-08-31T06:46:18.657118+0000","last_undegraded":"2024-08-31T06:46:18.657118+0000","last_fullsized":"2024-08-31T06:46:18.657118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:54.716259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754330+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:45:19.754330+0000","last_peered":"2024-08-31T06:45:19.754330+0000","last_clean":"2024-08-31T06:45:19.754330+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:45:19.754330+0000","last_undegraded":"2024-08-31T06:45:19.754330+0000","last_fullsized":"2024-08-31T06:45:19.754330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656693+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:46:18.656693+0000","last_peered":"2024-08-31T06:46:18.656693+0000","last_clean":"2024-08-31T06:46:18.656693+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:46:18.656693+0000","last_undegraded":"2024-08-31T06:46:18.656693+0000","last_fullsized":"2024-08-31T06:46:18.656693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749624+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:45:19.749624+0000","last_peered":"2024-08-31T06:45:19.749624+0000","last_clean":"2024-08-31T06:45:19.749624+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:45:19.749624+0000","last_undegraded":"2024-08-31T06:45:19.749624+0000","last_fullsized":"2024-08-31T06:45:19.749624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640852+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:46:18.640852+0000","last_peered":"2024-08-31T06:46:18.640852+0000","last_clean":"2024-08-31T06:46:18.640852+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:46:18.640852+0000","last_undegraded":"2024-08-31T06:46:18.640852+0000","last_fullsized":"2024-08-31T06:46:18.640852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'53","reported_seq":102,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.059704+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:46:41.059704+0000","last_peered":"2024-08-31T06:46:41.059704+0000","last_clean":"2024-08-31T06:46:41.059704+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:46:41.059704+0000","last_undegraded":"2024-08-31T06:46:41.059704+0000","last_fullsized":"2024-08-31T06:46:41.059704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":77,"num_write":92,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639289+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:46:18.639289+0000","last_peered":"2024-08-31T06:46:18.639289+0000","last_clean":"2024-08-31T06:46:18.639289+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:46:18.639289+0000","last_undegraded":"2024-08-31T06:46:18.639289+0000","last_fullsized":"2024-08-31T06:46:18.639289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941154+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:45:19.941154+0000","last_peered":"2024-08-31T06:45:19.941154+0000","last_clean":"2024-08-31T06:45:19.941154+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:45:19.941154+0000","last_undegraded":"2024-08-31T06:45:19.941154+0000","last_fullsized":"2024-08-31T06:45:19.941154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659568+0000","last_change":"2024-08-31T06:45:19.942466+0000","last_active":"2024-08-31T06:46:18.659568+0000","last_peered":"2024-08-31T06:46:18.659568+0000","last_clean":"2024-08-31T06:46:18.659568+0000","last_became_active":"2024-08-31T06:45:19.941936+0000","last_became_peered":"2024-08-31T06:45:19.941936+0000","last_unstale":"2024-08-31T06:46:18.659568+0000","last_undegraded":"2024-08-31T06:46:18.659568+0000","last_fullsized":"2024-08-31T06:46:18.659568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:25.406883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.761034+0000","last_change":"2024-08-31T06:45:19.760954+0000","last_active":"2024-08-31T06:45:19.761034+0000","last_peered":"2024-08-31T06:45:19.761034+0000","last_clean":"2024-08-31T06:45:19.761034+0000","last_became_active":"2024-08-31T06:45:19.754797+0000","last_became_peered":"2024-08-31T06:45:19.754797+0000","last_unstale":"2024-08-31T06:45:19.761034+0000","last_undegraded":"2024-08-31T06:45:19.761034+0000","last_fullsized":"2024-08-31T06:45:19.761034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:25.559400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.614619+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:46:18.614619+0000","last_peered":"2024-08-31T06:46:18.614619+0000","last_clean":"2024-08-31T06:46:18.614619+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:46:18.614619+0000","last_undegraded":"2024-08-31T06:46:18.614619+0000","last_fullsized":"2024-08-31T06:46:18.614619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939437+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:45:19.939437+0000","last_peered":"2024-08-31T06:45:19.939437+0000","last_clean":"2024-08-31T06:45:19.939437+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:45:19.939437+0000","last_undegraded":"2024-08-31T06:45:19.939437+0000","last_fullsized":"2024-08-31T06:45:19.939437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.646654+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:46:18.646654+0000","last_peered":"2024-08-31T06:46:18.646654+0000","last_clean":"2024-08-31T06:46:18.646654+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:46:18.646654+0000","last_undegraded":"2024-08-31T06:46:18.646654+0000","last_fullsized":"2024-08-31T06:46:18.646654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751817+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:45:19.751817+0000","last_peered":"2024-08-31T06:45:19.751817+0000","last_clean":"2024-08-31T06:45:19.751817+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:45:19.751817+0000","last_undegraded":"2024-08-31T06:45:19.751817+0000","last_fullsized":"2024-08-31T06:45:19.751817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651274+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:46:18.651274+0000","last_peered":"2024-08-31T06:46:18.651274+0000","last_clean":"2024-08-31T06:46:18.651274+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:46:18.651274+0000","last_undegraded":"2024-08-31T06:46:18.651274+0000","last_fullsized":"2024-08-31T06:46:18.651274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670609+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:46:18.670609+0000","last_peered":"2024-08-31T06:46:18.670609+0000","last_clean":"2024-08-31T06:46:18.670609+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:46:18.670609+0000","last_undegraded":"2024-08-31T06:46:18.670609+0000","last_fullsized":"2024-08-31T06:46:18.670609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671752+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:46:18.671752+0000","last_peered":"2024-08-31T06:46:18.671752+0000","last_clean":"2024-08-31T06:46:18.671752+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:46:18.671752+0000","last_undegraded":"2024-08-31T06:46:18.671752+0000","last_fullsized":"2024-08-31T06:46:18.671752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756544+0000","last_change":"2024-08-31T06:45:19.756432+0000","last_active":"2024-08-31T06:45:19.756544+0000","last_peered":"2024-08-31T06:45:19.756544+0000","last_clean":"2024-08-31T06:45:19.756544+0000","last_became_active":"2024-08-31T06:45:19.751184+0000","last_became_peered":"2024-08-31T06:45:19.751184+0000","last_unstale":"2024-08-31T06:45:19.756544+0000","last_undegraded":"2024-08-31T06:45:19.756544+0000","last_fullsized":"2024-08-31T06:45:19.756544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:23.569829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670996+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:46:18.670996+0000","last_peered":"2024-08-31T06:46:18.670996+0000","last_clean":"2024-08-31T06:46:18.670996+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:46:18.670996+0000","last_undegraded":"2024-08-31T06:46:18.670996+0000","last_fullsized":"2024-08-31T06:46:18.670996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749443+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:45:19.749443+0000","last_peered":"2024-08-31T06:45:19.749443+0000","last_clean":"2024-08-31T06:45:19.749443+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:45:19.749443+0000","last_undegraded":"2024-08-31T06:45:19.749443+0000","last_fullsized":"2024-08-31T06:45:19.749443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665231+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:46:18.665231+0000","last_peered":"2024-08-31T06:46:18.665231+0000","last_clean":"2024-08-31T06:46:18.665231+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:46:18.665231+0000","last_undegraded":"2024-08-31T06:46:18.665231+0000","last_fullsized":"2024-08-31T06:46:18.665231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940028+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:45:19.940028+0000","last_peered":"2024-08-31T06:45:19.940028+0000","last_clean":"2024-08-31T06:45:19.940028+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:45:19.940028+0000","last_undegraded":"2024-08-31T06:45:19.940028+0000","last_fullsized":"2024-08-31T06:45:19.940028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653688+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:46:18.653688+0000","last_peered":"2024-08-31T06:46:18.653688+0000","last_clean":"2024-08-31T06:46:18.653688+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:46:18.653688+0000","last_undegraded":"2024-08-31T06:46:18.653688+0000","last_fullsized":"2024-08-31T06:46:18.653688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754818+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:45:19.754818+0000","last_peered":"2024-08-31T06:45:19.754818+0000","last_clean":"2024-08-31T06:45:19.754818+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:45:19.754818+0000","last_undegraded":"2024-08-31T06:45:19.754818+0000","last_fullsized":"2024-08-31T06:45:19.754818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":861163,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":808,"num_read_kb":531,"num_write":325,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2386881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":258,"ondisk_log_size":258,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776165,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":409286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939690,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1069912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103215,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":409522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":409442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1441792,"data_stored":1003813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":408911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37212,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707940,"statfs":{"total":95995035648,"available":95956930560,"internally_reserved":0,"allocated":1851392,"data_stored":1395857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":412802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1642496,"data_stored":1196214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378705,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":477161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542232,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":476433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":410182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":806912,"data_stored":787276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":396668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":197346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":464499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:46:45.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:46:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:45.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:45 smithi037 ceph-mon[18612]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 164 KiB/s wr, 27 op/s 2024-08-31T06:46:45.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:45 smithi037 ceph-mon[18612]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 -- 172.21.15.37:0/1228856938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c102880 msgr2=0x7f3f4c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 --2- 172.21.15.37:0/1228856938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c102880 0x7f3f4c102c90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009900 tx=0x7f3f4802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:45.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 -- 172.21.15.37:0/1228856938 shutdown_connections 2024-08-31T06:46:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 --2- 172.21.15.37:0/1228856938 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f4c108b10 0x7f3f4c10f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 --2- 172.21.15.37:0/1228856938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c1081c0 0x7f3f4c1085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 --2- 172.21.15.37:0/1228856938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c102880 0x7f3f4c102c90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 -- 172.21.15.37:0/1228856938 >> 172.21.15.37:0/1228856938 conn(0x7f3f4c079510 msgr2=0x7f3f4c079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 -- 172.21.15.37:0/1228856938 shutdown_connections 2024-08-31T06:46:45.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.876+0000 7f3f53680640 1 -- 172.21.15.37:0/1228856938 wait complete. 2024-08-31T06:46:45.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.877+0000 7f3f53680640 1 Processor -- start 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.877+0000 7f3f53680640 1 -- start start 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.877+0000 7f3f53680640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c102880 0x7f3f4c19a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.877+0000 7f3f53680640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f4c1081c0 0x7f3f4c19a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.877+0000 7f3f53680640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c108b10 0x7f3f4c19fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.877+0000 7f3f53680640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c112670 con 0x7f3f4c108b10 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.877+0000 7f3f53680640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1124f0 con 0x7f3f4c102880 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.877+0000 7f3f53680640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c1127f0 con 0x7f3f4c1081c0 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c108b10 0x7f3f4c19fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c108b10 0x7f3f4c19fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49524/0 (socket says 172.21.15.37:49524) 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 -- 172.21.15.37:0/1698799926 learned_addr learned my addr 172.21.15.37:0/1698799926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f50c1b640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f4c1081c0 0x7f3f4c19a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:45.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f5141c640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c102880 0x7f3f4c19a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 -- 172.21.15.37:0/1698799926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f4c1081c0 msgr2=0x7f3f4c19a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f4c1081c0 0x7f3f4c19a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 -- 172.21.15.37:0/1698799926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c102880 msgr2=0x7f3f4c19a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c102880 0x7f3f4c19a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 -- 172.21.15.37:0/1698799926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c1a01e0 con 0x7f3f4c108b10 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f51c1d640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c108b10 0x7f3f4c19fb70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cce0 tx=0x7f3f4400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f427fc640 1 -- 172.21.15.37:0/1698799926 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400f450 con 0x7f3f4c108b10 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f427fc640 1 -- 172.21.15.37:0/1698799926 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f4400fa80 con 0x7f3f4c108b10 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c1a04d0 con 0x7f3f4c108b10 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f427fc640 1 -- 172.21.15.37:0/1698799926 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44018ad0 con 0x7f3f4c108b10 2024-08-31T06:46:45.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.878+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c1a6cf0 con 0x7f3f4c108b10 2024-08-31T06:46:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.880+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c103b00 con 0x7f3f4c108b10 2024-08-31T06:46:45.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.881+0000 7f3f427fc640 1 -- 172.21.15.37:0/1698799926 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f3f4400f5f0 con 0x7f3f4c108b10 2024-08-31T06:46:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.882+0000 7f3f427fc640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3f380b4cd0 0x7f3f380b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.882+0000 7f3f5141c640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3f380b4cd0 0x7f3f380b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.882+0000 7f3f427fc640 1 -- 172.21.15.37:0/1698799926 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3f440e5c60 con 0x7f3f4c108b10 2024-08-31T06:46:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.883+0000 7f3f5141c640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3f380b4cd0 0x7f3f380b71e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3f480057c0 tx=0x7f3f480058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:45.885+0000 7f3f427fc640 1 -- 172.21.15.37:0/1698799926 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f3f44014030 con 0x7f3f4c108b10 2024-08-31T06:46:45.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:45 smithi066 ceph-mon[22244]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 164 KiB/s wr, 27 op/s 2024-08-31T06:46:45.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:45 smithi066 ceph-mon[22244]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:45 smithi106 ceph-mon[22134]: pgmap v317: 97 pgs: 97 active+clean; 1.4 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 164 KiB/s wr, 27 op/s 2024-08-31T06:46:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:45 smithi106 ceph-mon[22134]: from='client.15537 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.067+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f4c0635a0 con 0x7f3f380b4cd0 2024-08-31T06:46:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.071+0000 7f3f427fc640 1 -- 172.21.15.37:0/1698799926 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258884 (secure 0 0 0) 0x7f3f4c0635a0 con 0x7f3f380b4cd0 2024-08-31T06:46:46.075 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3f380b4cd0 msgr2=0x7f3f380b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3f380b4cd0 0x7f3f380b71e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3f480057c0 tx=0x7f3f480058d0 comp rx=0 tx=0).stop 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c108b10 msgr2=0x7f3f4c19fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c108b10 0x7f3f4c19fb70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cce0 tx=0x7f3f4400a620 comp rx=0 tx=0).stop 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 shutdown_connections 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3f380b4cd0 0x7f3f380b71e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c108b10 0x7f3f4c19fb70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f4c1081c0 0x7f3f4c19a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 --2- 172.21.15.37:0/1698799926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f4c102880 0x7f3f4c19a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 >> 172.21.15.37:0/1698799926 conn(0x7f3f4c079510 msgr2=0x7f3f4c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 shutdown_connections 2024-08-31T06:46:46.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:46.074+0000 7f3f53680640 1 -- 172.21.15.37:0/1698799926 wait complete. 2024-08-31T06:46:46.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:46 smithi037 ceph-mon[18612]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:46.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:46 smithi066 ceph-mon[22244]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:46.925 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-08-31T06:46:44.274949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1451765,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":889,"num_read_kb":600,"num_write":450,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":852,"ondisk_log_size":852,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366580,"kb_used_data":13052,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575244,"statfs":{"total":1151940427776,"available":1151565049856,"internally_reserved":0,"allocated":13365248,"data_stored":8079535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":794999,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":185,"num_read_kb":147,"num_write":146,"num_write_kb":1974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003352"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665746+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:46:18.665746+0000","last_peered":"2024-08-31T06:46:18.665746+0000","last_clean":"2024-08-31T06:46:18.665746+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:46:18.665746+0000","last_undegraded":"2024-08-31T06:46:18.665746+0000","last_fullsized":"2024-08-31T06:46:18.665746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659822+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:46:18.659822+0000","last_peered":"2024-08-31T06:46:18.659822+0000","last_clean":"2024-08-31T06:46:18.659822+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:46:18.659822+0000","last_undegraded":"2024-08-31T06:46:18.659822+0000","last_fullsized":"2024-08-31T06:46:18.659822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665290+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:46:18.665290+0000","last_peered":"2024-08-31T06:46:18.665290+0000","last_clean":"2024-08-31T06:46:18.665290+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:46:18.665290+0000","last_undegraded":"2024-08-31T06:46:18.665290+0000","last_fullsized":"2024-08-31T06:46:18.665290+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.650100+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:46:18.650100+0000","last_peered":"2024-08-31T06:46:18.650100+0000","last_clean":"2024-08-31T06:46:18.650100+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:46:18.650100+0000","last_undegraded":"2024-08-31T06:46:18.650100+0000","last_fullsized":"2024-08-31T06:46:18.650100+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640151+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:46:18.640151+0000","last_peered":"2024-08-31T06:46:18.640151+0000","last_clean":"2024-08-31T06:46:18.640151+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:46:18.640151+0000","last_undegraded":"2024-08-31T06:46:18.640151+0000","last_fullsized":"2024-08-31T06:46:18.640151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657815+0000","last_change":"2024-08-31T06:45:19.756707+0000","last_active":"2024-08-31T06:46:18.657815+0000","last_peered":"2024-08-31T06:46:18.657815+0000","last_clean":"2024-08-31T06:46:18.657815+0000","last_became_active":"2024-08-31T06:45:19.756086+0000","last_became_peered":"2024-08-31T06:45:19.756086+0000","last_unstale":"2024-08-31T06:46:18.657815+0000","last_undegraded":"2024-08-31T06:46:18.657815+0000","last_fullsized":"2024-08-31T06:46:18.657815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:44:24.147502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662767+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:46:18.662767+0000","last_peered":"2024-08-31T06:46:18.662767+0000","last_clean":"2024-08-31T06:46:18.662767+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:46:18.662767+0000","last_undegraded":"2024-08-31T06:46:18.662767+0000","last_fullsized":"2024-08-31T06:46:18.662767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.654017+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:46:18.654017+0000","last_peered":"2024-08-31T06:46:18.654017+0000","last_clean":"2024-08-31T06:46:18.654017+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:46:18.654017+0000","last_undegraded":"2024-08-31T06:46:18.654017+0000","last_fullsized":"2024-08-31T06:46:18.654017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671760+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:46:18.671760+0000","last_peered":"2024-08-31T06:46:18.671760+0000","last_clean":"2024-08-31T06:46:18.671760+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:46:18.671760+0000","last_undegraded":"2024-08-31T06:46:18.671760+0000","last_fullsized":"2024-08-31T06:46:18.671760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659726+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:46:18.659726+0000","last_peered":"2024-08-31T06:46:18.659726+0000","last_clean":"2024-08-31T06:46:18.659726+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:46:18.659726+0000","last_undegraded":"2024-08-31T06:46:18.659726+0000","last_fullsized":"2024-08-31T06:46:18.659726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.666910+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:46:18.666910+0000","last_peered":"2024-08-31T06:46:18.666910+0000","last_clean":"2024-08-31T06:46:18.666910+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:46:18.666910+0000","last_undegraded":"2024-08-31T06:46:18.666910+0000","last_fullsized":"2024-08-31T06:46:18.666910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649818+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:46:18.649818+0000","last_peered":"2024-08-31T06:46:18.649818+0000","last_clean":"2024-08-31T06:46:18.649818+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:46:18.649818+0000","last_undegraded":"2024-08-31T06:46:18.649818+0000","last_fullsized":"2024-08-31T06:46:18.649818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658630+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:46:18.658630+0000","last_peered":"2024-08-31T06:46:18.658630+0000","last_clean":"2024-08-31T06:46:18.658630+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:46:18.658630+0000","last_undegraded":"2024-08-31T06:46:18.658630+0000","last_fullsized":"2024-08-31T06:46:18.658630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656512+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:46:18.656512+0000","last_peered":"2024-08-31T06:46:18.656512+0000","last_clean":"2024-08-31T06:46:18.656512+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:46:18.656512+0000","last_undegraded":"2024-08-31T06:46:18.656512+0000","last_fullsized":"2024-08-31T06:46:18.656512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658480+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:46:18.658480+0000","last_peered":"2024-08-31T06:46:18.658480+0000","last_clean":"2024-08-31T06:46:18.658480+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:46:18.658480+0000","last_undegraded":"2024-08-31T06:46:18.658480+0000","last_fullsized":"2024-08-31T06:46:18.658480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672261+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:46:18.672261+0000","last_peered":"2024-08-31T06:46:18.672261+0000","last_clean":"2024-08-31T06:46:18.672261+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:46:18.672261+0000","last_undegraded":"2024-08-31T06:46:18.672261+0000","last_fullsized":"2024-08-31T06:46:18.672261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665677+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:46:18.665677+0000","last_peered":"2024-08-31T06:46:18.665677+0000","last_clean":"2024-08-31T06:46:18.665677+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:46:18.665677+0000","last_undegraded":"2024-08-31T06:46:18.665677+0000","last_fullsized":"2024-08-31T06:46:18.665677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658429+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:46:18.658429+0000","last_peered":"2024-08-31T06:46:18.658429+0000","last_clean":"2024-08-31T06:46:18.658429+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:46:18.658429+0000","last_undegraded":"2024-08-31T06:46:18.658429+0000","last_fullsized":"2024-08-31T06:46:18.658429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644995+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:46:18.644995+0000","last_peered":"2024-08-31T06:46:18.644995+0000","last_clean":"2024-08-31T06:46:18.644995+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:46:18.644995+0000","last_undegraded":"2024-08-31T06:46:18.644995+0000","last_fullsized":"2024-08-31T06:46:18.644995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653051+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:46:18.653051+0000","last_peered":"2024-08-31T06:46:18.653051+0000","last_clean":"2024-08-31T06:46:18.653051+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:46:18.653051+0000","last_undegraded":"2024-08-31T06:46:18.653051+0000","last_fullsized":"2024-08-31T06:46:18.653051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661106+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:46:18.661106+0000","last_peered":"2024-08-31T06:46:18.661106+0000","last_clean":"2024-08-31T06:46:18.661106+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:46:18.661106+0000","last_undegraded":"2024-08-31T06:46:18.661106+0000","last_fullsized":"2024-08-31T06:46:18.661106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.673097+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:46:18.673097+0000","last_peered":"2024-08-31T06:46:18.673097+0000","last_clean":"2024-08-31T06:46:18.673097+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:46:18.673097+0000","last_undegraded":"2024-08-31T06:46:18.673097+0000","last_fullsized":"2024-08-31T06:46:18.673097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638344+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:46:18.638344+0000","last_peered":"2024-08-31T06:46:18.638344+0000","last_clean":"2024-08-31T06:46:18.638344+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:46:18.638344+0000","last_undegraded":"2024-08-31T06:46:18.638344+0000","last_fullsized":"2024-08-31T06:46:18.638344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651434+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:46:18.651434+0000","last_peered":"2024-08-31T06:46:18.651434+0000","last_clean":"2024-08-31T06:46:18.651434+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:46:18.651434+0000","last_undegraded":"2024-08-31T06:46:18.651434+0000","last_fullsized":"2024-08-31T06:46:18.651434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638274+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:46:18.638274+0000","last_peered":"2024-08-31T06:46:18.638274+0000","last_clean":"2024-08-31T06:46:18.638274+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:46:18.638274+0000","last_undegraded":"2024-08-31T06:46:18.638274+0000","last_fullsized":"2024-08-31T06:46:18.638274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658774+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:46:18.658774+0000","last_peered":"2024-08-31T06:46:18.658774+0000","last_clean":"2024-08-31T06:46:18.658774+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:46:18.658774+0000","last_undegraded":"2024-08-31T06:46:18.658774+0000","last_fullsized":"2024-08-31T06:46:18.658774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637037+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:46:18.637037+0000","last_peered":"2024-08-31T06:46:18.637037+0000","last_clean":"2024-08-31T06:46:18.637037+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:46:18.637037+0000","last_undegraded":"2024-08-31T06:46:18.637037+0000","last_fullsized":"2024-08-31T06:46:18.637037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.645592+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:46:18.645592+0000","last_peered":"2024-08-31T06:46:18.645592+0000","last_clean":"2024-08-31T06:46:18.645592+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:46:18.645592+0000","last_undegraded":"2024-08-31T06:46:18.645592+0000","last_fullsized":"2024-08-31T06:46:18.645592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658756+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:46:18.658756+0000","last_peered":"2024-08-31T06:46:18.658756+0000","last_clean":"2024-08-31T06:46:18.658756+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:46:18.658756+0000","last_undegraded":"2024-08-31T06:46:18.658756+0000","last_fullsized":"2024-08-31T06:46:18.658756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647670+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:46:18.647670+0000","last_peered":"2024-08-31T06:46:18.647670+0000","last_clean":"2024-08-31T06:46:18.647670+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:46:18.647670+0000","last_undegraded":"2024-08-31T06:46:18.647670+0000","last_fullsized":"2024-08-31T06:46:18.647670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658511+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:46:18.658511+0000","last_peered":"2024-08-31T06:46:18.658511+0000","last_clean":"2024-08-31T06:46:18.658511+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:46:18.658511+0000","last_undegraded":"2024-08-31T06:46:18.658511+0000","last_fullsized":"2024-08-31T06:46:18.658511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647528+0000","last_change":"2024-08-31T06:45:19.754501+0000","last_active":"2024-08-31T06:46:18.647528+0000","last_peered":"2024-08-31T06:46:18.647528+0000","last_clean":"2024-08-31T06:46:18.647528+0000","last_became_active":"2024-08-31T06:45:19.754085+0000","last_became_peered":"2024-08-31T06:45:19.754085+0000","last_unstale":"2024-08-31T06:46:18.647528+0000","last_undegraded":"2024-08-31T06:46:18.647528+0000","last_fullsized":"2024-08-31T06:46:18.647528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:50:04.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637559+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:46:18.637559+0000","last_peered":"2024-08-31T06:46:18.637559+0000","last_clean":"2024-08-31T06:46:18.637559+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:46:18.637559+0000","last_undegraded":"2024-08-31T06:46:18.637559+0000","last_fullsized":"2024-08-31T06:46:18.637559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'9","reported_seq":161,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.089011+0000","last_change":"2024-08-31T06:45:19.947200+0000","last_active":"2024-08-31T06:46:41.089011+0000","last_peered":"2024-08-31T06:46:41.089011+0000","last_clean":"2024-08-31T06:46:41.089011+0000","last_became_active":"2024-08-31T06:45:19.942294+0000","last_became_peered":"2024-08-31T06:45:19.942294+0000","last_unstale":"2024-08-31T06:46:41.089011+0000","last_undegraded":"2024-08-31T06:46:41.089011+0000","last_fullsized":"2024-08-31T06:46:41.089011+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:40.241862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651596+0000","last_change":"2024-08-31T06:45:19.942081+0000","last_active":"2024-08-31T06:46:18.651596+0000","last_peered":"2024-08-31T06:46:18.651596+0000","last_clean":"2024-08-31T06:46:18.651596+0000","last_became_active":"2024-08-31T06:45:19.941427+0000","last_became_peered":"2024-08-31T06:45:19.941427+0000","last_unstale":"2024-08-31T06:46:18.651596+0000","last_undegraded":"2024-08-31T06:46:18.651596+0000","last_fullsized":"2024-08-31T06:46:18.651596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:47.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749301+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:45:19.749301+0000","last_peered":"2024-08-31T06:45:19.749301+0000","last_clean":"2024-08-31T06:45:19.749301+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:45:19.749301+0000","last_undegraded":"2024-08-31T06:45:19.749301+0000","last_fullsized":"2024-08-31T06:45:19.749301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940290+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:45:19.940290+0000","last_peered":"2024-08-31T06:45:19.940290+0000","last_clean":"2024-08-31T06:45:19.940290+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:45:19.940290+0000","last_undegraded":"2024-08-31T06:45:19.940290+0000","last_fullsized":"2024-08-31T06:45:19.940290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639066+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:46:18.639066+0000","last_peered":"2024-08-31T06:46:18.639066+0000","last_clean":"2024-08-31T06:46:18.639066+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:46:18.639066+0000","last_undegraded":"2024-08-31T06:46:18.639066+0000","last_fullsized":"2024-08-31T06:46:18.639066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748301+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:45:19.748301+0000","last_peered":"2024-08-31T06:45:19.748301+0000","last_clean":"2024-08-31T06:45:19.748301+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:45:19.748301+0000","last_undegraded":"2024-08-31T06:45:19.748301+0000","last_fullsized":"2024-08-31T06:45:19.748301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656325+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:46:18.656325+0000","last_peered":"2024-08-31T06:46:18.656325+0000","last_clean":"2024-08-31T06:46:18.656325+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:46:18.656325+0000","last_undegraded":"2024-08-31T06:46:18.656325+0000","last_fullsized":"2024-08-31T06:46:18.656325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:40.086917+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:46:40.086917+0000","last_peered":"2024-08-31T06:46:40.086917+0000","last_clean":"2024-08-31T06:46:40.086917+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:46:40.086917+0000","last_undegraded":"2024-08-31T06:46:40.086917+0000","last_fullsized":"2024-08-31T06:46:40.086917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670727+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:46:18.670727+0000","last_peered":"2024-08-31T06:46:18.670727+0000","last_clean":"2024-08-31T06:46:18.670727+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:46:18.670727+0000","last_undegraded":"2024-08-31T06:46:18.670727+0000","last_fullsized":"2024-08-31T06:46:18.670727+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753069+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:45:19.753069+0000","last_peered":"2024-08-31T06:45:19.753069+0000","last_clean":"2024-08-31T06:45:19.753069+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:45:19.753069+0000","last_undegraded":"2024-08-31T06:45:19.753069+0000","last_fullsized":"2024-08-31T06:45:19.753069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659721+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:46:18.659721+0000","last_peered":"2024-08-31T06:46:18.659721+0000","last_clean":"2024-08-31T06:46:18.659721+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:46:18.659721+0000","last_undegraded":"2024-08-31T06:46:18.659721+0000","last_fullsized":"2024-08-31T06:46:18.659721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748845+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:45:19.748845+0000","last_peered":"2024-08-31T06:45:19.748845+0000","last_clean":"2024-08-31T06:45:19.748845+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:45:19.748845+0000","last_undegraded":"2024-08-31T06:45:19.748845+0000","last_fullsized":"2024-08-31T06:45:19.748845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672581+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:46:18.672581+0000","last_peered":"2024-08-31T06:46:18.672581+0000","last_clean":"2024-08-31T06:46:18.672581+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:46:18.672581+0000","last_undegraded":"2024-08-31T06:46:18.672581+0000","last_fullsized":"2024-08-31T06:46:18.672581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":290,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.088348+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:46:41.088348+0000","last_peered":"2024-08-31T06:46:41.088348+0000","last_clean":"2024-08-31T06:46:41.088348+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:46:41.088348+0000","last_undegraded":"2024-08-31T06:46:41.088348+0000","last_fullsized":"2024-08-31T06:46:41.088348+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67729,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":231,"num_read_kb":181,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660282+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:46:18.660282+0000","last_peered":"2024-08-31T06:46:18.660282+0000","last_clean":"2024-08-31T06:46:18.660282+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:46:18.660282+0000","last_undegraded":"2024-08-31T06:46:18.660282+0000","last_fullsized":"2024-08-31T06:46:18.660282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752795+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:45:19.752795+0000","last_peered":"2024-08-31T06:45:19.752795+0000","last_clean":"2024-08-31T06:45:19.752795+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:45:19.752795+0000","last_undegraded":"2024-08-31T06:45:19.752795+0000","last_fullsized":"2024-08-31T06:45:19.752795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660443+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:46:18.660443+0000","last_peered":"2024-08-31T06:46:18.660443+0000","last_clean":"2024-08-31T06:46:18.660443+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:46:18.660443+0000","last_undegraded":"2024-08-31T06:46:18.660443+0000","last_fullsized":"2024-08-31T06:46:18.660443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748495+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:45:19.748495+0000","last_peered":"2024-08-31T06:45:19.748495+0000","last_clean":"2024-08-31T06:45:19.748495+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:45:19.748495+0000","last_undegraded":"2024-08-31T06:45:19.748495+0000","last_fullsized":"2024-08-31T06:45:19.748495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661922+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:46:18.661922+0000","last_peered":"2024-08-31T06:46:18.661922+0000","last_clean":"2024-08-31T06:46:18.661922+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:46:18.661922+0000","last_undegraded":"2024-08-31T06:46:18.661922+0000","last_fullsized":"2024-08-31T06:46:18.661922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'7","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:40.860230+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:46:40.860230+0000","last_peered":"2024-08-31T06:46:40.860230+0000","last_clean":"2024-08-31T06:46:40.860230+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:46:40.860230+0000","last_undegraded":"2024-08-31T06:46:40.860230+0000","last_fullsized":"2024-08-31T06:46:40.860230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":7,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662079+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:46:18.662079+0000","last_peered":"2024-08-31T06:46:18.662079+0000","last_clean":"2024-08-31T06:46:18.662079+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:46:18.662079+0000","last_undegraded":"2024-08-31T06:46:18.662079+0000","last_fullsized":"2024-08-31T06:46:18.662079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748696+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:45:19.748696+0000","last_peered":"2024-08-31T06:45:19.748696+0000","last_clean":"2024-08-31T06:45:19.748696+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:45:19.748696+0000","last_undegraded":"2024-08-31T06:45:19.748696+0000","last_fullsized":"2024-08-31T06:45:19.748696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671183+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:46:18.671183+0000","last_peered":"2024-08-31T06:46:18.671183+0000","last_clean":"2024-08-31T06:46:18.671183+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:46:18.671183+0000","last_undegraded":"2024-08-31T06:46:18.671183+0000","last_fullsized":"2024-08-31T06:46:18.671183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749767+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:45:19.749767+0000","last_peered":"2024-08-31T06:45:19.749767+0000","last_clean":"2024-08-31T06:45:19.749767+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:45:19.749767+0000","last_undegraded":"2024-08-31T06:45:19.749767+0000","last_fullsized":"2024-08-31T06:45:19.749767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644774+0000","last_change":"2024-08-31T06:45:19.941511+0000","last_active":"2024-08-31T06:46:18.644774+0000","last_peered":"2024-08-31T06:46:18.644774+0000","last_clean":"2024-08-31T06:46:18.644774+0000","last_became_active":"2024-08-31T06:45:19.940991+0000","last_became_peered":"2024-08-31T06:45:19.940991+0000","last_unstale":"2024-08-31T06:46:18.644774+0000","last_undegraded":"2024-08-31T06:46:18.644774+0000","last_fullsized":"2024-08-31T06:46:18.644774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:25.268854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940677+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:45:19.940677+0000","last_peered":"2024-08-31T06:45:19.940677+0000","last_clean":"2024-08-31T06:45:19.940677+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:45:19.940677+0000","last_undegraded":"2024-08-31T06:45:19.940677+0000","last_fullsized":"2024-08-31T06:45:19.940677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662071+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:46:18.662071+0000","last_peered":"2024-08-31T06:46:18.662071+0000","last_clean":"2024-08-31T06:46:18.662071+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:46:18.662071+0000","last_undegraded":"2024-08-31T06:46:18.662071+0000","last_fullsized":"2024-08-31T06:46:18.662071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'60","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.521443+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:46:41.521443+0000","last_peered":"2024-08-31T06:46:41.521443+0000","last_clean":"2024-08-31T06:46:41.521443+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:46:41.521443+0000","last_undegraded":"2024-08-31T06:46:41.521443+0000","last_fullsized":"2024-08-31T06:46:41.521443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.663152+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:46:18.663152+0000","last_peered":"2024-08-31T06:46:18.663152+0000","last_clean":"2024-08-31T06:46:18.663152+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:46:18.663152+0000","last_undegraded":"2024-08-31T06:46:18.663152+0000","last_fullsized":"2024-08-31T06:46:18.663152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753167+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:45:19.753167+0000","last_peered":"2024-08-31T06:45:19.753167+0000","last_clean":"2024-08-31T06:45:19.753167+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:45:19.753167+0000","last_undegraded":"2024-08-31T06:45:19.753167+0000","last_fullsized":"2024-08-31T06:45:19.753167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.667685+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:46:18.667685+0000","last_peered":"2024-08-31T06:46:18.667685+0000","last_clean":"2024-08-31T06:46:18.667685+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:46:18.667685+0000","last_undegraded":"2024-08-31T06:46:18.667685+0000","last_fullsized":"2024-08-31T06:46:18.667685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753541+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:45:19.753541+0000","last_peered":"2024-08-31T06:45:19.753541+0000","last_clean":"2024-08-31T06:45:19.753541+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:45:19.753541+0000","last_undegraded":"2024-08-31T06:45:19.753541+0000","last_fullsized":"2024-08-31T06:45:19.753541+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941116+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:45:19.941116+0000","last_peered":"2024-08-31T06:45:19.941116+0000","last_clean":"2024-08-31T06:45:19.941116+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:45:19.941116+0000","last_undegraded":"2024-08-31T06:45:19.941116+0000","last_fullsized":"2024-08-31T06:45:19.941116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658466+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:46:18.658466+0000","last_peered":"2024-08-31T06:46:18.658466+0000","last_clean":"2024-08-31T06:46:18.658466+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:46:18.658466+0000","last_undegraded":"2024-08-31T06:46:18.658466+0000","last_fullsized":"2024-08-31T06:46:18.658466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753349+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:45:19.753349+0000","last_peered":"2024-08-31T06:45:19.753349+0000","last_clean":"2024-08-31T06:45:19.753349+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:45:19.753349+0000","last_undegraded":"2024-08-31T06:45:19.753349+0000","last_fullsized":"2024-08-31T06:45:19.753349+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647034+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:46:18.647034+0000","last_peered":"2024-08-31T06:46:18.647034+0000","last_clean":"2024-08-31T06:46:18.647034+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:46:18.647034+0000","last_undegraded":"2024-08-31T06:46:18.647034+0000","last_fullsized":"2024-08-31T06:46:18.647034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":136,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:38.856696+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:46:38.856696+0000","last_peered":"2024-08-31T06:46:38.856696+0000","last_clean":"2024-08-31T06:46:38.856696+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:46:38.856696+0000","last_undegraded":"2024-08-31T06:46:38.856696+0000","last_fullsized":"2024-08-31T06:46:38.856696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647947+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:46:18.647947+0000","last_peered":"2024-08-31T06:46:18.647947+0000","last_clean":"2024-08-31T06:46:18.647947+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:46:18.647947+0000","last_undegraded":"2024-08-31T06:46:18.647947+0000","last_fullsized":"2024-08-31T06:46:18.647947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753337+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:45:19.753337+0000","last_peered":"2024-08-31T06:45:19.753337+0000","last_clean":"2024-08-31T06:45:19.753337+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:45:19.753337+0000","last_undegraded":"2024-08-31T06:45:19.753337+0000","last_fullsized":"2024-08-31T06:45:19.753337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657118+0000","last_change":"2024-08-31T06:45:19.759585+0000","last_active":"2024-08-31T06:46:18.657118+0000","last_peered":"2024-08-31T06:46:18.657118+0000","last_clean":"2024-08-31T06:46:18.657118+0000","last_became_active":"2024-08-31T06:45:19.759026+0000","last_became_peered":"2024-08-31T06:45:19.759026+0000","last_unstale":"2024-08-31T06:46:18.657118+0000","last_undegraded":"2024-08-31T06:46:18.657118+0000","last_fullsized":"2024-08-31T06:46:18.657118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:54.716259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754330+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:45:19.754330+0000","last_peered":"2024-08-31T06:45:19.754330+0000","last_clean":"2024-08-31T06:45:19.754330+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:45:19.754330+0000","last_undegraded":"2024-08-31T06:45:19.754330+0000","last_fullsized":"2024-08-31T06:45:19.754330+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656693+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:46:18.656693+0000","last_peered":"2024-08-31T06:46:18.656693+0000","last_clean":"2024-08-31T06:46:18.656693+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:46:18.656693+0000","last_undegraded":"2024-08-31T06:46:18.656693+0000","last_fullsized":"2024-08-31T06:46:18.656693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749624+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:45:19.749624+0000","last_peered":"2024-08-31T06:45:19.749624+0000","last_clean":"2024-08-31T06:45:19.749624+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:45:19.749624+0000","last_undegraded":"2024-08-31T06:45:19.749624+0000","last_fullsized":"2024-08-31T06:45:19.749624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640852+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:46:18.640852+0000","last_peered":"2024-08-31T06:46:18.640852+0000","last_clean":"2024-08-31T06:46:18.640852+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:46:18.640852+0000","last_undegraded":"2024-08-31T06:46:18.640852+0000","last_fullsized":"2024-08-31T06:46:18.640852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'53","reported_seq":102,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.059704+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:46:41.059704+0000","last_peered":"2024-08-31T06:46:41.059704+0000","last_clean":"2024-08-31T06:46:41.059704+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:46:41.059704+0000","last_undegraded":"2024-08-31T06:46:41.059704+0000","last_fullsized":"2024-08-31T06:46:41.059704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":90,"num_read_kb":77,"num_write":92,"num_write_kb":1094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639289+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:46:18.639289+0000","last_peered":"2024-08-31T06:46:18.639289+0000","last_clean":"2024-08-31T06:46:18.639289+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:46:18.639289+0000","last_undegraded":"2024-08-31T06:46:18.639289+0000","last_fullsized":"2024-08-31T06:46:18.639289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941154+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:45:19.941154+0000","last_peered":"2024-08-31T06:45:19.941154+0000","last_clean":"2024-08-31T06:45:19.941154+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:45:19.941154+0000","last_undegraded":"2024-08-31T06:45:19.941154+0000","last_fullsized":"2024-08-31T06:45:19.941154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659568+0000","last_change":"2024-08-31T06:45:19.942466+0000","last_active":"2024-08-31T06:46:18.659568+0000","last_peered":"2024-08-31T06:46:18.659568+0000","last_clean":"2024-08-31T06:46:18.659568+0000","last_became_active":"2024-08-31T06:45:19.941936+0000","last_became_peered":"2024-08-31T06:45:19.941936+0000","last_unstale":"2024-08-31T06:46:18.659568+0000","last_undegraded":"2024-08-31T06:46:18.659568+0000","last_fullsized":"2024-08-31T06:46:18.659568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:25.406883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.761034+0000","last_change":"2024-08-31T06:45:19.760954+0000","last_active":"2024-08-31T06:45:19.761034+0000","last_peered":"2024-08-31T06:45:19.761034+0000","last_clean":"2024-08-31T06:45:19.761034+0000","last_became_active":"2024-08-31T06:45:19.754797+0000","last_became_peered":"2024-08-31T06:45:19.754797+0000","last_unstale":"2024-08-31T06:45:19.761034+0000","last_undegraded":"2024-08-31T06:45:19.761034+0000","last_fullsized":"2024-08-31T06:45:19.761034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:25.559400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.614619+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:46:18.614619+0000","last_peered":"2024-08-31T06:46:18.614619+0000","last_clean":"2024-08-31T06:46:18.614619+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:46:18.614619+0000","last_undegraded":"2024-08-31T06:46:18.614619+0000","last_fullsized":"2024-08-31T06:46:18.614619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939437+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:45:19.939437+0000","last_peered":"2024-08-31T06:45:19.939437+0000","last_clean":"2024-08-31T06:45:19.939437+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:45:19.939437+0000","last_undegraded":"2024-08-31T06:45:19.939437+0000","last_fullsized":"2024-08-31T06:45:19.939437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.646654+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:46:18.646654+0000","last_peered":"2024-08-31T06:46:18.646654+0000","last_clean":"2024-08-31T06:46:18.646654+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:46:18.646654+0000","last_undegraded":"2024-08-31T06:46:18.646654+0000","last_fullsized":"2024-08-31T06:46:18.646654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751817+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:45:19.751817+0000","last_peered":"2024-08-31T06:45:19.751817+0000","last_clean":"2024-08-31T06:45:19.751817+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:45:19.751817+0000","last_undegraded":"2024-08-31T06:45:19.751817+0000","last_fullsized":"2024-08-31T06:45:19.751817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651274+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:46:18.651274+0000","last_peered":"2024-08-31T06:46:18.651274+0000","last_clean":"2024-08-31T06:46:18.651274+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:46:18.651274+0000","last_undegraded":"2024-08-31T06:46:18.651274+0000","last_fullsized":"2024-08-31T06:46:18.651274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670609+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:46:18.670609+0000","last_peered":"2024-08-31T06:46:18.670609+0000","last_clean":"2024-08-31T06:46:18.670609+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:46:18.670609+0000","last_undegraded":"2024-08-31T06:46:18.670609+0000","last_fullsized":"2024-08-31T06:46:18.670609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671752+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:46:18.671752+0000","last_peered":"2024-08-31T06:46:18.671752+0000","last_clean":"2024-08-31T06:46:18.671752+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:46:18.671752+0000","last_undegraded":"2024-08-31T06:46:18.671752+0000","last_fullsized":"2024-08-31T06:46:18.671752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756544+0000","last_change":"2024-08-31T06:45:19.756432+0000","last_active":"2024-08-31T06:45:19.756544+0000","last_peered":"2024-08-31T06:45:19.756544+0000","last_clean":"2024-08-31T06:45:19.756544+0000","last_became_active":"2024-08-31T06:45:19.751184+0000","last_became_peered":"2024-08-31T06:45:19.751184+0000","last_unstale":"2024-08-31T06:45:19.756544+0000","last_undegraded":"2024-08-31T06:45:19.756544+0000","last_fullsized":"2024-08-31T06:45:19.756544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:23.569829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670996+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:46:18.670996+0000","last_peered":"2024-08-31T06:46:18.670996+0000","last_clean":"2024-08-31T06:46:18.670996+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:46:18.670996+0000","last_undegraded":"2024-08-31T06:46:18.670996+0000","last_fullsized":"2024-08-31T06:46:18.670996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749443+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:45:19.749443+0000","last_peered":"2024-08-31T06:45:19.749443+0000","last_clean":"2024-08-31T06:45:19.749443+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:45:19.749443+0000","last_undegraded":"2024-08-31T06:45:19.749443+0000","last_fullsized":"2024-08-31T06:45:19.749443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665231+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:46:18.665231+0000","last_peered":"2024-08-31T06:46:18.665231+0000","last_clean":"2024-08-31T06:46:18.665231+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:46:18.665231+0000","last_undegraded":"2024-08-31T06:46:18.665231+0000","last_fullsized":"2024-08-31T06:46:18.665231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940028+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:45:19.940028+0000","last_peered":"2024-08-31T06:45:19.940028+0000","last_clean":"2024-08-31T06:45:19.940028+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:45:19.940028+0000","last_undegraded":"2024-08-31T06:45:19.940028+0000","last_fullsized":"2024-08-31T06:45:19.940028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653688+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:46:18.653688+0000","last_peered":"2024-08-31T06:46:18.653688+0000","last_clean":"2024-08-31T06:46:18.653688+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:46:18.653688+0000","last_undegraded":"2024-08-31T06:46:18.653688+0000","last_fullsized":"2024-08-31T06:46:18.653688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754818+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:45:19.754818+0000","last_peered":"2024-08-31T06:45:19.754818+0000","last_clean":"2024-08-31T06:45:19.754818+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:45:19.754818+0000","last_undegraded":"2024-08-31T06:45:19.754818+0000","last_fullsized":"2024-08-31T06:45:19.754818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":861163,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":808,"num_read_kb":531,"num_write":325,"num_write_kb":2096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2386881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":258,"ondisk_log_size":258,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776165,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":409286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939690,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1536000,"data_stored":1069912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103215,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":409522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266741,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":847872,"data_stored":409442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1441792,"data_stored":1003813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":408911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37212,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707940,"statfs":{"total":95995035648,"available":95956930560,"internally_reserved":0,"allocated":1851392,"data_stored":1395857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":412802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1642496,"data_stored":1196214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378705,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":477161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542232,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":476433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":410182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":806912,"data_stored":787276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":396668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":197346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":464499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:46:46.929 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-31T06:46:46.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph pg dump --format=json 2024-08-31T06:46:47.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:46 smithi106 ceph-mon[22134]: from='client.15543 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:47.187 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:47.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.675+0000 7fccf7fd0640 1 -- 172.21.15.37:0/4000030700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0102820 msgr2=0x7fccf0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.675+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/4000030700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0102820 0x7fccf0102c30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fccec009900 tx=0x7fccec02a410 comp rx=0 tx=0).stop 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 -- 172.21.15.37:0/4000030700 shutdown_connections 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/4000030700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf0108ab0 0x7fccf010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/4000030700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf0108160 0x7fccf0108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/4000030700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0102820 0x7fccf0102c30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 -- 172.21.15.37:0/4000030700 >> 172.21.15.37:0/4000030700 conn(0x7fccf00794e0 msgr2=0x7fccf00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 -- 172.21.15.37:0/4000030700 shutdown_connections 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 -- 172.21.15.37:0/4000030700 wait complete. 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 Processor -- start 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.676+0000 7fccf7fd0640 1 -- start start 2024-08-31T06:46:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf7fd0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf0102820 0x7fccf01990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf7fd0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0108160 0x7fccf0199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf7fd0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf0108ab0 0x7fccf019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf7fd0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fccf01125c0 con 0x7fccf0108160 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf7fd0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0112440 con 0x7fccf0108ab0 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf7fd0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fccf0112740 con 0x7fccf0102820 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0108160 0x7fccf0199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0108160 0x7fccf0199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49552/0 (socket says 172.21.15.37:49552) 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 -- 172.21.15.37:0/3160658897 learned_addr learned my addr 172.21.15.37:0/3160658897 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf5d6c640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf0102820 0x7fccf01990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 -- 172.21.15.37:0/3160658897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf0102820 msgr2=0x7fccf01990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf0102820 0x7fccf01990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 -- 172.21.15.37:0/3160658897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf0108ab0 msgr2=0x7fccf019e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:47.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf656d640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf0108ab0 0x7fccf019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf0108ab0 0x7fccf019e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 -- 172.21.15.37:0/3160658897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf019f040 con 0x7fccf0108160 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf656d640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf0108ab0 0x7fccf019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fccf556b640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0108160 0x7fccf0199670 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcce400c970 tx=0x7fcce400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.677+0000 7fcce2ffd640 1 -- 172.21.15.37:0/3160658897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4007bb0 con 0x7fccf0108160 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.678+0000 7fcce2ffd640 1 -- 172.21.15.37:0/3160658897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcce4007d50 con 0x7fccf0108160 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.678+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf019f330 con 0x7fccf0108160 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.678+0000 7fcce2ffd640 1 -- 172.21.15.37:0/3160658897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4004e10 con 0x7fccf0108160 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.678+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf01a5a90 con 0x7fccf0108160 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.679+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf0103aa0 con 0x7fccf0108160 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.680+0000 7fcce2ffd640 1 -- 172.21.15.37:0/3160658897 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7fcce4005000 con 0x7fccf0108160 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.681+0000 7fcce2ffd640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.681+0000 7fccf5d6c640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.681+0000 7fcce2ffd640 1 -- 172.21.15.37:0/3160658897 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fcce40e5660 con 0x7fccf0108160 2024-08-31T06:46:47.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.682+0000 7fccf5d6c640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fccec000c00 tx=0x7fccec009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:47.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.684+0000 7fcce2ffd640 1 -- 172.21.15.37:0/3160658897 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcce4014030 con 0x7fccf0108160 2024-08-31T06:46:47.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:47 smithi037 ceph-mon[18612]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-08-31T06:46:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.867+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fccf00635a0 con 0x7fccdc0b4ca0 2024-08-31T06:46:47.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.872+0000 7fcce2ffd640 1 -- 172.21.15.37:0/3160658897 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258893 (secure 0 0 0) 0x7fccf00635a0 con 0x7fccdc0b4ca0 2024-08-31T06:46:47.875 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:47.876 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-31T06:46:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccdc0b4ca0 msgr2=0x7fccdc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fccec000c00 tx=0x7fccec009680 comp rx=0 tx=0).stop 2024-08-31T06:46:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0108160 msgr2=0x7fccf0199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0108160 0x7fccf0199670 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcce400c970 tx=0x7fcce400ce30 comp rx=0 tx=0).stop 2024-08-31T06:46:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 shutdown_connections 2024-08-31T06:46:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccdc0b4ca0 0x7fccdc0b71b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0108160 0x7fccf0199670 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf0108ab0 0x7fccf019e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 --2- 172.21.15.37:0/3160658897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf0102820 0x7fccf01990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:47.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 >> 172.21.15.37:0/3160658897 conn(0x7fccf00794e0 msgr2=0x7fccf01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:47.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 shutdown_connections 2024-08-31T06:46:47.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:47.875+0000 7fccf7fd0640 1 -- 172.21.15.37:0/3160658897 wait complete. 2024-08-31T06:46:47.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:47 smithi066 ceph-mon[22244]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-08-31T06:46:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:47 smithi106 ceph-mon[22134]: pgmap v318: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-08-31T06:46:48.655 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2024-08-31T06:46:46.275476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1451765,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1123,"num_read_kb":808,"num_write":538,"num_write_kb":4376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":897,"ondisk_log_size":897,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367796,"kb_used_data":14208,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574028,"statfs":{"total":1151940427776,"available":1151563804672,"internally_reserved":0,"allocated":14548992,"data_stored":9259743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":361674044},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":794999,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":419,"num_read_kb":355,"num_write":234,"num_write_kb":2102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003303"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665746+0000","last_change":"2024-08-31T06:44:42.646297+0000","last_active":"2024-08-31T06:46:18.665746+0000","last_peered":"2024-08-31T06:46:18.665746+0000","last_clean":"2024-08-31T06:46:18.665746+0000","last_became_active":"2024-08-31T06:44:42.645949+0000","last_became_peered":"2024-08-31T06:44:42.645949+0000","last_unstale":"2024-08-31T06:46:18.665746+0000","last_undegraded":"2024-08-31T06:46:18.665746+0000","last_fullsized":"2024-08-31T06:46:18.665746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:06:21.327980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659822+0000","last_change":"2024-08-31T06:44:42.640759+0000","last_active":"2024-08-31T06:46:18.659822+0000","last_peered":"2024-08-31T06:46:18.659822+0000","last_clean":"2024-08-31T06:46:18.659822+0000","last_became_active":"2024-08-31T06:44:42.640420+0000","last_became_peered":"2024-08-31T06:44:42.640420+0000","last_unstale":"2024-08-31T06:46:18.659822+0000","last_undegraded":"2024-08-31T06:46:18.659822+0000","last_fullsized":"2024-08-31T06:46:18.659822+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:54:35.483890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665290+0000","last_change":"2024-08-31T06:44:42.639478+0000","last_active":"2024-08-31T06:46:18.665290+0000","last_peered":"2024-08-31T06:46:18.665290+0000","last_clean":"2024-08-31T06:46:18.665290+0000","last_became_active":"2024-08-31T06:44:42.639060+0000","last_became_peered":"2024-08-31T06:44:42.639060+0000","last_unstale":"2024-08-31T06:46:18.665290+0000","last_undegraded":"2024-08-31T06:46:18.665290+0000","last_fullsized":"2024-08-31T06:46:18.665290+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:31.133251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.650100+0000","last_change":"2024-08-31T06:44:42.627458+0000","last_active":"2024-08-31T06:46:18.650100+0000","last_peered":"2024-08-31T06:46:18.650100+0000","last_clean":"2024-08-31T06:46:18.650100+0000","last_became_active":"2024-08-31T06:44:42.625906+0000","last_became_peered":"2024-08-31T06:44:42.625906+0000","last_unstale":"2024-08-31T06:46:18.650100+0000","last_undegraded":"2024-08-31T06:46:18.650100+0000","last_fullsized":"2024-08-31T06:46:18.650100+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:15:28.455803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640151+0000","last_change":"2024-08-31T06:44:42.635447+0000","last_active":"2024-08-31T06:46:18.640151+0000","last_peered":"2024-08-31T06:46:18.640151+0000","last_clean":"2024-08-31T06:46:18.640151+0000","last_became_active":"2024-08-31T06:44:42.635049+0000","last_became_peered":"2024-08-31T06:44:42.635049+0000","last_unstale":"2024-08-31T06:46:18.640151+0000","last_undegraded":"2024-08-31T06:46:18.640151+0000","last_fullsized":"2024-08-31T06:46:18.640151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:37:24.592593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657815+0000","last_change":"2024-08-31T06:45:19.756707+0000","last_active":"2024-08-31T06:46:18.657815+0000","last_peered":"2024-08-31T06:46:18.657815+0000","last_clean":"2024-08-31T06:46:18.657815+0000","last_became_active":"2024-08-31T06:45:19.756086+0000","last_became_peered":"2024-08-31T06:45:19.756086+0000","last_unstale":"2024-08-31T06:46:18.657815+0000","last_undegraded":"2024-08-31T06:46:18.657815+0000","last_fullsized":"2024-08-31T06:46:18.657815+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:44:24.147502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662767+0000","last_change":"2024-08-31T06:44:42.641355+0000","last_active":"2024-08-31T06:46:18.662767+0000","last_peered":"2024-08-31T06:46:18.662767+0000","last_clean":"2024-08-31T06:46:18.662767+0000","last_became_active":"2024-08-31T06:44:42.640859+0000","last_became_peered":"2024-08-31T06:44:42.640859+0000","last_unstale":"2024-08-31T06:46:18.662767+0000","last_undegraded":"2024-08-31T06:46:18.662767+0000","last_fullsized":"2024-08-31T06:46:18.662767+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:55:48.343932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.654017+0000","last_change":"2024-08-31T06:44:42.635722+0000","last_active":"2024-08-31T06:46:18.654017+0000","last_peered":"2024-08-31T06:46:18.654017+0000","last_clean":"2024-08-31T06:46:18.654017+0000","last_became_active":"2024-08-31T06:44:42.635380+0000","last_became_peered":"2024-08-31T06:44:42.635380+0000","last_unstale":"2024-08-31T06:46:18.654017+0000","last_undegraded":"2024-08-31T06:46:18.654017+0000","last_fullsized":"2024-08-31T06:46:18.654017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:06:52.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671760+0000","last_change":"2024-08-31T06:44:42.648716+0000","last_active":"2024-08-31T06:46:18.671760+0000","last_peered":"2024-08-31T06:46:18.671760+0000","last_clean":"2024-08-31T06:46:18.671760+0000","last_became_active":"2024-08-31T06:44:42.648306+0000","last_became_peered":"2024-08-31T06:44:42.648306+0000","last_unstale":"2024-08-31T06:46:18.671760+0000","last_undegraded":"2024-08-31T06:46:18.671760+0000","last_fullsized":"2024-08-31T06:46:18.671760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:15:56.953001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659726+0000","last_change":"2024-08-31T06:44:42.633086+0000","last_active":"2024-08-31T06:46:18.659726+0000","last_peered":"2024-08-31T06:46:18.659726+0000","last_clean":"2024-08-31T06:46:18.659726+0000","last_became_active":"2024-08-31T06:44:42.632598+0000","last_became_peered":"2024-08-31T06:44:42.632598+0000","last_unstale":"2024-08-31T06:46:18.659726+0000","last_undegraded":"2024-08-31T06:46:18.659726+0000","last_fullsized":"2024-08-31T06:46:18.659726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:05:29.679237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.666910+0000","last_change":"2024-08-31T06:44:42.647751+0000","last_active":"2024-08-31T06:46:18.666910+0000","last_peered":"2024-08-31T06:46:18.666910+0000","last_clean":"2024-08-31T06:46:18.666910+0000","last_became_active":"2024-08-31T06:44:42.647315+0000","last_became_peered":"2024-08-31T06:44:42.647315+0000","last_unstale":"2024-08-31T06:46:18.666910+0000","last_undegraded":"2024-08-31T06:46:18.666910+0000","last_fullsized":"2024-08-31T06:46:18.666910+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:38:27.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.649818+0000","last_change":"2024-08-31T06:44:42.627864+0000","last_active":"2024-08-31T06:46:18.649818+0000","last_peered":"2024-08-31T06:46:18.649818+0000","last_clean":"2024-08-31T06:46:18.649818+0000","last_became_active":"2024-08-31T06:44:42.627064+0000","last_became_peered":"2024-08-31T06:44:42.627064+0000","last_unstale":"2024-08-31T06:46:18.649818+0000","last_undegraded":"2024-08-31T06:46:18.649818+0000","last_fullsized":"2024-08-31T06:46:18.649818+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:09:25.930829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658630+0000","last_change":"2024-08-31T06:44:42.635939+0000","last_active":"2024-08-31T06:46:18.658630+0000","last_peered":"2024-08-31T06:46:18.658630+0000","last_clean":"2024-08-31T06:46:18.658630+0000","last_became_active":"2024-08-31T06:44:42.635583+0000","last_became_peered":"2024-08-31T06:44:42.635583+0000","last_unstale":"2024-08-31T06:46:18.658630+0000","last_undegraded":"2024-08-31T06:46:18.658630+0000","last_fullsized":"2024-08-31T06:46:18.658630+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:53:31.884393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656512+0000","last_change":"2024-08-31T06:44:42.640629+0000","last_active":"2024-08-31T06:46:18.656512+0000","last_peered":"2024-08-31T06:46:18.656512+0000","last_clean":"2024-08-31T06:46:18.656512+0000","last_became_active":"2024-08-31T06:44:42.640260+0000","last_became_peered":"2024-08-31T06:44:42.640260+0000","last_unstale":"2024-08-31T06:46:18.656512+0000","last_undegraded":"2024-08-31T06:46:18.656512+0000","last_fullsized":"2024-08-31T06:46:18.656512+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:03:07.900680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658480+0000","last_change":"2024-08-31T06:44:42.627395+0000","last_active":"2024-08-31T06:46:18.658480+0000","last_peered":"2024-08-31T06:46:18.658480+0000","last_clean":"2024-08-31T06:46:18.658480+0000","last_became_active":"2024-08-31T06:44:42.626976+0000","last_became_peered":"2024-08-31T06:44:42.626976+0000","last_unstale":"2024-08-31T06:46:18.658480+0000","last_undegraded":"2024-08-31T06:46:18.658480+0000","last_fullsized":"2024-08-31T06:46:18.658480+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:06:13.615945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672261+0000","last_change":"2024-08-31T06:44:42.644754+0000","last_active":"2024-08-31T06:46:18.672261+0000","last_peered":"2024-08-31T06:46:18.672261+0000","last_clean":"2024-08-31T06:46:18.672261+0000","last_became_active":"2024-08-31T06:44:42.644297+0000","last_became_peered":"2024-08-31T06:44:42.644297+0000","last_unstale":"2024-08-31T06:46:18.672261+0000","last_undegraded":"2024-08-31T06:46:18.672261+0000","last_fullsized":"2024-08-31T06:46:18.672261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:25:34.933837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665677+0000","last_change":"2024-08-31T06:44:42.646771+0000","last_active":"2024-08-31T06:46:18.665677+0000","last_peered":"2024-08-31T06:46:18.665677+0000","last_clean":"2024-08-31T06:46:18.665677+0000","last_became_active":"2024-08-31T06:44:42.646231+0000","last_became_peered":"2024-08-31T06:44:42.646231+0000","last_unstale":"2024-08-31T06:46:18.665677+0000","last_undegraded":"2024-08-31T06:46:18.665677+0000","last_fullsized":"2024-08-31T06:46:18.665677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:17:33.125632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658429+0000","last_change":"2024-08-31T06:44:42.637574+0000","last_active":"2024-08-31T06:46:18.658429+0000","last_peered":"2024-08-31T06:46:18.658429+0000","last_clean":"2024-08-31T06:46:18.658429+0000","last_became_active":"2024-08-31T06:44:42.637237+0000","last_became_peered":"2024-08-31T06:44:42.637237+0000","last_unstale":"2024-08-31T06:46:18.658429+0000","last_undegraded":"2024-08-31T06:46:18.658429+0000","last_fullsized":"2024-08-31T06:46:18.658429+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:35:14.373596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644995+0000","last_change":"2024-08-31T06:44:42.626723+0000","last_active":"2024-08-31T06:46:18.644995+0000","last_peered":"2024-08-31T06:46:18.644995+0000","last_clean":"2024-08-31T06:46:18.644995+0000","last_became_active":"2024-08-31T06:44:42.626297+0000","last_became_peered":"2024-08-31T06:44:42.626297+0000","last_unstale":"2024-08-31T06:46:18.644995+0000","last_undegraded":"2024-08-31T06:46:18.644995+0000","last_fullsized":"2024-08-31T06:46:18.644995+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:26.203798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653051+0000","last_change":"2024-08-31T06:44:42.634139+0000","last_active":"2024-08-31T06:46:18.653051+0000","last_peered":"2024-08-31T06:46:18.653051+0000","last_clean":"2024-08-31T06:46:18.653051+0000","last_became_active":"2024-08-31T06:44:42.633801+0000","last_became_peered":"2024-08-31T06:44:42.633801+0000","last_unstale":"2024-08-31T06:46:18.653051+0000","last_undegraded":"2024-08-31T06:46:18.653051+0000","last_fullsized":"2024-08-31T06:46:18.653051+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:55.202554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661106+0000","last_change":"2024-08-31T06:44:42.638590+0000","last_active":"2024-08-31T06:46:18.661106+0000","last_peered":"2024-08-31T06:46:18.661106+0000","last_clean":"2024-08-31T06:46:18.661106+0000","last_became_active":"2024-08-31T06:44:42.638214+0000","last_became_peered":"2024-08-31T06:44:42.638214+0000","last_unstale":"2024-08-31T06:46:18.661106+0000","last_undegraded":"2024-08-31T06:46:18.661106+0000","last_fullsized":"2024-08-31T06:46:18.661106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:34:53.426664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.673097+0000","last_change":"2024-08-31T06:44:42.644793+0000","last_active":"2024-08-31T06:46:18.673097+0000","last_peered":"2024-08-31T06:46:18.673097+0000","last_clean":"2024-08-31T06:46:18.673097+0000","last_became_active":"2024-08-31T06:44:42.644340+0000","last_became_peered":"2024-08-31T06:44:42.644340+0000","last_unstale":"2024-08-31T06:46:18.673097+0000","last_undegraded":"2024-08-31T06:46:18.673097+0000","last_fullsized":"2024-08-31T06:46:18.673097+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:24:29.756151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638344+0000","last_change":"2024-08-31T06:44:42.630249+0000","last_active":"2024-08-31T06:46:18.638344+0000","last_peered":"2024-08-31T06:46:18.638344+0000","last_clean":"2024-08-31T06:46:18.638344+0000","last_became_active":"2024-08-31T06:44:42.629614+0000","last_became_peered":"2024-08-31T06:44:42.629614+0000","last_unstale":"2024-08-31T06:46:18.638344+0000","last_undegraded":"2024-08-31T06:46:18.638344+0000","last_fullsized":"2024-08-31T06:46:18.638344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:19:46.867527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651434+0000","last_change":"2024-08-31T06:44:42.635733+0000","last_active":"2024-08-31T06:46:18.651434+0000","last_peered":"2024-08-31T06:46:18.651434+0000","last_clean":"2024-08-31T06:46:18.651434+0000","last_became_active":"2024-08-31T06:44:42.635338+0000","last_became_peered":"2024-08-31T06:44:42.635338+0000","last_unstale":"2024-08-31T06:46:18.651434+0000","last_undegraded":"2024-08-31T06:46:18.651434+0000","last_fullsized":"2024-08-31T06:46:18.651434+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:01:16.091343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.638274+0000","last_change":"2024-08-31T06:44:42.632260+0000","last_active":"2024-08-31T06:46:18.638274+0000","last_peered":"2024-08-31T06:46:18.638274+0000","last_clean":"2024-08-31T06:46:18.638274+0000","last_became_active":"2024-08-31T06:44:42.630986+0000","last_became_peered":"2024-08-31T06:44:42.630986+0000","last_unstale":"2024-08-31T06:46:18.638274+0000","last_undegraded":"2024-08-31T06:46:18.638274+0000","last_fullsized":"2024-08-31T06:46:18.638274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:28:23.433133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658774+0000","last_change":"2024-08-31T06:44:42.639485+0000","last_active":"2024-08-31T06:46:18.658774+0000","last_peered":"2024-08-31T06:46:18.658774+0000","last_clean":"2024-08-31T06:46:18.658774+0000","last_became_active":"2024-08-31T06:44:42.639013+0000","last_became_peered":"2024-08-31T06:44:42.639013+0000","last_unstale":"2024-08-31T06:46:18.658774+0000","last_undegraded":"2024-08-31T06:46:18.658774+0000","last_fullsized":"2024-08-31T06:46:18.658774+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:10:56.855596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637037+0000","last_change":"2024-08-31T06:44:42.636865+0000","last_active":"2024-08-31T06:46:18.637037+0000","last_peered":"2024-08-31T06:46:18.637037+0000","last_clean":"2024-08-31T06:46:18.637037+0000","last_became_active":"2024-08-31T06:44:42.636513+0000","last_became_peered":"2024-08-31T06:44:42.636513+0000","last_unstale":"2024-08-31T06:46:18.637037+0000","last_undegraded":"2024-08-31T06:46:18.637037+0000","last_fullsized":"2024-08-31T06:46:18.637037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:36:34.897549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.645592+0000","last_change":"2024-08-31T06:44:42.633474+0000","last_active":"2024-08-31T06:46:18.645592+0000","last_peered":"2024-08-31T06:46:18.645592+0000","last_clean":"2024-08-31T06:46:18.645592+0000","last_became_active":"2024-08-31T06:44:42.633119+0000","last_became_peered":"2024-08-31T06:44:42.633119+0000","last_unstale":"2024-08-31T06:46:18.645592+0000","last_undegraded":"2024-08-31T06:46:18.645592+0000","last_fullsized":"2024-08-31T06:46:18.645592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:40:51.611282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658756+0000","last_change":"2024-08-31T06:44:42.635004+0000","last_active":"2024-08-31T06:46:18.658756+0000","last_peered":"2024-08-31T06:46:18.658756+0000","last_clean":"2024-08-31T06:46:18.658756+0000","last_became_active":"2024-08-31T06:44:42.634618+0000","last_became_peered":"2024-08-31T06:44:42.634618+0000","last_unstale":"2024-08-31T06:46:18.658756+0000","last_undegraded":"2024-08-31T06:46:18.658756+0000","last_fullsized":"2024-08-31T06:46:18.658756+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:06:09.072878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647670+0000","last_change":"2024-08-31T06:44:42.637416+0000","last_active":"2024-08-31T06:46:18.647670+0000","last_peered":"2024-08-31T06:46:18.647670+0000","last_clean":"2024-08-31T06:46:18.647670+0000","last_became_active":"2024-08-31T06:44:42.637067+0000","last_became_peered":"2024-08-31T06:44:42.637067+0000","last_unstale":"2024-08-31T06:46:18.647670+0000","last_undegraded":"2024-08-31T06:46:18.647670+0000","last_fullsized":"2024-08-31T06:46:18.647670+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:03:52.615271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658511+0000","last_change":"2024-08-31T06:44:42.636687+0000","last_active":"2024-08-31T06:46:18.658511+0000","last_peered":"2024-08-31T06:46:18.658511+0000","last_clean":"2024-08-31T06:46:18.658511+0000","last_became_active":"2024-08-31T06:44:42.636263+0000","last_became_peered":"2024-08-31T06:44:42.636263+0000","last_unstale":"2024-08-31T06:46:18.658511+0000","last_undegraded":"2024-08-31T06:46:18.658511+0000","last_fullsized":"2024-08-31T06:46:18.658511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:28:29.423659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647528+0000","last_change":"2024-08-31T06:45:19.754501+0000","last_active":"2024-08-31T06:46:18.647528+0000","last_peered":"2024-08-31T06:46:18.647528+0000","last_clean":"2024-08-31T06:46:18.647528+0000","last_became_active":"2024-08-31T06:45:19.754085+0000","last_became_peered":"2024-08-31T06:45:19.754085+0000","last_unstale":"2024-08-31T06:46:18.647528+0000","last_undegraded":"2024-08-31T06:46:18.647528+0000","last_fullsized":"2024-08-31T06:46:18.647528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:50:04.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.637559+0000","last_change":"2024-08-31T06:44:42.637361+0000","last_active":"2024-08-31T06:46:18.637559+0000","last_peered":"2024-08-31T06:46:18.637559+0000","last_clean":"2024-08-31T06:46:18.637559+0000","last_became_active":"2024-08-31T06:44:42.637034+0000","last_became_peered":"2024-08-31T06:44:42.637034+0000","last_unstale":"2024-08-31T06:46:18.637559+0000","last_undegraded":"2024-08-31T06:46:18.637559+0000","last_fullsized":"2024-08-31T06:46:18.637559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:53:11.972173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'9","reported_seq":161,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.089011+0000","last_change":"2024-08-31T06:45:19.947200+0000","last_active":"2024-08-31T06:46:41.089011+0000","last_peered":"2024-08-31T06:46:41.089011+0000","last_clean":"2024-08-31T06:46:41.089011+0000","last_became_active":"2024-08-31T06:45:19.942294+0000","last_became_peered":"2024-08-31T06:45:19.942294+0000","last_unstale":"2024-08-31T06:46:41.089011+0000","last_undegraded":"2024-08-31T06:46:41.089011+0000","last_fullsized":"2024-08-31T06:46:41.089011+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:03:40.241862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651596+0000","last_change":"2024-08-31T06:45:19.942081+0000","last_active":"2024-08-31T06:46:18.651596+0000","last_peered":"2024-08-31T06:46:18.651596+0000","last_clean":"2024-08-31T06:46:18.651596+0000","last_became_active":"2024-08-31T06:45:19.941427+0000","last_became_peered":"2024-08-31T06:45:19.941427+0000","last_unstale":"2024-08-31T06:46:18.651596+0000","last_undegraded":"2024-08-31T06:46:18.651596+0000","last_fullsized":"2024-08-31T06:46:18.651596+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:09:47.677751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749301+0000","last_change":"2024-08-31T06:44:40.626014+0000","last_active":"2024-08-31T06:45:19.749301+0000","last_peered":"2024-08-31T06:45:19.749301+0000","last_clean":"2024-08-31T06:45:19.749301+0000","last_became_active":"2024-08-31T06:44:40.624347+0000","last_became_peered":"2024-08-31T06:44:40.624347+0000","last_unstale":"2024-08-31T06:45:19.749301+0000","last_undegraded":"2024-08-31T06:45:19.749301+0000","last_fullsized":"2024-08-31T06:45:19.749301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:55:02.424381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940290+0000","last_change":"2024-08-31T06:44:40.615054+0000","last_active":"2024-08-31T06:45:19.940290+0000","last_peered":"2024-08-31T06:45:19.940290+0000","last_clean":"2024-08-31T06:45:19.940290+0000","last_became_active":"2024-08-31T06:44:40.614677+0000","last_became_peered":"2024-08-31T06:44:40.614677+0000","last_unstale":"2024-08-31T06:45:19.940290+0000","last_undegraded":"2024-08-31T06:45:19.940290+0000","last_fullsized":"2024-08-31T06:45:19.940290+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:26:27.568616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639066+0000","last_change":"2024-08-31T06:44:42.631278+0000","last_active":"2024-08-31T06:46:18.639066+0000","last_peered":"2024-08-31T06:46:18.639066+0000","last_clean":"2024-08-31T06:46:18.639066+0000","last_became_active":"2024-08-31T06:44:42.630936+0000","last_became_peered":"2024-08-31T06:44:42.630936+0000","last_unstale":"2024-08-31T06:46:18.639066+0000","last_undegraded":"2024-08-31T06:46:18.639066+0000","last_fullsized":"2024-08-31T06:46:18.639066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:02:17.859172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748301+0000","last_change":"2024-08-31T06:44:40.626214+0000","last_active":"2024-08-31T06:45:19.748301+0000","last_peered":"2024-08-31T06:45:19.748301+0000","last_clean":"2024-08-31T06:45:19.748301+0000","last_became_active":"2024-08-31T06:44:40.625771+0000","last_became_peered":"2024-08-31T06:44:40.625771+0000","last_unstale":"2024-08-31T06:45:19.748301+0000","last_undegraded":"2024-08-31T06:45:19.748301+0000","last_fullsized":"2024-08-31T06:45:19.748301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:36:11.211615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656325+0000","last_change":"2024-08-31T06:44:42.627725+0000","last_active":"2024-08-31T06:46:18.656325+0000","last_peered":"2024-08-31T06:46:18.656325+0000","last_clean":"2024-08-31T06:46:18.656325+0000","last_became_active":"2024-08-31T06:44:42.627371+0000","last_became_peered":"2024-08-31T06:44:42.627371+0000","last_unstale":"2024-08-31T06:46:18.656325+0000","last_undegraded":"2024-08-31T06:46:18.656325+0000","last_fullsized":"2024-08-31T06:46:18.656325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:53:54.680080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":141,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:45.094812+0000","last_change":"2024-08-31T06:44:40.625345+0000","last_active":"2024-08-31T06:46:45.094812+0000","last_peered":"2024-08-31T06:46:45.094812+0000","last_clean":"2024-08-31T06:46:45.094812+0000","last_became_active":"2024-08-31T06:44:40.624796+0000","last_became_peered":"2024-08-31T06:44:40.624796+0000","last_unstale":"2024-08-31T06:46:45.094812+0000","last_undegraded":"2024-08-31T06:46:45.094812+0000","last_fullsized":"2024-08-31T06:46:45.094812+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:13:46.091825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670727+0000","last_change":"2024-08-31T06:44:42.644655+0000","last_active":"2024-08-31T06:46:18.670727+0000","last_peered":"2024-08-31T06:46:18.670727+0000","last_clean":"2024-08-31T06:46:18.670727+0000","last_became_active":"2024-08-31T06:44:42.644229+0000","last_became_peered":"2024-08-31T06:44:42.644229+0000","last_unstale":"2024-08-31T06:46:18.670727+0000","last_undegraded":"2024-08-31T06:46:18.670727+0000","last_fullsized":"2024-08-31T06:46:18.670727+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:54:25.516679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753069+0000","last_change":"2024-08-31T06:44:40.624776+0000","last_active":"2024-08-31T06:45:19.753069+0000","last_peered":"2024-08-31T06:45:19.753069+0000","last_clean":"2024-08-31T06:45:19.753069+0000","last_became_active":"2024-08-31T06:44:40.624354+0000","last_became_peered":"2024-08-31T06:44:40.624354+0000","last_unstale":"2024-08-31T06:45:19.753069+0000","last_undegraded":"2024-08-31T06:45:19.753069+0000","last_fullsized":"2024-08-31T06:45:19.753069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:08.006362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659721+0000","last_change":"2024-08-31T06:44:42.636524+0000","last_active":"2024-08-31T06:46:18.659721+0000","last_peered":"2024-08-31T06:46:18.659721+0000","last_clean":"2024-08-31T06:46:18.659721+0000","last_became_active":"2024-08-31T06:44:42.636169+0000","last_became_peered":"2024-08-31T06:44:42.636169+0000","last_unstale":"2024-08-31T06:46:18.659721+0000","last_undegraded":"2024-08-31T06:46:18.659721+0000","last_fullsized":"2024-08-31T06:46:18.659721+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:23:36.585151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748845+0000","last_change":"2024-08-31T06:44:40.763906+0000","last_active":"2024-08-31T06:45:19.748845+0000","last_peered":"2024-08-31T06:45:19.748845+0000","last_clean":"2024-08-31T06:45:19.748845+0000","last_became_active":"2024-08-31T06:44:40.763123+0000","last_became_peered":"2024-08-31T06:44:40.763123+0000","last_unstale":"2024-08-31T06:45:19.748845+0000","last_undegraded":"2024-08-31T06:45:19.748845+0000","last_fullsized":"2024-08-31T06:45:19.748845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:15:21.537051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.672581+0000","last_change":"2024-08-31T06:44:42.647608+0000","last_active":"2024-08-31T06:46:18.672581+0000","last_peered":"2024-08-31T06:46:18.672581+0000","last_clean":"2024-08-31T06:46:18.672581+0000","last_became_active":"2024-08-31T06:44:42.647157+0000","last_became_peered":"2024-08-31T06:44:42.647157+0000","last_unstale":"2024-08-31T06:46:18.672581+0000","last_undegraded":"2024-08-31T06:46:18.672581+0000","last_fullsized":"2024-08-31T06:46:18.672581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:53:36.680417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'36","reported_seq":301,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:46.096098+0000","last_change":"2024-08-31T06:44:40.627458+0000","last_active":"2024-08-31T06:46:46.096098+0000","last_peered":"2024-08-31T06:46:46.096098+0000","last_clean":"2024-08-31T06:46:46.096098+0000","last_became_active":"2024-08-31T06:44:40.626892+0000","last_became_peered":"2024-08-31T06:44:40.626892+0000","last_unstale":"2024-08-31T06:46:46.096098+0000","last_undegraded":"2024-08-31T06:46:46.096098+0000","last_fullsized":"2024-08-31T06:46:46.096098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:53.285079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67729,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":242,"num_read_kb":187,"num_write":37,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660282+0000","last_change":"2024-08-31T06:44:42.636331+0000","last_active":"2024-08-31T06:46:18.660282+0000","last_peered":"2024-08-31T06:46:18.660282+0000","last_clean":"2024-08-31T06:46:18.660282+0000","last_became_active":"2024-08-31T06:44:42.635983+0000","last_became_peered":"2024-08-31T06:44:42.635983+0000","last_unstale":"2024-08-31T06:46:18.660282+0000","last_undegraded":"2024-08-31T06:46:18.660282+0000","last_fullsized":"2024-08-31T06:46:18.660282+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:18:14.559877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.752795+0000","last_change":"2024-08-31T06:44:40.628592+0000","last_active":"2024-08-31T06:45:19.752795+0000","last_peered":"2024-08-31T06:45:19.752795+0000","last_clean":"2024-08-31T06:45:19.752795+0000","last_became_active":"2024-08-31T06:44:40.628178+0000","last_became_peered":"2024-08-31T06:44:40.628178+0000","last_unstale":"2024-08-31T06:45:19.752795+0000","last_undegraded":"2024-08-31T06:45:19.752795+0000","last_fullsized":"2024-08-31T06:45:19.752795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:02:43.771056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.660443+0000","last_change":"2024-08-31T06:44:42.633744+0000","last_active":"2024-08-31T06:46:18.660443+0000","last_peered":"2024-08-31T06:46:18.660443+0000","last_clean":"2024-08-31T06:46:18.660443+0000","last_became_active":"2024-08-31T06:44:42.633345+0000","last_became_peered":"2024-08-31T06:44:42.633345+0000","last_unstale":"2024-08-31T06:46:18.660443+0000","last_undegraded":"2024-08-31T06:46:18.660443+0000","last_fullsized":"2024-08-31T06:46:18.660443+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:08:42.182859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748495+0000","last_change":"2024-08-31T06:44:40.630261+0000","last_active":"2024-08-31T06:45:19.748495+0000","last_peered":"2024-08-31T06:45:19.748495+0000","last_clean":"2024-08-31T06:45:19.748495+0000","last_became_active":"2024-08-31T06:44:40.629829+0000","last_became_peered":"2024-08-31T06:44:40.629829+0000","last_unstale":"2024-08-31T06:45:19.748495+0000","last_undegraded":"2024-08-31T06:45:19.748495+0000","last_fullsized":"2024-08-31T06:45:19.748495+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:38:00.974912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.661922+0000","last_change":"2024-08-31T06:44:42.632959+0000","last_active":"2024-08-31T06:46:18.661922+0000","last_peered":"2024-08-31T06:46:18.661922+0000","last_clean":"2024-08-31T06:46:18.661922+0000","last_became_active":"2024-08-31T06:44:42.632257+0000","last_became_peered":"2024-08-31T06:44:42.632257+0000","last_unstale":"2024-08-31T06:46:18.661922+0000","last_undegraded":"2024-08-31T06:46:18.661922+0000","last_fullsized":"2024-08-31T06:46:18.661922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:05:55.932830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'7","reported_seq":146,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:40.860230+0000","last_change":"2024-08-31T06:44:40.622934+0000","last_active":"2024-08-31T06:46:40.860230+0000","last_peered":"2024-08-31T06:46:40.860230+0000","last_clean":"2024-08-31T06:46:40.860230+0000","last_became_active":"2024-08-31T06:44:40.622476+0000","last_became_peered":"2024-08-31T06:44:40.622476+0000","last_unstale":"2024-08-31T06:46:40.860230+0000","last_undegraded":"2024-08-31T06:46:40.860230+0000","last_fullsized":"2024-08-31T06:46:40.860230+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:16:22.453716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2004,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":7,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662079+0000","last_change":"2024-08-31T06:44:42.639395+0000","last_active":"2024-08-31T06:46:18.662079+0000","last_peered":"2024-08-31T06:46:18.662079+0000","last_clean":"2024-08-31T06:46:18.662079+0000","last_became_active":"2024-08-31T06:44:42.638948+0000","last_became_peered":"2024-08-31T06:44:42.638948+0000","last_unstale":"2024-08-31T06:46:18.662079+0000","last_undegraded":"2024-08-31T06:46:18.662079+0000","last_fullsized":"2024-08-31T06:46:18.662079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:51:44.540202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748696+0000","last_change":"2024-08-31T06:44:40.763720+0000","last_active":"2024-08-31T06:45:19.748696+0000","last_peered":"2024-08-31T06:45:19.748696+0000","last_clean":"2024-08-31T06:45:19.748696+0000","last_became_active":"2024-08-31T06:44:40.763251+0000","last_became_peered":"2024-08-31T06:44:40.763251+0000","last_unstale":"2024-08-31T06:45:19.748696+0000","last_undegraded":"2024-08-31T06:45:19.748696+0000","last_fullsized":"2024-08-31T06:45:19.748696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:04:02.235649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671183+0000","last_change":"2024-08-31T06:44:42.646362+0000","last_active":"2024-08-31T06:46:18.671183+0000","last_peered":"2024-08-31T06:46:18.671183+0000","last_clean":"2024-08-31T06:46:18.671183+0000","last_became_active":"2024-08-31T06:44:42.645980+0000","last_became_peered":"2024-08-31T06:44:42.645980+0000","last_unstale":"2024-08-31T06:46:18.671183+0000","last_undegraded":"2024-08-31T06:46:18.671183+0000","last_fullsized":"2024-08-31T06:46:18.671183+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:00:19.946407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749767+0000","last_change":"2024-08-31T06:44:40.624589+0000","last_active":"2024-08-31T06:45:19.749767+0000","last_peered":"2024-08-31T06:45:19.749767+0000","last_clean":"2024-08-31T06:45:19.749767+0000","last_became_active":"2024-08-31T06:44:40.624215+0000","last_became_peered":"2024-08-31T06:44:40.624215+0000","last_unstale":"2024-08-31T06:45:19.749767+0000","last_undegraded":"2024-08-31T06:45:19.749767+0000","last_fullsized":"2024-08-31T06:45:19.749767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:09:05.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.644774+0000","last_change":"2024-08-31T06:45:19.941511+0000","last_active":"2024-08-31T06:46:18.644774+0000","last_peered":"2024-08-31T06:46:18.644774+0000","last_clean":"2024-08-31T06:46:18.644774+0000","last_became_active":"2024-08-31T06:45:19.940991+0000","last_became_peered":"2024-08-31T06:45:19.940991+0000","last_unstale":"2024-08-31T06:46:18.644774+0000","last_undegraded":"2024-08-31T06:46:18.644774+0000","last_fullsized":"2024-08-31T06:46:18.644774+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:52:25.268854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940677+0000","last_change":"2024-08-31T06:44:40.625226+0000","last_active":"2024-08-31T06:45:19.940677+0000","last_peered":"2024-08-31T06:45:19.940677+0000","last_clean":"2024-08-31T06:45:19.940677+0000","last_became_active":"2024-08-31T06:44:40.624810+0000","last_became_peered":"2024-08-31T06:44:40.624810+0000","last_unstale":"2024-08-31T06:45:19.940677+0000","last_undegraded":"2024-08-31T06:45:19.940677+0000","last_fullsized":"2024-08-31T06:45:19.940677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:40:30.575319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.662071+0000","last_change":"2024-08-31T06:44:42.643496+0000","last_active":"2024-08-31T06:46:18.662071+0000","last_peered":"2024-08-31T06:46:18.662071+0000","last_clean":"2024-08-31T06:46:18.662071+0000","last_became_active":"2024-08-31T06:44:42.643011+0000","last_became_peered":"2024-08-31T06:44:42.643011+0000","last_unstale":"2024-08-31T06:46:18.662071+0000","last_undegraded":"2024-08-31T06:46:18.662071+0000","last_fullsized":"2024-08-31T06:46:18.662071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:31:30.525084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'60","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.521443+0000","last_change":"2024-08-31T06:44:40.630143+0000","last_active":"2024-08-31T06:46:41.521443+0000","last_peered":"2024-08-31T06:46:41.521443+0000","last_clean":"2024-08-31T06:46:41.521443+0000","last_became_active":"2024-08-31T06:44:40.629558+0000","last_became_peered":"2024-08-31T06:44:40.629558+0000","last_unstale":"2024-08-31T06:46:41.521443+0000","last_undegraded":"2024-08-31T06:46:41.521443+0000","last_fullsized":"2024-08-31T06:46:41.521443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:31:17.756687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393846,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":71,"num_write_kb":873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.663152+0000","last_change":"2024-08-31T06:44:42.636178+0000","last_active":"2024-08-31T06:46:18.663152+0000","last_peered":"2024-08-31T06:46:18.663152+0000","last_clean":"2024-08-31T06:46:18.663152+0000","last_became_active":"2024-08-31T06:44:42.635792+0000","last_became_peered":"2024-08-31T06:44:42.635792+0000","last_unstale":"2024-08-31T06:46:18.663152+0000","last_undegraded":"2024-08-31T06:46:18.663152+0000","last_fullsized":"2024-08-31T06:46:18.663152+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:27:51.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753167+0000","last_change":"2024-08-31T06:44:40.763863+0000","last_active":"2024-08-31T06:45:19.753167+0000","last_peered":"2024-08-31T06:45:19.753167+0000","last_clean":"2024-08-31T06:45:19.753167+0000","last_became_active":"2024-08-31T06:44:40.763427+0000","last_became_peered":"2024-08-31T06:44:40.763427+0000","last_unstale":"2024-08-31T06:45:19.753167+0000","last_undegraded":"2024-08-31T06:45:19.753167+0000","last_fullsized":"2024-08-31T06:45:19.753167+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:41:37.076412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.667685+0000","last_change":"2024-08-31T06:44:42.637595+0000","last_active":"2024-08-31T06:46:18.667685+0000","last_peered":"2024-08-31T06:46:18.667685+0000","last_clean":"2024-08-31T06:46:18.667685+0000","last_became_active":"2024-08-31T06:44:42.637200+0000","last_became_peered":"2024-08-31T06:44:42.637200+0000","last_unstale":"2024-08-31T06:46:18.667685+0000","last_undegraded":"2024-08-31T06:46:18.667685+0000","last_fullsized":"2024-08-31T06:46:18.667685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:21:09.107781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753541+0000","last_change":"2024-08-31T06:43:31.838692+0000","last_active":"2024-08-31T06:45:19.753541+0000","last_peered":"2024-08-31T06:45:19.753541+0000","last_clean":"2024-08-31T06:45:19.753541+0000","last_became_active":"2024-08-31T06:43:31.833017+0000","last_became_peered":"2024-08-31T06:43:31.833017+0000","last_unstale":"2024-08-31T06:45:19.753541+0000","last_undegraded":"2024-08-31T06:45:19.753541+0000","last_fullsized":"2024-08-31T06:45:19.753541+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:40:10.954748+0000","last_clean_scrub_stamp":"2024-08-31T06:40:10.954748+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:35:18.108905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941116+0000","last_change":"2024-08-31T06:44:40.619745+0000","last_active":"2024-08-31T06:45:19.941116+0000","last_peered":"2024-08-31T06:45:19.941116+0000","last_clean":"2024-08-31T06:45:19.941116+0000","last_became_active":"2024-08-31T06:44:40.619240+0000","last_became_peered":"2024-08-31T06:44:40.619240+0000","last_unstale":"2024-08-31T06:45:19.941116+0000","last_undegraded":"2024-08-31T06:45:19.941116+0000","last_fullsized":"2024-08-31T06:45:19.941116+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:32:11.574570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.658466+0000","last_change":"2024-08-31T06:44:42.634730+0000","last_active":"2024-08-31T06:46:18.658466+0000","last_peered":"2024-08-31T06:46:18.658466+0000","last_clean":"2024-08-31T06:46:18.658466+0000","last_became_active":"2024-08-31T06:44:42.634397+0000","last_became_peered":"2024-08-31T06:44:42.634397+0000","last_unstale":"2024-08-31T06:46:18.658466+0000","last_undegraded":"2024-08-31T06:46:18.658466+0000","last_fullsized":"2024-08-31T06:46:18.658466+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:15:20.129447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753349+0000","last_change":"2024-08-31T06:44:40.626118+0000","last_active":"2024-08-31T06:45:19.753349+0000","last_peered":"2024-08-31T06:45:19.753349+0000","last_clean":"2024-08-31T06:45:19.753349+0000","last_became_active":"2024-08-31T06:44:40.625608+0000","last_became_peered":"2024-08-31T06:44:40.625608+0000","last_unstale":"2024-08-31T06:45:19.753349+0000","last_undegraded":"2024-08-31T06:45:19.753349+0000","last_fullsized":"2024-08-31T06:45:19.753349+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:23:59.771944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647034+0000","last_change":"2024-08-31T06:44:42.621217+0000","last_active":"2024-08-31T06:46:18.647034+0000","last_peered":"2024-08-31T06:46:18.647034+0000","last_clean":"2024-08-31T06:46:18.647034+0000","last_became_active":"2024-08-31T06:44:42.620547+0000","last_became_peered":"2024-08-31T06:44:42.620547+0000","last_unstale":"2024-08-31T06:46:18.647034+0000","last_undegraded":"2024-08-31T06:46:18.647034+0000","last_fullsized":"2024-08-31T06:46:18.647034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:25:00.677842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":142,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:44.866460+0000","last_change":"2024-08-31T06:44:40.763256+0000","last_active":"2024-08-31T06:46:44.866460+0000","last_peered":"2024-08-31T06:46:44.866460+0000","last_clean":"2024-08-31T06:46:44.866460+0000","last_became_active":"2024-08-31T06:44:40.762864+0000","last_became_peered":"2024-08-31T06:44:40.762864+0000","last_unstale":"2024-08-31T06:46:44.866460+0000","last_undegraded":"2024-08-31T06:46:44.866460+0000","last_fullsized":"2024-08-31T06:46:44.866460+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:16:26.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.647947+0000","last_change":"2024-08-31T06:44:42.645173+0000","last_active":"2024-08-31T06:46:18.647947+0000","last_peered":"2024-08-31T06:46:18.647947+0000","last_clean":"2024-08-31T06:46:18.647947+0000","last_became_active":"2024-08-31T06:44:42.644846+0000","last_became_peered":"2024-08-31T06:44:42.644846+0000","last_unstale":"2024-08-31T06:46:18.647947+0000","last_undegraded":"2024-08-31T06:46:18.647947+0000","last_fullsized":"2024-08-31T06:46:18.647947+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:44:05.712520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.753493+0000","last_change":"2024-08-31T06:44:40.621510+0000","last_active":"2024-08-31T06:45:19.753493+0000","last_peered":"2024-08-31T06:45:19.753493+0000","last_clean":"2024-08-31T06:45:19.753493+0000","last_became_active":"2024-08-31T06:44:40.621063+0000","last_became_peered":"2024-08-31T06:44:40.621063+0000","last_unstale":"2024-08-31T06:45:19.753493+0000","last_undegraded":"2024-08-31T06:45:19.753493+0000","last_fullsized":"2024-08-31T06:45:19.753493+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T14:22:39.858897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.657118+0000","last_change":"2024-08-31T06:45:19.759585+0000","last_active":"2024-08-31T06:46:18.657118+0000","last_peered":"2024-08-31T06:46:18.657118+0000","last_clean":"2024-08-31T06:46:18.657118+0000","last_became_active":"2024-08-31T06:45:19.759026+0000","last_became_peered":"2024-08-31T06:45:19.759026+0000","last_unstale":"2024-08-31T06:46:18.657118+0000","last_undegraded":"2024-08-31T06:46:18.657118+0000","last_fullsized":"2024-08-31T06:46:18.657118+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:54.716259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.754390+0000","last_change":"2024-08-31T06:44:40.763715+0000","last_active":"2024-08-31T06:45:19.754390+0000","last_peered":"2024-08-31T06:45:19.754390+0000","last_clean":"2024-08-31T06:45:19.754390+0000","last_became_active":"2024-08-31T06:44:40.763248+0000","last_became_peered":"2024-08-31T06:44:40.763248+0000","last_unstale":"2024-08-31T06:45:19.754390+0000","last_undegraded":"2024-08-31T06:45:19.754390+0000","last_fullsized":"2024-08-31T06:45:19.754390+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:28:05.066169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.656693+0000","last_change":"2024-08-31T06:44:42.634446+0000","last_active":"2024-08-31T06:46:18.656693+0000","last_peered":"2024-08-31T06:46:18.656693+0000","last_clean":"2024-08-31T06:46:18.656693+0000","last_became_active":"2024-08-31T06:44:42.632900+0000","last_became_peered":"2024-08-31T06:44:42.632900+0000","last_unstale":"2024-08-31T06:46:18.656693+0000","last_undegraded":"2024-08-31T06:46:18.656693+0000","last_fullsized":"2024-08-31T06:46:18.656693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T18:32:12.016678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749690+0000","last_change":"2024-08-31T06:44:40.765282+0000","last_active":"2024-08-31T06:45:19.749690+0000","last_peered":"2024-08-31T06:45:19.749690+0000","last_clean":"2024-08-31T06:45:19.749690+0000","last_became_active":"2024-08-31T06:44:40.764847+0000","last_became_peered":"2024-08-31T06:44:40.764847+0000","last_unstale":"2024-08-31T06:45:19.749690+0000","last_undegraded":"2024-08-31T06:45:19.749690+0000","last_fullsized":"2024-08-31T06:45:19.749690+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:49:31.841214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.640852+0000","last_change":"2024-08-31T06:44:42.622711+0000","last_active":"2024-08-31T06:46:18.640852+0000","last_peered":"2024-08-31T06:46:18.640852+0000","last_clean":"2024-08-31T06:46:18.640852+0000","last_became_active":"2024-08-31T06:44:42.622342+0000","last_became_peered":"2024-08-31T06:44:42.622342+0000","last_unstale":"2024-08-31T06:46:18.640852+0000","last_undegraded":"2024-08-31T06:46:18.640852+0000","last_fullsized":"2024-08-31T06:46:18.640852+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:31:20.957634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'98","reported_seq":210,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:42.238796+0000","last_change":"2024-08-31T06:44:40.622478+0000","last_active":"2024-08-31T06:46:42.238796+0000","last_peered":"2024-08-31T06:46:42.238796+0000","last_clean":"2024-08-31T06:46:42.238796+0000","last_became_active":"2024-08-31T06:44:40.622132+0000","last_became_peered":"2024-08-31T06:44:40.622132+0000","last_unstale":"2024-08-31T06:46:42.238796+0000","last_undegraded":"2024-08-31T06:46:42.238796+0000","last_fullsized":"2024-08-31T06:46:42.238796+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:03:28.295762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":180,"num_write_kb":1222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.639289+0000","last_change":"2024-08-31T06:44:42.634114+0000","last_active":"2024-08-31T06:46:18.639289+0000","last_peered":"2024-08-31T06:46:18.639289+0000","last_clean":"2024-08-31T06:46:18.639289+0000","last_became_active":"2024-08-31T06:44:42.633668+0000","last_became_peered":"2024-08-31T06:44:42.633668+0000","last_unstale":"2024-08-31T06:46:18.639289+0000","last_undegraded":"2024-08-31T06:46:18.639289+0000","last_fullsized":"2024-08-31T06:46:18.639289+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:52:54.115224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.941154+0000","last_change":"2024-08-31T06:44:40.615253+0000","last_active":"2024-08-31T06:45:19.941154+0000","last_peered":"2024-08-31T06:45:19.941154+0000","last_clean":"2024-08-31T06:45:19.941154+0000","last_became_active":"2024-08-31T06:44:40.614747+0000","last_became_peered":"2024-08-31T06:44:40.614747+0000","last_unstale":"2024-08-31T06:45:19.941154+0000","last_undegraded":"2024-08-31T06:45:19.941154+0000","last_fullsized":"2024-08-31T06:45:19.941154+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:16:43.010779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.659568+0000","last_change":"2024-08-31T06:45:19.942466+0000","last_active":"2024-08-31T06:46:18.659568+0000","last_peered":"2024-08-31T06:46:18.659568+0000","last_clean":"2024-08-31T06:46:18.659568+0000","last_became_active":"2024-08-31T06:45:19.941936+0000","last_became_peered":"2024-08-31T06:45:19.941936+0000","last_unstale":"2024-08-31T06:46:18.659568+0000","last_undegraded":"2024-08-31T06:46:18.659568+0000","last_fullsized":"2024-08-31T06:46:18.659568+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:44:25.406883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.761034+0000","last_change":"2024-08-31T06:45:19.760954+0000","last_active":"2024-08-31T06:45:19.761034+0000","last_peered":"2024-08-31T06:45:19.761034+0000","last_clean":"2024-08-31T06:45:19.761034+0000","last_became_active":"2024-08-31T06:45:19.754797+0000","last_became_peered":"2024-08-31T06:45:19.754797+0000","last_unstale":"2024-08-31T06:45:19.761034+0000","last_undegraded":"2024-08-31T06:45:19.761034+0000","last_fullsized":"2024-08-31T06:45:19.761034+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T17:17:25.559400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.614619+0000","last_change":"2024-08-31T06:44:42.628670+0000","last_active":"2024-08-31T06:46:18.614619+0000","last_peered":"2024-08-31T06:46:18.614619+0000","last_clean":"2024-08-31T06:46:18.614619+0000","last_became_active":"2024-08-31T06:44:42.628234+0000","last_became_peered":"2024-08-31T06:44:42.628234+0000","last_unstale":"2024-08-31T06:46:18.614619+0000","last_undegraded":"2024-08-31T06:46:18.614619+0000","last_fullsized":"2024-08-31T06:46:18.614619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:01:57.298910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.939437+0000","last_change":"2024-08-31T06:44:40.618586+0000","last_active":"2024-08-31T06:45:19.939437+0000","last_peered":"2024-08-31T06:45:19.939437+0000","last_clean":"2024-08-31T06:45:19.939437+0000","last_became_active":"2024-08-31T06:44:40.618199+0000","last_became_peered":"2024-08-31T06:44:40.618199+0000","last_unstale":"2024-08-31T06:45:19.939437+0000","last_undegraded":"2024-08-31T06:45:19.939437+0000","last_fullsized":"2024-08-31T06:45:19.939437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:32:25.719485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.646654+0000","last_change":"2024-08-31T06:44:42.633274+0000","last_active":"2024-08-31T06:46:18.646654+0000","last_peered":"2024-08-31T06:46:18.646654+0000","last_clean":"2024-08-31T06:46:18.646654+0000","last_became_active":"2024-08-31T06:44:42.632838+0000","last_became_peered":"2024-08-31T06:44:42.632838+0000","last_unstale":"2024-08-31T06:46:18.646654+0000","last_undegraded":"2024-08-31T06:46:18.646654+0000","last_fullsized":"2024-08-31T06:46:18.646654+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:52:19.530331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.751817+0000","last_change":"2024-08-31T06:44:40.623277+0000","last_active":"2024-08-31T06:45:19.751817+0000","last_peered":"2024-08-31T06:45:19.751817+0000","last_clean":"2024-08-31T06:45:19.751817+0000","last_became_active":"2024-08-31T06:44:40.622771+0000","last_became_peered":"2024-08-31T06:44:40.622771+0000","last_unstale":"2024-08-31T06:45:19.751817+0000","last_undegraded":"2024-08-31T06:45:19.751817+0000","last_fullsized":"2024-08-31T06:45:19.751817+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T07:12:23.113038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.651274+0000","last_change":"2024-08-31T06:44:42.637142+0000","last_active":"2024-08-31T06:46:18.651274+0000","last_peered":"2024-08-31T06:46:18.651274+0000","last_clean":"2024-08-31T06:46:18.651274+0000","last_became_active":"2024-08-31T06:44:42.636626+0000","last_became_peered":"2024-08-31T06:44:42.636626+0000","last_unstale":"2024-08-31T06:46:18.651274+0000","last_undegraded":"2024-08-31T06:46:18.651274+0000","last_fullsized":"2024-08-31T06:46:18.651274+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T15:07:25.049682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.748728+0000","last_change":"2024-08-31T06:44:40.628144+0000","last_active":"2024-08-31T06:45:19.748728+0000","last_peered":"2024-08-31T06:45:19.748728+0000","last_clean":"2024-08-31T06:45:19.748728+0000","last_became_active":"2024-08-31T06:44:40.627644+0000","last_became_peered":"2024-08-31T06:44:40.627644+0000","last_unstale":"2024-08-31T06:45:19.748728+0000","last_undegraded":"2024-08-31T06:45:19.748728+0000","last_fullsized":"2024-08-31T06:45:19.748728+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:36:48.215280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670609+0000","last_change":"2024-08-31T06:44:42.638693+0000","last_active":"2024-08-31T06:46:18.670609+0000","last_peered":"2024-08-31T06:46:18.670609+0000","last_clean":"2024-08-31T06:46:18.670609+0000","last_became_active":"2024-08-31T06:44:42.638095+0000","last_became_peered":"2024-08-31T06:44:42.638095+0000","last_unstale":"2024-08-31T06:46:18.670609+0000","last_undegraded":"2024-08-31T06:46:18.670609+0000","last_fullsized":"2024-08-31T06:46:18.670609+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T10:14:03.742087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.671752+0000","last_change":"2024-08-31T06:44:42.646848+0000","last_active":"2024-08-31T06:46:18.671752+0000","last_peered":"2024-08-31T06:46:18.671752+0000","last_clean":"2024-08-31T06:46:18.671752+0000","last_became_active":"2024-08-31T06:44:42.646045+0000","last_became_peered":"2024-08-31T06:44:42.646045+0000","last_unstale":"2024-08-31T06:46:18.671752+0000","last_undegraded":"2024-08-31T06:46:18.671752+0000","last_fullsized":"2024-08-31T06:46:18.671752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T08:42:52.394553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.756544+0000","last_change":"2024-08-31T06:45:19.756432+0000","last_active":"2024-08-31T06:45:19.756544+0000","last_peered":"2024-08-31T06:45:19.756544+0000","last_clean":"2024-08-31T06:45:19.756544+0000","last_became_active":"2024-08-31T06:45:19.751184+0000","last_became_peered":"2024-08-31T06:45:19.751184+0000","last_unstale":"2024-08-31T06:45:19.756544+0000","last_undegraded":"2024-08-31T06:45:19.756544+0000","last_fullsized":"2024-08-31T06:45:19.756544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T12:34:23.569829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.670996+0000","last_change":"2024-08-31T06:44:42.637617+0000","last_active":"2024-08-31T06:46:18.670996+0000","last_peered":"2024-08-31T06:46:18.670996+0000","last_clean":"2024-08-31T06:46:18.670996+0000","last_became_active":"2024-08-31T06:44:42.637154+0000","last_became_peered":"2024-08-31T06:44:42.637154+0000","last_unstale":"2024-08-31T06:46:18.670996+0000","last_undegraded":"2024-08-31T06:46:18.670996+0000","last_fullsized":"2024-08-31T06:46:18.670996+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T09:30:35.990006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.749443+0000","last_change":"2024-08-31T06:44:40.628087+0000","last_active":"2024-08-31T06:45:19.749443+0000","last_peered":"2024-08-31T06:45:19.749443+0000","last_clean":"2024-08-31T06:45:19.749443+0000","last_became_active":"2024-08-31T06:44:40.627633+0000","last_became_peered":"2024-08-31T06:44:40.627633+0000","last_unstale":"2024-08-31T06:45:19.749443+0000","last_undegraded":"2024-08-31T06:45:19.749443+0000","last_fullsized":"2024-08-31T06:45:19.749443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:28:19.028648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.665231+0000","last_change":"2024-08-31T06:44:42.637676+0000","last_active":"2024-08-31T06:46:18.665231+0000","last_peered":"2024-08-31T06:46:18.665231+0000","last_clean":"2024-08-31T06:46:18.665231+0000","last_became_active":"2024-08-31T06:44:42.637318+0000","last_became_peered":"2024-08-31T06:44:42.637318+0000","last_unstale":"2024-08-31T06:46:18.665231+0000","last_undegraded":"2024-08-31T06:46:18.665231+0000","last_fullsized":"2024-08-31T06:46:18.665231+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:43:01.669101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:45:19.940028+0000","last_change":"2024-08-31T06:44:40.764688+0000","last_active":"2024-08-31T06:45:19.940028+0000","last_peered":"2024-08-31T06:45:19.940028+0000","last_clean":"2024-08-31T06:45:19.940028+0000","last_became_active":"2024-08-31T06:44:40.764175+0000","last_became_peered":"2024-08-31T06:44:40.764175+0000","last_unstale":"2024-08-31T06:45:19.940028+0000","last_undegraded":"2024-08-31T06:45:19.940028+0000","last_fullsized":"2024-08-31T06:45:19.940028+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T16:29:45.590803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:18.653688+0000","last_change":"2024-08-31T06:44:42.633924+0000","last_active":"2024-08-31T06:46:18.653688+0000","last_peered":"2024-08-31T06:46:18.653688+0000","last_clean":"2024-08-31T06:46:18.653688+0000","last_became_active":"2024-08-31T06:44:42.631963+0000","last_became_peered":"2024-08-31T06:44:42.631963+0000","last_unstale":"2024-08-31T06:46:18.653688+0000","last_undegraded":"2024-08-31T06:46:18.653688+0000","last_fullsized":"2024-08-31T06:46:18.653688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:41.607825+0000","last_clean_scrub_stamp":"2024-08-31T06:44:41.607825+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T13:10:19.669700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-08-31T06:46:41.378748+0000","last_change":"2024-08-31T06:44:40.622565+0000","last_active":"2024-08-31T06:46:41.378748+0000","last_peered":"2024-08-31T06:46:41.378748+0000","last_clean":"2024-08-31T06:46:41.378748+0000","last_became_active":"2024-08-31T06:44:40.622164+0000","last_became_peered":"2024-08-31T06:44:40.622164+0000","last_unstale":"2024-08-31T06:46:41.378748+0000","last_undegraded":"2024-08-31T06:46:41.378748+0000","last_fullsized":"2024-08-31T06:46:41.378748+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-31T06:44:39.604157+0000","last_clean_scrub_stamp":"2024-08-31T06:44:39.604157+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-01T11:03:24.858256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":861163,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1042,"num_read_kb":739,"num_write":413,"num_write_kb":2224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2813952,"data_stored":2583489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776166,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":409286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939691,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28972,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716180,"statfs":{"total":95995035648,"available":95965368320,"internally_reserved":0,"allocated":1933312,"data_stored":1463688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103216,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28236,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716916,"statfs":{"total":95995035648,"available":95966121984,"internally_reserved":0,"allocated":1241088,"data_stored":802738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266742,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36556,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708596,"statfs":{"total":95995035648,"available":95957602304,"internally_reserved":0,"allocated":1241088,"data_stored":802658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462969,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28432,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716720,"statfs":{"total":95995035648,"available":95965921280,"internally_reserved":0,"allocated":1441792,"data_stored":1003813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626495,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":408911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790020,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37212,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707940,"statfs":{"total":95995035648,"available":95956930560,"internally_reserved":0,"allocated":1851392,"data_stored":1395857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986247,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":412802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149772,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1642496,"data_stored":1196214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378706,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":477161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542232,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":476433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":410182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":68457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":806912,"data_stored":787276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":396668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":464499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-31T06:46:48.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:46:48.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:48 smithi066 ceph-mon[22244]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:49.034 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:48 smithi037 ceph-mon[18612]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:49.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:48 smithi106 ceph-mon[22134]: from='client.15549 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-31T06:46:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 -- 172.21.15.37:0/4055851506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da4102d40 msgr2=0x7f9da410fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 --2- 172.21.15.37:0/4055851506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da4102d40 0x7f9da410fa60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009900 tx=0x7f9d9402a480 comp rx=0 tx=0).stop 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 -- 172.21.15.37:0/4055851506 shutdown_connections 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 --2- 172.21.15.37:0/4055851506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da4102d40 0x7f9da410fa60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 --2- 172.21.15.37:0/4055851506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da410ffa0 0x7f9da41123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 --2- 172.21.15.37:0/4055851506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9da41023f0 0x7f9da4102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 -- 172.21.15.37:0/4055851506 >> 172.21.15.37:0/4055851506 conn(0x7f9da4079510 msgr2=0x7f9da4079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 -- 172.21.15.37:0/4055851506 shutdown_connections 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.360+0000 7f9dab745640 1 -- 172.21.15.37:0/4055851506 wait complete. 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9dab745640 1 Processor -- start 2024-08-31T06:46:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9dab745640 1 -- start start 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9dab745640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da41023f0 0x7f9da419c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9dab745640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da4102d40 0x7f9da419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9dab745640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9da410ffa0 0x7f9da41a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9dab745640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9da4115940 con 0x7f9da41023f0 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9dab745640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9da41157c0 con 0x7f9da4102d40 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9dab745640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9da4115ac0 con 0x7f9da410ffa0 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9da94e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da41023f0 0x7f9da419c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9da94e1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da41023f0 0x7f9da419c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49570/0 (socket says 172.21.15.37:49570) 2024-08-31T06:46:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9da94e1640 1 -- 172.21.15.37:0/3076718744 learned_addr learned my addr 172.21.15.37:0/3076718744 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9da8ce0640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da4102d40 0x7f9da419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.361+0000 7f9da9ce2640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9da410ffa0 0x7f9da41a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9da94e1640 1 -- 172.21.15.37:0/3076718744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9da410ffa0 msgr2=0x7f9da41a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9da94e1640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9da410ffa0 0x7f9da41a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9da94e1640 1 -- 172.21.15.37:0/3076718744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da4102d40 msgr2=0x7f9da419c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9da94e1640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da4102d40 0x7f9da419c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9da94e1640 1 -- 172.21.15.37:0/3076718744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da41a22a0 con 0x7f9da41023f0 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9da94e1640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da41023f0 0x7f9da419c3f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9da000d770 tx=0x7f9da000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/3076718744 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0017070 con 0x7f9da41023f0 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da41a2590 con 0x7f9da41023f0 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/3076718744 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9da00054b0 con 0x7f9da41023f0 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/3076718744 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0004c60 con 0x7f9da41023f0 2024-08-31T06:46:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.362+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da41a2a50 con 0x7f9da41023f0 2024-08-31T06:46:49.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.363+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da406c000 con 0x7f9da41023f0 2024-08-31T06:46:49.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.365+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/3076718744 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f9da0004e00 con 0x7f9da41023f0 2024-08-31T06:46:49.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.366+0000 7f9d9a7fc640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9d900b4cd0 0x7f9d900b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:49.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.366+0000 7f9da8ce0640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9d900b4cd0 0x7f9d900b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:49.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.366+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/3076718744 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9da00e5300 con 0x7f9da41023f0 2024-08-31T06:46:49.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.366+0000 7f9da8ce0640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9d900b4cd0 0x7f9d900b71e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9d940057c0 tx=0x7f9d940058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:49.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.369+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/3076718744 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9da00abae0 con 0x7f9da41023f0 2024-08-31T06:46:49.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.590+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9da4102800 con 0x7f9da41023f0 2024-08-31T06:46:49.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.591+0000 7f9d9a7fc640 1 -- 172.21.15.37:0/3076718744 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f9da4102800 con 0x7f9da41023f0 2024-08-31T06:46:49.592 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:49.592 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:46:49.592 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9d900b4cd0 msgr2=0x7f9d900b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9d900b4cd0 0x7f9d900b71e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9d940057c0 tx=0x7f9d940058d0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da41023f0 msgr2=0x7f9da419c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da41023f0 0x7f9da419c3f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9da000d770 tx=0x7f9da000dc30 comp rx=0 tx=0).stop 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 shutdown_connections 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9d900b4cd0 0x7f9d900b71e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9da410ffa0 0x7f9da41a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da4102d40 0x7f9da419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 --2- 172.21.15.37:0/3076718744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da41023f0 0x7f9da419c3f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:49.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 >> 172.21.15.37:0/3076718744 conn(0x7f9da4079510 msgr2=0x7f9da4111580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:49.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 shutdown_connections 2024-08-31T06:46:49.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:49.593+0000 7f9dab745640 1 -- 172.21.15.37:0/3076718744 wait complete. 2024-08-31T06:46:49.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:49 smithi066 ceph-mon[22244]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 53 op/s 2024-08-31T06:46:49.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:49 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3076718744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:50.037 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:49 smithi037 ceph-mon[18612]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 53 op/s 2024-08-31T06:46:50.037 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:49 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3076718744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:49 smithi106 ceph-mon[22134]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 53 op/s 2024-08-31T06:46:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:49 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3076718744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:50.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:46:50.560 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:50.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:50 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:46:50.923 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:50 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:46:50.974 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:50 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:46:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 -- 172.21.15.37:0/3069766225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb0109300 msgr2=0x7f0fb0109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 --2- 172.21.15.37:0/3069766225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb0109300 0x7f0fb0109710 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009900 tx=0x7f0fa402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 -- 172.21.15.37:0/3069766225 shutdown_connections 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 --2- 172.21.15.37:0/3069766225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb0109300 0x7f0fb0109710 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 --2- 172.21.15.37:0/3069766225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb0109c50 0x7f0fb0110480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 --2- 172.21.15.37:0/3069766225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb0101e20 0x7f0fb0102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 -- 172.21.15.37:0/3069766225 >> 172.21.15.37:0/3069766225 conn(0x7f0fb0079c60 msgr2=0x7f0fb007a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 -- 172.21.15.37:0/3069766225 shutdown_connections 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.063+0000 7f0fb6593640 1 -- 172.21.15.37:0/3069766225 wait complete. 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.064+0000 7f0fb6593640 1 Processor -- start 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.064+0000 7f0fb6593640 1 -- start start 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.064+0000 7f0fb6593640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb0101e20 0x7f0fb019c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.064+0000 7f0fb6593640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb0109300 0x7f0fb019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.064+0000 7f0fb6593640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb0109c50 0x7f0fb01a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.064+0000 7f0fb6593640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb01137c0 con 0x7f0fb0109c50 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.064+0000 7f0fb6593640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb0113640 con 0x7f0fb0109300 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.064+0000 7f0fb6593640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb0113940 con 0x7f0fb0101e20 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb0101e20 0x7f0fb019c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb0101e20 0x7f0fb019c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:36528/0 (socket says 172.21.15.37:36528) 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0fb4b30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb0109c50 0x7f0fb01a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 -- 172.21.15.37:0/510542546 learned_addr learned my addr 172.21.15.37:0/510542546 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faf7fe640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb0109300 0x7f0fb019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 -- 172.21.15.37:0/510542546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb0109300 msgr2=0x7f0fb019ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb0109300 0x7f0fb019ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 -- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb0109c50 msgr2=0x7f0fb01a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb0109c50 0x7f0fb01a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 -- 172.21.15.37:0/510542546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb01a2420 con 0x7f0fb0101e20 2024-08-31T06:46:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0faffff640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb0101e20 0x7f0fb019c4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000e9f0 tx=0x7f0fa000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0fad7fa640 1 -- 172.21.15.37:0/510542546 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000cd80 con 0x7f0fb0101e20 2024-08-31T06:46:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0fad7fa640 1 -- 172.21.15.37:0/510542546 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0fa00054b0 con 0x7f0fb0101e20 2024-08-31T06:46:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0fad7fa640 1 -- 172.21.15.37:0/510542546 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0010430 con 0x7f0fb0101e20 2024-08-31T06:46:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb01a2710 con 0x7f0fb0101e20 2024-08-31T06:46:51.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.065+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb01a8e70 con 0x7f0fb0101e20 2024-08-31T06:46:51.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.066+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb0102230 con 0x7f0fb0101e20 2024-08-31T06:46:51.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.068+0000 7f0fad7fa640 1 -- 172.21.15.37:0/510542546 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f0fa00046c0 con 0x7f0fb0101e20 2024-08-31T06:46:51.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.069+0000 7f0fad7fa640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0f980b4ca0 0x7f0f980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:51.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.069+0000 7f0faf7fe640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0f980b4ca0 0x7f0f980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:51.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.069+0000 7f0fad7fa640 1 -- 172.21.15.37:0/510542546 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0fa00e5ab0 con 0x7f0fb0101e20 2024-08-31T06:46:51.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.069+0000 7f0faf7fe640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0f980b4ca0 0x7f0f980b71b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4005940 tx=0x7f0fa40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:51.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.072+0000 7f0fad7fa640 1 -- 172.21.15.37:0/510542546 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0fa00ac880 con 0x7f0fb0101e20 2024-08-31T06:46:51.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.308+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fb019d5e0 con 0x7f0fb0101e20 2024-08-31T06:46:51.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.309+0000 7f0fad7fa640 1 -- 172.21.15.37:0/510542546 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f0fa00ac180 con 0x7f0fb0101e20 2024-08-31T06:46:51.310 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:51.311 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:46:51.311 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:46:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.311+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0f980b4ca0 msgr2=0x7f0f980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.311+0000 7f0fb6593640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0f980b4ca0 0x7f0f980b71b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4005940 tx=0x7f0fa40058d0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.311+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb0101e20 msgr2=0x7f0fb019c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb0101e20 0x7f0fb019c4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000e9f0 tx=0x7f0fa000edf0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 shutdown_connections 2024-08-31T06:46:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0f980b4ca0 0x7f0f980b71b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb0109c50 0x7f0fb01a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fb0109300 0x7f0fb019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 --2- 172.21.15.37:0/510542546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0fb0101e20 0x7f0fb019c4b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 >> 172.21.15.37:0/510542546 conn(0x7f0fb0079c60 msgr2=0x7f0fb0105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 shutdown_connections 2024-08-31T06:46:51.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:51.312+0000 7f0fb6593640 1 -- 172.21.15.37:0/510542546 wait complete. 2024-08-31T06:46:51.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:51 smithi037 ceph-mon[18612]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 51 op/s 2024-08-31T06:46:51.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:51 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/510542546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:51.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:51 smithi066 ceph-mon[22244]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 51 op/s 2024-08-31T06:46:51.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:51 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/510542546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:51 smithi106 ceph-mon[22134]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 174 KiB/s wr, 51 op/s 2024-08-31T06:46:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:51 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/510542546' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:52.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:46:52.571 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:53.001 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:52 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:52 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:46:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:52 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:52 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 -- 172.21.15.37:0/1530502972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158103900 msgr2=0x7f8158103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 --2- 172.21.15.37:0/1530502972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158103900 0x7f8158103d10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f814802a410 comp rx=0 tx=0).stop 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 -- 172.21.15.37:0/1530502972 shutdown_connections 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 --2- 172.21.15.37:0/1530502972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8158109b90 0x7f81581103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 --2- 172.21.15.37:0/1530502972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8158109240 0x7f8158109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 --2- 172.21.15.37:0/1530502972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158103900 0x7f8158103d10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 -- 172.21.15.37:0/1530502972 >> 172.21.15.37:0/1530502972 conn(0x7f815807b5f0 msgr2=0x7f815807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 -- 172.21.15.37:0/1530502972 shutdown_connections 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.090+0000 7f815d3d1640 1 -- 172.21.15.37:0/1530502972 wait complete. 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.091+0000 7f815d3d1640 1 Processor -- start 2024-08-31T06:46:53.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.091+0000 7f815d3d1640 1 -- start start 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.091+0000 7f815d3d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8158103900 0x7f815819a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.091+0000 7f815d3d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158109240 0x7f815819a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.091+0000 7f815d3d1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8158109b90 0x7f815819fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.091+0000 7f815d3d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8158113700 con 0x7f8158109240 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.091+0000 7f815d3d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8158113580 con 0x7f8158103900 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.091+0000 7f815d3d1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8158113880 con 0x7f8158109b90 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158109240 0x7f815819a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158109240 0x7f815819a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49608/0 (socket says 172.21.15.37:49608) 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 -- 172.21.15.37:0/3795259190 learned_addr learned my addr 172.21.15.37:0/3795259190 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81577fe640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8158109b90 0x7f815819fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:53.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f8156ffd640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8158103900 0x7f815819a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 -- 172.21.15.37:0/3795259190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8158109b90 msgr2=0x7f815819fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8158109b90 0x7f815819fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 -- 172.21.15.37:0/3795259190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8158103900 msgr2=0x7f815819a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8158103900 0x7f815819a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 -- 172.21.15.37:0/3795259190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81581a00a0 con 0x7f8158109240 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f8156ffd640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8158103900 0x7f815819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f81567fc640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158109240 0x7f815819a790 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f814c00d740 tx=0x7f814c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f813ffff640 1 -- 172.21.15.37:0/3795259190 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c017070 con 0x7f8158109240 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81581a0390 con 0x7f8158109240 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f813ffff640 1 -- 172.21.15.37:0/3795259190 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f814c00de50 con 0x7f8158109240 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f813ffff640 1 -- 172.21.15.37:0/3795259190 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814c00f620 con 0x7f8158109240 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.092+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81581a6bb0 con 0x7f8158109240 2024-08-31T06:46:53.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.093+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8158103d10 con 0x7f8158109240 2024-08-31T06:46:53.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.095+0000 7f813ffff640 1 -- 172.21.15.37:0/3795259190 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f814c01a070 con 0x7f8158109240 2024-08-31T06:46:53.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.096+0000 7f813ffff640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81400b4cd0 0x7f81400b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:53.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.096+0000 7f8156ffd640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81400b4cd0 0x7f81400b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:53.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.096+0000 7f813ffff640 1 -- 172.21.15.37:0/3795259190 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f814c0e4f10 con 0x7f8158109240 2024-08-31T06:46:53.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.096+0000 7f8156ffd640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81400b4cd0 0x7f81400b71e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8148006010 tx=0x7f8148000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:53.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.099+0000 7f813ffff640 1 -- 172.21.15.37:0/3795259190 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f814c0abce0 con 0x7f8158109240 2024-08-31T06:46:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:52 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:52 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:46:53.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.288+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f815810b990 con 0x7f8158109240 2024-08-31T06:46:53.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.289+0000 7f813ffff640 1 -- 172.21.15.37:0/3795259190 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+23049 (secure 0 0 0) 0x7f814c0b4220 con 0x7f8158109240 2024-08-31T06:46:53.291 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:53.291 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:45:19.740510+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81400b4cd0 msgr2=0x7f81400b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81400b4cd0 0x7f81400b71e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8148006010 tx=0x7f8148000bc0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158109240 msgr2=0x7f815819a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158109240 0x7f815819a790 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f814c00d740 tx=0x7f814c00dc00 comp rx=0 tx=0).stop 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 shutdown_connections 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81400b4cd0 0x7f81400b71e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8158109240 0x7f815819a790 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8158109b90 0x7f815819fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 --2- 172.21.15.37:0/3795259190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8158103900 0x7f815819a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:53.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 >> 172.21.15.37:0/3795259190 conn(0x7f815807b5f0 msgr2=0x7f81581073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:53.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 shutdown_connections 2024-08-31T06:46:53.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:53.292+0000 7f815d3d1640 1 -- 172.21.15.37:0/3795259190 wait complete. 2024-08-31T06:46:53.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:53 smithi037 ceph-mon[18612]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 54 op/s 2024-08-31T06:46:53.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:53 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3795259190' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:54.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-31T06:46:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:53 smithi106 ceph-mon[22134]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 54 op/s 2024-08-31T06:46:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:53 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3795259190' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:53 smithi066 ceph-mon[22244]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 174 KiB/s wr, 54 op/s 2024-08-31T06:46:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:53 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3795259190' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:46:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:55.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:46:55.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:46:55.477 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.506 INFO:teuthology.orchestra.run.smithi037.stdout:{"run_dir":"/var/run/ceph"} 2024-08-31T06:46:55.506 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-31T06:46:55.506 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5413 2024-08-31T06:46:55.507 DEBUG:tasks.quiescer:Yielding 2024-08-31T06:46:55.507 INFO:teuthology.run_tasks:Running task workunit... 2024-08-31T06:46:55.521 INFO:tasks.workunit:Pulling workunits from ref d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:46:55.521 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-31T06:46:55.521 INFO:tasks.workunit:timeout=3h 2024-08-31T06:46:55.521 INFO:tasks.workunit:cleanup=True 2024-08-31T06:46:55.521 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:55.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:46:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 -- 172.21.15.37:0/3122538861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9681080b0 msgr2=0x7fa9681084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 --2- 172.21.15.37:0/3122538861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9681080b0 0x7fa9681084c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009900 tx=0x7fa95c02a410 comp rx=0 tx=0).stop 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 -- 172.21.15.37:0/3122538861 shutdown_connections 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 --2- 172.21.15.37:0/3122538861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9681080b0 0x7fa9681084c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 --2- 172.21.15.37:0/3122538861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa968108a00 0x7fa96810f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 --2- 172.21.15.37:0/3122538861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa968102780 0x7fa968102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 -- 172.21.15.37:0/3122538861 >> 172.21.15.37:0/3122538861 conn(0x7fa9680fe180 msgr2=0x7fa9681005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 -- 172.21.15.37:0/3122538861 shutdown_connections 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.511+0000 7fa96e807640 1 -- 172.21.15.37:0/3122538861 wait complete. 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96e807640 1 Processor -- start 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96e807640 1 -- start start 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96e807640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa968102780 0x7fa96819a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96e807640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9681080b0 0x7fa96819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96e807640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa968108a00 0x7fa96819f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96e807640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9681136c0 con 0x7fa968108a00 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96e807640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa968113540 con 0x7fa968102780 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96e807640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa968113840 con 0x7fa9681080b0 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96cda4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa968108a00 0x7fa96819f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96cda4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa968108a00 0x7fa96819f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55954/0 (socket says 172.21.15.37:55954) 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa96cda4640 1 -- 172.21.15.37:0/3337066249 learned_addr learned my addr 172.21.15.37:0/3337066249 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.512+0000 7fa9677fe640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9681080b0 0x7fa96819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa967fff640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa968102780 0x7fa96819a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa96cda4640 1 -- 172.21.15.37:0/3337066249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9681080b0 msgr2=0x7fa96819a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa96cda4640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9681080b0 0x7fa96819a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa96cda4640 1 -- 172.21.15.37:0/3337066249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa968102780 msgr2=0x7fa96819a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa96cda4640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa968102780 0x7fa96819a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa96cda4640 1 -- 172.21.15.37:0/3337066249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9681a0070 con 0x7fa968108a00 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa967fff640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa968102780 0x7fa96819a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa96cda4640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa968108a00 0x7fa96819f970 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa96000eaa0 tx=0x7fa96000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa9657fa640 1 -- 172.21.15.37:0/3337066249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96000cdb0 con 0x7fa968108a00 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa9657fa640 1 -- 172.21.15.37:0/3337066249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa960005020 con 0x7fa968108a00 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa9657fa640 1 -- 172.21.15.37:0/3337066249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9600116d0 con 0x7fa968108a00 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa96e807640 1 -- 172.21.15.37:0/3337066249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9681a0360 con 0x7fa968108a00 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.513+0000 7fa96e807640 1 -- 172.21.15.37:0/3337066249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9681a6af0 con 0x7fa968108a00 2024-08-31T06:46:55.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa975848740 1 Processor -- start 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa9657fa640 1 -- 172.21.15.37:0/3337066249 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7fa960011870 con 0x7fa968108a00 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa975848740 1 -- start start 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa975848740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x56184318cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa975848740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x56184318d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa975848740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x56184318d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa975848740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561843102000 con 0x561842de91b0 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa975848740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5618430f1590 con 0x561842dc02f0 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa975848740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5618430f5540 con 0x561842dc84d0 2024-08-31T06:46:55.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa9677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x56184318cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa9677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x56184318cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55958/0 (socket says 172.21.15.37:55958) 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa9677fe640 1 -- 172.21.15.37:0/3253288527 learned_addr learned my addr 172.21.15.37:0/3253288527 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.516+0000 7fa967fff640 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x56184318d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9677fe640 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x56184318d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9677fe640 1 -- 172.21.15.37:0/3253288527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 msgr2=0x56184318d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9677fe640 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x56184318d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9677fe640 1 -- 172.21.15.37:0/3253288527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 msgr2=0x56184318d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9677fe640 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x56184318d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9677fe640 1 -- 172.21.15.37:0/3253288527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561842e54790 con 0x561842de91b0 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9657fa640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9500b4d20 0x7fa9500b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa967fff640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9500b4d20 0x7fa9500b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9677fe640 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x56184318cac0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0057c0 tx=0x7fa95c0095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1549d1596d77a7dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa9657fa640 1 -- 172.21.15.37:0/3337066249 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa9600e56b0 con 0x7fa968108a00 2024-08-31T06:46:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa94e7fc640 1 -- 172.21.15.37:0/3253288527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c043020 con 0x561842de91b0 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa94e7fc640 1 -- 172.21.15.37:0/3253288527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa95c0046c0 con 0x561842de91b0 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.517+0000 7fa94e7fc640 1 -- 172.21.15.37:0/3253288527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c035070 con 0x561842de91b0 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 -- 172.21.15.37:0/3253288527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 msgr2=0x56184318cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa967fff640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9500b4d20 0x7fa9500b7230 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56184318b740 tx=0x7fa95800b5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x56184318cac0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa95c0057c0 tx=0x7fa95c0095d0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 -- 172.21.15.37:0/3253288527 shutdown_connections 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x56184318d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x56184318d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 --2- 172.21.15.37:0/3253288527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x56184318cac0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 -- 172.21.15.37:0/3253288527 >> 172.21.15.37:0/3253288527 conn(0x561842ddd300 msgr2=0x56184318a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 -- 172.21.15.37:0/3253288527 shutdown_connections 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.518+0000 7fa975848740 1 -- 172.21.15.37:0/3253288527 wait complete. 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 1 -- start start 2024-08-31T06:46:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 1 Processor -- start 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc02f0 0x561843198700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x561843198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842de91b0 0x5618431a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56184302aab0 con 0x561842dc02f0 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561843078680 con 0x561842de91b0 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56184319b1e0 con 0x561842dc84d0 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa975848740 10 client.0 _ll_register_callbacks cb 0x561842e00a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa967fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc02f0 0x561843198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa967fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc02f0 0x561843198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55974/0 (socket says 172.21.15.37:55974) 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa967fff640 1 -- 172.21.15.37:0/747330326 learned_addr learned my addr 172.21.15.37:0/747330326 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa9677fe640 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x561843198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.519+0000 7fa96cda4640 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842de91b0 0x5618431a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa967fff640 1 -- 172.21.15.37:0/747330326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 msgr2=0x561843198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa967fff640 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x561843198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa967fff640 1 -- 172.21.15.37:0/747330326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842de91b0 msgr2=0x5618431a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa967fff640 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842de91b0 0x5618431a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa967fff640 1 -- 172.21.15.37:0/747330326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561842ecd620 con 0x561842dc02f0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa967fff640 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc02f0 0x561843198700 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa95800b910 tx=0x7fa9580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b42e1841ac4903 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa9477fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa9477fe640 1 -- 172.21.15.37:0/747330326 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958004220 con 0x561842dc02f0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa9477fe640 1 -- 172.21.15.37:0/747330326 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa9580043c0 con 0x561842dc02f0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa975848740 1 -- 172.21.15.37:0/747330326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa95c0046c0 con 0x561842dc02f0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa9477fe640 1 -- 172.21.15.37:0/747330326 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa95800f8c0 con 0x561842dc02f0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa975848740 10 client.15579 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa975848740 1 -- 172.21.15.37:0/747330326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618431a72d0 con 0x561842dc02f0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.520+0000 7fa9477fe640 1 -- 172.21.15.37:0/747330326 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa95c0046c0 con 0x561842dc02f0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.521+0000 7fa9477fe640 1 -- 172.21.15.37:0/747330326 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa958003c30 con 0x561842dc02f0 2024-08-31T06:46:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.521+0000 7fa975848740 10 client.15579 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.521+0000 7fa975848740 10 client.15579 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.521+0000 7fa975848740 20 client.15579 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.521+0000 7fa975848740 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561842da7d80 0x5618431aa810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.521+0000 7fa975848740 4 client.15579 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.521+0000 7fa975848740 1 -- 172.21.15.37:0/747330326 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561843103f50 con 0x561842da7d80 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.521+0000 7fa9677fe640 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561842da7d80 0x5618431aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.522+0000 7fa9677fe640 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561842da7d80 0x5618431aa810 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82b77bf02d77f500 server_cookie=4d0f48df98b6c4bf in_seq=0 out_seq=0 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.522+0000 7fa9477fe640 10 client.15579 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.522+0000 7fa9477fe640 1 -- 172.21.15.37:0/747330326 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561843103f50 con 0x561842da7d80 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.522+0000 7fa9477fe640 10 client.15579 handle_command_reply: tid=0 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.522+0000 7fa975848740 1 client.15579 shutdown 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 -- 172.21.15.37:0/747330326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc02f0 msgr2=0x561843198700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc02f0 0x561843198700 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa95800b910 tx=0x7fa9580046c0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 -- 172.21.15.37:0/747330326 shutdown_connections 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561842da7d80 0x5618431aa810 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842de91b0 0x5618431a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x561843198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa9477fe640 0 client.15579 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 --2- 172.21.15.37:0/747330326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc02f0 0x561843198700 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 -- 172.21.15.37:0/747330326 >> 172.21.15.37:0/747330326 conn(0x561842ddd300 msgr2=0x56184318daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 -- 172.21.15.37:0/747330326 shutdown_connections 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 1 -- 172.21.15.37:0/747330326 wait complete. 2024-08-31T06:46:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.523+0000 7fa975848740 20 client.15579 trim_cache size 0 max 16384 2024-08-31T06:46:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa975848740 1 Processor -- start 2024-08-31T06:46:55.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa975848740 1 -- start start 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa975848740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x561843191b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa975848740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc84d0 0x5618431920c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa975848740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842de91b0 0x5618431956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa975848740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9681b1b10 con 0x561842dc84d0 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa975848740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9681af3e0 con 0x561842dc02f0 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa975848740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9681ad230 con 0x561842de91b0 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa9677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc84d0 0x5618431920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa9677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc84d0 0x5618431920c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55980/0 (socket says 172.21.15.37:55980) 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa9677fe640 1 -- 172.21.15.37:0/2640797768 learned_addr learned my addr 172.21.15.37:0/2640797768 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.539+0000 7fa967fff640 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x561843191b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa96cda4640 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842de91b0 0x5618431956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa9677fe640 1 -- 172.21.15.37:0/2640797768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842de91b0 msgr2=0x5618431956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa9677fe640 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842de91b0 0x5618431956c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa9677fe640 1 -- 172.21.15.37:0/2640797768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 msgr2=0x561843191b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa9677fe640 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x561843191b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa9677fe640 1 -- 172.21.15.37:0/2640797768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56184319ac30 con 0x561842dc84d0 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa967fff640 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x561843191b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa9677fe640 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc84d0 0x5618431920c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa95c02a9d0 tx=0x7fa95c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd0b51ee103f9a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa94dffb640 1 -- 172.21.15.37:0/2640797768 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c055020 con 0x561842dc84d0 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa94dffb640 1 -- 172.21.15.37:0/2640797768 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa95c003c80 con 0x561842dc84d0 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.540+0000 7fa94dffb640 1 -- 172.21.15.37:0/2640797768 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c043040 con 0x561842dc84d0 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 -- 172.21.15.37:0/2640797768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc84d0 msgr2=0x5618431920c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc84d0 0x5618431920c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa95c02a9d0 tx=0x7fa95c02a410 comp rx=0 tx=0).stop 2024-08-31T06:46:55.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 -- 172.21.15.37:0/2640797768 shutdown_connections 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842dc84d0 0x5618431920c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842de91b0 0x5618431956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 --2- 172.21.15.37:0/2640797768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x561843191b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 -- 172.21.15.37:0/2640797768 >> 172.21.15.37:0/2640797768 conn(0x561842ddd300 msgr2=0x561843196d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 -- 172.21.15.37:0/2640797768 shutdown_connections 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.541+0000 7fa975848740 1 -- 172.21.15.37:0/2640797768 wait complete. 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 1 -- start start 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 1 Processor -- start 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x56184319e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x56184319ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x561843214220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9681ad8a0 con 0x561842de91b0 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9681aed10 con 0x561842dc02f0 2024-08-31T06:46:55.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9681adf70 con 0x561842dc84d0 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.542+0000 7fa975848740 10 client.0 _ll_register_callbacks cb 0x7fa95800ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x561843214220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x561843214220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55996/0 (socket says 172.21.15.37:55996) 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 -- 172.21.15.37:0/2349154267 learned_addr learned my addr 172.21.15.37:0/2349154267 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa9677fe640 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x56184319ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa967fff640 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x56184319e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 -- 172.21.15.37:0/2349154267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 msgr2=0x56184319ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x56184319ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 -- 172.21.15.37:0/2349154267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 msgr2=0x56184319e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:55.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x56184319e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 -- 172.21.15.37:0/2349154267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56184319f550 con 0x561842de91b0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa96cda4640 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x561843214220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa9600a7e60 tx=0x7fa960005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e3b4d93b611d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa9477fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa9477fe640 1 -- 172.21.15.37:0/2349154267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96001f040 con 0x561842de91b0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa9477fe640 1 -- 172.21.15.37:0/2349154267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa9600b02b0 con 0x561842de91b0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa975848740 1 -- 172.21.15.37:0/2349154267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa95c003c80 con 0x561842de91b0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.543+0000 7fa9477fe640 1 -- 172.21.15.37:0/2349154267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa960097170 con 0x561842de91b0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa975848740 10 client.15585 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa975848740 1 -- 172.21.15.37:0/2349154267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561843215820 con 0x561842de91b0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa9477fe640 1 -- 172.21.15.37:0/2349154267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa95c003c80 con 0x561842de91b0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa9477fe640 1 -- 172.21.15.37:0/2349154267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa96000f040 con 0x561842de91b0 2024-08-31T06:46:55.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa975848740 10 client.15585 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa975848740 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:46:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa975848740 20 client.15585 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa975848740 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561842d7d1c0 0x561843217f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa975848740 4 client.15585 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:46:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa975848740 1 -- 172.21.15.37:0/2349154267 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5618430ff9f0 con 0x561842d7d1c0 2024-08-31T06:46:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.544+0000 7fa967fff640 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561842d7d1c0 0x561843217f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.545+0000 7fa9477fe640 10 client.15585 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:55.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.545+0000 7fa967fff640 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561842d7d1c0 0x561843217f60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5114c5d3116b273 server_cookie=7a58d3b4d2049710 in_seq=0 out_seq=0 2024-08-31T06:46:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-31T06:46:55.552 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 79h/121d Inode: 1 Links: 2 2024-08-31T06:46:55.552 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-31T06:46:55.552 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-31T06:46:55.552 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-31 06:44:58.041775803 +0000 2024-08-31T06:46:55.552 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-31 06:44:58.041775803 +0000 2024-08-31T06:46:55.552 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-31 06:46:31.261168002 +0000 2024-08-31T06:46:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2024-08-31T06:46:55.553 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-31T06:46:55.553 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-31T06:46:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa9477fe640 1 -- 172.21.15.37:0/2349154267 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5618430ff9f0 con 0x561842d7d1c0 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa9477fe640 10 client.15585 handle_command_reply: tid=0 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 client.15585 shutdown 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 -- 172.21.15.37:0/2349154267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 msgr2=0x561843214220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x561843214220 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa9600a7e60 tx=0x7fa960005450 comp rx=0 tx=0).stop 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 -- 172.21.15.37:0/2349154267 shutdown_connections 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561842d7d1c0 0x561843217f60 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561842de91b0 0x561843214220 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa9477fe640 0 client.15585 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561842dc84d0 0x56184319ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 --2- 172.21.15.37:0/2349154267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561842dc02f0 0x56184319e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 -- 172.21.15.37:0/2349154267 >> 172.21.15.37:0/2349154267 conn(0x561842ddd300 msgr2=0x561843191b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 -- 172.21.15.37:0/2349154267 shutdown_connections 2024-08-31T06:46:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 1 -- 172.21.15.37:0/2349154267 wait complete. 2024-08-31T06:46:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.558+0000 7fa975848740 20 client.15585 trim_cache size 0 max 16384 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 -- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9500b4d20 msgr2=0x7fa9500b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9500b4d20 0x7fa9500b7230 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x56184318b740 tx=0x7fa95800b5c0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 -- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa968108a00 msgr2=0x7fa96819f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa968108a00 0x7fa96819f970 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa96000eaa0 tx=0x7fa96000ef60 comp rx=0 tx=0).stop 2024-08-31T06:46:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 -- 172.21.15.37:0/3337066249 shutdown_connections 2024-08-31T06:46:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9500b4d20 0x7fa9500b7230 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa968108a00 0x7fa96819f970 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9681080b0 0x7fa96819a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 --2- 172.21.15.37:0/3337066249 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa968102780 0x7fa96819a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 -- 172.21.15.37:0/3337066249 >> 172.21.15.37:0/3337066249 conn(0x7fa9680fe180 msgr2=0x7fa968107790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 -- 172.21.15.37:0/3337066249 shutdown_connections 2024-08-31T06:46:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:46:55.559+0000 7fa96e807640 1 -- 172.21.15.37:0/3337066249 wait complete. 2024-08-31T06:46:55.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:46:55.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:46:55.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.589 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d19e6118f7015f0047264006cb0c873528eb3ae6 2024-08-31T06:46:55.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:46:55.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:46:55.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:46:55.646 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-31T06:46:55.791 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:56.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:56 smithi037 ceph-mon[18612]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 KiB/s wr, 30 op/s 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 -- 172.21.15.37:0/4103394978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108140 msgr2=0x7f026c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 --2- 172.21.15.37:0/4103394978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108140 0x7f026c108550 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f025c009900 tx=0x7f025c02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 -- 172.21.15.37:0/4103394978 shutdown_connections 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 --2- 172.21.15.37:0/4103394978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108140 0x7f026c108550 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 --2- 172.21.15.37:0/4103394978 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c108a90 0x7f026c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 --2- 172.21.15.37:0/4103394978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c102800 0x7f026c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 -- 172.21.15.37:0/4103394978 >> 172.21.15.37:0/4103394978 conn(0x7f026c0794d0 msgr2=0x7f026c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 -- 172.21.15.37:0/4103394978 shutdown_connections 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.299+0000 7f0271cc0640 1 -- 172.21.15.37:0/4103394978 wait complete. 2024-08-31T06:46:56.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.300+0000 7f0271cc0640 1 Processor -- start 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.300+0000 7f0271cc0640 1 -- start start 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.300+0000 7f0271cc0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c102800 0x7f026c0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.300+0000 7f0271cc0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c108140 0x7f026c0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.300+0000 7f0271cc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108a90 0x7f026c0ffe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.300+0000 7f0271cc0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f026c112570 con 0x7f026c108a90 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.300+0000 7f0271cc0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f026c1123f0 con 0x7f026c108140 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.300+0000 7f0271cc0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f026c1126f0 con 0x7f026c102800 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108a90 0x7f026c0ffe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:56.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026b7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c102800 0x7f026c0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108a90 0x7f026c0ffe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56018/0 (socket says 172.21.15.37:56018) 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 -- 172.21.15.37:0/2430623827 learned_addr learned my addr 172.21.15.37:0/2430623827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026affd640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c108140 0x7f026c0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 -- 172.21.15.37:0/2430623827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c102800 msgr2=0x7f026c0ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c102800 0x7f026c0ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 -- 172.21.15.37:0/2430623827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c108140 msgr2=0x7f026c0ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c108140 0x7f026c0ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 -- 172.21.15.37:0/2430623827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f026c1a8530 con 0x7f026c108a90 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026b7fe640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c102800 0x7f026c0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.301+0000 7f026bfff640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108a90 0x7f026c0ffe90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0264009fd0 tx=0x7f026400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.302+0000 7f0268ff9640 1 -- 172.21.15.37:0/2430623827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264017070 con 0x7f026c108a90 2024-08-31T06:46:56.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.302+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f026c1a8820 con 0x7f026c108a90 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.302+0000 7f0268ff9640 1 -- 172.21.15.37:0/2430623827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0264003e00 con 0x7f026c108a90 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.302+0000 7f0268ff9640 1 -- 172.21.15.37:0/2430623827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264010460 con 0x7f026c108a90 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.302+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f026c1a8ce0 con 0x7f026c108a90 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.303+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f026c102c10 con 0x7f026c108a90 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.305+0000 7f0268ff9640 1 -- 172.21.15.37:0/2430623827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f0264003970 con 0x7f026c108a90 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.306+0000 7f0268ff9640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02580b4ca0 0x7f02580b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.306+0000 7f0268ff9640 1 -- 172.21.15.37:0/2430623827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f02640e5620 con 0x7f026c108a90 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.306+0000 7f026b7fe640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02580b4ca0 0x7f02580b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.307+0000 7f026b7fe640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02580b4ca0 0x7f02580b71b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f026c100e60 tx=0x7f025400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:56.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.309+0000 7f0268ff9640 1 -- 172.21.15.37:0/2430623827 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f02640abda0 con 0x7f026c108a90 2024-08-31T06:46:56.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.534+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f026c100710 con 0x7f026c108a90 2024-08-31T06:46:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.535+0000 7f0268ff9640 1 -- 172.21.15.37:0/2430623827 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f02640b0560 con 0x7f026c108a90 2024-08-31T06:46:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:46:56.536 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:46:56.537 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:46:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.537+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02580b4ca0 msgr2=0x7f02580b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.537+0000 7f0271cc0640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02580b4ca0 0x7f02580b71b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f026c100e60 tx=0x7f025400b390 comp rx=0 tx=0).stop 2024-08-31T06:46:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108a90 msgr2=0x7f026c0ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108a90 0x7f026c0ffe90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0264009fd0 tx=0x7f026400b260 comp rx=0 tx=0).stop 2024-08-31T06:46:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 shutdown_connections 2024-08-31T06:46:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02580b4ca0 0x7f02580b71b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f026c108a90 0x7f026c0ffe90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f026c108140 0x7f026c0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 --2- 172.21.15.37:0/2430623827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c102800 0x7f026c0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 >> 172.21.15.37:0/2430623827 conn(0x7f026c0794d0 msgr2=0x7f026c06b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 shutdown_connections 2024-08-31T06:46:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:56.538+0000 7f0271cc0640 1 -- 172.21.15.37:0/2430623827 wait complete. 2024-08-31T06:46:56.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:56 smithi106 ceph-mon[22134]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 KiB/s wr, 30 op/s 2024-08-31T06:46:56.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:56 smithi066 ceph-mon[22244]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 KiB/s wr, 30 op/s 2024-08-31T06:46:57.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-31T06:44:43.326015+0000', 'modified': '2024-08-31T06:46:31.653316+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24695, 'mds_1': 24658, 'mds_2': 24656}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24629': {'gid': 24629, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.66:6835/298046856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6834', 'nonce': 298046856}, {'type': 'v1', 'addr': '172.21.15.66:6835', 'nonce': 298046856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.106:6835/2636907745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 2636907745}, {'type': 'v1', 'addr': '172.21.15.106:6835', 'nonce': 2636907745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24643': {'gid': 24643, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.106:6837/1095097353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6836', 'nonce': 1095097353}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 1095097353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.66:6837/3257187794', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6836', 'nonce': 3257187794}, {'type': 'v1', 'addr': '172.21.15.66:6837', 'nonce': 3257187794}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24658': {'gid': 24658, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.106:6839/1806859517', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6838', 'nonce': 1806859517}, {'type': 'v1', 'addr': '172.21.15.106:6839', 'nonce': 1806859517}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.66:6839/2855667585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6838', 'nonce': 2855667585}, {'type': 'v1', 'addr': '172.21.15.66:6839', 'nonce': 2855667585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24658, 24695, 24656]} 2024-08-31T06:46:57.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-31T06:46:57.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.h status 2024-08-31T06:46:57.491 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:57 smithi037 ceph-mon[18612]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 KiB/s wr, 34 op/s 2024-08-31T06:46:57.491 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:57 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2430623827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:57.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:57 smithi106 ceph-mon[22134]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 KiB/s wr, 34 op/s 2024-08-31T06:46:57.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:57 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2430623827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:57.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:57 smithi066 ceph-mon[22244]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 KiB/s wr, 34 op/s 2024-08-31T06:46:57.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:57 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2430623827' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:46:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2344750706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad81081a0 msgr2=0x7f7ad81085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2344750706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad81081a0 0x7f7ad81085b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009900 tx=0x7f7acc02a410 comp rx=0 tx=0).stop 2024-08-31T06:46:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2344750706 shutdown_connections 2024-08-31T06:46:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2344750706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad81081a0 0x7f7ad81085b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2344750706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad8108af0 0x7f7ad810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2344750706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ad8102f30 0x7f7ad8103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2344750706 >> 172.21.15.37:0/2344750706 conn(0x7f7ad8079d30 msgr2=0x7f7ad807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2344750706 shutdown_connections 2024-08-31T06:46:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.099+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2344750706 wait complete. 2024-08-31T06:46:58.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7adc9e4640 1 Processor -- start 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7adc9e4640 1 -- start start 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7adc9e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad8102f30 0x7f7ad80feb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7adc9e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ad81081a0 0x7f7ad80ff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7adc9e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad8108af0 0x7f7ad80ff610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7adc9e4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad81126d0 con 0x7f7ad8102f30 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7adc9e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad8112550 con 0x7f7ad81081a0 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7adc9e4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad8112850 con 0x7f7ad8108af0 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad8102f30 0x7f7ad80feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.100+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad8102f30 0x7f7ad80feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56034/0 (socket says 172.21.15.37:56034) 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad659c640 1 -- 172.21.15.37:0/2877803754 learned_addr learned my addr 172.21.15.37:0/2877803754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad5d9b640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ad81081a0 0x7f7ad80ff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad8108af0 0x7f7ad80ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad659c640 1 -- 172.21.15.37:0/2877803754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad8108af0 msgr2=0x7f7ad80ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad659c640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad8108af0 0x7f7ad80ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad659c640 1 -- 172.21.15.37:0/2877803754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ad81081a0 msgr2=0x7f7ad80ff0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad659c640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ad81081a0 0x7f7ad80ff0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad659c640 1 -- 172.21.15.37:0/2877803754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad81a86b0 con 0x7f7ad8102f30 2024-08-31T06:46:58.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad8108af0 0x7f7ad80ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ad659c640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad8102f30 0x7f7ad80feb90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800d950 tx=0x7f7ac800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ac77fe640 1 -- 172.21.15.37:0/2877803754 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8017070 con 0x7f7ad8102f30 2024-08-31T06:46:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ac77fe640 1 -- 172.21.15.37:0/2877803754 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac8009c30 con 0x7f7ad8102f30 2024-08-31T06:46:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7ac77fe640 1 -- 172.21.15.37:0/2877803754 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800f620 con 0x7f7ad8102f30 2024-08-31T06:46:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2877803754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad81a89a0 con 0x7f7ad8102f30 2024-08-31T06:46:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.101+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2877803754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad81a8eb0 con 0x7f7ad8102f30 2024-08-31T06:46:58.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.104+0000 7f7ae2f59740 1 Processor -- start 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ae2f59740 1 -- start start 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ac77fe640 1 -- 172.21.15.37:0/2877803754 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f7ac8010460 con 0x7f7ad8102f30 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ccf60 0x55e6036727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e603672cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ac280 0x55e603673230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e6035e93f0 con 0x55e6032a40a0 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e6035d8980 con 0x55e6032ac280 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e6035dc930 con 0x55e6032ccf60 2024-08-31T06:46:58.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e603672cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e603672cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56044/0 (socket says 172.21.15.37:56044) 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ad659c640 1 -- 172.21.15.37:0/3376191016 learned_addr learned my addr 172.21.15.37:0/3376191016 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ccf60 0x55e6036727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.105+0000 7f7ad5d9b640 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ac280 0x55e603673230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ad659c640 1 -- 172.21.15.37:0/3376191016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ccf60 msgr2=0x55e6036727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ad659c640 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ccf60 0x55e6036727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ad659c640 1 -- 172.21.15.37:0/3376191016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ac280 msgr2=0x55e603673230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ad659c640 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ac280 0x55e603673230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ad659c640 1 -- 172.21.15.37:0/3376191016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e603338540 con 0x55e6032a40a0 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ad5d9b640 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ac280 0x55e603673230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ad659c640 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e603672cf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80e2840 tx=0x7f7ac80ed910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2c28a92993e097 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ac4ff9640 1 -- 172.21.15.37:0/3376191016 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80f8070 con 0x55e6032a40a0 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ac77fe640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ac00b4ca0 0x7f7ac00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ac4ff9640 1 -- 172.21.15.37:0/3376191016 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac80e5a50 con 0x55e6032a40a0 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ac4ff9640 1 -- 172.21.15.37:0/3376191016 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80a7ec0 con 0x55e6032a40a0 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ac77fe640 1 -- 172.21.15.37:0/2877803754 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7ac80e50a0 con 0x7f7ad8102f30 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.106+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ac00b4ca0 0x7f7ac00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3376191016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 msgr2=0x55e603672cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ac00b4ca0 0x7f7ac00b71b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000c610 tx=0x7f7ad000e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e603672cf0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80e2840 tx=0x7f7ac80ed910 comp rx=0 tx=0).stop 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3376191016 shutdown_connections 2024-08-31T06:46:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e603672cf0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ac280 0x55e603673230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3376191016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ccf60 0x55e6036727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3376191016 >> 172.21.15.37:0/3376191016 conn(0x55e6032c1350 msgr2=0x55e6036706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3376191016 shutdown_connections 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.107+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3376191016 wait complete. 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 1 -- start start 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 1 Processor -- start 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032a40a0 0x55e60367dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ac280 0x55e60367e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 0x55e60368a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e60343b5f0 con 0x55e6032ac280 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e60355f600 con 0x55e6032ccf60 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e603680f90 con 0x55e6032a40a0 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ae2f59740 10 client.0 _ll_register_callbacks cb 0x55e603585af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ad5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ac280 0x55e60367e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ad5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ac280 0x55e60367e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56046/0 (socket says 172.21.15.37:56046) 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ad5d9b640 1 -- 172.21.15.37:0/364729944 learned_addr learned my addr 172.21.15.37:0/364729944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.108+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 0x55e60368a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ad659c640 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032a40a0 0x55e60367dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ad5d9b640 1 -- 172.21.15.37:0/364729944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032a40a0 msgr2=0x55e60367dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ad5d9b640 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032a40a0 0x55e60367dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ad5d9b640 1 -- 172.21.15.37:0/364729944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 msgr2=0x55e60368a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:58.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ad5d9b640 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 0x55e60368a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ad5d9b640 1 -- 172.21.15.37:0/364729944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6035987b0 con 0x55e6032ac280 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ad659c640 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032a40a0 0x55e60367dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ad5d9b640 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ac280 0x55e60367e3e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7acc005ab0 tx=0x7f7acc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93de598306164c16 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7abdffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7abdffb640 1 -- 172.21.15.37:0/364729944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc035070 con 0x55e6032ac280 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7abdffb640 1 -- 172.21.15.37:0/364729944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7acc003c40 con 0x55e6032ac280 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ae2f59740 1 -- 172.21.15.37:0/364729944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ac80e5a50 con 0x55e6032ac280 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7abdffb640 1 -- 172.21.15.37:0/364729944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7acc003e40 con 0x55e6032ac280 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ae2f59740 10 client.15603 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.109+0000 7f7ae2f59740 1 -- 172.21.15.37:0/364729944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e60368ccd0 con 0x55e6032ac280 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7abdffb640 1 -- 172.21.15.37:0/364729944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac80e5a50 con 0x55e6032ac280 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7abdffb640 1 -- 172.21.15.37:0/364729944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7acc03b4c0 con 0x55e6032ac280 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7ae2f59740 10 client.15603 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7ae2f59740 10 client.15603 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7ae2f59740 20 client.15603 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55e60328b8e0 0x55e603690730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7ae2f59740 4 client.15603 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7ae2f59740 1 -- 172.21.15.37:0/364729944 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6035eb340 con 0x55e60328b8e0 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.110+0000 7f7ad659c640 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55e60328b8e0 0x55e603690730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.111+0000 7f7ad659c640 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55e60328b8e0 0x55e603690730 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c17cb6c0bf94ac1a server_cookie=7c5ba833d99302d6 in_seq=0 out_seq=0 2024-08-31T06:46:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.111+0000 7f7abdffb640 10 client.15603 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.111+0000 7f7abdffb640 1 -- 172.21.15.37:0/364729944 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6035eb340 con 0x55e60328b8e0 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.111+0000 7f7abdffb640 10 client.15603 handle_command_reply: tid=0 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.111+0000 7f7ae2f59740 1 client.15603 shutdown 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 -- 172.21.15.37:0/364729944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ac280 msgr2=0x55e60367e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ac280 0x55e60367e3e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7acc005ab0 tx=0x7f7acc004600 comp rx=0 tx=0).stop 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 -- 172.21.15.37:0/364729944 shutdown_connections 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ac280 0x55e60367e3e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55e60328b8e0 0x55e603690730 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 0x55e60368a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/364729944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032a40a0 0x55e60367dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 -- 172.21.15.37:0/364729944 >> 172.21.15.37:0/364729944 conn(0x55e6032c1350 msgr2=0x55e603675940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:58.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7abdffb640 0 client.15603 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 -- 172.21.15.37:0/364729944 shutdown_connections 2024-08-31T06:46:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 1 -- 172.21.15.37:0/364729944 wait complete. 2024-08-31T06:46:58.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.112+0000 7f7ae2f59740 20 client.15603 trim_cache size 0 max 16384 2024-08-31T06:46:58.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.130+0000 7f7ae2f59740 1 Processor -- start 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.130+0000 7f7ae2f59740 1 -- start start 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e60368a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 0x55e603678fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 0x55e603679520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e60368ea70 con 0x55e6032a40a0 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e60368f140 con 0x55e6032ccf60 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e60368f810 con 0x55e6032ac280 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e60368a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e60368a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56054/0 (socket says 172.21.15.37:56054) 2024-08-31T06:46:58.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 -- 172.21.15.37:0/203347598 learned_addr learned my addr 172.21.15.37:0/203347598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 -- 172.21.15.37:0/203347598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 msgr2=0x55e603678fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 --2- 172.21.15.37:0/203347598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 0x55e603678fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 -- 172.21.15.37:0/203347598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 msgr2=0x55e603679520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 --2- 172.21.15.37:0/203347598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 0x55e603679520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 -- 172.21.15.37:0/203347598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e60366beb0 con 0x55e6032a40a0 2024-08-31T06:46:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7ad659c640 1 --2- 172.21.15.37:0/203347598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e60368a220 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80f6040 tx=0x7f7ac80a5f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a119dd5acdc8eaa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7abffff640 1 -- 172.21.15.37:0/203347598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8020040 con 0x55e6032a40a0 2024-08-31T06:46:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7abffff640 1 -- 172.21.15.37:0/203347598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac80ab380 con 0x55e6032a40a0 2024-08-31T06:46:58.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.131+0000 7f7abffff640 1 -- 172.21.15.37:0/203347598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80a7000 con 0x55e6032a40a0 2024-08-31T06:46:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 -- 172.21.15.37:0/203347598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 msgr2=0x55e60368a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/203347598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e60368a220 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80f6040 tx=0x7f7ac80a5f90 comp rx=0 tx=0).stop 2024-08-31T06:46:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 -- 172.21.15.37:0/203347598 shutdown_connections 2024-08-31T06:46:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/203347598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032ccf60 0x55e603679520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/203347598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 0x55e603678fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/203347598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032a40a0 0x55e60368a220 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 -- 172.21.15.37:0/203347598 >> 172.21.15.37:0/203347598 conn(0x55e6032c1350 msgr2=0x55e60368e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 -- 172.21.15.37:0/203347598 shutdown_connections 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 -- 172.21.15.37:0/203347598 wait complete. 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.132+0000 7f7ae2f59740 1 -- start start 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ae2f59740 1 Processor -- start 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032a40a0 0x55e6036930c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 0x55e603693680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ae2f59740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ccf60 0x55e603697130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e6036905b0 con 0x55e6032ccf60 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e60368fee0 con 0x55e6032a40a0 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ae2f59740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e603690c80 con 0x55e6032ac280 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ae2f59740 10 client.0 _ll_register_callbacks cb 0x7f7acc004210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ccf60 0x55e603697130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ccf60 0x55e603697130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56058/0 (socket says 172.21.15.37:56058) 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad6d9d640 1 -- 172.21.15.37:0/3325959914 learned_addr learned my addr 172.21.15.37:0/3325959914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad659c640 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032a40a0 0x55e6036930c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad5d9b640 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 0x55e603693680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad6d9d640 1 -- 172.21.15.37:0/3325959914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 msgr2=0x55e603693680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 0x55e603693680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad6d9d640 1 -- 172.21.15.37:0/3325959914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032a40a0 msgr2=0x55e6036930c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032a40a0 0x55e6036930c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.133+0000 7f7ad6d9d640 1 -- 172.21.15.37:0/3325959914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6036977a0 con 0x55e6032ccf60 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7ad6d9d640 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ccf60 0x55e603697130 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0007f20 tx=0x7f7ad0009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d4fec3b7f36dec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7abdffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7abdffb640 1 -- 172.21.15.37:0/3325959914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0028020 con 0x55e6032ccf60 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7abdffb640 1 -- 172.21.15.37:0/3325959914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7ad0024470 con 0x55e6032ccf60 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3325959914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ac80ab380 con 0x55e6032ccf60 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7abdffb640 1 -- 172.21.15.37:0/3325959914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7ad0033050 con 0x55e6032ccf60 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7ae2f59740 10 client.15609 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3325959914 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e603698bc0 con 0x55e6032ccf60 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7abdffb640 1 -- 172.21.15.37:0/3325959914 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac80ab380 con 0x55e6032ccf60 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7abdffb640 1 -- 172.21.15.37:0/3325959914 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7ad00237a0 con 0x55e6032ccf60 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.134+0000 7f7ae2f59740 10 client.15609 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.135+0000 7f7ae2f59740 10 client.15609 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.135+0000 7f7ae2f59740 20 client.15609 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.135+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55e603260c90 0x55e6036fe7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.135+0000 7f7ae2f59740 4 client.15609 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:46:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.135+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3325959914 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "status"}) -- 0x55e6035e6de0 con 0x55e603260c90 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.135+0000 7f7ad659c640 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55e603260c90 0x55e6036fe7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.135+0000 7f7ad659c640 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55e603260c90 0x55e6036fe7a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af97987ad4dbc5dc server_cookie=cba2e54e387093ea in_seq=0 out_seq=0 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.135+0000 7f7abdffb640 10 client.15609 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7abdffb640 1 -- 172.21.15.37:0/3325959914 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e6035e6de0 con 0x55e603260c90 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7abdffb640 10 client.15609 handle_command_reply: tid=0 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 client.15609 shutdown 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3325959914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ccf60 msgr2=0x55e603697130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ccf60 0x55e603697130 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0007f20 tx=0x7f7ad0009850 comp rx=0 tx=0).stop 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3325959914 shutdown_connections 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6032ccf60 0x55e603697130 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55e603260c90 0x55e6036fe7a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7abdffb640 0 client.15609 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e6032ac280 0x55e603693680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 --2- 172.21.15.37:0/3325959914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e6032a40a0 0x55e6036930c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3325959914 >> 172.21.15.37:0/3325959914 conn(0x55e6032c1350 msgr2=0x55e603678fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3325959914 shutdown_connections 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 1 -- 172.21.15.37:0/3325959914 wait complete. 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.136+0000 7f7ae2f59740 20 client.15609 trim_cache size 0 max 16384 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:46:58.144 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24656, 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 126.489253268, 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 25, 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 76, 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 157.00997321400001 2024-08-31T06:46:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ac00b4ca0 msgr2=0x7f7ac00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ac00b4ca0 0x7f7ac00b71b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000c610 tx=0x7f7ad000e040 comp rx=0 tx=0).stop 2024-08-31T06:46:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad8102f30 msgr2=0x7f7ad80feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad8102f30 0x7f7ad80feb90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800d950 tx=0x7f7ac800de10 comp rx=0 tx=0).stop 2024-08-31T06:46:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2877803754 shutdown_connections 2024-08-31T06:46:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ac00b4ca0 0x7f7ac00b71b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ad8108af0 0x7f7ad80ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ad81081a0 0x7f7ad80ff0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 --2- 172.21.15.37:0/2877803754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ad8102f30 0x7f7ad80feb90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2877803754 >> 172.21.15.37:0/2877803754 conn(0x7f7ad8079d30 msgr2=0x7f7ad81011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2877803754 shutdown_connections 2024-08-31T06:46:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:58.137+0000 7f7adc9e4640 1 -- 172.21.15.37:0/2877803754 wait complete. 2024-08-31T06:46:58.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.i status 2024-08-31T06:46:59.039 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:46:59.420 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:46:59 smithi037 ceph-mon[18612]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-31T06:46:59.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:46:59 smithi066 ceph-mon[22244]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-31T06:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 -- 172.21.15.37:0/3646937868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc109090 msgr2=0x7f14dc1094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 --2- 172.21.15.37:0/3646937868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc109090 0x7f14dc1094a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f14c4009900 tx=0x7f14c402a410 comp rx=0 tx=0).stop 2024-08-31T06:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 -- 172.21.15.37:0/3646937868 shutdown_connections 2024-08-31T06:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 --2- 172.21.15.37:0/3646937868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc109090 0x7f14dc1094a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 --2- 172.21.15.37:0/3646937868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14dc1099e0 0x7f14dc110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 --2- 172.21.15.37:0/3646937868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc103750 0x7f14dc103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 -- 172.21.15.37:0/3646937868 >> 172.21.15.37:0/3646937868 conn(0x7f14dc0ff1c0 msgr2=0x7f14dc101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 -- 172.21.15.37:0/3646937868 shutdown_connections 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.656+0000 7f14e0803640 1 -- 172.21.15.37:0/3646937868 wait complete. 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.657+0000 7f14e0803640 1 Processor -- start 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.657+0000 7f14e0803640 1 -- start start 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.657+0000 7f14e0803640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14dc103750 0x7f14dc19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.657+0000 7f14e0803640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc109090 0x7f14dc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.657+0000 7f14e0803640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1099e0 0x7f14dc19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.657+0000 7f14e0803640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc113570 con 0x7f14dc1099e0 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.657+0000 7f14e0803640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1133f0 con 0x7f14dc103750 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.657+0000 7f14e0803640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1136f0 con 0x7f14dc109090 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1099e0 0x7f14dc19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1099e0 0x7f14dc19f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56082/0 (socket says 172.21.15.37:56082) 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 -- 172.21.15.37:0/3620061297 learned_addr learned my addr 172.21.15.37:0/3620061297 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14dad9d640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14dc103750 0x7f14dc19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14da59c640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc109090 0x7f14dc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 -- 172.21.15.37:0/3620061297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc109090 msgr2=0x7f14dc19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc109090 0x7f14dc19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 -- 172.21.15.37:0/3620061297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14dc103750 msgr2=0x7f14dc19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14dc103750 0x7f14dc19a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 -- 172.21.15.37:0/3620061297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc19fff0 con 0x7f14dc1099e0 2024-08-31T06:46:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14db59e640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1099e0 0x7f14dc19f8c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c970 tx=0x7f14d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14d3fff640 1 -- 172.21.15.37:0/3620061297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4007bb0 con 0x7f14dc1099e0 2024-08-31T06:46:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14d3fff640 1 -- 172.21.15.37:0/3620061297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14d4007d50 con 0x7f14dc1099e0 2024-08-31T06:46:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14e0803640 1 -- 172.21.15.37:0/3620061297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc1a02e0 con 0x7f14dc1099e0 2024-08-31T06:46:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14d3fff640 1 -- 172.21.15.37:0/3620061297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4004d50 con 0x7f14dc1099e0 2024-08-31T06:46:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.658+0000 7f14e0803640 1 -- 172.21.15.37:0/3620061297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc1a6a40 con 0x7f14dc1099e0 2024-08-31T06:46:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.661+0000 7f14e7579740 1 Processor -- start 2024-08-31T06:46:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.661+0000 7f14d3fff640 1 -- 172.21.15.37:0/3620061297 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f14d4005020 con 0x7f14dc1099e0 2024-08-31T06:46:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.661+0000 7f14e7579740 1 -- start start 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.661+0000 7f14e7579740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.661+0000 7f14e7579740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3e90a0 0x559bff7b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14e7579740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14e7579740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559bff72e3f0 con 0x559bff3f1280 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14e7579740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559bff71d980 con 0x559bff3e90a0 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14e7579740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559bff721930 con 0x559bff411f60 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56096/0 (socket says 172.21.15.37:56096) 2024-08-31T06:46:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 -- 172.21.15.37:0/204459439 learned_addr learned my addr 172.21.15.37:0/204459439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14dad9d640 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3e90a0 0x559bff7b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 -- 172.21.15.37:0/204459439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 msgr2=0x559bff7b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 -- 172.21.15.37:0/204459439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3e90a0 msgr2=0x559bff7b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3e90a0 0x559bff7b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 -- 172.21.15.37:0/204459439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bff47d540 con 0x559bff3f1280 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14d3fff640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f14c80b4ca0 0x7f14c80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14da59c640 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7b83e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f14c40057c0 tx=0x7f14c4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e5bd5b4e4ef880 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14dad9d640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f14c80b4ca0 0x7f14c80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.662+0000 7f14d3fff640 1 -- 172.21.15.37:0/3620061297 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f14d40e5110 con 0x7f14dc1099e0 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.663+0000 7f14d17fa640 1 -- 172.21.15.37:0/204459439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4035040 con 0x559bff3f1280 2024-08-31T06:46:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.663+0000 7f14d17fa640 1 -- 172.21.15.37:0/204459439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14c40044c0 con 0x559bff3f1280 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.663+0000 7f14d17fa640 1 -- 172.21.15.37:0/204459439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4003c80 con 0x559bff3f1280 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.663+0000 7f14e7579740 1 -- 172.21.15.37:0/204459439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 msgr2=0x559bff7b83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.663+0000 7f14dad9d640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f14c80b4ca0 0x7f14c80b71b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00a510 tx=0x7f14cc00d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.663+0000 7f14e7579740 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7b83e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f14c40057c0 tx=0x7f14c4005fd0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 -- 172.21.15.37:0/204459439 shutdown_connections 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7b83e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3e90a0 0x559bff7b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 --2- 172.21.15.37:0/204459439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 -- 172.21.15.37:0/204459439 >> 172.21.15.37:0/204459439 conn(0x559bff406350 msgr2=0x559bff7b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 -- 172.21.15.37:0/204459439 shutdown_connections 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 -- 172.21.15.37:0/204459439 wait complete. 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 -- start start 2024-08-31T06:46:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 Processor -- start 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff3e90a0 0x559bff7c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff411f60 0x559bff7c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559bff5805f0 con 0x559bff3f1280 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559bff6a4600 con 0x559bff411f60 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.664+0000 7f14e7579740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559bff7ca410 con 0x559bff3e90a0 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14e7579740 10 client.0 _ll_register_callbacks cb 0x559bff6caaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56100/0 (socket says 172.21.15.37:56100) 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 -- 172.21.15.37:0/984710489 learned_addr learned my addr 172.21.15.37:0/984710489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14dad9d640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff3e90a0 0x559bff7c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14db59e640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff411f60 0x559bff7c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 -- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff3e90a0 msgr2=0x559bff7c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff3e90a0 0x559bff7c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 -- 172.21.15.37:0/984710489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff411f60 msgr2=0x559bff7c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff411f60 0x559bff7c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 -- 172.21.15.37:0/984710489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bff6dd7b0 con 0x559bff3f1280 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14dad9d640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff3e90a0 0x559bff7c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14db59e640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff411f60 0x559bff7c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14da59c640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7c78e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f14c402a450 tx=0x7f14c40318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914e128b74111f6a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14c27fc640 1 -- 172.21.15.37:0/984710489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4035070 con 0x559bff3f1280 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14c27fc640 1 -- 172.21.15.37:0/984710489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f14c4003c00 con 0x559bff3f1280 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.665+0000 7f14e7579740 1 -- 172.21.15.37:0/984710489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559bff730340 con 0x559bff3f1280 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14c27fc640 1 -- 172.21.15.37:0/984710489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14c4057050 con 0x559bff3f1280 2024-08-31T06:46:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14e7579740 10 client.15621 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14e7579740 1 -- 172.21.15.37:0/984710489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559bff7d6120 con 0x559bff3f1280 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14c27fc640 1 -- 172.21.15.37:0/984710489 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559bff730340 con 0x559bff3f1280 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14c27fc640 1 -- 172.21.15.37:0/984710489 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f14c403d900 con 0x559bff3f1280 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14e7579740 10 client.15621 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14e7579740 10 client.15621 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14e7579740 20 client.15621 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14e7579740 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559bff3d08e0 0x559bff7d9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14e7579740 4 client.15621 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14e7579740 1 -- 172.21.15.37:0/984710489 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bff72bde0 con 0x559bff3d08e0 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.666+0000 7f14dad9d640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559bff3d08e0 0x559bff7d9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.667+0000 7f14dad9d640 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559bff3d08e0 0x559bff7d9630 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a1cf446055e996ea server_cookie=8d3d728745635ea in_seq=0 out_seq=0 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.667+0000 7f14c27fc640 10 client.15621 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.667+0000 7f14c27fc640 1 -- 172.21.15.37:0/984710489 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559bff72bde0 con 0x559bff3d08e0 2024-08-31T06:46:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.667+0000 7f14c27fc640 10 client.15621 handle_command_reply: tid=0 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.667+0000 7f14e7579740 1 client.15621 shutdown 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 -- 172.21.15.37:0/984710489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 msgr2=0x559bff7c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7c78e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f14c402a450 tx=0x7f14c40318e0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 -- 172.21.15.37:0/984710489 shutdown_connections 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559bff3d08e0 0x559bff7d9630 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3f1280 0x559bff7c78e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff411f60 0x559bff7c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14c27fc640 0 client.15621 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 --2- 172.21.15.37:0/984710489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff3e90a0 0x559bff7c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 -- 172.21.15.37:0/984710489 >> 172.21.15.37:0/984710489 conn(0x559bff406350 msgr2=0x559bff7baab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 -- 172.21.15.37:0/984710489 shutdown_connections 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 1 -- 172.21.15.37:0/984710489 wait complete. 2024-08-31T06:46:59.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.668+0000 7f14e7579740 20 client.15621 trim_cache size 0 max 16384 2024-08-31T06:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14e7579740 1 Processor -- start 2024-08-31T06:46:59.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14e7579740 1 -- start start 2024-08-31T06:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14e7579740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14e7579740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 0x559bff7b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14e7579740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14e7579740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559bff7d7970 con 0x559bff3e90a0 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14e7579740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559bff7d8040 con 0x559bff3f1280 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14e7579740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559bff7d8710 con 0x559bff411f60 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56102/0 (socket says 172.21.15.37:56102) 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14dad9d640 1 -- 172.21.15.37:0/3337336492 learned_addr learned my addr 172.21.15.37:0/3337336492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.688+0000 7f14da59c640 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 0x559bff7b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14db59e640 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14dad9d640 1 -- 172.21.15.37:0/3337336492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 msgr2=0x559bff7b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14dad9d640 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14dad9d640 1 -- 172.21.15.37:0/3337336492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 msgr2=0x559bff7b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:59.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14dad9d640 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 0x559bff7b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14dad9d640 1 -- 172.21.15.37:0/3337336492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bff7d8bc0 con 0x559bff3e90a0 2024-08-31T06:46:59.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14db59e640 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:59.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14dad9d640 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7d2de0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x559bff7ba9d0 tx=0x7f14cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f0975c8901770a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:59.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14d0ff9640 1 -- 172.21.15.37:0/3337336492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc031070 con 0x559bff3e90a0 2024-08-31T06:46:59.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14d0ff9640 1 -- 172.21.15.37:0/3337336492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14cc026c70 con 0x559bff3e90a0 2024-08-31T06:46:59.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.689+0000 7f14d0ff9640 1 -- 172.21.15.37:0/3337336492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc01e040 con 0x559bff3e90a0 2024-08-31T06:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 -- 172.21.15.37:0/3337336492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 msgr2=0x559bff7d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7d2de0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x559bff7ba9d0 tx=0x7f14cc014000 comp rx=0 tx=0).stop 2024-08-31T06:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 -- 172.21.15.37:0/3337336492 shutdown_connections 2024-08-31T06:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 0x559bff7b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 --2- 172.21.15.37:0/3337336492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7d2de0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 -- 172.21.15.37:0/3337336492 >> 172.21.15.37:0/3337336492 conn(0x559bff406350 msgr2=0x559bff7d26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:59.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 -- 172.21.15.37:0/3337336492 shutdown_connections 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 -- 172.21.15.37:0/3337336492 wait complete. 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.690+0000 7f14e7579740 1 -- start start 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14e7579740 1 Processor -- start 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14e7579740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14e7579740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 0x559bff7db2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14e7579740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7db820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14e7579740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559bff7d94b0 con 0x559bff3e90a0 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14e7579740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559bff7d8de0 con 0x559bff3f1280 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14e7579740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559bff7d9b80 con 0x559bff411f60 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14e7579740 10 client.0 _ll_register_callbacks cb 0x7f14c4031620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7e1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56114/0 (socket says 172.21.15.37:56114) 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14dad9d640 1 -- 172.21.15.37:0/475059409 learned_addr learned my addr 172.21.15.37:0/475059409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:46:59.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14db59e640 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7db820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14da59c640 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 0x559bff7db2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14dad9d640 1 -- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 msgr2=0x559bff7db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14dad9d640 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7db820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14dad9d640 1 -- 172.21.15.37:0/475059409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 msgr2=0x559bff7db2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14dad9d640 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 0x559bff7db2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14dad9d640 1 -- 172.21.15.37:0/475059409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bff7dbd60 con 0x559bff3e90a0 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.691+0000 7f14db59e640 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7db820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14dad9d640 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7e1e30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f14cc01a010 tx=0x7f14cc009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a551182848f30a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14c27fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14c27fc640 1 -- 172.21.15.37:0/475059409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc031070 con 0x559bff3e90a0 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14c27fc640 1 -- 172.21.15.37:0/475059409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f14cc02caf0 con 0x559bff3e90a0 2024-08-31T06:46:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14e7579740 1 -- 172.21.15.37:0/475059409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14cc026c70 con 0x559bff3e90a0 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14c27fc640 1 -- 172.21.15.37:0/475059409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f14cc02ccf0 con 0x559bff3e90a0 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14e7579740 10 client.15627 fetch_fsmap learned FSMap version 25 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14e7579740 1 -- 172.21.15.37:0/475059409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559bff7e1720 con 0x559bff3e90a0 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14c27fc640 1 -- 172.21.15.37:0/475059409 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14cc026c70 con 0x559bff3e90a0 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.692+0000 7f14c27fc640 1 -- 172.21.15.37:0/475059409 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f14cc037850 con 0x559bff3e90a0 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14e7579740 10 client.15627 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14e7579740 10 client.15627 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14e7579740 20 client.15627 populate_metadata read hostname 'smithi037' 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14e7579740 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559bff3a5c90 0x559bff847e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14e7579740 4 client.15627 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14e7579740 1 -- 172.21.15.37:0/475059409 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "status"}) -- 0x559bff729520 con 0x559bff3a5c90 2024-08-31T06:46:59.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14da59c640 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559bff3a5c90 0x559bff847e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14c27fc640 10 client.15627 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14da59c640 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559bff3a5c90 0x559bff847e70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3f721c4fbbb5e54 server_cookie=41ee89dd9f817cc1 in_seq=0 out_seq=0 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14c27fc640 1 -- 172.21.15.37:0/475059409 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559bff729520 con 0x559bff3a5c90 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14c27fc640 10 client.15627 handle_command_reply: tid=0 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.693+0000 7f14e7579740 1 client.15627 shutdown 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 -- 172.21.15.37:0/475059409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 msgr2=0x559bff7e1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7e1e30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f14cc01a010 tx=0x7f14cc009740 comp rx=0 tx=0).stop 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 -- 172.21.15.37:0/475059409 shutdown_connections 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559bff3a5c90 0x559bff847e70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559bff411f60 0x559bff7db820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559bff3f1280 0x559bff7db2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 --2- 172.21.15.37:0/475059409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559bff3e90a0 0x559bff7e1e30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 -- 172.21.15.37:0/475059409 >> 172.21.15.37:0/475059409 conn(0x559bff406350 msgr2=0x559bff7c8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14c27fc640 0 client.15627 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:46:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 -- 172.21.15.37:0/475059409 shutdown_connections 2024-08-31T06:46:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 1 -- 172.21.15.37:0/475059409 wait complete. 2024-08-31T06:46:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e7579740 20 client.15627 trim_cache size 0 max 16384 2024-08-31T06:46:59.701 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24658, 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 129.052391546, 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 25, 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 76, 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 155.99385675100001 2024-08-31T06:46:59.702 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:46:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e0803640 1 -- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f14c80b4ca0 msgr2=0x7f14c80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e0803640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f14c80b4ca0 0x7f14c80b71b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00a510 tx=0x7f14cc00d040 comp rx=0 tx=0).stop 2024-08-31T06:46:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e0803640 1 -- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1099e0 msgr2=0x7f14dc19f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:46:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.694+0000 7f14e0803640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1099e0 0x7f14dc19f8c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f14d400c970 tx=0x7f14d400ce30 comp rx=0 tx=0).stop 2024-08-31T06:46:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.695+0000 7f14e0803640 1 -- 172.21.15.37:0/3620061297 shutdown_connections 2024-08-31T06:46:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.695+0000 7f14e0803640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f14c80b4ca0 0x7f14c80b71b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.695+0000 7f14e0803640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1099e0 0x7f14dc19f8c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.695+0000 7f14e0803640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14dc109090 0x7f14dc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.695+0000 7f14e0803640 1 --2- 172.21.15.37:0/3620061297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14dc103750 0x7f14dc19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:46:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.695+0000 7f14e0803640 1 -- 172.21.15.37:0/3620061297 >> 172.21.15.37:0/3620061297 conn(0x7f14dc0ff1c0 msgr2=0x7f14dc1015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:46:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.695+0000 7f14e0803640 1 -- 172.21.15.37:0/3620061297 shutdown_connections 2024-08-31T06:46:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:46:59.695+0000 7f14e0803640 1 -- 172.21.15.37:0/3620061297 wait complete. 2024-08-31T06:46:59.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:46:59 smithi106 ceph-mon[22134]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-08-31T06:47:00.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.b status 2024-08-31T06:47:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:00.605 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:47:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:47:00.535+0000 7ff8cf2d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:47:00.605 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:47:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:47:00.535+0000 7ff8cf2d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:47:00.605 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:47:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:47:00.535+0000 7ff8cf2d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:47:00.605 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:47:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:47:00.535+0000 7ff8cf2d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:47:00.605 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:47:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x[18839]: 2024-08-31T06:47:00.535+0000 7ff8cf2d8640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-31T06:47:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 -- 172.21.15.37:0/698769430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac10dc50 msgr2=0x7f3cac1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 --2- 172.21.15.37:0/698769430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac10dc50 0x7f3cac1100d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009ca0 tx=0x7f3ca402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 -- 172.21.15.37:0/698769430 shutdown_connections 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 --2- 172.21.15.37:0/698769430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac10dc50 0x7f3cac1100d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 --2- 172.21.15.37:0/698769430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cac104ff0 0x7f3cac10d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 --2- 172.21.15.37:0/698769430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cac1046a0 0x7f3cac104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 -- 172.21.15.37:0/698769430 >> 172.21.15.37:0/698769430 conn(0x7f3cac079500 msgr2=0x7f3cac079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 -- 172.21.15.37:0/698769430 shutdown_connections 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 -- 172.21.15.37:0/698769430 wait complete. 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.132+0000 7f3cb2793640 1 Processor -- start 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb2793640 1 -- start start 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb2793640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac1046a0 0x7f3cac19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb2793640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cac104ff0 0x7f3cac19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb2793640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cac10dc50 0x7f3cac19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb2793640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac113740 con 0x7f3cac1046a0 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb2793640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac1135c0 con 0x7f3cac10dc50 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb2793640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac1138c0 con 0x7f3cac104ff0 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac1046a0 0x7f3cac19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac1046a0 0x7f3cac19a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56146/0 (socket says 172.21.15.37:56146) 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cabfff640 1 -- 172.21.15.37:0/1683582252 learned_addr learned my addr 172.21.15.37:0/1683582252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cac104ff0 0x7f3cac19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cac10dc50 0x7f3cac19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cabfff640 1 -- 172.21.15.37:0/1683582252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cac104ff0 msgr2=0x7f3cac19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cabfff640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cac104ff0 0x7f3cac19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cabfff640 1 -- 172.21.15.37:0/1683582252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cac10dc50 msgr2=0x7f3cac19f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cabfff640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cac10dc50 0x7f3cac19f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cabfff640 1 -- 172.21.15.37:0/1683582252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac1a00c0 con 0x7f3cac1046a0 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cac104ff0 0x7f3cac19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.133+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cac10dc50 0x7f3cac19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.134+0000 7f3cabfff640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac1046a0 0x7f3cac19a150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00e9c0 tx=0x7f3c9c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.134+0000 7f3ca97fa640 1 -- 172.21.15.37:0/1683582252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00cd80 con 0x7f3cac1046a0 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.134+0000 7f3ca97fa640 1 -- 172.21.15.37:0/1683582252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c9c0044b0 con 0x7f3cac1046a0 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.134+0000 7f3cb2793640 1 -- 172.21.15.37:0/1683582252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac1a03b0 con 0x7f3cac1046a0 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.134+0000 7f3ca97fa640 1 -- 172.21.15.37:0/1683582252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c010430 con 0x7f3cac1046a0 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.134+0000 7f3cb2793640 1 -- 172.21.15.37:0/1683582252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac1a6b10 con 0x7f3cac1046a0 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.136+0000 7f3cb8d08740 1 Processor -- start 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.136+0000 7f3cb8d08740 1 -- start start 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.136+0000 7f3ca97fa640 1 -- 172.21.15.37:0/1683582252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) ==== 152702+0+0 (secure 0 0 0) 0x7f3c9c003f00 con 0x7f3cac1046a0 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 0x555eebdab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9dd0a0 0x555eebdabcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9e5280 0x555eebdac230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555eebd223f0 con 0x555eeb9e5280 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555eebd11980 con 0x555eeb9dd0a0 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x555eebd15930 con 0x555eeba05f60 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9e5280 0x555eebdac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9e5280 0x555eebdac230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56156/0 (socket says 172.21.15.37:56156) 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 -- 172.21.15.37:0/3946787413 learned_addr learned my addr 172.21.15.37:0/3946787413 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 0x555eebdab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cabfff640 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9dd0a0 0x555eebdabcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 -- 172.21.15.37:0/3946787413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 msgr2=0x555eebdab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 0x555eebdab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 -- 172.21.15.37:0/3946787413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9dd0a0 msgr2=0x555eebdabcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9dd0a0 0x555eebdabcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 -- 172.21.15.37:0/3946787413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eeba71540 con 0x555eeb9e5280 2024-08-31T06:47:01.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cabfff640 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9dd0a0 0x555eebdabcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.137+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9e5280 0x555eebdac230 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009cb0 tx=0x7f3ca00117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6746e1af20300dc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.138+0000 7f3ca97fa640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c940b4ca0 0x7f3c940b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.138+0000 7f3c927fc640 1 -- 172.21.15.37:0/3946787413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0012450 con 0x555eeb9e5280 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.138+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c940b4ca0 0x7f3c940b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.138+0000 7f3c927fc640 1 -- 172.21.15.37:0/3946787413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ca0012a80 con 0x555eeb9e5280 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.138+0000 7f3c927fc640 1 -- 172.21.15.37:0/3946787413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000fb50 con 0x555eeb9e5280 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.138+0000 7f3ca97fa640 1 -- 172.21.15.37:0/1683582252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3c9c0e5a10 con 0x7f3cac1046a0 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 -- 172.21.15.37:0/3946787413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9e5280 msgr2=0x555eebdac230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c940b4ca0 0x7f3c940b71b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4004af0 tx=0x7f3ca4005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9e5280 0x555eebdac230 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009cb0 tx=0x7f3ca00117b0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 -- 172.21.15.37:0/3946787413 shutdown_connections 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9e5280 0x555eebdac230 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9dd0a0 0x555eebdabcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/3946787413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 0x555eebdab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 -- 172.21.15.37:0/3946787413 >> 172.21.15.37:0/3946787413 conn(0x555eeb9fa350 msgr2=0x555eebda96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 -- 172.21.15.37:0/3946787413 shutdown_connections 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 -- 172.21.15.37:0/3946787413 wait complete. 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 -- start start 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.139+0000 7f3cb8d08740 1 Processor -- start 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 0x555eebdb6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdb72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdb77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555eebb745f0 con 0x555eeba05f60 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555eebc98600 con 0x555eeb9e5280 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x555eebdbe3a0 con 0x555eeb9dd0a0 2024-08-31T06:47:01.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb8d08740 10 client.0 _ll_register_callbacks cb 0x555eebcbeaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb0d30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdb77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb0d30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdb77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56172/0 (socket says 172.21.15.37:56172) 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb0d30640 1 -- 172.21.15.37:0/1600909373 learned_addr learned my addr 172.21.15.37:0/1600909373 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cabfff640 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 0x555eebdb6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdb72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb0d30640 1 -- 172.21.15.37:0/1600909373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 msgr2=0x555eebdb6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 0x555eebdb6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb0d30640 1 -- 172.21.15.37:0/1600909373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 msgr2=0x555eebdb72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdb72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.140+0000 7f3cb0d30640 1 -- 172.21.15.37:0/1600909373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eebcd17b0 con 0x555eeba05f60 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdb77e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4035000 tx=0x7f3ca402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79482578fa443e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3c8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/1600909373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4031680 con 0x555eeba05f60 2024-08-31T06:47:01.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/1600909373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3ca40045c0 con 0x555eeba05f60 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 1 -- 172.21.15.37:0/1600909373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ca0012a80 con 0x555eeba05f60 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/1600909373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3ca40047c0 con 0x555eeba05f60 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 10 client.15645 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 1 -- 172.21.15.37:0/1600909373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555eebdc9fd0 con 0x555eeba05f60 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/1600909373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ca0012a80 con 0x555eeba05f60 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/1600909373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3ca4050070 con 0x555eeba05f60 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 10 client.15645 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 10 client.15645 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 20 client.15645 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555eeb9c48e0 0x555eebdcdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 4 client.15645 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.141+0000 7f3cb8d08740 1 -- 172.21.15.37:0/1600909373 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eebd24340 con 0x555eeb9c48e0 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.142+0000 7f3cabfff640 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555eeb9c48e0 0x555eebdcdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.142+0000 7f3c8b7fe640 10 client.15645 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:01.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.142+0000 7f3cabfff640 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555eeb9c48e0 0x555eebdcdb10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5f657b6282f0a0 server_cookie=cc92871d9d82895b in_seq=0 out_seq=0 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/1600909373 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555eebd24340 con 0x555eeb9c48e0 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3c8b7fe640 10 client.15645 handle_command_reply: tid=0 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 client.15645 shutdown 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 -- 172.21.15.37:0/1600909373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 msgr2=0x555eebdb77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdb77e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4035000 tx=0x7f3ca402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 -- 172.21.15.37:0/1600909373 shutdown_connections 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555eeb9c48e0 0x555eebdcdb10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdb77e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdb72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/1600909373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 0x555eebdb6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3cb8d08740 1 -- 172.21.15.37:0/1600909373 >> 172.21.15.37:0/1600909373 conn(0x555eeb9fa350 msgr2=0x555eebdae940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:01.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.143+0000 7f3c8b7fe640 0 client.15645 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:01.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.144+0000 7f3cb8d08740 1 -- 172.21.15.37:0/1600909373 shutdown_connections 2024-08-31T06:47:01.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.144+0000 7f3cb8d08740 1 -- 172.21.15.37:0/1600909373 wait complete. 2024-08-31T06:47:01.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.144+0000 7f3cb8d08740 20 client.15645 trim_cache size 0 max 16384 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb8d08740 1 Processor -- start 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb8d08740 1 -- start start 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9dd0a0 0x555eebdcc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebda9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 0x555eebdb3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555eebdcbe50 con 0x555eeb9dd0a0 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555eebdcc520 con 0x555eeb9e5280 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x555eebdccbf0 con 0x555eeba05f60 2024-08-31T06:47:01.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9dd0a0 0x555eebdcc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9dd0a0 0x555eebdcc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56188/0 (socket says 172.21.15.37:56188) 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cabfff640 1 -- 172.21.15.37:0/2270065667 learned_addr learned my addr 172.21.15.37:0/2270065667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebda9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cabfff640 1 -- 172.21.15.37:0/2270065667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 msgr2=0x555eebdb3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 0x555eebdb3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cabfff640 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 0x555eebdb3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cabfff640 1 -- 172.21.15.37:0/2270065667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 msgr2=0x555eebda9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cabfff640 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebda9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cabfff640 1 -- 172.21.15.37:0/2270065667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eebdb25b0 con 0x555eeb9dd0a0 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.162+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebda9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.163+0000 7f3cabfff640 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9dd0a0 0x555eebdcc6a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00cfd0 tx=0x7f3c9c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec722b86c562cb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:01.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.163+0000 7f3c91ffb640 1 -- 172.21.15.37:0/2270065667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0ac840 con 0x555eeb9dd0a0 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.163+0000 7f3c91ffb640 1 -- 172.21.15.37:0/2270065667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c9c0ac140 con 0x555eeb9dd0a0 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.163+0000 7f3c91ffb640 1 -- 172.21.15.37:0/2270065667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0a83d0 con 0x555eeb9dd0a0 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.163+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2270065667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9dd0a0 msgr2=0x555eebdcc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.163+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9dd0a0 0x555eebdcc6a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00cfd0 tx=0x7f3c9c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2270065667 shutdown_connections 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeba05f60 0x555eebdb3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebda9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2270065667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeb9dd0a0 0x555eebdcc6a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2270065667 >> 172.21.15.37:0/2270065667 conn(0x555eeb9fa350 msgr2=0x555eebdb55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2270065667 shutdown_connections 2024-08-31T06:47:01.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2270065667 wait complete. 2024-08-31T06:47:01.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 -- start start 2024-08-31T06:47:01.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.164+0000 7f3cb8d08740 1 Processor -- start 2024-08-31T06:47:01.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 0x555eebdd65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdcfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb8d08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdd0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555eebdcd990 con 0x555eeba05f60 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555eebdcd2c0 con 0x555eeb9e5280 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb8d08740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x555eebdce060 con 0x555eeb9dd0a0 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb8d08740 10 client.0 _ll_register_callbacks cb 0x7f3ca4003d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdd0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdd0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56194/0 (socket says 172.21.15.37:56194) 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 -- 172.21.15.37:0/2970696114 learned_addr learned my addr 172.21.15.37:0/2970696114 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cabfff640 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 0x555eebdd65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdcfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 -- 172.21.15.37:0/2970696114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 msgr2=0x555eebdd65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 0x555eebdd65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 -- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 msgr2=0x555eebdcfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdcfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 -- 172.21.15.37:0/2970696114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eebdd0820 con 0x555eeba05f60 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cab7fe640 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdcfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3cb0d30640 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdd0090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4006010 tx=0x7f3ca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536cc94bc8757024 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3c8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.165+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/2970696114 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca405f030 con 0x555eeba05f60 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/2970696114 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3ca4041040 con 0x555eeba05f60 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2970696114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c9c0ac140 con 0x555eeba05f60 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/2970696114 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3ca4069050 con 0x555eeba05f60 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 10 client.15651 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2970696114 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555eebe38fe0 con 0x555eeba05f60 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/2970696114 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c9c0ac140 con 0x555eeba05f60 2024-08-31T06:47:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/2970696114 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3ca4050040 con 0x555eeba05f60 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 10 client.15651 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 10 client.15651 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 20 client.15651 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555eeb999c90 0x555eebe3c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 4 client.15651 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2970696114 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "status"}) -- 0x555eebda9770 con 0x555eeb999c90 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.166+0000 7f3cabfff640 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555eeb999c90 0x555eebe3c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cabfff640 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555eeb999c90 0x555eebe3c7d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbc9de571524e034 server_cookie=3f3cad54d43d5dbc in_seq=0 out_seq=0 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3c8b7fe640 10 client.15651 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3c8b7fe640 1 -- 172.21.15.37:0/2970696114 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555eebda9770 con 0x555eeb999c90 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3c8b7fe640 10 client.15651 handle_command_reply: tid=0 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 client.15651 shutdown 2024-08-31T06:47:01.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2970696114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 msgr2=0x555eebdd0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdd0090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4006010 tx=0x7f3ca40046c0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2970696114 shutdown_connections 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555eeb999c90 0x555eebe3c7d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555eeba05f60 0x555eebdd0090 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555eeb9e5280 0x555eebdcfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 --2- 172.21.15.37:0/2970696114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555eeb9dd0a0 0x555eebdd65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2970696114 >> 172.21.15.37:0/2970696114 conn(0x555eeb9fa350 msgr2=0x555eebdb6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.167+0000 7f3c8b7fe640 0 client.15651 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2970696114 shutdown_connections 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb8d08740 1 -- 172.21.15.37:0/2970696114 wait complete. 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb8d08740 20 client.15651 trim_cache size 0 max 16384 2024-08-31T06:47:01.175 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "22785f22-6763-11ef-bcd4-c7b262605968", 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24695, 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 137.52058498700001, 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 25, 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 76, 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 76, 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 148.59601645399999 2024-08-31T06:47:01.176 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:47:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 -- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c940b4ca0 msgr2=0x7f3c940b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c940b4ca0 0x7f3c940b71b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4004af0 tx=0x7f3ca4005d80 comp rx=0 tx=0).stop 2024-08-31T06:47:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 -- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac1046a0 msgr2=0x7f3cac19a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac1046a0 0x7f3cac19a150 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00e9c0 tx=0x7f3c9c00ee80 comp rx=0 tx=0).stop 2024-08-31T06:47:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 -- 172.21.15.37:0/1683582252 shutdown_connections 2024-08-31T06:47:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c940b4ca0 0x7f3c940b71b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cac10dc50 0x7f3cac19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3cac104ff0 0x7f3cac19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 --2- 172.21.15.37:0/1683582252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cac1046a0 0x7f3cac19a150 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:01.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 -- 172.21.15.37:0/1683582252 >> 172.21.15.37:0/1683582252 conn(0x7f3cac079500 msgr2=0x7f3cac1006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:01.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 -- 172.21.15.37:0/1683582252 shutdown_connections 2024-08-31T06:47:01.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:01.168+0000 7f3cb2793640 1 -- 172.21.15.37:0/1683582252 wait complete. 2024-08-31T06:47:01.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:01 smithi037 ceph-mon[18612]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T06:47:01.616 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:01 smithi106 ceph-mon[22134]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T06:47:01.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:01 smithi066 ceph-mon[22244]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T06:47:01.882 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-31T06:47:03.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:03 smithi106 ceph-mon[22134]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-31T06:47:03.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:03 smithi106 ceph-mon[22134]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-08-31T06:47:03.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:03 smithi037 ceph-mon[18612]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-31T06:47:03.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:03 smithi037 ceph-mon[18612]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-08-31T06:47:03.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:03 smithi066 ceph-mon[22244]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-08-31T06:47:03.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:03 smithi066 ceph-mon[22244]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-08-31T06:47:05.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:05 smithi106 ceph-mon[22134]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-08-31T06:47:05.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:05 smithi037 ceph-mon[18612]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-08-31T06:47:05.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:05 smithi066 ceph-mon[22244]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-08-31T06:47:07.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:07 smithi106 ceph-mon[22134]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-31T06:47:07.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:07 smithi037 ceph-mon[18612]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-31T06:47:07.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:07 smithi066 ceph-mon[22244]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-31T06:47:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 -- 172.21.15.37:0/2577851264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1581046d0 msgr2=0x7fb158104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2577851264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1581046d0 0x7fb158104ae0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb154009900 tx=0x7fb15402a410 comp rx=0 tx=0).stop 2024-08-31T06:47:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 -- 172.21.15.37:0/2577851264 shutdown_connections 2024-08-31T06:47:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2577851264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb15810db30 0x7fb158110020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2577851264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb158105020 0x7fb15810d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2577851264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1581046d0 0x7fb158104ae0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 -- 172.21.15.37:0/2577851264 >> 172.21.15.37:0/2577851264 conn(0x7fb1580fe160 msgr2=0x7fb1581005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 -- 172.21.15.37:0/2577851264 shutdown_connections 2024-08-31T06:47:08.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.671+0000 7fb1604c5640 1 -- 172.21.15.37:0/2577851264 wait complete. 2024-08-31T06:47:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb1604c5640 1 Processor -- start 2024-08-31T06:47:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb1604c5640 1 -- start start 2024-08-31T06:47:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb1604c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1581046d0 0x7fb15819a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb1604c5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158105020 0x7fb15819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb1604c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15810db30 0x7fb15819f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb1604c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb158113670 con 0x7fb15810db30 2024-08-31T06:47:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb1604c5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581134f0 con 0x7fb1581046d0 2024-08-31T06:47:08.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb1604c5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581137f0 con 0x7fb158105020 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb15ea62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15810db30 0x7fb15819f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb15ea62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15810db30 0x7fb15819f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39574/0 (socket says 172.21.15.37:39574) 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb15ea62640 1 -- 172.21.15.37:0/2946265385 learned_addr learned my addr 172.21.15.37:0/2946265385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb15e261640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1581046d0 0x7fb15819a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.672+0000 7fb15da60640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158105020 0x7fb15819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb15ea62640 1 -- 172.21.15.37:0/2946265385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158105020 msgr2=0x7fb15819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb15ea62640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158105020 0x7fb15819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb15ea62640 1 -- 172.21.15.37:0/2946265385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1581046d0 msgr2=0x7fb15819a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb15ea62640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1581046d0 0x7fb15819a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb15ea62640 1 -- 172.21.15.37:0/2946265385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1581a0020 con 0x7fb15810db30 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb15ea62640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15810db30 0x7fb15819f920 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb15000eaa0 tx=0x7fb15000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb14f7fe640 1 -- 172.21.15.37:0/2946265385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15000cdb0 con 0x7fb15810db30 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb1604c5640 1 -- 172.21.15.37:0/2946265385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1581a0310 con 0x7fb15810db30 2024-08-31T06:47:08.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb14f7fe640 1 -- 172.21.15.37:0/2946265385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb150005020 con 0x7fb15810db30 2024-08-31T06:47:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb14f7fe640 1 -- 172.21.15.37:0/2946265385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1500116d0 con 0x7fb15810db30 2024-08-31T06:47:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.673+0000 7fb1604c5640 1 -- 172.21.15.37:0/2946265385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1581a6aa0 con 0x7fb15810db30 2024-08-31T06:47:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.676+0000 7fb167433740 1 Processor -- start 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.676+0000 7fb14f7fe640 1 -- 172.21.15.37:0/2946265385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7fb150004a40 con 0x7fb15810db30 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.676+0000 7fb167433740 1 -- start start 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb167433740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558641ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb167433740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 0x55b558642000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb167433740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b558642540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb167433740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b5585b7000 con 0x55b55829e1b0 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb167433740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b5585a6590 con 0x55b55827d4d0 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb167433740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b5585aa540 con 0x55b5582752f0 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558641ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558641ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39576/0 (socket says 172.21.15.37:39576) 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 -- 172.21.15.37:0/3536519191 learned_addr learned my addr 172.21.15.37:0/3536519191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15e261640 1 --2- 172.21.15.37:0/3536519191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 0x55b558642000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb14f7fe640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1440b4d30 0x7fb1440b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 -- 172.21.15.37:0/3536519191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 msgr2=0x55b558642000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 --2- 172.21.15.37:0/3536519191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 0x55b558642000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 -- 172.21.15.37:0/3536519191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 msgr2=0x55b558642540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 --2- 172.21.15.37:0/3536519191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b558642540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 -- 172.21.15.37:0/3536519191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b558309790 con 0x55b55829e1b0 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15ea62640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1440b4d30 0x7fb1440b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb14f7fe640 1 -- 172.21.15.37:0/2946265385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb1500e5850 con 0x7fb15810db30 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.677+0000 7fb15da60640 1 --2- 172.21.15.37:0/3536519191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558641ac0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb14800bcd0 tx=0x7fb148011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f324f63432d4c1a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.678+0000 7fb14cbfe640 1 -- 172.21.15.37:0/3536519191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14801a400 con 0x55b55829e1b0 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.678+0000 7fb14cbfe640 1 -- 172.21.15.37:0/3536519191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb14801aa30 con 0x55b55829e1b0 2024-08-31T06:47:08.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.678+0000 7fb14cbfe640 1 -- 172.21.15.37:0/3536519191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148012920 con 0x55b55829e1b0 2024-08-31T06:47:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 -- 172.21.15.37:0/3536519191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 msgr2=0x55b558641ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb15ea62640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1440b4d30 0x7fb1440b7240 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1500e2f80 tx=0x7fb150093040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 --2- 172.21.15.37:0/3536519191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558641ac0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb14800bcd0 tx=0x7fb148011750 comp rx=0 tx=0).stop 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 -- 172.21.15.37:0/3536519191 shutdown_connections 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 --2- 172.21.15.37:0/3536519191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b558642540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 --2- 172.21.15.37:0/3536519191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 0x55b558642000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 --2- 172.21.15.37:0/3536519191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558641ac0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 -- 172.21.15.37:0/3536519191 >> 172.21.15.37:0/3536519191 conn(0x55b558292300 msgr2=0x55b55863f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 -- 172.21.15.37:0/3536519191 shutdown_connections 2024-08-31T06:47:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 -- 172.21.15.37:0/3536519191 wait complete. 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 -- start start 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.679+0000 7fb167433740 1 Processor -- start 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb167433740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 0x55b55864d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb167433740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b55864dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb167433740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558659530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb167433740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b5584dfab0 con 0x55b55829e1b0 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb167433740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b55852d680 con 0x55b55827d4d0 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb167433740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b558650240 con 0x55b5582752f0 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb167433740 10 client.0 _ll_register_callbacks cb 0x55b5582b5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558659530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558659530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39586/0 (socket says 172.21.15.37:39586) 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 -- 172.21.15.37:0/3692878766 learned_addr learned my addr 172.21.15.37:0/3692878766 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 0x55b55864d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15e261640 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b55864dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 -- 172.21.15.37:0/3692878766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 msgr2=0x55b55864d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 0x55b55864d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 -- 172.21.15.37:0/3692878766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 msgr2=0x55b55864dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b55864dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 -- 172.21.15.37:0/3692878766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b558382620 con 0x55b55829e1b0 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb15da60640 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558659530 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55b55864fd10 tx=0x7fb148012500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7f2994fb0b8d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb141ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.680+0000 7fb141ffb640 1 -- 172.21.15.37:0/3692878766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14802f060 con 0x55b55829e1b0 2024-08-31T06:47:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb141ffb640 1 -- 172.21.15.37:0/3692878766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb148022040 con 0x55b55829e1b0 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 1 -- 172.21.15.37:0/3692878766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb14801aa30 con 0x55b55829e1b0 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb141ffb640 1 -- 172.21.15.37:0/3692878766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb148012940 con 0x55b55829e1b0 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 10 client.15663 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 1 -- 172.21.15.37:0/3692878766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b55865c2b0 con 0x55b55829e1b0 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb141ffb640 1 -- 172.21.15.37:0/3692878766 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb14801aa30 con 0x55b55829e1b0 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb141ffb640 1 -- 172.21.15.37:0/3692878766 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb14800f4e0 con 0x55b55829e1b0 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 10 client.15663 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 10 client.15663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 20 client.15663 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b55825cd80 0x55b55865f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 4 client.15663 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:08.688 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.681+0000 7fb167433740 1 -- 172.21.15.37:0/3692878766 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5585b8f50 con 0x55b55825cd80 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.682+0000 7fb15e261640 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b55825cd80 0x55b55865f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.682+0000 7fb141ffb640 10 client.15663 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.682+0000 7fb15e261640 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b55825cd80 0x55b55865f6d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc6d466a22a24ce1 server_cookie=7726f607e12af8c7 in_seq=0 out_seq=0 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb141ffb640 1 -- 172.21.15.37:0/3692878766 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5585b8f50 con 0x55b55825cd80 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb141ffb640 10 client.15663 handle_command_reply: tid=0 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 client.15663 shutdown 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 -- 172.21.15.37:0/3692878766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 msgr2=0x55b558659530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558659530 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x55b55864fd10 tx=0x7fb148012500 comp rx=0 tx=0).stop 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 -- 172.21.15.37:0/3692878766 shutdown_connections 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b55825cd80 0x55b55865f6d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55829e1b0 0x55b558659530 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b55864dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 --2- 172.21.15.37:0/3692878766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b5582752f0 0x55b55864d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb141ffb640 0 client.15663 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 -- 172.21.15.37:0/3692878766 >> 172.21.15.37:0/3692878766 conn(0x55b558292300 msgr2=0x55b558642af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 -- 172.21.15.37:0/3692878766 shutdown_connections 2024-08-31T06:47:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.683+0000 7fb167433740 1 -- 172.21.15.37:0/3692878766 wait complete. 2024-08-31T06:47:08.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.684+0000 7fb167433740 20 client.15663 trim_cache size 0 max 16384 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb167433740 1 Processor -- start 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb167433740 1 -- start start 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb167433740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5582752f0 0x55b5586485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb167433740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55827d4d0 0x55b558648b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb167433740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 0x55b55864bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb167433740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581b1b80 con 0x55b55827d4d0 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb167433740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581af450 con 0x55b5582752f0 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb167433740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581ad2a0 con 0x55b55829e1b0 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb15e261640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55827d4d0 0x55b558648b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb15e261640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55827d4d0 0x55b558648b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39594/0 (socket says 172.21.15.37:39594) 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb15e261640 1 -- 172.21.15.37:0/3743843212 learned_addr learned my addr 172.21.15.37:0/3743843212 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.699+0000 7fb15da60640 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5582752f0 0x55b5586485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb15da60640 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 0x55b55864bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb15e261640 1 -- 172.21.15.37:0/3743843212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 msgr2=0x55b55864bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb15e261640 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 0x55b55864bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb15e261640 1 -- 172.21.15.37:0/3743843212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5582752f0 msgr2=0x55b5586485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb15e261640 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5582752f0 0x55b5586485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb15e261640 1 -- 172.21.15.37:0/3743843212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b558640350 con 0x55b55827d4d0 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb15e261640 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55827d4d0 0x55b558648b00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb154005f70 tx=0x7fb1540058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3edf86ae8eba7bf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb143fff640 1 -- 172.21.15.37:0/3743843212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154049020 con 0x55b55827d4d0 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb143fff640 1 -- 172.21.15.37:0/3743843212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb154031970 con 0x55b55827d4d0 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.700+0000 7fb143fff640 1 -- 172.21.15.37:0/3743843212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb154035040 con 0x55b55827d4d0 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 -- 172.21.15.37:0/3743843212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55827d4d0 msgr2=0x55b558648b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55827d4d0 0x55b558648b00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb154005f70 tx=0x7fb1540058d0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 -- 172.21.15.37:0/3743843212 shutdown_connections 2024-08-31T06:47:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b55827d4d0 0x55b558648b00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 0x55b55864bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 --2- 172.21.15.37:0/3743843212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b5582752f0 0x55b5586485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 -- 172.21.15.37:0/3743843212 >> 172.21.15.37:0/3743843212 conn(0x55b558292300 msgr2=0x55b558646bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 -- 172.21.15.37:0/3743843212 shutdown_connections 2024-08-31T06:47:08.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 -- 172.21.15.37:0/3743843212 wait complete. 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 -- start start 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.701+0000 7fb167433740 1 Processor -- start 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb167433740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5582752f0 0x55b558651560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb167433740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b558651aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb167433740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 0x55b558651fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb167433740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581ad910 con 0x55b5582752f0 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb167433740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581aed80 con 0x55b55827d4d0 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb167433740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb1581adfe0 con 0x55b55829e1b0 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb167433740 10 client.0 _ll_register_callbacks cb 0x7fb154005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5582752f0 0x55b558651560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5582752f0 0x55b558651560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39606/0 (socket says 172.21.15.37:39606) 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 -- 172.21.15.37:0/1639046442 learned_addr learned my addr 172.21.15.37:0/1639046442 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 0x55b558651fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15e261640 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b558651aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 -- 172.21.15.37:0/1639046442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 msgr2=0x55b558651fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 0x55b558651fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 -- 172.21.15.37:0/1639046442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 msgr2=0x55b558651aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b558651aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 -- 172.21.15.37:0/1639046442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5586c9000 con 0x55b5582752f0 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb15da60640 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5582752f0 0x55b558651560 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb148011c50 tx=0x7fb14800bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ec88bea25cbd78 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb141ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.702+0000 7fb141ffb640 1 -- 172.21.15.37:0/1639046442 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14802f030 con 0x55b5582752f0 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb141ffb640 1 -- 172.21.15.37:0/1639046442 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb14800fba0 con 0x55b5582752f0 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 1 -- 172.21.15.37:0/1639046442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b5585b49f0 con 0x55b5582752f0 2024-08-31T06:47:08.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb141ffb640 1 -- 172.21.15.37:0/1639046442 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb148046050 con 0x55b5582752f0 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 10 client.15669 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 1 -- 172.21.15.37:0/1639046442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b5586ca290 con 0x55b5582752f0 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb141ffb640 1 -- 172.21.15.37:0/1639046442 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b5585b49f0 con 0x55b5582752f0 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb141ffb640 1 -- 172.21.15.37:0/1639046442 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb148012c70 con 0x55b5582752f0 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 10 client.15669 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 10 client.15669 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 20 client.15669 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b5582321c0 0x55b5586cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 4 client.15669 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb167433740 1 -- 172.21.15.37:0/1639046442 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5585b2130 con 0x55b5582321c0 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.703+0000 7fb15e261640 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b5582321c0 0x55b5586cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.704+0000 7fb141ffb640 10 client.15669 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:08.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.704+0000 7fb15e261640 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b5582321c0 0x55b5586cca20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b362a19fd33a5d72 server_cookie=98df50047681d727 in_seq=0 out_seq=0 2024-08-31T06:47:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.712+0000 7fb141ffb640 1 -- 172.21.15.37:0/1639046442 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5585b2130 con 0x55b5582321c0 2024-08-31T06:47:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.712+0000 7fb141ffb640 10 client.15669 handle_command_reply: tid=0 2024-08-31T06:47:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.712+0000 7fb167433740 1 client.15669 shutdown 2024-08-31T06:47:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 -- 172.21.15.37:0/1639046442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5582752f0 msgr2=0x55b558651560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5582752f0 0x55b558651560 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fb148011c50 tx=0x7fb14800bdc0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 -- 172.21.15.37:0/1639046442 shutdown_connections 2024-08-31T06:47:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b5582321c0 0x55b5586cca20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b55829e1b0 0x55b558651fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b55827d4d0 0x55b558651aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb141ffb640 0 client.15669 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 --2- 172.21.15.37:0/1639046442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5582752f0 0x55b558651560 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 -- 172.21.15.37:0/1639046442 >> 172.21.15.37:0/1639046442 conn(0x55b558292300 msgr2=0x55b558646bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 -- 172.21.15.37:0/1639046442 shutdown_connections 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 1 -- 172.21.15.37:0/1639046442 wait complete. 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb167433740 20 client.15669 trim_cache size 0 max 16384 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:47:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:47:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:47:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:47:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb1604c5640 1 -- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1440b4d30 msgr2=0x7fb1440b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1440b4d30 0x7fb1440b7240 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1500e2f80 tx=0x7fb150093040 comp rx=0 tx=0).stop 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb1604c5640 1 -- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15810db30 msgr2=0x7fb15819f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15810db30 0x7fb15819f920 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb15000eaa0 tx=0x7fb15000ef60 comp rx=0 tx=0).stop 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb1604c5640 1 -- 172.21.15.37:0/2946265385 shutdown_connections 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb1440b4d30 0x7fb1440b7240 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15810db30 0x7fb15819f920 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.713+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb158105020 0x7fb15819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.714+0000 7fb1604c5640 1 --2- 172.21.15.37:0/2946265385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1581046d0 0x7fb15819a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.714+0000 7fb1604c5640 1 -- 172.21.15.37:0/2946265385 >> 172.21.15.37:0/2946265385 conn(0x7fb1580fe160 msgr2=0x7fb15810fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.714+0000 7fb1604c5640 1 -- 172.21.15.37:0/2946265385 shutdown_connections 2024-08-31T06:47:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:08.714+0000 7fb1604c5640 1 -- 172.21.15.37:0/2946265385 wait complete. 2024-08-31T06:47:09.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:09 smithi106 ceph-mon[22134]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-08-31T06:47:09.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:09 smithi037 ceph-mon[18612]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-08-31T06:47:09.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:09 smithi066 ceph-mon[22244]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-08-31T06:47:11.657 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:11 smithi037 ceph-mon[18612]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-08-31T06:47:11.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:11 smithi106 ceph-mon[22134]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-08-31T06:47:11.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:11 smithi066 ceph-mon[22244]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-08-31T06:47:13.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:47:13.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:13 smithi037 ceph-mon[18612]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-08-31T06:47:13.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:13 smithi106 ceph-mon[22134]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-08-31T06:47:13.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:13 smithi066 ceph-mon[22244]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 25 op/s 2024-08-31T06:47:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.470+0000 7f0bde061640 1 -- 172.21.15.37:0/1330336170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8102010 msgr2=0x7f0bd8102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.470+0000 7f0bde061640 1 --2- 172.21.15.37:0/1330336170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8102010 0x7f0bd8102420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009900 tx=0x7f0bc802a410 comp rx=0 tx=0).stop 2024-08-31T06:47:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.471+0000 7f0bde061640 1 -- 172.21.15.37:0/1330336170 shutdown_connections 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.471+0000 7f0bde061640 1 --2- 172.21.15.37:0/1330336170 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108250 0x7f0bd810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.471+0000 7f0bde061640 1 --2- 172.21.15.37:0/1330336170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8107900 0x7f0bd8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.471+0000 7f0bde061640 1 --2- 172.21.15.37:0/1330336170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8102010 0x7f0bd8102420 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.471+0000 7f0bde061640 1 -- 172.21.15.37:0/1330336170 >> 172.21.15.37:0/1330336170 conn(0x7f0bd8077a60 msgr2=0x7f0bd8077ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.471+0000 7f0bde061640 1 -- 172.21.15.37:0/1330336170 shutdown_connections 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.471+0000 7f0bde061640 1 -- 172.21.15.37:0/1330336170 wait complete. 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.471+0000 7f0bde061640 1 Processor -- start 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bde061640 1 -- start start 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bde061640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102010 0x7f0bd819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bde061640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8107900 0x7f0bd819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bde061640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108250 0x7f0bd819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bde061640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8111540 con 0x7f0bd8107900 2024-08-31T06:47:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bde061640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81113c0 con 0x7f0bd8102010 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bde061640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81116c0 con 0x7f0bd8108250 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8107900 0x7f0bd819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8107900 0x7f0bd819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60272/0 (socket says 172.21.15.37:60272) 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2987182517 learned_addr learned my addr 172.21.15.37:0/2987182517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108250 0x7f0bd819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102010 0x7f0bd819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2987182517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108250 msgr2=0x7f0bd819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108250 0x7f0bd819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2987182517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102010 msgr2=0x7f0bd819a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102010 0x7f0bd819a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.472+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2987182517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd81a0170 con 0x7f0bd8107900 2024-08-31T06:47:14.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.473+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8107900 0x7f0bd819a7a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00e9f0 tx=0x7f0bcc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.473+0000 7f0bd4ff9640 1 -- 172.21.15.37:0/2987182517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc00ccc0 con 0x7f0bd8107900 2024-08-31T06:47:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.473+0000 7f0bde061640 1 -- 172.21.15.37:0/2987182517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd81a0460 con 0x7f0bd8107900 2024-08-31T06:47:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.473+0000 7f0bd4ff9640 1 -- 172.21.15.37:0/2987182517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0bcc0108c0 con 0x7f0bd8107900 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.473+0000 7f0bd4ff9640 1 -- 172.21.15.37:0/2987182517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc018660 con 0x7f0bd8107900 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.473+0000 7f0bde061640 1 -- 172.21.15.37:0/2987182517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd81a6bc0 con 0x7f0bd8107900 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.476+0000 7f0be45d6740 1 Processor -- start 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.476+0000 7f0bd4ff9640 1 -- 172.21.15.37:0/2987182517 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f0bcc010430 con 0x7f0bd8107900 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.476+0000 7f0be45d6740 1 -- start start 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7a9070 0x560c6cb4e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb4e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb4ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0be45d6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c6cac5630 con 0x560c6c7801b0 2024-08-31T06:47:14.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0be45d6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560c6cab4bc0 con 0x560c6c788390 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0be45d6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560c6cab8b70 con 0x560c6c7a9070 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0bd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb4e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0bd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb4e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60284/0 (socket says 172.21.15.37:60284) 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0bd77fe640 1 -- 172.21.15.37:0/903576231 learned_addr learned my addr 172.21.15.37:0/903576231 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7a9070 0x560c6cb4e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.477+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb4ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd77fe640 1 -- 172.21.15.37:0/903576231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7a9070 msgr2=0x560c6cb4e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7a9070 0x560c6cb4e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd77fe640 1 -- 172.21.15.37:0/903576231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 msgr2=0x560c6cb4ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb4ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd77fe640 1 -- 172.21.15.37:0/903576231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6c814650 con 0x560c6c7801b0 2024-08-31T06:47:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb4ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb4e840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0bc802a930 tx=0x7f0bc8031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341ee843e1caa86b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd4ff9640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4d30 0x7f0bc00b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4d30 0x7f0bc00b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bbdffb640 1 -- 172.21.15.37:0/903576231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8035030 con 0x560c6c7801b0 2024-08-31T06:47:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bd4ff9640 1 -- 172.21.15.37:0/2987182517 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0bcc0e5a70 con 0x7f0bd8107900 2024-08-31T06:47:14.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.478+0000 7f0bbdffb640 1 -- 172.21.15.37:0/903576231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0bc8040070 con 0x560c6c7801b0 2024-08-31T06:47:14.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.479+0000 7f0bbdffb640 1 -- 172.21.15.37:0/903576231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8003850 con 0x560c6c7801b0 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 -- 172.21.15.37:0/903576231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 msgr2=0x560c6cb4e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4d30 0x7f0bc00b7240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000a380 tx=0x7f0bd0010040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb4e840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0bc802a930 tx=0x7f0bc8031a70 comp rx=0 tx=0).stop 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 -- 172.21.15.37:0/903576231 shutdown_connections 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb4e840 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb4ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 --2- 172.21.15.37:0/903576231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7a9070 0x560c6cb4e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 -- 172.21.15.37:0/903576231 >> 172.21.15.37:0/903576231 conn(0x560c6c79d460 msgr2=0x560c6cb4c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 -- 172.21.15.37:0/903576231 shutdown_connections 2024-08-31T06:47:14.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 -- 172.21.15.37:0/903576231 wait complete. 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.480+0000 7f0be45d6740 1 -- start start 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0be45d6740 1 Processor -- start 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7801b0 0x560c6cb5dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 0x560c6cb5e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0be45d6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c6c917700 con 0x560c6c7a9070 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0be45d6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560c6ca3b700 con 0x560c6c7801b0 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0be45d6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560c6cb60e80 con 0x560c6c788390 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0be45d6740 10 client.0 _ll_register_callbacks cb 0x560c6ca6adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.481+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60294/0 (socket says 172.21.15.37:60294) 2024-08-31T06:47:14.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bd7fff640 1 -- 172.21.15.37:0/1377220191 learned_addr learned my addr 172.21.15.37:0/1377220191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7801b0 0x560c6cb5dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bd7fff640 1 -- 172.21.15.37:0/1377220191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 msgr2=0x560c6cb5e2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 0x560c6cb5e2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bd7fff640 1 -- 172.21.15.37:0/1377220191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7801b0 msgr2=0x560c6cb5dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7801b0 0x560c6cb5dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bd7fff640 1 -- 172.21.15.37:0/1377220191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6ca748b0 con 0x560c6c7a9070 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5e840 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00042f0 tx=0x7f0bd0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca772f2583aa6d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.482+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/1377220191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd002a060 con 0x560c6c7a9070 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/1377220191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0bd0009040 con 0x560c6c7a9070 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 1 -- 172.21.15.37:0/1377220191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc8040070 con 0x560c6c7a9070 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/1377220191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0bd000dc70 con 0x560c6c7a9070 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 10 client.15681 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 1 -- 172.21.15.37:0/1377220191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c6cb6cc40 con 0x560c6c7a9070 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/1377220191 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0bc8040070 con 0x560c6c7a9070 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/1377220191 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0bd000b040 con 0x560c6c7a9070 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 10 client.15681 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 10 client.15681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 20 client.15681 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560c6c7679f0 0x560c6cb70210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 4 client.15681 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.483+0000 7f0be45d6740 1 -- 172.21.15.37:0/1377220191 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c6cac7580 con 0x560c6c7679f0 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.484+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560c6c7679f0 0x560c6cb70210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.485+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560c6c7679f0 0x560c6cb70210 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23efe8e0a784da8e server_cookie=3f6cbe027aaaf894 in_seq=0 out_seq=0 2024-08-31T06:47:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.485+0000 7f0bb6ffd640 10 client.15681 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.485+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/1377220191 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c6cac7580 con 0x560c6c7679f0 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.485+0000 7f0bb6ffd640 10 client.15681 handle_command_reply: tid=0 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.485+0000 7f0be45d6740 1 client.15681 shutdown 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 -- 172.21.15.37:0/1377220191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 msgr2=0x560c6cb5e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5e840 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00042f0 tx=0x7f0bd0004ab0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 -- 172.21.15.37:0/1377220191 shutdown_connections 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560c6c7679f0 0x560c6cb70210 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5e840 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 0x560c6cb5e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1377220191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7801b0 0x560c6cb5dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 -- 172.21.15.37:0/1377220191 >> 172.21.15.37:0/1377220191 conn(0x560c6c79d460 msgr2=0x560c6cb4a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0bb6ffd640 0 client.15681 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 -- 172.21.15.37:0/1377220191 shutdown_connections 2024-08-31T06:47:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 1 -- 172.21.15.37:0/1377220191 wait complete. 2024-08-31T06:47:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.486+0000 7f0be45d6740 20 client.15681 trim_cache size 0 max 16384 2024-08-31T06:47:14.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0be45d6740 1 Processor -- start 2024-08-31T06:47:14.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0be45d6740 1 -- start start 2024-08-31T06:47:14.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7801b0 0x560c6cb5fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb5af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0be45d6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81afae0 con 0x560c6c7a9070 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0be45d6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81ad3b0 con 0x560c6c788390 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0be45d6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81ab200 con 0x560c6c7801b0 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0bd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60306/0 (socket says 172.21.15.37:60306) 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.505+0000 7f0bd7fff640 1 -- 172.21.15.37:0/1905342493 learned_addr learned my addr 172.21.15.37:0/1905342493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7801b0 0x560c6cb5fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd7fff640 1 -- 172.21.15.37:0/1905342493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7801b0 msgr2=0x560c6cb5fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7801b0 0x560c6cb5fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb5af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd7fff640 1 -- 172.21.15.37:0/1905342493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 msgr2=0x560c6cb5af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb5af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd7fff640 1 -- 172.21.15.37:0/1905342493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6cb4f0f0 con 0x560c6c7a9070 2024-08-31T06:47:14.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:14.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5b4b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000a4b0 tx=0x7f0bd0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceed1e2126ff24e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:14.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bbd7fa640 1 -- 172.21.15.37:0/1905342493 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00048f0 con 0x560c6c7a9070 2024-08-31T06:47:14.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bbd7fa640 1 -- 172.21.15.37:0/1905342493 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0bd0003dd0 con 0x560c6c7a9070 2024-08-31T06:47:14.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.506+0000 7f0bbd7fa640 1 -- 172.21.15.37:0/1905342493 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd002f830 con 0x560c6c7a9070 2024-08-31T06:47:14.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 -- 172.21.15.37:0/1905342493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 msgr2=0x560c6cb5b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5b4b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000a4b0 tx=0x7f0bd0005fd0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 -- 172.21.15.37:0/1905342493 shutdown_connections 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7a9070 0x560c6cb5b4b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c788390 0x560c6cb5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 --2- 172.21.15.37:0/1905342493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c7801b0 0x560c6cb5fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 -- 172.21.15.37:0/1905342493 >> 172.21.15.37:0/1905342493 conn(0x560c6c79d460 msgr2=0x560c6cb53b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 -- 172.21.15.37:0/1905342493 shutdown_connections 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.507+0000 7f0be45d6740 1 -- 172.21.15.37:0/1905342493 wait complete. 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.508+0000 7f0be45d6740 1 -- start start 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.508+0000 7f0be45d6740 1 Processor -- start 2024-08-31T06:47:14.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 0x560c6cb63e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0be45d6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7a9070 0x560c6cb643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0be45d6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81ab870 con 0x560c6c7801b0 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0be45d6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81acce0 con 0x560c6c7a9070 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0be45d6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81abf40 con 0x560c6c788390 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0be45d6740 10 client.0 _ll_register_callbacks cb 0x7f0bd000ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb669a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60312/0 (socket says 172.21.15.37:60312) 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd77fe640 1 -- 172.21.15.37:0/3777637669 learned_addr learned my addr 172.21.15.37:0/3777637669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 0x560c6cb63e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7a9070 0x560c6cb643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd77fe640 1 -- 172.21.15.37:0/3777637669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 msgr2=0x560c6cb63e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 0x560c6cb63e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd77fe640 1 -- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7a9070 msgr2=0x560c6cb643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7a9070 0x560c6cb643d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd77fe640 1 -- 172.21.15.37:0/3777637669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6cb64b60 con 0x560c6c7801b0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 0x560c6cb63e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.509+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7a9070 0x560c6cb643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.510+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb669a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8006010 tx=0x7f0bc8031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b359a8e7395c0e94 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.510+0000 7f0bb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.510+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/3777637669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8035040 con 0x560c6c7801b0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.510+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/3777637669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0bc8004240 con 0x560c6c7801b0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.510+0000 7f0be45d6740 1 -- 172.21.15.37:0/3777637669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bd0003dd0 con 0x560c6c7801b0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.510+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/3777637669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0bc8004440 con 0x560c6c7801b0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.510+0000 7f0be45d6740 10 client.15687 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.510+0000 7f0be45d6740 1 -- 172.21.15.37:0/3777637669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c6cbdab00 con 0x560c6c7801b0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/3777637669 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0bd0003dd0 con 0x560c6c7801b0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/3777637669 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0bc804c040 con 0x560c6c7801b0 2024-08-31T06:47:14.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0be45d6740 10 client.15687 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:14.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0be45d6740 10 client.15687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:14.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0be45d6740 20 client.15687 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:14.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0be45d6740 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560c6c73cda0 0x560c6cbdce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:14.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0be45d6740 4 client.15687 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:47:14.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0be45d6740 1 -- 172.21.15.37:0/3777637669 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560c6cb50960 con 0x560c6c73cda0 2024-08-31T06:47:14.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.511+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560c6c73cda0 0x560c6cbdce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:14.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560c6c73cda0 0x560c6cbdce70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41035bff8310f52 server_cookie=e7447c90658db2a1 in_seq=0 out_seq=0 2024-08-31T06:47:14.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0bb6ffd640 10 client.15687 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:14.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0bb6ffd640 1 -- 172.21.15.37:0/3777637669 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x560c6cb50960 con 0x560c6c73cda0 2024-08-31T06:47:14.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0bb6ffd640 10 client.15687 handle_command_reply: tid=0 2024-08-31T06:47:14.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 client.15687 shutdown 2024-08-31T06:47:14.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 -- 172.21.15.37:0/3777637669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 msgr2=0x560c6cb669a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb669a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8006010 tx=0x7f0bc8031840 comp rx=0 tx=0).stop 2024-08-31T06:47:14.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 -- 172.21.15.37:0/3777637669 shutdown_connections 2024-08-31T06:47:14.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560c6c73cda0 0x560c6cbdce70 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6c7a9070 0x560c6cb643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6c788390 0x560c6cb63e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 --2- 172.21.15.37:0/3777637669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6c7801b0 0x560c6cb669a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0bb6ffd640 0 client.15687 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 -- 172.21.15.37:0/3777637669 >> 172.21.15.37:0/3777637669 conn(0x560c6c79d460 msgr2=0x560c6cb69ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 -- 172.21.15.37:0/3777637669 shutdown_connections 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 1 -- 172.21.15.37:0/3777637669 wait complete. 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.512+0000 7f0be45d6740 20 client.15687 trim_cache size 0 max 16384 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:47:14.518 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:14.519 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:47:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 -- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4d30 msgr2=0x7f0bc00b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4d30 0x7f0bc00b7240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0bd000a380 tx=0x7f0bd0010040 comp rx=0 tx=0).stop 2024-08-31T06:47:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 -- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8107900 msgr2=0x7f0bd819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8107900 0x7f0bd819a7a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00e9f0 tx=0x7f0bcc00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 -- 172.21.15.37:0/2987182517 shutdown_connections 2024-08-31T06:47:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4d30 0x7f0bc00b7240 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8107900 0x7f0bd819a7a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108250 0x7f0bd819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 --2- 172.21.15.37:0/2987182517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102010 0x7f0bd819a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 -- 172.21.15.37:0/2987182517 >> 172.21.15.37:0/2987182517 conn(0x7f0bd8077a60 msgr2=0x7f0bd8105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 -- 172.21.15.37:0/2987182517 shutdown_connections 2024-08-31T06:47:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:14.513+0000 7f0bde061640 1 -- 172.21.15.37:0/2987182517 wait complete. 2024-08-31T06:47:15.293 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:47:15.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:47:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:15.720 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:15 smithi037 ceph-mon[18612]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-08-31T06:47:15.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:15 smithi106 ceph-mon[22134]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-08-31T06:47:15.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:15 smithi066 ceph-mon[22244]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2024-08-31T06:47:16.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 -- 172.21.15.37:0/2580235884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c102800 msgr2=0x7ffa3c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:16.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2580235884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c102800 0x7ffa3c102c10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009900 tx=0x7ffa2c02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 -- 172.21.15.37:0/2580235884 shutdown_connections 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2580235884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa3c108a90 0x7ffa3c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2580235884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3c108140 0x7ffa3c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2580235884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c102800 0x7ffa3c102c10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 -- 172.21.15.37:0/2580235884 >> 172.21.15.37:0/2580235884 conn(0x7ffa3c0794d0 msgr2=0x7ffa3c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 -- 172.21.15.37:0/2580235884 shutdown_connections 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.100+0000 7ffa413d2640 1 -- 172.21.15.37:0/2580235884 wait complete. 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.101+0000 7ffa413d2640 1 Processor -- start 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.101+0000 7ffa413d2640 1 -- start start 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.101+0000 7ffa413d2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa3c102800 0x7ffa3c103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.101+0000 7ffa413d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c108140 0x7ffa3c104530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.101+0000 7ffa413d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3c108a90 0x7ffa3c104a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.101+0000 7ffa413d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c1125a0 con 0x7ffa3c108140 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa413d2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c112420 con 0x7ffa3c108a90 2024-08-31T06:47:16.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa413d2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c112720 con 0x7ffa3c102800 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c108140 0x7ffa3c104530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c108140 0x7ffa3c104530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60324/0 (socket says 172.21.15.37:60324) 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 -- 172.21.15.37:0/2560068113 learned_addr learned my addr 172.21.15.37:0/2560068113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3affd640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa3c102800 0x7ffa3c103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3b7fe640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3c108a90 0x7ffa3c104a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 -- 172.21.15.37:0/2560068113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa3c102800 msgr2=0x7ffa3c103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa3c102800 0x7ffa3c103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 -- 172.21.15.37:0/2560068113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3c108a90 msgr2=0x7ffa3c104a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3c108a90 0x7ffa3c104a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 -- 172.21.15.37:0/2560068113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c1a8350 con 0x7ffa3c108140 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa3a7fc640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c108140 0x7ffa3c104530 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000d770 tx=0x7ffa3000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa23fff640 1 -- 172.21.15.37:0/2560068113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa30017070 con 0x7ffa3c108140 2024-08-31T06:47:16.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa23fff640 1 -- 172.21.15.37:0/2560068113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa30009c30 con 0x7ffa3c108140 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa23fff640 1 -- 172.21.15.37:0/2560068113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000f620 con 0x7ffa3c108140 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.102+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c1a8640 con 0x7ffa3c108140 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.103+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c1a8b80 con 0x7ffa3c108140 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.104+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c102c10 con 0x7ffa3c108140 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.106+0000 7ffa23fff640 1 -- 172.21.15.37:0/2560068113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7ffa3001a070 con 0x7ffa3c108140 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.107+0000 7ffa23fff640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa240b4d30 0x7ffa240b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.107+0000 7ffa3affd640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa240b4d30 0x7ffa240b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.107+0000 7ffa23fff640 1 -- 172.21.15.37:0/2560068113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ffa300e50e0 con 0x7ffa3c108140 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.108+0000 7ffa3affd640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa240b4d30 0x7ffa240b7240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c105a40 tx=0x7ffa2c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:16.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.110+0000 7ffa23fff640 1 -- 172.21.15.37:0/2560068113 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7ffa30009de0 con 0x7ffa3c108140 2024-08-31T06:47:16.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.332+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa3c1a8f80 con 0x7ffa3c108140 2024-08-31T06:47:16.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.333+0000 7ffa23fff640 1 -- 172.21.15.37:0/2560068113 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7ffa300ab750 con 0x7ffa3c108140 2024-08-31T06:47:16.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:47:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:47:16.335 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:47:16.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa240b4d30 msgr2=0x7ffa240b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:16.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa240b4d30 0x7ffa240b7240 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c105a40 tx=0x7ffa2c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c108140 msgr2=0x7ffa3c104530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c108140 0x7ffa3c104530 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000d770 tx=0x7ffa3000dc30 comp rx=0 tx=0).stop 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 shutdown_connections 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa240b4d30 0x7ffa240b7240 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa3c108140 0x7ffa3c104530 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3c108a90 0x7ffa3c104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.336+0000 7ffa413d2640 1 --2- 172.21.15.37:0/2560068113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa3c102800 0x7ffa3c103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.337+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 >> 172.21.15.37:0/2560068113 conn(0x7ffa3c0794d0 msgr2=0x7ffa3c1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.337+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 shutdown_connections 2024-08-31T06:47:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:16.337+0000 7ffa413d2640 1 -- 172.21.15.37:0/2560068113 wait complete. 2024-08-31T06:47:16.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:16 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2560068113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:16.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:16 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2560068113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:16.883 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-31T06:47:16.884 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T06:47:16.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:47:16.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:16 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2560068113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:17.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:47:17.254 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:17.684 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:17 smithi037 ceph-mon[18612]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-08-31T06:47:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.780+0000 7f70af326640 1 -- 172.21.15.37:0/2644207919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108160 msgr2=0x7f70a8108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.780+0000 7f70af326640 1 --2- 172.21.15.37:0/2644207919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108160 0x7f70a8108570 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7098009900 tx=0x7f709802a410 comp rx=0 tx=0).stop 2024-08-31T06:47:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.781+0000 7f70af326640 1 -- 172.21.15.37:0/2644207919 shutdown_connections 2024-08-31T06:47:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.781+0000 7f70af326640 1 --2- 172.21.15.37:0/2644207919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108160 0x7f70a8108570 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:17.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.781+0000 7f70af326640 1 --2- 172.21.15.37:0/2644207919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a8108ab0 0x7f70a810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.781+0000 7f70af326640 1 --2- 172.21.15.37:0/2644207919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a8102820 0x7f70a8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.781+0000 7f70af326640 1 -- 172.21.15.37:0/2644207919 >> 172.21.15.37:0/2644207919 conn(0x7f70a80794e0 msgr2=0x7f70a80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.781+0000 7f70af326640 1 -- 172.21.15.37:0/2644207919 shutdown_connections 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.781+0000 7f70af326640 1 -- 172.21.15.37:0/2644207919 wait complete. 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70af326640 1 Processor -- start 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70af326640 1 -- start start 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70af326640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a8102820 0x7f70a819afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70af326640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a8108160 0x7f70a819b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70af326640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108ab0 0x7f70a819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70af326640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8112590 con 0x7f70a8108ab0 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70af326640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8112410 con 0x7f70a8102820 2024-08-31T06:47:17.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70af326640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8112710 con 0x7f70a8108160 2024-08-31T06:47:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70ad8c3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108ab0 0x7f70a819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70ad8c3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108ab0 0x7f70a819ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60344/0 (socket says 172.21.15.37:60344) 2024-08-31T06:47:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70ad8c3640 1 -- 172.21.15.37:0/3489092120 learned_addr learned my addr 172.21.15.37:0/3489092120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70ac8c1640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a8108160 0x7f70a819b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.782+0000 7f70ad0c2640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a8102820 0x7f70a819afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f70ad8c3640 1 -- 172.21.15.37:0/3489092120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a8108160 msgr2=0x7f70a819b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f70ad8c3640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a8108160 0x7f70a819b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:17.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f70ad8c3640 1 -- 172.21.15.37:0/3489092120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a8102820 msgr2=0x7f70a819afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f70ad8c3640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a8102820 0x7f70a819afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f70ad8c3640 1 -- 172.21.15.37:0/3489092120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a81a6280 con 0x7f70a8108ab0 2024-08-31T06:47:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f70ad8c3640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108ab0 0x7f70a819ba40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f70a000eaa0 tx=0x7f70a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f709e7fc640 1 -- 172.21.15.37:0/3489092120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a000cdb0 con 0x7f70a8108ab0 2024-08-31T06:47:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f709e7fc640 1 -- 172.21.15.37:0/3489092120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70a0005020 con 0x7f70a8108ab0 2024-08-31T06:47:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f709e7fc640 1 -- 172.21.15.37:0/3489092120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a00116d0 con 0x7f70a8108ab0 2024-08-31T06:47:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.783+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a81a6570 con 0x7f70a8108ab0 2024-08-31T06:47:17.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.784+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a81a6a30 con 0x7f70a8108ab0 2024-08-31T06:47:17.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.785+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a8103aa0 con 0x7f70a8108ab0 2024-08-31T06:47:17.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.787+0000 7f709e7fc640 1 -- 172.21.15.37:0/3489092120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f70a00051d0 con 0x7f70a8108ab0 2024-08-31T06:47:17.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.788+0000 7f709e7fc640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70940b4db0 0x7f70940b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:17.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.788+0000 7f70ad0c2640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70940b4db0 0x7f70940b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:17.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.788+0000 7f709e7fc640 1 -- 172.21.15.37:0/3489092120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f70a00e5740 con 0x7f70a8108ab0 2024-08-31T06:47:17.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.789+0000 7f70ad0c2640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70940b4db0 0x7f70940b72c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f70a806c460 tx=0x7f70a400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:17.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:17.793+0000 7f709e7fc640 1 -- 172.21.15.37:0/3489092120 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f70a0016030 con 0x7f70a8108ab0 2024-08-31T06:47:17.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:17 smithi106 ceph-mon[22134]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-08-31T06:47:17.830 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:17.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:17 smithi066 ceph-mon[22244]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.0 KiB/s wr, 9 op/s 2024-08-31T06:47:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.051+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70a802e430 con 0x7f70a8108ab0 2024-08-31T06:47:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.052+0000 7f709e7fc640 1 -- 172.21.15.37:0/3489092120 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f70a00abdb0 con 0x7f70a8108ab0 2024-08-31T06:47:18.053 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:47:18.054 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:47:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:47:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70940b4db0 msgr2=0x7f70940b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70940b4db0 0x7f70940b72c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f70a806c460 tx=0x7f70a400b390 comp rx=0 tx=0).stop 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108ab0 msgr2=0x7f70a819ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108ab0 0x7f70a819ba40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f70a000eaa0 tx=0x7f70a000ef60 comp rx=0 tx=0).stop 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 shutdown_connections 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70940b4db0 0x7f70940b72c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a8108ab0 0x7f70a819ba40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70a8108160 0x7f70a819b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 --2- 172.21.15.37:0/3489092120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70a8102820 0x7f70a819afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.054+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 >> 172.21.15.37:0/3489092120 conn(0x7f70a80794e0 msgr2=0x7f70a8105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.055+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 shutdown_connections 2024-08-31T06:47:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.055+0000 7f70af326640 1 -- 172.21.15.37:0/3489092120 wait complete. 2024-08-31T06:47:18.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:18 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3489092120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:18.799 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T06:47:18.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T06:47:18.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:18 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3489092120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:18.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:18 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3489092120' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:18.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 -- 172.21.15.37:0/3560042119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b441050a0 msgr2=0x7f6b4410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:18.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 --2- 172.21.15.37:0/3560042119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b441050a0 0x7f6b4410d5f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009900 tx=0x7f6b3002a410 comp rx=0 tx=0).stop 2024-08-31T06:47:18.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 -- 172.21.15.37:0/3560042119 shutdown_connections 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 --2- 172.21.15.37:0/3560042119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b441050a0 0x7f6b4410d5f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 --2- 172.21.15.37:0/3560042119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4410dbb0 0x7f6b441100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 --2- 172.21.15.37:0/3560042119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b44104750 0x7f6b44104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 -- 172.21.15.37:0/3560042119 >> 172.21.15.37:0/3560042119 conn(0x7f6b440794d0 msgr2=0x7f6b440798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 -- 172.21.15.37:0/3560042119 shutdown_connections 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.985+0000 7f6b4af87640 1 -- 172.21.15.37:0/3560042119 wait complete. 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b4af87640 1 Processor -- start 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b4af87640 1 -- start start 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b4af87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b44104750 0x7f6b4419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b4af87640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b441050a0 0x7f6b4419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b4af87640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4410dbb0 0x7f6b4419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b4af87640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441136f0 con 0x7f6b44104750 2024-08-31T06:47:18.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b4af87640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44113570 con 0x7f6b4410dbb0 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b4af87640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44113870 con 0x7f6b441050a0 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b44104750 0x7f6b4419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b441050a0 0x7f6b4419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b44104750 0x7f6b4419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60356/0 (socket says 172.21.15.37:60356) 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b441050a0 0x7f6b4419a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51046/0 (socket says 172.21.15.37:51046) 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.986+0000 7f6b48d23640 1 -- 172.21.15.37:0/455896352 learned_addr learned my addr 172.21.15.37:0/455896352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b49524640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4410dbb0 0x7f6b4419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b43fff640 1 -- 172.21.15.37:0/455896352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4410dbb0 msgr2=0x7f6b4419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b43fff640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4410dbb0 0x7f6b4419fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b43fff640 1 -- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b44104750 msgr2=0x7f6b4419a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b43fff640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b44104750 0x7f6b4419a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b43fff640 1 -- 172.21.15.37:0/455896352 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b441a0170 con 0x7f6b441050a0 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b48d23640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b44104750 0x7f6b4419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:18.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b43fff640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b441050a0 0x7f6b4419a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b3002aa00 tx=0x7f6b30003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b41ffb640 1 -- 172.21.15.37:0/455896352 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3003f070 con 0x7f6b441050a0 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b4af87640 1 -- 172.21.15.37:0/455896352 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b441a0400 con 0x7f6b441050a0 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b41ffb640 1 -- 172.21.15.37:0/455896352 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b30003e50 con 0x7f6b441050a0 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.987+0000 7f6b41ffb640 1 -- 172.21.15.37:0/455896352 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30035030 con 0x7f6b441050a0 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.988+0000 7f6b4af87640 1 -- 172.21.15.37:0/455896352 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b441a6bc0 con 0x7f6b441050a0 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.990+0000 7f6b514fc740 1 Processor -- start 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.990+0000 7f6b514fc740 1 -- start start 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee59db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee5a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea96390 0x558adee6c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b514fc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558adedd3680 con 0x558adea96390 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b514fc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558adedc2c10 con 0x558adea8e1b0 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b514fc740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558adedc6bc0 con 0x558adeab7070 2024-08-31T06:47:18.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b41ffb640 1 -- 172.21.15.37:0/455896352 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f6b30042070 con 0x7f6b441050a0 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee5a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea96390 0x558adee6c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee5a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:48878/0 (socket says 172.21.15.37:48878) 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.991+0000 7f6b48d23640 1 -- 172.21.15.37:0/4075462751 learned_addr learned my addr 172.21.15.37:0/4075462751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.992+0000 7f6b49524640 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee59db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.992+0000 7f6b48d23640 1 -- 172.21.15.37:0/4075462751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 msgr2=0x558adee59db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.992+0000 7f6b48d23640 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee59db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.992+0000 7f6b48d23640 1 -- 172.21.15.37:0/4075462751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea96390 msgr2=0x558adee6c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.992+0000 7f6b48d23640 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea96390 0x558adee6c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.992+0000 7f6b48d23640 1 -- 172.21.15.37:0/4075462751 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adeb22650 con 0x558adea8e1b0 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.992+0000 7f6b49524640 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee59db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.992+0000 7f6b43fff640 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea96390 0x558adee6c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.993+0000 7f6b41ffb640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b340b4d30 0x7f6b340b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:18.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.993+0000 7f6b48d23640 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee5a330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b380115f0 tx=0x7f6b38011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ec01ddf32d7835 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.993+0000 7f6b49524640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b340b4d30 0x7f6b340b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.993+0000 7f6b41ffb640 1 -- 172.21.15.37:0/455896352 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6b30105d60 con 0x7f6b441050a0 2024-08-31T06:47:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.993+0000 7f6b2effd640 1 -- 172.21.15.37:0/4075462751 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38004020 con 0x558adea8e1b0 2024-08-31T06:47:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.993+0000 7f6b2effd640 1 -- 172.21.15.37:0/4075462751 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b380041c0 con 0x558adea8e1b0 2024-08-31T06:47:18.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.993+0000 7f6b2effd640 1 -- 172.21.15.37:0/4075462751 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38003830 con 0x558adea8e1b0 2024-08-31T06:47:19.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.994+0000 7f6b514fc740 1 -- 172.21.15.37:0/4075462751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 msgr2=0x558adee5a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:19.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.994+0000 7f6b514fc740 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee5a330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6b380115f0 tx=0x7f6b38011ab0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.994+0000 7f6b49524640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b340b4d30 0x7f6b340b7240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c005fd0 tx=0x7f6b3c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:19.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.994+0000 7f6b514fc740 1 -- 172.21.15.37:0/4075462751 shutdown_connections 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.994+0000 7f6b514fc740 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea96390 0x558adee6c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.994+0000 7f6b514fc740 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee5a330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.994+0000 7f6b514fc740 1 --2- 172.21.15.37:0/4075462751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee59db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.994+0000 7f6b514fc740 1 -- 172.21.15.37:0/4075462751 >> 172.21.15.37:0/4075462751 conn(0x558adeaab460 msgr2=0x558adee5c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.995+0000 7f6b514fc740 1 -- 172.21.15.37:0/4075462751 shutdown_connections 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.995+0000 7f6b514fc740 1 -- 172.21.15.37:0/4075462751 wait complete. 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.995+0000 7f6b514fc740 1 -- start start 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.995+0000 7f6b514fc740 1 Processor -- start 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee70b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea96390 0x558adee71160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee76180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b514fc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558adec25700 con 0x558adeab7070 2024-08-31T06:47:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b514fc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558aded49750 con 0x558adea8e1b0 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b514fc740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558adee6d200 con 0x558adea96390 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b514fc740 10 client.0 _ll_register_callbacks cb 0x558aded78e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b49524640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee76180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee70b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee70b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:48890/0 (socket says 172.21.15.37:48890) 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b48d23640 1 -- 172.21.15.37:0/3713281936 learned_addr learned my addr 172.21.15.37:0/3713281936 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b49524640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee76180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60382/0 (socket says 172.21.15.37:60382) 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.996+0000 7f6b43fff640 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea96390 0x558adee71160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b48d23640 1 -- 172.21.15.37:0/3713281936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea96390 msgr2=0x558adee71160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b48d23640 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea96390 0x558adee71160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b48d23640 1 -- 172.21.15.37:0/3713281936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 msgr2=0x558adee76180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b48d23640 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee76180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b48d23640 1 -- 172.21.15.37:0/3713281936 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aded82900 con 0x558adea8e1b0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b49524640 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee76180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b48d23640 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee70b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b3801b040 tx=0x7f6b38005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f1c84eb96449861 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b23fff640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b23fff640 1 -- 172.21.15.37:0/3713281936 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38027020 con 0x558adea8e1b0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b514fc740 1 -- 172.21.15.37:0/3713281936 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b380041c0 con 0x558adea8e1b0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b23fff640 1 -- 172.21.15.37:0/3713281936 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6b38016040 con 0x558adea8e1b0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b23fff640 1 -- 172.21.15.37:0/3713281936 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b38032050 con 0x558adea8e1b0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b514fc740 10 client.25295 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.997+0000 7f6b514fc740 1 -- 172.21.15.37:0/3713281936 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558adee7f040 con 0x558adea8e1b0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b23fff640 1 -- 172.21.15.37:0/3713281936 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b380041c0 con 0x558adea8e1b0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b23fff640 1 -- 172.21.15.37:0/3713281936 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b38004af0 con 0x558adea8e1b0 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b514fc740 10 client.25295 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b514fc740 10 client.25295 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:47:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b514fc740 20 client.25295 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558adea759f0 0x558adee82460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b514fc740 4 client.25295 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b514fc740 1 -- 172.21.15.37:0/3713281936 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558adedd55d0 con 0x558adea759f0 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.998+0000 7f6b43fff640 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558adea759f0 0x558adee82460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.999+0000 7f6b23fff640 10 client.25295 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.999+0000 7f6b43fff640 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558adea759f0 0x558adee82460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa6a407cc1ba6e22 server_cookie=208e881d58dad413 in_seq=0 out_seq=0 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.999+0000 7f6b23fff640 1 -- 172.21.15.37:0/3713281936 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558adedd55d0 con 0x558adea759f0 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:18.999+0000 7f6b23fff640 10 client.25295 handle_command_reply: tid=0 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 client.25295 shutdown 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 -- 172.21.15.37:0/3713281936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 msgr2=0x558adee70b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee70b80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b3801b040 tx=0x7f6b38005db0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 -- 172.21.15.37:0/3713281936 shutdown_connections 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee76180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558adea759f0 0x558adee82460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea96390 0x558adee71160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3713281936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea8e1b0 0x558adee70b80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b514fc740 1 -- 172.21.15.37:0/3713281936 >> 172.21.15.37:0/3713281936 conn(0x558adeaab460 msgr2=0x558adee591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.000+0000 7f6b23fff640 0 client.25295 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:47:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.001+0000 7f6b514fc740 1 -- 172.21.15.37:0/3713281936 shutdown_connections 2024-08-31T06:47:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.001+0000 7f6b514fc740 1 -- 172.21.15.37:0/3713281936 wait complete. 2024-08-31T06:47:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.001+0000 7f6b514fc740 20 client.25295 trim_cache size 0 max 16384 2024-08-31T06:47:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.016+0000 7f6b514fc740 1 Processor -- start 2024-08-31T06:47:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.016+0000 7f6b514fc740 1 -- start start 2024-08-31T06:47:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.016+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea8e1b0 0x558adee5bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.016+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee5c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee760f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b514fc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441af9f0 con 0x558adeab7070 2024-08-31T06:47:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b514fc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441ad2c0 con 0x558adea96390 2024-08-31T06:47:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b514fc740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441ab130 con 0x558adea8e1b0 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea8e1b0 0x558adee5bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea8e1b0 0x558adee5bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51084/0 (socket says 172.21.15.37:51084) 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 -- 172.21.15.37:0/3403789254 learned_addr learned my addr 172.21.15.37:0/3403789254 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b43fff640 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee5c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b49524640 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee760f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 -- 172.21.15.37:0/3403789254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 msgr2=0x558adee5c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee5c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 -- 172.21.15.37:0/3403789254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 msgr2=0x558adee760f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee760f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 -- 172.21.15.37:0/3403789254 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558adee5cbc0 con 0x558adea8e1b0 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b49524640 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee760f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b43fff640 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee5c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.017+0000 7f6b48d23640 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea8e1b0 0x558adee5bdd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009370 tx=0x7f6b38009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e1daeabe4fdced server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.018+0000 7f6b2e7fc640 1 -- 172.21.15.37:0/3403789254 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38027070 con 0x558adea8e1b0 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.018+0000 7f6b2e7fc640 1 -- 172.21.15.37:0/3403789254 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b3800fd40 con 0x558adea8e1b0 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.018+0000 7f6b2e7fc640 1 -- 172.21.15.37:0/3403789254 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38023cc0 con 0x558adea8e1b0 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 -- 172.21.15.37:0/3403789254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea8e1b0 msgr2=0x558adee5bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea8e1b0 0x558adee5bdd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6b38009370 tx=0x7f6b38009bf0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 -- 172.21.15.37:0/3403789254 shutdown_connections 2024-08-31T06:47:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adeab7070 0x558adee760f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee5c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 --2- 172.21.15.37:0/3403789254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adea8e1b0 0x558adee5bdd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 -- 172.21.15.37:0/3403789254 >> 172.21.15.37:0/3403789254 conn(0x558adeaab460 msgr2=0x558adee6b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 -- 172.21.15.37:0/3403789254 shutdown_connections 2024-08-31T06:47:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.019+0000 7f6b514fc740 1 -- 172.21.15.37:0/3403789254 wait complete. 2024-08-31T06:47:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.020+0000 7f6b514fc740 1 -- start start 2024-08-31T06:47:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.020+0000 7f6b514fc740 1 Processor -- start 2024-08-31T06:47:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea8e1b0 0x558adee7cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee7d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b514fc740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee78110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea8e1b0 0x558adee7cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b514fc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441ab780 con 0x558adea8e1b0 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b48d23640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea8e1b0 0x558adee7cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60392/0 (socket says 172.21.15.37:60392) 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b48d23640 1 -- 172.21.15.37:0/2122332732 learned_addr learned my addr 172.21.15.37:0/2122332732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441acbf0 con 0x558adea96390 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b43fff640 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee7d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441abe50 con 0x558adeab7070 2024-08-31T06:47:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.021+0000 7f6b49524640 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee78110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b43fff640 1 -- 172.21.15.37:0/2122332732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 msgr2=0x558adee78110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b43fff640 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee78110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b43fff640 1 -- 172.21.15.37:0/2122332732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea8e1b0 msgr2=0x558adee7cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b43fff640 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea8e1b0 0x558adee7cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b43fff640 1 -- 172.21.15.37:0/2122332732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558adee55820 con 0x558adea96390 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b48d23640 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea8e1b0 0x558adee7cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b514fc740 10 client.0 _ll_register_callbacks cb 0x7f6b30103260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b3800fd40 con 0x558adea96390 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b23fff640 10 client.25298 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b43fff640 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee7d090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b301033d0 tx=0x7f6b30000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddd52e0936319f48 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b23fff640 1 -- 172.21.15.37:0/2122332732 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30049040 con 0x558adea96390 2024-08-31T06:47:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.022+0000 7f6b23fff640 1 -- 172.21.15.37:0/2122332732 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6b30103be0 con 0x558adea96390 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b23fff640 1 -- 172.21.15.37:0/2122332732 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b300cbae0 con 0x558adea96390 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b514fc740 10 client.25298 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=25}) -- 0x558adeeec5f0 con 0x558adea96390 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b23fff640 1 -- 172.21.15.37:0/2122332732 <== mon.2 v2:172.21.15.66:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b30031be0 con 0x558adea96390 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b514fc740 10 client.25298 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b514fc740 10 client.25298 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b514fc740 20 client.25298 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b514fc740 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558adea4ada0 0x558adeeeeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b514fc740 4 client.25298 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:47:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.023+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f6b3800fd40 con 0x558adea4ada0 2024-08-31T06:47:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.024+0000 7f6b48d23640 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558adea4ada0 0x558adeeeeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.024+0000 7f6b48d23640 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558adea4ada0 0x558adeeeeca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ec96bbaf05a09267 server_cookie=8251273db28c217e in_seq=0 out_seq=0 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.024+0000 7f6b23fff640 10 client.25298 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.024+0000 7f6b23fff640 1 -- 172.21.15.37:0/2122332732 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f6b3800fd40 con 0x558adea4ada0 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.024+0000 7f6b23fff640 10 client.25298 handle_command_reply: tid=0 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.024+0000 7f6b514fc740 1 client.25298 shutdown 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 msgr2=0x558adee7d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee7d090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b301033d0 tx=0x7f6b30000bc0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 shutdown_connections 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558adea4ada0 0x558adeeeeca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558adeab7070 0x558adee78110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b23fff640 0 client.25298 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:47:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558adea96390 0x558adee7d090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 --2- 172.21.15.37:0/2122332732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558adea8e1b0 0x558adee7cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 >> 172.21.15.37:0/2122332732 conn(0x558adeaab460 msgr2=0x558adee6f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 shutdown_connections 2024-08-31T06:47:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 1 -- 172.21.15.37:0/2122332732 wait complete. 2024-08-31T06:47:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.025+0000 7f6b514fc740 20 client.25298 trim_cache size 0 max 16384 2024-08-31T06:47:19.029 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:47:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 -- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b340b4d30 msgr2=0x7f6b340b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b340b4d30 0x7f6b340b7240 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c005fd0 tx=0x7f6b3c009600 comp rx=0 tx=0).stop 2024-08-31T06:47:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 -- 172.21.15.37:0/455896352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b441050a0 msgr2=0x7f6b4419a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b441050a0 0x7f6b4419a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6b3002aa00 tx=0x7f6b30003c60 comp rx=0 tx=0).stop 2024-08-31T06:47:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 -- 172.21.15.37:0/455896352 shutdown_connections 2024-08-31T06:47:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b340b4d30 0x7f6b340b7240 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4410dbb0 0x7f6b4419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b441050a0 0x7f6b4419a7a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 --2- 172.21.15.37:0/455896352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b44104750 0x7f6b4419a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.026+0000 7f6b4af87640 1 -- 172.21.15.37:0/455896352 >> 172.21.15.37:0/455896352 conn(0x7f6b440794d0 msgr2=0x7f6b441006c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.027+0000 7f6b4af87640 1 -- 172.21.15.37:0/455896352 shutdown_connections 2024-08-31T06:47:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:19.027+0000 7f6b4af87640 1 -- 172.21.15.37:0/455896352 wait complete. 2024-08-31T06:47:19.302 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:19.707 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:19 smithi037 ceph-mon[18612]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-08-31T06:47:19.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:47:19.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:19 smithi106 ceph-mon[22134]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-08-31T06:47:19.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:19 smithi066 ceph-mon[22244]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-08-31T06:47:20.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 -- 172.21.15.37:0/886467764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109280 msgr2=0x7f6c40109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 --2- 172.21.15.37:0/886467764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109280 0x7f6c40109690 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009900 tx=0x7f6c3002a410 comp rx=0 tx=0).stop 2024-08-31T06:47:20.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 -- 172.21.15.37:0/886467764 shutdown_connections 2024-08-31T06:47:20.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 --2- 172.21.15.37:0/886467764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109280 0x7f6c40109690 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 --2- 172.21.15.37:0/886467764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c40109bd0 0x7f6c40110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 --2- 172.21.15.37:0/886467764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c40103940 0x7f6c40103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 -- 172.21.15.37:0/886467764 >> 172.21.15.37:0/886467764 conn(0x7f6c400ff390 msgr2=0x7f6c401017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 -- 172.21.15.37:0/886467764 shutdown_connections 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.264+0000 7f6c47843640 1 -- 172.21.15.37:0/886467764 wait complete. 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c47843640 1 Processor -- start 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c47843640 1 -- start start 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c47843640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c40103940 0x7f6c4019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c47843640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c40109280 0x7f6c4019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c47843640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109bd0 0x7f6c401a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c47843640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40075e90 con 0x7f6c40109bd0 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c47843640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40075d10 con 0x7f6c40103940 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c47843640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6c40076010 con 0x7f6c40109280 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c45de0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109bd0 0x7f6c401a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c45de0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109bd0 0x7f6c401a1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60408/0 (socket says 172.21.15.37:60408) 2024-08-31T06:47:20.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c45de0640 1 -- 172.21.15.37:0/1930799851 learned_addr learned my addr 172.21.15.37:0/1930799851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c455df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c40103940 0x7f6c4019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.265+0000 7f6c44dde640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c40109280 0x7f6c4019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c45de0640 1 -- 172.21.15.37:0/1930799851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c40109280 msgr2=0x7f6c4019c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c45de0640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c40109280 0x7f6c4019c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c45de0640 1 -- 172.21.15.37:0/1930799851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c40103940 msgr2=0x7f6c4019c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c45de0640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c40103940 0x7f6c4019c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c45de0640 1 -- 172.21.15.37:0/1930799851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c401a2210 con 0x7f6c40109bd0 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c455df640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c40103940 0x7f6c4019c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c45de0640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109bd0 0x7f6c401a1ba0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800eaa0 tx=0x7f6c3800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c367fc640 1 -- 172.21.15.37:0/1930799851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c38004d20 con 0x7f6c40109bd0 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c47843640 1 -- 172.21.15.37:0/1930799851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c401a2500 con 0x7f6c40109bd0 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c367fc640 1 -- 172.21.15.37:0/1930799851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c38005020 con 0x7f6c40109bd0 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c367fc640 1 -- 172.21.15.37:0/1930799851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c380116d0 con 0x7f6c40109bd0 2024-08-31T06:47:20.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.266+0000 7f6c47843640 1 -- 172.21.15.37:0/1930799851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c401a8d20 con 0x7f6c40109bd0 2024-08-31T06:47:20.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c367fc640 1 -- 172.21.15.37:0/1930799851 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f6c3800caf0 con 0x7f6c40109bd0 2024-08-31T06:47:20.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c4ddb8740 1 Processor -- start 2024-08-31T06:47:20.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c4ddb8740 1 -- start start 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd56c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd571d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 0x55634dd57710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55634dccb330 con 0x55634d986980 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55634dcba8c0 con 0x55634d9af840 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.270+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55634dcbe870 con 0x55634d98eb60 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd56c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c367fc640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6c2c0b4d60 0x7f6c2c0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 0x55634dd57710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd56c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:48932/0 (socket says 172.21.15.37:48932) 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 -- 172.21.15.37:0/2082931607 learned_addr learned my addr 172.21.15.37:0/2082931607 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c367fc640 1 -- 172.21.15.37:0/1930799851 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6c380e5790 con 0x7f6c40109bd0 2024-08-31T06:47:20.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 -- 172.21.15.37:0/2082931607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 msgr2=0x55634dd57710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 --2- 172.21.15.37:0/2082931607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 0x55634dd57710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 -- 172.21.15.37:0/2082931607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 msgr2=0x55634dd571d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 --2- 172.21.15.37:0/2082931607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.271+0000 7f6c44dde640 1 -- 172.21.15.37:0/2082931607 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55634dc72df0 con 0x55634d9af840 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.272+0000 7f6c45de0640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6c2c0b4d60 0x7f6c2c0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.272+0000 7f6c44dde640 1 --2- 172.21.15.37:0/2082931607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd56c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c30005f70 tx=0x7f6c30000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f98dbc83aa93ea6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.272+0000 7f6c2b7fe640 1 -- 172.21.15.37:0/2082931607 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30035070 con 0x55634d9af840 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.272+0000 7f6c45de0640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6c2c0b4d60 0x7f6c2c0b7270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6c380e2ec0 tx=0x7f6c38005730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.272+0000 7f6c2b7fe640 1 -- 172.21.15.37:0/2082931607 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c30031840 con 0x55634d9af840 2024-08-31T06:47:20.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.272+0000 7f6c2b7fe640 1 -- 172.21.15.37:0/2082931607 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30003e10 con 0x55634d9af840 2024-08-31T06:47:20.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.273+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2082931607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 msgr2=0x55634dd56c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.273+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2082931607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd56c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6c30005f70 tx=0x7f6c30000bc0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.273+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2082931607 shutdown_connections 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.273+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2082931607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.273+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2082931607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 0x55634dd57710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.273+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2082931607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd56c90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.273+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2082931607 >> 172.21.15.37:0/2082931607 conn(0x55634d9a3990 msgr2=0x55634dd54b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.274+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2082931607 shutdown_connections 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.274+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2082931607 wait complete. 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.274+0000 7f6c4ddb8740 1 -- start start 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.274+0000 7f6c4ddb8740 1 Processor -- start 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d986980 0x55634dd62550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 0x55634dd62b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d9af840 0x55634dd6e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55634db1d7a0 con 0x55634d9af840 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55634dc41240 con 0x55634d98eb60 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55634dd65410 con 0x55634d986980 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c4ddb8740 10 client.0 _ll_register_callbacks cb 0x55634d9c7090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d9af840 0x55634dd6e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d9af840 0x55634dd6e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60432/0 (socket says 172.21.15.37:60432) 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 -- 172.21.15.37:0/3186482186 learned_addr learned my addr 172.21.15.37:0/3186482186 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c455df640 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 0x55634dd62b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d986980 0x55634dd62550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 -- 172.21.15.37:0/3186482186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d986980 msgr2=0x55634dd62550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d986980 0x55634dd62550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 -- 172.21.15.37:0/3186482186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 msgr2=0x55634dd62b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 0x55634dd62b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.275+0000 7f6c44dde640 1 -- 172.21.15.37:0/3186482186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55634dc772b0 con 0x55634d9af840 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c44dde640 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d9af840 0x55634dd6e730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6c3002ac00 tx=0x7f6c3002ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1352326da590f19f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c28ff9640 1 -- 172.21.15.37:0/3186482186 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30035030 con 0x55634d9af840 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c28ff9640 1 -- 172.21.15.37:0/3186482186 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6c30004050 con 0x55634d9af840 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3186482186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c30031840 con 0x55634d9af840 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c28ff9640 1 -- 172.21.15.37:0/3186482186 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6c30004250 con 0x55634d9af840 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c4ddb8740 10 client.15726 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3186482186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55634da29b90 con 0x55634d9af840 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.276+0000 7f6c28ff9640 1 -- 172.21.15.37:0/3186482186 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c30031840 con 0x55634d9af840 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.277+0000 7f6c28ff9640 1 -- 172.21.15.37:0/3186482186 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6c3003b460 con 0x55634d9af840 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.277+0000 7f6c4ddb8740 10 client.15726 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.277+0000 7f6c4ddb8740 10 client.15726 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.277+0000 7f6c4ddb8740 20 client.15726 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:20.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.277+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55634d96e1c0 0x55634dd74470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.277+0000 7f6c4ddb8740 4 client.15726 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:20.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.277+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3186482186 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55634dccd280 con 0x55634d96e1c0 2024-08-31T06:47:20.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.277+0000 7f6c455df640 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55634d96e1c0 0x55634dd74470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.278+0000 7f6c455df640 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55634d96e1c0 0x55634dd74470 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af2f5a31def0fa7 server_cookie=8abb9cc99b78c898 in_seq=0 out_seq=0 2024-08-31T06:47:20.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.278+0000 7f6c28ff9640 10 client.15726 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c28ff9640 1 -- 172.21.15.37:0/3186482186 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55634dccd280 con 0x55634d96e1c0 2024-08-31T06:47:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c28ff9640 10 client.15726 handle_command_reply: tid=0 2024-08-31T06:47:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 client.15726 shutdown 2024-08-31T06:47:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3186482186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d9af840 msgr2=0x55634dd6e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d9af840 0x55634dd6e730 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6c3002ac00 tx=0x7f6c3002ab90 comp rx=0 tx=0).stop 2024-08-31T06:47:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3186482186 shutdown_connections 2024-08-31T06:47:20.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55634d96e1c0 0x55634dd74470 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d9af840 0x55634dd6e730 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 0x55634dd62b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3186482186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d986980 0x55634dd62550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3186482186 >> 172.21.15.37:0/3186482186 conn(0x55634d9a3990 msgr2=0x55634dd53340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c28ff9640 0 client.15726 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3186482186 shutdown_connections 2024-08-31T06:47:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3186482186 wait complete. 2024-08-31T06:47:20.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.279+0000 7f6c4ddb8740 20 client.15726 trim_cache size 0 max 16384 2024-08-31T06:47:20.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c4ddb8740 1 Processor -- start 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c4ddb8740 1 -- start start 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd53d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 0x55634dd6e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d9af840 0x55634dd6ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c401afa30 con 0x55634d986980 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c401ad300 con 0x55634d98eb60 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6c401ab1d0 con 0x55634d9af840 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd53d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd53d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60436/0 (socket says 172.21.15.37:60436) 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c44dde640 1 -- 172.21.15.37:0/3290001957 learned_addr learned my addr 172.21.15.37:0/3290001957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.306+0000 7f6c455df640 1 --2- 172.21.15.37:0/3290001957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 0x55634dd6e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c44dde640 1 -- 172.21.15.37:0/3290001957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d9af840 msgr2=0x55634dd6ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c44dde640 1 --2- 172.21.15.37:0/3290001957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d9af840 0x55634dd6ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c44dde640 1 -- 172.21.15.37:0/3290001957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 msgr2=0x55634dd6e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c44dde640 1 --2- 172.21.15.37:0/3290001957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 0x55634dd6e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c44dde640 1 -- 172.21.15.37:0/3290001957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55634dc8ad90 con 0x55634d986980 2024-08-31T06:47:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c44dde640 1 --2- 172.21.15.37:0/3290001957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd53d00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009850 tx=0x7f6c30009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0a0fee771003d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c2affd640 1 -- 172.21.15.37:0/3290001957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30065070 con 0x55634d986980 2024-08-31T06:47:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c2affd640 1 -- 172.21.15.37:0/3290001957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c30042070 con 0x55634d986980 2024-08-31T06:47:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.307+0000 7f6c2affd640 1 -- 172.21.15.37:0/3290001957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30035040 con 0x55634d986980 2024-08-31T06:47:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.308+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3290001957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 msgr2=0x55634dd53d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.308+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3290001957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd53d00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6c30009850 tx=0x7f6c30009640 comp rx=0 tx=0).stop 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3290001957 shutdown_connections 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3290001957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d9af840 0x55634dd6ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3290001957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d98eb60 0x55634dd6e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/3290001957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd53d00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3290001957 >> 172.21.15.37:0/3290001957 conn(0x55634d9a3990 msgr2=0x55634dd54480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3290001957 shutdown_connections 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/3290001957 wait complete. 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 -- start start 2024-08-31T06:47:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.309+0000 7f6c4ddb8740 1 Processor -- start 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd77b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 0x55634dd74030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c4ddb8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd74570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c401ab820 con 0x55634d986980 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6c401acc30 con 0x55634d9af840 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c4ddb8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6c401abe90 con 0x55634d98eb60 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c4ddb8740 10 client.0 _ll_register_callbacks cb 0x7f6c30031e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd77b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd77b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60446/0 (socket says 172.21.15.37:60446) 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 -- 172.21.15.37:0/2690322482 learned_addr learned my addr 172.21.15.37:0/2690322482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c455df640 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 0x55634dd74030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd74570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 -- 172.21.15.37:0/2690322482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 msgr2=0x55634dd74030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 0x55634dd74030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 -- 172.21.15.37:0/2690322482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 msgr2=0x55634dd74570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd74570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.310+0000 7f6c44dde640 1 -- 172.21.15.37:0/2690322482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55634dd74be0 con 0x55634d986980 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.311+0000 7f6c44dde640 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd77b70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6c3003d010 tx=0x7f6c30057f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ca2e56c02855a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.311+0000 7f6c28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.311+0000 7f6c28ff9640 1 -- 172.21.15.37:0/2690322482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30065040 con 0x55634d986980 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.311+0000 7f6c28ff9640 1 -- 172.21.15.37:0/2690322482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6c3003ba70 con 0x55634d986980 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.311+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2690322482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c30042070 con 0x55634d986980 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.311+0000 7f6c28ff9640 1 -- 172.21.15.37:0/2690322482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6c3003bc70 con 0x55634d986980 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.311+0000 7f6c4ddb8740 10 client.15732 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2690322482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55634dddfa00 con 0x55634d986980 2024-08-31T06:47:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c28ff9640 1 -- 172.21.15.37:0/2690322482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c30073070 con 0x55634d986980 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c28ff9640 1 -- 172.21.15.37:0/2690322482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6c30060720 con 0x55634d986980 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c4ddb8740 10 client.15732 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c4ddb8740 10 client.15732 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c4ddb8740 20 client.15732 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55634d943570 0x55634dde1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c4ddb8740 4 client.15732 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.312+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2690322482 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x55634dcc8d20 con 0x55634d943570 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.313+0000 7f6c455df640 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55634d943570 0x55634dde1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.314+0000 7f6c28ff9640 10 client.15732 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.314+0000 7f6c455df640 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55634d943570 0x55634dde1fb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab9034a9e2a4f450 server_cookie=45c06eeea2656a96 in_seq=0 out_seq=0 2024-08-31T06:47:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c28ff9640 1 -- 172.21.15.37:0/2690322482 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55634dcc8d20 con 0x55634d943570 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c28ff9640 10 client.15732 handle_command_reply: tid=0 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 client.15732 shutdown 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2690322482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 msgr2=0x55634dd77b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd77b70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6c3003d010 tx=0x7f6c30057f60 comp rx=0 tx=0).stop 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2690322482 shutdown_connections 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55634d943570 0x55634dde1fb0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c28ff9640 0 client.15732 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634d9af840 0x55634dd74570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634d98eb60 0x55634dd74030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 --2- 172.21.15.37:0/2690322482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634d986980 0x55634dd77b70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.323+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2690322482 >> 172.21.15.37:0/2690322482 conn(0x55634d9a3990 msgr2=0x55634dd57b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2690322482 shutdown_connections 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c4ddb8740 1 -- 172.21.15.37:0/2690322482 wait complete. 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c4ddb8740 20 client.15732 trim_cache size 0 max 16384 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 25, 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 2, 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-31T06:47:20.326 INFO:teuthology.orchestra.run.smithi037.stdout: "45065ce7": { 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 2, 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 146.4, 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-31T06:47:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-31T06:47:20.328 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:20.328 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:20.328 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:20.328 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:20.328 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:20.328 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c47843640 1 -- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6c2c0b4d60 msgr2=0x7f6c2c0b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c47843640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6c2c0b4d60 0x7f6c2c0b7270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6c380e2ec0 tx=0x7f6c38005730 comp rx=0 tx=0).stop 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c47843640 1 -- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109bd0 msgr2=0x7f6c401a1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c47843640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109bd0 0x7f6c401a1ba0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800eaa0 tx=0x7f6c3800eea0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c47843640 1 -- 172.21.15.37:0/1930799851 shutdown_connections 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c47843640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6c2c0b4d60 0x7f6c2c0b7270 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.324+0000 7f6c47843640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c40109bd0 0x7f6c401a1ba0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.325+0000 7f6c47843640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c40109280 0x7f6c4019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.325+0000 7f6c47843640 1 --2- 172.21.15.37:0/1930799851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c40103940 0x7f6c4019c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.325+0000 7f6c47843640 1 -- 172.21.15.37:0/1930799851 >> 172.21.15.37:0/1930799851 conn(0x7f6c400ff390 msgr2=0x7f6c40107bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.325+0000 7f6c47843640 1 -- 172.21.15.37:0/1930799851 shutdown_connections 2024-08-31T06:47:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:20.325+0000 7f6c47843640 1 -- 172.21.15.37:0/1930799851 wait complete. 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 -- 172.21.15.37:0/1723146683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 msgr2=0x7facd010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 --2- 172.21.15.37:0/1723146683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 0x7facd010d670 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7facc0009900 tx=0x7facc002a410 comp rx=0 tx=0).stop 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 -- 172.21.15.37:0/1723146683 shutdown_connections 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 --2- 172.21.15.37:0/1723146683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 0x7facd010d670 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 --2- 172.21.15.37:0/1723146683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facd010dc00 0x7facd01100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 --2- 172.21.15.37:0/1723146683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facd01047d0 0x7facd0104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 -- 172.21.15.37:0/1723146683 >> 172.21.15.37:0/1723146683 conn(0x7facd0079500 msgr2=0x7facd0079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 -- 172.21.15.37:0/1723146683 shutdown_connections 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.085+0000 7facd79cd640 1 -- 172.21.15.37:0/1723146683 wait complete. 2024-08-31T06:47:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd79cd640 1 Processor -- start 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd79cd640 1 -- start start 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd79cd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facd01047d0 0x7facd019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd79cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 0x7facd019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd79cd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facd010dc00 0x7facd019f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd79cd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7facd01136f0 con 0x7facd0105120 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd79cd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7facd0113570 con 0x7facd01047d0 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd79cd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7facd0113870 con 0x7facd010dc00 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd4f68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 0x7facd019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd4f68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 0x7facd019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60466/0 (socket says 172.21.15.37:60466) 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd4f68640 1 -- 172.21.15.37:0/3907327555 learned_addr learned my addr 172.21.15.37:0/3907327555 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd5769640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facd01047d0 0x7facd019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd5f6a640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facd010dc00 0x7facd019f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd4f68640 1 -- 172.21.15.37:0/3907327555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facd010dc00 msgr2=0x7facd019f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd4f68640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facd010dc00 0x7facd019f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd4f68640 1 -- 172.21.15.37:0/3907327555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facd01047d0 msgr2=0x7facd019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd4f68640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facd01047d0 0x7facd019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd4f68640 1 -- 172.21.15.37:0/3907327555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd01a00d0 con 0x7facd0105120 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.086+0000 7facd5f6a640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facd010dc00 0x7facd019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.087+0000 7facd4f68640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 0x7facd019a700 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7facc0005940 tx=0x7facc00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.087+0000 7facc67fc640 1 -- 172.21.15.37:0/3907327555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc003f030 con 0x7facd0105120 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.087+0000 7facd79cd640 1 -- 172.21.15.37:0/3907327555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd01a0360 con 0x7facd0105120 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.087+0000 7facc67fc640 1 -- 172.21.15.37:0/3907327555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facc0003a80 con 0x7facd0105120 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.087+0000 7facc67fc640 1 -- 172.21.15.37:0/3907327555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0035070 con 0x7facd0105120 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.087+0000 7facd79cd640 1 -- 172.21.15.37:0/3907327555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd01a6b20 con 0x7facd0105120 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.090+0000 7facddf42740 1 Processor -- start 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facddf42740 1 -- start start 2024-08-31T06:47:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facddf42740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f0616070 0x5558f09bb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facddf42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09bb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facc67fc640 1 -- 172.21.15.37:0/3907327555 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7facc0042030 con 0x7facd0105120 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facddf42740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facddf42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5558f0932680 con 0x5558f05ed1b0 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facddf42740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5558f0921c10 con 0x5558f0616070 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facddf42740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5558f0925bc0 con 0x5558f05f5390 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd5769640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09bb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd5769640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09bb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60472/0 (socket says 172.21.15.37:60472) 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd5769640 1 -- 172.21.15.37:0/4085332864 learned_addr learned my addr 172.21.15.37:0/4085332864 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd5f6a640 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f0616070 0x5558f09bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd4f68640 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd5769640 1 -- 172.21.15.37:0/4085332864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 msgr2=0x5558f09bbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd5769640 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09bbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd5769640 1 -- 172.21.15.37:0/4085332864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f0616070 msgr2=0x5558f09bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.091+0000 7facd5769640 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f0616070 0x5558f09bb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facd5769640 1 -- 172.21.15.37:0/4085332864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f0681650 con 0x5558f05ed1b0 2024-08-31T06:47:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facd5f6a640 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f0616070 0x5558f09bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facd5769640 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09bb850 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7faccc00bcb0 tx=0x7faccc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59686e9a48fd729 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facbb7fe640 1 -- 172.21.15.37:0/4085332864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc004020 con 0x5558f05ed1b0 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facbb7fe640 1 -- 172.21.15.37:0/4085332864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faccc0054b0 con 0x5558f05ed1b0 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facbb7fe640 1 -- 172.21.15.37:0/4085332864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc004bc0 con 0x5558f05ed1b0 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facc67fc640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7facbc0b4d30 0x7facbc0b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facd5f6a640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7facbc0b4d30 0x7facbc0b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.092+0000 7facc67fc640 1 -- 172.21.15.37:0/3907327555 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7facc0105c10 con 0x7facd0105120 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facd5f6a640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7facbc0b4d30 0x7facbc0b7240 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7facc8005fd0 tx=0x7facc8009590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 -- 172.21.15.37:0/4085332864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 msgr2=0x5558f09bb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09bb850 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7faccc00bcb0 tx=0x7faccc0107a0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 -- 172.21.15.37:0/4085332864 shutdown_connections 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09bb850 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09bbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 --2- 172.21.15.37:0/4085332864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f0616070 0x5558f09bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 -- 172.21.15.37:0/4085332864 >> 172.21.15.37:0/4085332864 conn(0x5558f060a460 msgr2=0x5558f09b9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 -- 172.21.15.37:0/4085332864 shutdown_connections 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.093+0000 7facddf42740 1 -- 172.21.15.37:0/4085332864 wait complete. 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facddf42740 1 -- start start 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facddf42740 1 Processor -- start 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facddf42740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facddf42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05f5390 0x5558f09cb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facddf42740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 0x5558f09d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facddf42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5558f0784700 con 0x5558f05f5390 2024-08-31T06:47:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facddf42740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5558f08a8750 con 0x5558f05ed1b0 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facddf42740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5558f09cde50 con 0x5558f0616070 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.094+0000 7facd4f68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05f5390 0x5558f09cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd4f68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05f5390 0x5558f09cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60474/0 (socket says 172.21.15.37:60474) 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd4f68640 1 -- 172.21.15.37:0/855135183 learned_addr learned my addr 172.21.15.37:0/855135183 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facddf42740 10 client.0 _ll_register_callbacks cb 0x5558f08d7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd5769640 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd5f6a640 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 0x5558f09d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd4f68640 1 -- 172.21.15.37:0/855135183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 msgr2=0x5558f09d71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd4f68640 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 0x5558f09d71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd4f68640 1 -- 172.21.15.37:0/855135183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 msgr2=0x5558f09cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd4f68640 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd4f68640 1 -- 172.21.15.37:0/855135183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f08e1900 con 0x5558f05f5390 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd5769640 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:21.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facd4f68640 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05f5390 0x5558f09cb330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7facc0004650 tx=0x7facc0003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffb637da2970e8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facb8ff9640 1 -- 172.21.15.37:0/855135183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0049070 con 0x5558f05f5390 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facb8ff9640 1 -- 172.21.15.37:0/855135183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7facc00cc430 con 0x5558f05f5390 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facddf42740 1 -- 172.21.15.37:0/855135183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faccc0054b0 con 0x5558f05f5390 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facb8ff9640 1 -- 172.21.15.37:0/855135183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7facc00cbfa0 con 0x5558f05f5390 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facddf42740 10 client.15744 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.095+0000 7facddf42740 1 -- 172.21.15.37:0/855135183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5558f09d9bb0 con 0x5558f05f5390 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facb8ff9640 1 -- 172.21.15.37:0/855135183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faccc0054b0 con 0x5558f05f5390 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facb8ff9640 1 -- 172.21.15.37:0/855135183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7facc0079080 con 0x5558f05f5390 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facddf42740 10 client.15744 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facddf42740 10 client.15744 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facddf42740 20 client.15744 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facddf42740 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5558f05d49f0 0x5558f09dd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facddf42740 4 client.15744 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facddf42740 1 -- 172.21.15.37:0/855135183 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558f09345d0 con 0x5558f05d49f0 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.096+0000 7facd5769640 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5558f05d49f0 0x5558f09dd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.097+0000 7facd5769640 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5558f05d49f0 0x5558f09dd0e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=375b059e94307765 server_cookie=b86b0be7960bb1c6 in_seq=0 out_seq=0 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.097+0000 7facb8ff9640 10 client.15744 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facb8ff9640 1 -- 172.21.15.37:0/855135183 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5558f09345d0 con 0x5558f05d49f0 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facb8ff9640 10 client.15744 handle_command_reply: tid=0 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 client.15744 shutdown 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 -- 172.21.15.37:0/855135183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05f5390 msgr2=0x5558f09cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05f5390 0x5558f09cb330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7facc0004650 tx=0x7facc0003f90 comp rx=0 tx=0).stop 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 -- 172.21.15.37:0/855135183 shutdown_connections 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5558f05d49f0 0x5558f09dd0e0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05f5390 0x5558f09cb330 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 0x5558f09d71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 --2- 172.21.15.37:0/855135183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 -- 172.21.15.37:0/855135183 >> 172.21.15.37:0/855135183 conn(0x5558f060a460 msgr2=0x5558f09bcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facb8ff9640 0 client.15744 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:47:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 -- 172.21.15.37:0/855135183 shutdown_connections 2024-08-31T06:47:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 1 -- 172.21.15.37:0/855135183 wait complete. 2024-08-31T06:47:21.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.098+0000 7facddf42740 20 client.15744 trim_cache size 0 max 16384 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facddf42740 1 Processor -- start 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facddf42740 1 -- start start 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facddf42740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facddf42740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facddf42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f0616070 0x5558f09c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facddf42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7facd01afa20 con 0x5558f0616070 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facddf42740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7facd01ad2f0 con 0x5558f05ed1b0 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facddf42740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7facd01ab140 con 0x5558f05f5390 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facd5f6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f0616070 0x5558f09c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facd5f6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f0616070 0x5558f09c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60486/0 (socket says 172.21.15.37:60486) 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facd5f6a640 1 -- 172.21.15.37:0/3683832923 learned_addr learned my addr 172.21.15.37:0/3683832923 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facd5769640 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.112+0000 7facd4f68640 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facd5f6a640 1 -- 172.21.15.37:0/3683832923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 msgr2=0x5558f09c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facd5f6a640 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facd5f6a640 1 -- 172.21.15.37:0/3683832923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 msgr2=0x5558f09c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facd5f6a640 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facd5f6a640 1 -- 172.21.15.37:0/3683832923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f05d4c10 con 0x5558f0616070 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facd4f68640 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facd5f6a640 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f0616070 0x5558f09c7fe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7facc80128e0 tx=0x7facc8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11860841a6f83b0f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facbaffd640 1 -- 172.21.15.37:0/3683832923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8012e60 con 0x5558f0616070 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facbaffd640 1 -- 172.21.15.37:0/3683832923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facc8020430 con 0x5558f0616070 2024-08-31T06:47:21.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.113+0000 7facbaffd640 1 -- 172.21.15.37:0/3683832923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc8028630 con 0x5558f0616070 2024-08-31T06:47:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 -- 172.21.15.37:0/3683832923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f0616070 msgr2=0x5558f09c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f0616070 0x5558f09c7fe0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7facc80128e0 tx=0x7facc8014000 comp rx=0 tx=0).stop 2024-08-31T06:47:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 -- 172.21.15.37:0/3683832923 shutdown_connections 2024-08-31T06:47:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f0616070 0x5558f09c7fe0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f05f5390 0x5558f09c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 --2- 172.21.15.37:0/3683832923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05ed1b0 0x5558f09c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 -- 172.21.15.37:0/3683832923 >> 172.21.15.37:0/3683832923 conn(0x5558f060a460 msgr2=0x5558f09c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 -- 172.21.15.37:0/3683832923 shutdown_connections 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.114+0000 7facddf42740 1 -- 172.21.15.37:0/3683832923 wait complete. 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 1 -- start start 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 1 Processor -- start 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09d3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05f5390 0x5558f09cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 0x5558f09cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7facd01ab7b0 con 0x5558f05ed1b0 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7facd01acc20 con 0x5558f05f5390 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7facd01abe80 con 0x5558f0616070 2024-08-31T06:47:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facddf42740 10 client.0 _ll_register_callbacks cb 0x7facc0103170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facd5769640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09d3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facd5769640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09d3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60500/0 (socket says 172.21.15.37:60500) 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facd5769640 1 -- 172.21.15.37:0/1398534668 learned_addr learned my addr 172.21.15.37:0/1398534668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.115+0000 7facd4f68640 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05f5390 0x5558f09cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facd5f6a640 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 0x5558f09cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facd5769640 1 -- 172.21.15.37:0/1398534668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 msgr2=0x5558f09cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facd5769640 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 0x5558f09cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facd5769640 1 -- 172.21.15.37:0/1398534668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05f5390 msgr2=0x5558f09cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facd5769640 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05f5390 0x5558f09cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facd5769640 1 -- 172.21.15.37:0/1398534668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f0a46a70 con 0x5558f05ed1b0 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facd5769640 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09d3b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x5558f09b9f90 tx=0x7faccc005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1a87dcfd3304b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facb8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facb8ff9640 1 -- 172.21.15.37:0/1398534668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc034060 con 0x5558f05ed1b0 2024-08-31T06:47:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facddf42740 1 -- 172.21.15.37:0/1398534668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc8020430 con 0x5558f05ed1b0 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facb8ff9640 1 -- 172.21.15.37:0/1398534668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7faccc0052d0 con 0x5558f05ed1b0 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facb8ff9640 1 -- 172.21.15.37:0/1398534668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faccc0035f0 con 0x5558f05ed1b0 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facddf42740 10 client.15750 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.116+0000 7facddf42740 1 -- 172.21.15.37:0/1398534668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5558f0a47bf0 con 0x5558f05ed1b0 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facb8ff9640 1 -- 172.21.15.37:0/1398534668 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7facc8020430 con 0x5558f05ed1b0 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facb8ff9640 1 -- 172.21.15.37:0/1398534668 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faccc02e070 con 0x5558f05ed1b0 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facddf42740 10 client.15750 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facddf42740 10 client.15750 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facddf42740 20 client.15750 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facddf42740 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5558f05a9da0 0x5558f0a4a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facddf42740 4 client.15750 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facddf42740 1 -- 172.21.15.37:0/1398534668 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5558f0930070 con 0x5558f05a9da0 2024-08-31T06:47:21.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.117+0000 7facd4f68640 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5558f05a9da0 0x5558f0a4a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facd4f68640 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5558f05a9da0 0x5558f0a4a040 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c637b73b4ee183dd server_cookie=9f70bf9fc8a8b357 in_seq=0 out_seq=0 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facb8ff9640 10 client.15750 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facb8ff9640 1 -- 172.21.15.37:0/1398534668 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5558f0930070 con 0x5558f05a9da0 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facb8ff9640 10 client.15750 handle_command_reply: tid=0 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 client.15750 shutdown 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 -- 172.21.15.37:0/1398534668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 msgr2=0x5558f09d3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09d3b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x5558f09b9f90 tx=0x7faccc005be0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 -- 172.21.15.37:0/1398534668 shutdown_connections 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5558f05a9da0 0x5558f0a4a040 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5558f0616070 0x5558f09cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facb8ff9640 0 client.15750 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5558f05f5390 0x5558f09cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 --2- 172.21.15.37:0/1398534668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5558f05ed1b0 0x5558f09d3b30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.118+0000 7facddf42740 1 -- 172.21.15.37:0/1398534668 >> 172.21.15.37:0/1398534668 conn(0x5558f060a460 msgr2=0x5558f09bc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facddf42740 1 -- 172.21.15.37:0/1398534668 shutdown_connections 2024-08-31T06:47:21.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facddf42740 1 -- 172.21.15.37:0/1398534668 wait complete. 2024-08-31T06:47:21.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facddf42740 20 client.15750 trim_cache size 0 max 16384 2024-08-31T06:47:21.124 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:47:21.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 -- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7facbc0b4d30 msgr2=0x7facbc0b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7facbc0b4d30 0x7facbc0b7240 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7facc8005fd0 tx=0x7facc8009590 comp rx=0 tx=0).stop 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 -- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 msgr2=0x7facd019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 0x7facd019a700 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7facc0005940 tx=0x7facc00040e0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 -- 172.21.15.37:0/3907327555 shutdown_connections 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7facbc0b4d30 0x7facbc0b7240 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facd0105120 0x7facd019a700 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facd010dc00 0x7facd019f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 --2- 172.21.15.37:0/3907327555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facd01047d0 0x7facd019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.119+0000 7facd79cd640 1 -- 172.21.15.37:0/3907327555 >> 172.21.15.37:0/3907327555 conn(0x7facd0079500 msgr2=0x7facd0100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.120+0000 7facd79cd640 1 -- 172.21.15.37:0/3907327555 shutdown_connections 2024-08-31T06:47:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:21.120+0000 7facd79cd640 1 -- 172.21.15.37:0/3907327555 wait complete. 2024-08-31T06:47:21.656 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '45065ce7', quiesce took 4.8 seconds. Will release after: 21.599999999999998 2024-08-31T06:47:21.716 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:21 smithi037 ceph-mon[18612]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-08-31T06:47:21.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:21 smithi106 ceph-mon[22134]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-08-31T06:47:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.820+0000 7fdee0e53640 1 -- 172.21.15.37:0/1556417417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 msgr2=0x7fdedc102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.820+0000 7fdee0e53640 1 --2- 172.21.15.37:0/1556417417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 0x7fdedc102bb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009900 tx=0x7fdecc02a410 comp rx=0 tx=0).stop 2024-08-31T06:47:21.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.820+0000 7fdee0e53640 1 -- 172.21.15.37:0/1556417417 shutdown_connections 2024-08-31T06:47:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.820+0000 7fdee0e53640 1 --2- 172.21.15.37:0/1556417417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdedc108a10 0x7fdedc10f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.820+0000 7fdee0e53640 1 --2- 172.21.15.37:0/1556417417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdedc1080c0 0x7fdedc1084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.820+0000 7fdee0e53640 1 --2- 172.21.15.37:0/1556417417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 0x7fdedc102bb0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.820+0000 7fdee0e53640 1 -- 172.21.15.37:0/1556417417 >> 172.21.15.37:0/1556417417 conn(0x7fdedc078450 msgr2=0x7fdedc078860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.820+0000 7fdee0e53640 1 -- 172.21.15.37:0/1556417417 shutdown_connections 2024-08-31T06:47:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.821+0000 7fdee0e53640 1 -- 172.21.15.37:0/1556417417 wait complete. 2024-08-31T06:47:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.821+0000 7fdee0e53640 1 Processor -- start 2024-08-31T06:47:21.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.821+0000 7fdee0e53640 1 -- start start 2024-08-31T06:47:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdee0e53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 0x7fdedc19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdee0e53640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdedc1080c0 0x7fdedc19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdee0e53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdedc108a10 0x7fdedc19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdee0e53640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc112570 con 0x7fdedc1027a0 2024-08-31T06:47:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdee0e53640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1123f0 con 0x7fdedc108a10 2024-08-31T06:47:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdee0e53640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1126f0 con 0x7fdedc1080c0 2024-08-31T06:47:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 0x7fdedc19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 0x7fdedc19a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60514/0 (socket says 172.21.15.37:60514) 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 -- 172.21.15.37:0/2237245222 learned_addr learned my addr 172.21.15.37:0/2237245222 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fded9d9b640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdedc1080c0 0x7fdedc19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdedad9d640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdedc108a10 0x7fdedc19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 -- 172.21.15.37:0/2237245222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdedc1080c0 msgr2=0x7fdedc19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdedc1080c0 0x7fdedc19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 -- 172.21.15.37:0/2237245222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdedc108a10 msgr2=0x7fdedc19f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdedc108a10 0x7fdedc19f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 -- 172.21.15.37:0/2237245222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdedc1a00b0 con 0x7fdedc1027a0 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.822+0000 7fdeda59c640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 0x7fdedc19a180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009230 tx=0x7fdecc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.823+0000 7fdecb7fe640 1 -- 172.21.15.37:0/2237245222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc03f030 con 0x7fdedc1027a0 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.823+0000 7fdecb7fe640 1 -- 172.21.15.37:0/2237245222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdecc003a80 con 0x7fdedc1027a0 2024-08-31T06:47:21.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.823+0000 7fdecb7fe640 1 -- 172.21.15.37:0/2237245222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc035070 con 0x7fdedc1027a0 2024-08-31T06:47:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.823+0000 7fdee0e53640 1 -- 172.21.15.37:0/2237245222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdedc1a0340 con 0x7fdedc1027a0 2024-08-31T06:47:21.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.823+0000 7fdee0e53640 1 -- 172.21.15.37:0/2237245222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdedc1a07e0 con 0x7fdedc1027a0 2024-08-31T06:47:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.825+0000 7fdee7dc1740 1 Processor -- start 2024-08-31T06:47:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdee7dc1740 1 -- start start 2024-08-31T06:47:21.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d551b0 0x564a090f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 0x564a090f9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdecb7fe640 1 -- 172.21.15.37:0/2237245222 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7fdecc042030 con 0x7fdedc1027a0 2024-08-31T06:47:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a090f9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564a0906e000 con 0x564a08d551b0 2024-08-31T06:47:21.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564a0905d590 con 0x564a08d344d0 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564a09061540 con 0x564a08d2c2f0 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdedad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d551b0 0x564a090f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdedad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d551b0 0x564a090f8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60516/0 (socket says 172.21.15.37:60516) 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdedad9d640 1 -- 172.21.15.37:0/4118749966 learned_addr learned my addr 172.21.15.37:0/4118749966 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdeda59c640 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 0x564a090f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fded9d9b640 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a090f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdedad9d640 1 -- 172.21.15.37:0/4118749966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 msgr2=0x564a090f9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdedad9d640 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 0x564a090f9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdedad9d640 1 -- 172.21.15.37:0/4118749966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 msgr2=0x564a090f9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdedad9d640 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a090f9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fdedad9d640 1 -- 172.21.15.37:0/4118749966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a08dc0790 con 0x564a08d551b0 2024-08-31T06:47:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.826+0000 7fded9d9b640 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a090f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.827+0000 7fdedad9d640 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d551b0 0x564a090f8ce0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fded4009ee0 tx=0x7fded4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ce5b5abc67674e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.827+0000 7fdec8ff9640 1 -- 172.21.15.37:0/4118749966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4016070 con 0x564a08d551b0 2024-08-31T06:47:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.827+0000 7fdec8ff9640 1 -- 172.21.15.37:0/4118749966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fded4004d20 con 0x564a08d551b0 2024-08-31T06:47:21.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.827+0000 7fdec8ff9640 1 -- 172.21.15.37:0/4118749966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded40126b0 con 0x564a08d551b0 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.827+0000 7fdecb7fe640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdec40b4d30 0x7fdec40b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.827+0000 7fdeda59c640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdec40b4d30 0x7fdec40b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.827+0000 7fdecb7fe640 1 -- 172.21.15.37:0/2237245222 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fdecc105e40 con 0x7fdedc1027a0 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 -- 172.21.15.37:0/4118749966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d551b0 msgr2=0x564a090f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d551b0 0x564a090f8ce0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fded4009ee0 tx=0x7fded4010740 comp rx=0 tx=0).stop 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdeda59c640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdec40b4d30 0x7fdec40b7240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdecc103570 tx=0x7fdecc1096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 -- 172.21.15.37:0/4118749966 shutdown_connections 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a090f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 0x564a090f9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/4118749966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d551b0 0x564a090f8ce0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 -- 172.21.15.37:0/4118749966 >> 172.21.15.37:0/4118749966 conn(0x564a08d49300 msgr2=0x564a090f6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 -- 172.21.15.37:0/4118749966 shutdown_connections 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 -- 172.21.15.37:0/4118749966 wait complete. 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 -- start start 2024-08-31T06:47:21.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.828+0000 7fdee7dc1740 1 Processor -- start 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d2c2f0 0x564a09104930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a09104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d551b0 0x564a09110750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564a08f96ab0 con 0x564a08d344d0 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564a08fe4680 con 0x564a08d2c2f0 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564a09107460 con 0x564a08d551b0 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdee7dc1740 10 client.0 _ll_register_callbacks cb 0x564a08d6ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a09104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a09104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60518/0 (socket says 172.21.15.37:60518) 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 -- 172.21.15.37:0/3937188325 learned_addr learned my addr 172.21.15.37:0/3937188325 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d2c2f0 0x564a09104930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d551b0 0x564a09110750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 -- 172.21.15.37:0/3937188325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d551b0 msgr2=0x564a09110750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d551b0 0x564a09110750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 -- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d2c2f0 msgr2=0x564a09104930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d2c2f0 0x564a09104930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 -- 172.21.15.37:0/3937188325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a08e39620 con 0x564a08d344d0 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d2c2f0 0x564a09104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fded9d9b640 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a09104ef0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fded000b910 tx=0x7fded000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfaafe7f27af177 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.829+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3937188325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0005020 con 0x564a08d344d0 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3937188325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fded00051c0 con 0x564a08d344d0 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3937188325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fded4004d20 con 0x564a08d344d0 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3937188325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fded00053c0 con 0x564a08d344d0 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 10 client.15762 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3937188325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564a091134f0 con 0x564a08d344d0 2024-08-31T06:47:21.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3937188325 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fded4004d20 con 0x564a08d344d0 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3937188325 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fded0012650 con 0x564a08d344d0 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 10 client.15762 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 10 client.15762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 20 client.15762 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564a08d13d80 0x564a09116aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 4 client.15762 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.830+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3937188325 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a0906ff50 con 0x564a08d13d80 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.831+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564a08d13d80 0x564a09116aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.831+0000 7fdec1ffb640 10 client.15762 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.831+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564a08d13d80 0x564a09116aa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93f4597d4e6f7a16 server_cookie=5d478a5d927d7f74 in_seq=0 out_seq=0 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3937188325 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a0906ff50 con 0x564a08d13d80 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdec1ffb640 10 client.15762 handle_command_reply: tid=0 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 client.15762 shutdown 2024-08-31T06:47:21.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3937188325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 msgr2=0x564a09104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a09104ef0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fded000b910 tx=0x7fded000bdd0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3937188325 shutdown_connections 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564a08d13d80 0x564a09116aa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a09104ef0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d551b0 0x564a09110750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdec1ffb640 0 client.15762 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3937188325 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d2c2f0 0x564a09104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3937188325 >> 172.21.15.37:0/3937188325 conn(0x564a08d49300 msgr2=0x564a090f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3937188325 shutdown_connections 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3937188325 wait complete. 2024-08-31T06:47:21.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.832+0000 7fdee7dc1740 20 client.15762 trim_cache size 0 max 16384 2024-08-31T06:47:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdee7dc1740 1 Processor -- start 2024-08-31T06:47:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdee7dc1740 1 -- start start 2024-08-31T06:47:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d13d80 0x564a09104300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 0x564a090f6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a090f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1b1c10 con 0x564a08d344d0 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1af4e0 con 0x564a08d13d80 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1ad330 con 0x564a08d2c2f0 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.847+0000 7fdedad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a090f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a090f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60520/0 (socket says 172.21.15.37:60520) 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 -- 172.21.15.37:0/1261286363 learned_addr learned my addr 172.21.15.37:0/1261286363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fded9d9b640 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 0x564a090f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d13d80 0x564a09104300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 -- 172.21.15.37:0/1261286363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 msgr2=0x564a090f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 0x564a090f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 -- 172.21.15.37:0/1261286363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d13d80 msgr2=0x564a09104300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d13d80 0x564a09104300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 -- 172.21.15.37:0/1261286363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a09102c00 con 0x564a08d344d0 2024-08-31T06:47:21.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdedad9d640 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a090f66c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fded4011010 tx=0x7fded40097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55660633e4de086 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdec3fff640 1 -- 172.21.15.37:0/1261286363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4016040 con 0x564a08d344d0 2024-08-31T06:47:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdec3fff640 1 -- 172.21.15.37:0/1261286363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fded40129f0 con 0x564a08d344d0 2024-08-31T06:47:21.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.848+0000 7fdec3fff640 1 -- 172.21.15.37:0/1261286363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded40308a0 con 0x564a08d344d0 2024-08-31T06:47:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 -- 172.21.15.37:0/1261286363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 msgr2=0x564a090f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a090f66c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fded4011010 tx=0x7fded40097e0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 -- 172.21.15.37:0/1261286363 shutdown_connections 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d344d0 0x564a090f66c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d2c2f0 0x564a090f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/1261286363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d13d80 0x564a09104300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 -- 172.21.15.37:0/1261286363 >> 172.21.15.37:0/1261286363 conn(0x564a08d49300 msgr2=0x564a09103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 -- 172.21.15.37:0/1261286363 shutdown_connections 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.849+0000 7fdee7dc1740 1 -- 172.21.15.37:0/1261286363 wait complete. 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 1 -- start start 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 1 Processor -- start 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d13d80 0x564a0910cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d2c2f0 0x564a09108180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a091086c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1ad9a0 con 0x564a08d2c2f0 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1aee10 con 0x564a08d344d0 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdedc1ae070 con 0x564a08d13d80 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdee7dc1740 10 client.0 _ll_register_callbacks cb 0x7fded0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fded9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d2c2f0 0x564a09108180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fded9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d2c2f0 0x564a09108180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60522/0 (socket says 172.21.15.37:60522) 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fded9d9b640 1 -- 172.21.15.37:0/3018458737 learned_addr learned my addr 172.21.15.37:0/3018458737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a091086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.850+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d13d80 0x564a0910cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fded9d9b640 1 -- 172.21.15.37:0/3018458737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d13d80 msgr2=0x564a0910cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fded9d9b640 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d13d80 0x564a0910cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fded9d9b640 1 -- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 msgr2=0x564a091086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fded9d9b640 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a091086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fded9d9b640 1 -- 172.21.15.37:0/3018458737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a09108cb0 con 0x564a08d2c2f0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a091086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fded9d9b640 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d2c2f0 0x564a09108180 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fded0001eb0 tx=0x7fded0004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f69c82ff619748 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3018458737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0027040 con 0x564a08d2c2f0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3018458737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fded0012450 con 0x564a08d2c2f0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3018458737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fded40129f0 con 0x564a08d2c2f0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3018458737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fded0012650 con 0x564a08d2c2f0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdee7dc1740 10 client.15768 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3018458737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564a09181220 con 0x564a08d2c2f0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.851+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3018458737 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fded40129f0 con 0x564a08d2c2f0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.852+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3018458737 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fded001a420 con 0x564a08d2c2f0 2024-08-31T06:47:21.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.852+0000 7fdee7dc1740 10 client.15768 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.852+0000 7fdee7dc1740 10 client.15768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.852+0000 7fdee7dc1740 20 client.15768 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.852+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564a08d551b0 0x564a09183a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.852+0000 7fdee7dc1740 4 client.15768 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:47:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.852+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3018458737 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a0906b9f0 con 0x564a08d551b0 2024-08-31T06:47:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.852+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564a08d551b0 0x564a09183a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.853+0000 7fdec1ffb640 10 client.15768 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:21.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.853+0000 7fdedad9d640 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564a08d551b0 0x564a09183a10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e718c6ec7afb58e server_cookie=f0512159fb887aa8 in_seq=0 out_seq=0 2024-08-31T06:47:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdec1ffb640 1 -- 172.21.15.37:0/3018458737 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a0906b9f0 con 0x564a08d551b0 2024-08-31T06:47:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdec1ffb640 10 client.15768 handle_command_reply: tid=0 2024-08-31T06:47:21.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 client.15768 shutdown 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3018458737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d2c2f0 msgr2=0x564a09108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d2c2f0 0x564a09108180 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fded0001eb0 tx=0x7fded0004520 comp rx=0 tx=0).stop 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3018458737 shutdown_connections 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564a08d551b0 0x564a09183a10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564a08d2c2f0 0x564a09108180 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564a08d344d0 0x564a091086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdec1ffb640 0 client.15768 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 --2- 172.21.15.37:0/3018458737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564a08d13d80 0x564a0910cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3018458737 >> 172.21.15.37:0/3018458737 conn(0x564a08d49300 msgr2=0x564a090f9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3018458737 shutdown_connections 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 1 -- 172.21.15.37:0/3018458737 wait complete. 2024-08-31T06:47:21.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.857+0000 7fdee7dc1740 20 client.15768 trim_cache size 0 max 16384 2024-08-31T06:47:21.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:47:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:47:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:47:21.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 -- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdec40b4d30 msgr2=0x7fdec40b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdec40b4d30 0x7fdec40b7240 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdecc103570 tx=0x7fdecc1096a0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 -- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 msgr2=0x7fdedc19a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 0x7fdedc19a180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fdecc009230 tx=0x7fdecc004270 comp rx=0 tx=0).stop 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 -- 172.21.15.37:0/2237245222 shutdown_connections 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdec40b4d30 0x7fdec40b7240 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdedc108a10 0x7fdedc19f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdedc1080c0 0x7fdedc19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 --2- 172.21.15.37:0/2237245222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdedc1027a0 0x7fdedc19a180 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 -- 172.21.15.37:0/2237245222 >> 172.21.15.37:0/2237245222 conn(0x7fdedc078450 msgr2=0x7fdedc06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 -- 172.21.15.37:0/2237245222 shutdown_connections 2024-08-31T06:47:21.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:21.858+0000 7fdee0e53640 1 -- 172.21.15.37:0/2237245222 wait complete. 2024-08-31T06:47:21.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:21 smithi066 ceph-mon[22244]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-08-31T06:47:22.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:47:23.176 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:23.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:23 smithi037 ceph-mon[18612]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-31T06:47:23.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:23 smithi106 ceph-mon[22134]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-31T06:47:23.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:23 smithi066 ceph-mon[22244]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-31T06:47:25.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:25 smithi037 ceph-mon[18612]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-31T06:47:25.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:25 smithi106 ceph-mon[22134]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.873+0000 7f7c807c8640 1 -- 172.21.15.37:0/968538717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7810db90 msgr2=0x7f7c781100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.873+0000 7f7c807c8640 1 --2- 172.21.15.37:0/968538717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7810db90 0x7f7c781100a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009ca0 tx=0x7f7c7002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.873+0000 7f7c807c8640 1 -- 172.21.15.37:0/968538717 shutdown_connections 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.873+0000 7f7c807c8640 1 --2- 172.21.15.37:0/968538717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7810db90 0x7f7c781100a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.873+0000 7f7c807c8640 1 --2- 172.21.15.37:0/968538717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c78105010 0x7f7c7810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.873+0000 7f7c807c8640 1 --2- 172.21.15.37:0/968538717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c781045e0 0x7f7c781049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.873+0000 7f7c807c8640 1 -- 172.21.15.37:0/968538717 >> 172.21.15.37:0/968538717 conn(0x7f7c780794d0 msgr2=0x7f7c780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.874+0000 7f7c807c8640 1 -- 172.21.15.37:0/968538717 shutdown_connections 2024-08-31T06:47:25.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.874+0000 7f7c807c8640 1 -- 172.21.15.37:0/968538717 wait complete. 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.874+0000 7f7c807c8640 1 Processor -- start 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.874+0000 7f7c807c8640 1 -- start start 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c807c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c781045e0 0x7f7c781024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c807c8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c78105010 0x7f7c78102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c807c8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c7810db90 0x7f7c78102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c807c8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78113710 con 0x7f7c781045e0 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c807c8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78113590 con 0x7f7c78105010 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c807c8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78113890 con 0x7f7c7810db90 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7e564640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c781045e0 0x7f7c781024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7e564640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c781045e0 0x7f7c781024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48836/0 (socket says 172.21.15.37:48836) 2024-08-31T06:47:25.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7e564640 1 -- 172.21.15.37:0/3830073969 learned_addr learned my addr 172.21.15.37:0/3830073969 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c7810db90 0x7f7c78102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c78105010 0x7f7c78102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7e564640 1 -- 172.21.15.37:0/3830073969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c7810db90 msgr2=0x7f7c78102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7e564640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c7810db90 0x7f7c78102f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7e564640 1 -- 172.21.15.37:0/3830073969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c78105010 msgr2=0x7f7c78102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7e564640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c78105010 0x7f7c78102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.875+0000 7f7c7e564640 1 -- 172.21.15.37:0/3830073969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c781a83a0 con 0x7f7c781045e0 2024-08-31T06:47:25.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.876+0000 7f7c7e564640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c781045e0 0x7f7c781024f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400d770 tx=0x7f7c7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:25.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.876+0000 7f7c6f7fe640 1 -- 172.21.15.37:0/3830073969 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74017070 con 0x7f7c781045e0 2024-08-31T06:47:25.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.876+0000 7f7c807c8640 1 -- 172.21.15.37:0/3830073969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c781a8690 con 0x7f7c781045e0 2024-08-31T06:47:25.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.876+0000 7f7c6f7fe640 1 -- 172.21.15.37:0/3830073969 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c74009c30 con 0x7f7c781045e0 2024-08-31T06:47:25.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.877+0000 7f7c6f7fe640 1 -- 172.21.15.37:0/3830073969 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74003c50 con 0x7f7c781045e0 2024-08-31T06:47:25.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.877+0000 7f7c807c8640 1 -- 172.21.15.37:0/3830073969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c781a8c20 con 0x7f7c781045e0 2024-08-31T06:47:25.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.880+0000 7f7c6f7fe640 1 -- 172.21.15.37:0/3830073969 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f7c74003df0 con 0x7f7c781045e0 2024-08-31T06:47:25.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c86d3d740 1 Processor -- start 2024-08-31T06:47:25.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c86d3d740 1 -- start start 2024-08-31T06:47:25.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c6f7fe640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c640b4d30 0x7f7c640b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded41070 0x5585df0e6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0e6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c640b4d30 0x7f7c640b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded20390 0x5585df0e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5585df05d680 con 0x5585ded20390 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.881+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5585df04cc10 con 0x5585ded181b0 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5585df050bc0 con 0x5585ded41070 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7e564640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded41070 0x5585df0e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7e564640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded41070 0x5585df0e6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:58290/0 (socket says 172.21.15.37:58290) 2024-08-31T06:47:25.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7e564640 1 -- 172.21.15.37:0/3282415420 learned_addr learned my addr 172.21.15.37:0/3282415420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded20390 0x5585df0e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7e564640 1 -- 172.21.15.37:0/3282415420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 msgr2=0x5585df0e6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7e564640 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0e6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7e564640 1 -- 172.21.15.37:0/3282415420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded20390 msgr2=0x5585df0e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7e564640 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded20390 0x5585df0e6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7e564640 1 -- 172.21.15.37:0/3282415420 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585dedac650 con 0x5585ded41070 2024-08-31T06:47:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.882+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded20390 0x5585df0e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.883+0000 7f7c7e564640 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded41070 0x5585df0e6350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c74082300 tx=0x7f7c740a5bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf9be406a8c250c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.883+0000 7f7c6cff9640 1 -- 172.21.15.37:0/3282415420 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400f3c0 con 0x5585ded41070 2024-08-31T06:47:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.883+0000 7f7c6f7fe640 1 -- 172.21.15.37:0/3830073969 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7c740e50b0 con 0x7f7c781045e0 2024-08-31T06:47:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.883+0000 7f7c6cff9640 1 -- 172.21.15.37:0/3282415420 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c74009de0 con 0x5585ded41070 2024-08-31T06:47:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.883+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c640b4d30 0x7f7c640b7240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c70006010 tx=0x7f7c700093d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.884+0000 7f7c6cff9640 1 -- 172.21.15.37:0/3282415420 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400f590 con 0x5585ded41070 2024-08-31T06:47:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.884+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3282415420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded41070 msgr2=0x5585df0e6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.884+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded41070 0x5585df0e6350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c74082300 tx=0x7f7c740a5bd0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.884+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3282415420 shutdown_connections 2024-08-31T06:47:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.884+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded20390 0x5585df0e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.884+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0e6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.884+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/3282415420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded41070 0x5585df0e6350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.884+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3282415420 >> 172.21.15.37:0/3282415420 conn(0x5585ded35460 msgr2=0x5585df0e4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.885+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3282415420 shutdown_connections 2024-08-31T06:47:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.885+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3282415420 wait complete. 2024-08-31T06:47:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.885+0000 7f7c86d3d740 1 -- start start 2024-08-31T06:47:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.885+0000 7f7c86d3d740 1 Processor -- start 2024-08-31T06:47:25.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:25 smithi066 ceph-mon[22244]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded181b0 0x5585df0f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded20390 0x5585df0f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0fdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c7ed65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0fdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c7ed65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0fdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48852/0 (socket says 172.21.15.37:48852) 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c7ed65640 1 -- 172.21.15.37:0/775234266 learned_addr learned my addr 172.21.15.37:0/775234266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5585deeaf700 con 0x5585ded41070 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5585defd3750 con 0x5585ded20390 2024-08-31T06:47:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5585df0f4b80 con 0x5585ded181b0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c7e564640 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded181b0 0x5585df0f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.886+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded20390 0x5585df0f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c7e564640 1 -- 172.21.15.37:0/775234266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded20390 msgr2=0x5585df0f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c7e564640 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded20390 0x5585df0f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c7e564640 1 -- 172.21.15.37:0/775234266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 msgr2=0x5585df0fdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c7e564640 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0fdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c7e564640 1 -- 172.21.15.37:0/775234266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585df00c900 con 0x5585ded181b0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0fdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c7e564640 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded181b0 0x5585df0f19f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c740e2810 tx=0x7f7c74000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=899b3ef9381bf7ab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c86d3d740 10 client.0 _ll_register_callbacks cb 0x5585df002e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c74009de0 con 0x5585ded181b0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c61ffb640 1 -- 172.21.15.37:0/775234266 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74020070 con 0x5585ded181b0 2024-08-31T06:47:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.887+0000 7f7c61ffb640 1 -- 172.21.15.37:0/775234266 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7c7400ecb0 con 0x5585ded181b0 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c61ffb640 1 -- 172.21.15.37:0/775234266 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c7400fcc0 con 0x5585ded181b0 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c86d3d740 10 client.25339 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5585df100290 con 0x5585ded181b0 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c61ffb640 1 -- 172.21.15.37:0/775234266 <== mon.1 v2:172.21.15.106:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7c740e2a30 con 0x5585ded181b0 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c86d3d740 10 client.25339 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c86d3d740 10 client.25339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c86d3d740 20 client.25339 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5585decff9f0 0x5585df103750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c86d3d740 4 client.25339 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7c74009de0 con 0x5585decff9f0 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.888+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5585decff9f0 0x5585df103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.889+0000 7f7c61ffb640 10 client.25339 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.889+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5585decff9f0 0x5585df103750 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fff7e714d8ec63c4 server_cookie=980ba579e90daac5 in_seq=0 out_seq=0 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c61ffb640 1 -- 172.21.15.37:0/775234266 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7c74009de0 con 0x5585decff9f0 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c61ffb640 10 client.25339 handle_command_reply: tid=0 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 client.25339 shutdown 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded181b0 msgr2=0x5585df0f19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded181b0 0x5585df0f19f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c740e2810 tx=0x7f7c74000bc0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 shutdown_connections 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5585decff9f0 0x5585df103750 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0fdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded20390 0x5585df0f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/775234266 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded181b0 0x5585df0f19f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.890+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 >> 172.21.15.37:0/775234266 conn(0x5585ded35460 msgr2=0x5585df0e94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.891+0000 7f7c61ffb640 0 client.25339 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.891+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 shutdown_connections 2024-08-31T06:47:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.891+0000 7f7c86d3d740 1 -- 172.21.15.37:0/775234266 wait complete. 2024-08-31T06:47:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.891+0000 7f7c86d3d740 20 client.25339 trim_cache size 0 max 16384 2024-08-31T06:47:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c86d3d740 1 Processor -- start 2024-08-31T06:47:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c86d3d740 1 -- start start 2024-08-31T06:47:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 0x5585df0fddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0e3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781b3dd0 con 0x5585ded41070 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781b16a0 con 0x5585ded181b0 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781af4f0 con 0x5585ded20390 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c7ed65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c7ed65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0e3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48860/0 (socket says 172.21.15.37:48860) 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c7ed65640 1 -- 172.21.15.37:0/3349072656 learned_addr learned my addr 172.21.15.37:0/3349072656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c7e564640 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.917+0000 7f7c7ed65640 1 -- 172.21.15.37:0/3349072656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 msgr2=0x5585df0fddc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 0x5585df0fddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c7ed65640 1 -- 172.21.15.37:0/3349072656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 msgr2=0x5585df0f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c7ed65640 1 -- 172.21.15.37:0/3349072656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585df0e4b30 con 0x5585ded41070 2024-08-31T06:47:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c7e564640 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0e3810 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7c70031fa0 tx=0x7f7c70040070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e62bb9a2e8b5f84 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c63fff640 1 -- 172.21.15.37:0/3349072656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70004040 con 0x5585ded41070 2024-08-31T06:47:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c63fff640 1 -- 172.21.15.37:0/3349072656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c70053070 con 0x5585ded41070 2024-08-31T06:47:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.918+0000 7f7c63fff640 1 -- 172.21.15.37:0/3349072656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70030aa0 con 0x5585ded41070 2024-08-31T06:47:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.919+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3349072656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 msgr2=0x5585df0e3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.919+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0e3810 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7c70031fa0 tx=0x7f7c70040070 comp rx=0 tx=0).stop 2024-08-31T06:47:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3349072656 shutdown_connections 2024-08-31T06:47:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded41070 0x5585df0e3810 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 0x5585df0fddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/3349072656 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded181b0 0x5585df0f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3349072656 >> 172.21.15.37:0/3349072656 conn(0x5585ded35460 msgr2=0x5585df0f17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3349072656 shutdown_connections 2024-08-31T06:47:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 -- 172.21.15.37:0/3349072656 wait complete. 2024-08-31T06:47:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 -- start start 2024-08-31T06:47:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.920+0000 7f7c86d3d740 1 Processor -- start 2024-08-31T06:47:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded181b0 0x5585df0fa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 0x5585df0f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c86d3d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded41070 0x5585df0f6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781afb60 con 0x5585ded181b0 2024-08-31T06:47:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781b0fd0 con 0x5585ded41070 2024-08-31T06:47:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c86d3d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781b0230 con 0x5585ded20390 2024-08-31T06:47:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c86d3d740 10 client.0 _ll_register_callbacks cb 0x7f7c740abe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded181b0 0x5585df0fa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded181b0 0x5585df0fa610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48872/0 (socket says 172.21.15.37:48872) 2024-08-31T06:47:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 -- 172.21.15.37:0/2152247681 learned_addr learned my addr 172.21.15.37:0/2152247681 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 0x5585df0f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded41070 0x5585df0f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 -- 172.21.15.37:0/2152247681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 msgr2=0x5585df0f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 0x5585df0f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 -- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded41070 msgr2=0x5585df0f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded41070 0x5585df0f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 -- 172.21.15.37:0/2152247681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585df0f6790 con 0x5585ded181b0 2024-08-31T06:47:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 0x5585df0f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7ed65640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded41070 0x5585df0f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c7e564640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded181b0 0x5585df0fa610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7c740ab600 tx=0x7f7c740a5bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148c0ac319fd3c18 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.921+0000 7f7c61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.922+0000 7f7c61ffb640 1 -- 172.21.15.37:0/2152247681 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74020070 con 0x5585ded181b0 2024-08-31T06:47:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.922+0000 7f7c61ffb640 1 -- 172.21.15.37:0/2152247681 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7c74085280 con 0x5585ded181b0 2024-08-31T06:47:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.922+0000 7f7c86d3d740 1 -- 172.21.15.37:0/2152247681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c70053070 con 0x5585ded181b0 2024-08-31T06:47:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.922+0000 7f7c61ffb640 1 -- 172.21.15.37:0/2152247681 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7c7400e350 con 0x5585ded181b0 2024-08-31T06:47:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.922+0000 7f7c86d3d740 10 client.15786 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.922+0000 7f7c86d3d740 1 -- 172.21.15.37:0/2152247681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5585df1768b0 con 0x5585ded181b0 2024-08-31T06:47:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.922+0000 7f7c61ffb640 1 -- 172.21.15.37:0/2152247681 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c70053070 con 0x5585ded181b0 2024-08-31T06:47:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.923+0000 7f7c61ffb640 1 -- 172.21.15.37:0/2152247681 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7c7405b200 con 0x5585ded181b0 2024-08-31T06:47:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.923+0000 7f7c86d3d740 10 client.15786 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.923+0000 7f7c86d3d740 10 client.15786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.923+0000 7f7c86d3d740 20 client.15786 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.923+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5585decd4da0 0x5585df178df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.923+0000 7f7c86d3d740 4 client.15786 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:47:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.923+0000 7f7c86d3d740 1 -- 172.21.15.37:0/2152247681 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585df05f5d0 con 0x5585decd4da0 2024-08-31T06:47:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.923+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5585decd4da0 0x5585df178df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c7dd63640 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5585decd4da0 0x5585df178df0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adc36eda3c3a5871 server_cookie=4a9037855a1af1e in_seq=0 out_seq=0 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c61ffb640 10 client.15786 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c61ffb640 1 -- 172.21.15.37:0/2152247681 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585df05f5d0 con 0x5585decd4da0 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c61ffb640 10 client.15786 handle_command_reply: tid=0 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 client.15786 shutdown 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 -- 172.21.15.37:0/2152247681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded181b0 msgr2=0x5585df0fa610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded181b0 0x5585df0fa610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f7c740ab600 tx=0x7f7c740a5bd0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 -- 172.21.15.37:0/2152247681 shutdown_connections 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5585decd4da0 0x5585df178df0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c61ffb640 0 client.15786 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5585ded41070 0x5585df0f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585ded20390 0x5585df0f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 --2- 172.21.15.37:0/2152247681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5585ded181b0 0x5585df0fa610 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.924+0000 7f7c86d3d740 1 -- 172.21.15.37:0/2152247681 >> 172.21.15.37:0/2152247681 conn(0x5585ded35460 msgr2=0x5585df0f2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.925+0000 7f7c86d3d740 1 -- 172.21.15.37:0/2152247681 shutdown_connections 2024-08-31T06:47:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.925+0000 7f7c86d3d740 1 -- 172.21.15.37:0/2152247681 wait complete. 2024-08-31T06:47:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.925+0000 7f7c86d3d740 20 client.15786 trim_cache size 0 max 16384 2024-08-31T06:47:25.937 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:47:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.925+0000 7f7c807c8640 1 -- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c640b4d30 msgr2=0x7f7c640b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.925+0000 7f7c807c8640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c640b4d30 0x7f7c640b7240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c70006010 tx=0x7f7c700093d0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.925+0000 7f7c807c8640 1 -- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c781045e0 msgr2=0x7f7c781024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.925+0000 7f7c807c8640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c781045e0 0x7f7c781024f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400d770 tx=0x7f7c7400dc30 comp rx=0 tx=0).stop 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.926+0000 7f7c807c8640 1 -- 172.21.15.37:0/3830073969 shutdown_connections 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.926+0000 7f7c807c8640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7c640b4d30 0x7f7c640b7240 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.926+0000 7f7c807c8640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c7810db90 0x7f7c78102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.926+0000 7f7c807c8640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c78105010 0x7f7c78102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.926+0000 7f7c807c8640 1 --2- 172.21.15.37:0/3830073969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c781045e0 0x7f7c781024f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.926+0000 7f7c807c8640 1 -- 172.21.15.37:0/3830073969 >> 172.21.15.37:0/3830073969 conn(0x7f7c780794d0 msgr2=0x7f7c78100520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.926+0000 7f7c807c8640 1 -- 172.21.15.37:0/3830073969 shutdown_connections 2024-08-31T06:47:25.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:25.926+0000 7f7c807c8640 1 -- 172.21.15.37:0/3830073969 wait complete. 2024-08-31T06:47:27.597 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:47:27.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:47:27.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:27 smithi106 ceph-mon[22134]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:27.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:27 smithi037 ceph-mon[18612]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:27.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:27 smithi066 ceph-mon[22244]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:27.914 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 -- 172.21.15.37:0/2162421679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 msgr2=0x7f32d4102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 --2- 172.21.15.37:0/2162421679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 0x7f32d4102c10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009900 tx=0x7f32d002a410 comp rx=0 tx=0).stop 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 -- 172.21.15.37:0/2162421679 shutdown_connections 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 --2- 172.21.15.37:0/2162421679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32d4108a90 0x7f32d410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 --2- 172.21.15.37:0/2162421679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32d4108140 0x7f32d4108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 --2- 172.21.15.37:0/2162421679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 0x7f32d4102c10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 -- 172.21.15.37:0/2162421679 >> 172.21.15.37:0/2162421679 conn(0x7f32d40794d0 msgr2=0x7f32d40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 -- 172.21.15.37:0/2162421679 shutdown_connections 2024-08-31T06:47:28.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.455+0000 7f32dc251640 1 -- 172.21.15.37:0/2162421679 wait complete. 2024-08-31T06:47:28.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.456+0000 7f32dc251640 1 Processor -- start 2024-08-31T06:47:28.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.456+0000 7f32dc251640 1 -- start start 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32dc251640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 0x7f32d419a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32dc251640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32d4108140 0x7f32d419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32dc251640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32d4108a90 0x7f32d419f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32dc251640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41125c0 con 0x7f32d4102800 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32dc251640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4112440 con 0x7f32d4108a90 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32dc251640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4112740 con 0x7f32d4108140 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d9fed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 0x7f32d419a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d9fed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 0x7f32d419a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48888/0 (socket says 172.21.15.37:48888) 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d9fed640 1 -- 172.21.15.37:0/2253797021 learned_addr learned my addr 172.21.15.37:0/2253797021 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d97ec640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32d4108140 0x7f32d419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32da7ee640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32d4108a90 0x7f32d419f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d9fed640 1 -- 172.21.15.37:0/2253797021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32d4108140 msgr2=0x7f32d419a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d9fed640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32d4108140 0x7f32d419a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d9fed640 1 -- 172.21.15.37:0/2253797021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32d4108a90 msgr2=0x7f32d419f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d9fed640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32d4108a90 0x7f32d419f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.457+0000 7f32d9fed640 1 -- 172.21.15.37:0/2253797021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d41a00b0 con 0x7f32d4102800 2024-08-31T06:47:28.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.458+0000 7f32d9fed640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 0x7f32d419a140 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009230 tx=0x7f32d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:28.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.458+0000 7f32caffd640 1 -- 172.21.15.37:0/2253797021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d003f030 con 0x7f32d4102800 2024-08-31T06:47:28.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.458+0000 7f32dc251640 1 -- 172.21.15.37:0/2253797021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d41a0340 con 0x7f32d4102800 2024-08-31T06:47:28.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.458+0000 7f32caffd640 1 -- 172.21.15.37:0/2253797021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d0003a80 con 0x7f32d4102800 2024-08-31T06:47:28.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.458+0000 7f32caffd640 1 -- 172.21.15.37:0/2253797021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0035070 con 0x7f32d4102800 2024-08-31T06:47:28.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.458+0000 7f32dc251640 1 -- 172.21.15.37:0/2253797021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d4109290 con 0x7f32d4102800 2024-08-31T06:47:28.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.461+0000 7f32e27c6740 1 Processor -- start 2024-08-31T06:47:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.461+0000 7f32e27c6740 1 -- start start 2024-08-31T06:47:28.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.461+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7ec5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.461+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 0x55dea7ec5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.461+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 0x55dea7ec6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.461+0000 7f32e27c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dea7e3b5f0 con 0x55dea7b1f350 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.461+0000 7f32e27c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dea7e2ab80 con 0x55dea7af6490 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.461+0000 7f32e27c6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dea7e2eb30 con 0x55dea7afe670 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32da7ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7ec5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32da7ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7ec5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48890/0 (socket says 172.21.15.37:48890) 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32da7ee640 1 -- 172.21.15.37:0/1273822026 learned_addr learned my addr 172.21.15.37:0/1273822026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:28.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32d97ec640 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 0x55dea7ec6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32d97ec640 1 -- 172.21.15.37:0/1273822026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 msgr2=0x55dea7ec5cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:47:28.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32d97ec640 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 0x55dea7ec5cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32d97ec640 1 -- 172.21.15.37:0/1273822026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 msgr2=0x55dea7ec5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:28.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32d97ec640 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7ec5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32d97ec640 1 -- 172.21.15.37:0/1273822026 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dea7b8a930 con 0x55dea7afe670 2024-08-31T06:47:28.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32da7ee640 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7ec5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:28.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32d97ec640 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 0x55dea7ec6200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005fd0 tx=0x7f32c400bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91faab31f81273bc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:28.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.462+0000 7f32caffd640 1 -- 172.21.15.37:0/2253797021 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f32d0042030 con 0x7f32d4102800 2024-08-31T06:47:28.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.463+0000 7f32bffff640 1 -- 172.21.15.37:0/1273822026 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4003ba0 con 0x55dea7afe670 2024-08-31T06:47:28.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.463+0000 7f32bffff640 1 -- 172.21.15.37:0/1273822026 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32c4015070 con 0x55dea7afe670 2024-08-31T06:47:28.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.463+0000 7f32bffff640 1 -- 172.21.15.37:0/1273822026 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4004b80 con 0x55dea7afe670 2024-08-31T06:47:28.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.463+0000 7f32caffd640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f32c00b4d30 0x7f32c00b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32da7ee640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f32c00b4d30 0x7f32c00b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32caffd640 1 -- 172.21.15.37:0/2253797021 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f32d0105d90 con 0x7f32d4102800 2024-08-31T06:47:28.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 -- 172.21.15.37:0/1273822026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 msgr2=0x55dea7ec6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 0x55dea7ec6200 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005fd0 tx=0x7f32c400bb20 comp rx=0 tx=0).stop 2024-08-31T06:47:28.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 -- 172.21.15.37:0/1273822026 shutdown_connections 2024-08-31T06:47:28.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 0x55dea7ec6200 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 0x55dea7ec5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 --2- 172.21.15.37:0/1273822026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7ec5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 -- 172.21.15.37:0/1273822026 >> 172.21.15.37:0/1273822026 conn(0x55dea7b13740 msgr2=0x55dea7ec3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 -- 172.21.15.37:0/1273822026 shutdown_connections 2024-08-31T06:47:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32da7ee640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f32c00b4d30 0x7f32c00b7240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f32cc005f40 tx=0x7f32cc009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.464+0000 7f32e27c6740 1 -- 172.21.15.37:0/1273822026 wait complete. 2024-08-31T06:47:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.465+0000 7f32e27c6740 1 -- start start 2024-08-31T06:47:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.465+0000 7f32e27c6740 1 Processor -- start 2024-08-31T06:47:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.465+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 0x55dea7ed1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7edd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32e27c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dea7c8d890 con 0x55dea7b1f350 2024-08-31T06:47:28.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32e27c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dea7db1790 con 0x55dea7afe670 2024-08-31T06:47:28.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32e27c6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dea7ed3f60 con 0x55dea7af6490 2024-08-31T06:47:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32e27c6740 10 client.0 _ll_register_callbacks cb 0x55dea7b36ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32da7ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7edd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32d9fed640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 0x55dea7ed1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32da7ee640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7edd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48894/0 (socket says 172.21.15.37:48894) 2024-08-31T06:47:28.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32da7ee640 1 -- 172.21.15.37:0/4002156502 learned_addr learned my addr 172.21.15.37:0/4002156502 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32d97ec640 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32d9fed640 1 -- 172.21.15.37:0/4002156502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 msgr2=0x55dea7ed15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32d9fed640 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32d9fed640 1 -- 172.21.15.37:0/4002156502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 msgr2=0x55dea7edd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32d9fed640 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7edd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32d9fed640 1 -- 172.21.15.37:0/4002156502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dea7de8f30 con 0x55dea7af6490 2024-08-31T06:47:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32d9fed640 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 0x55dea7ed1010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32d0103460 tx=0x7f32d00c8390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bae29e8dfcc1f76 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:28.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.466+0000 7f32bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:47:28.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32bd7fa640 1 -- 172.21.15.37:0/4002156502 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0049070 con 0x55dea7af6490 2024-08-31T06:47:28.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32bd7fa640 1 -- 172.21.15.37:0/4002156502 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f32d0103710 con 0x55dea7af6490 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 1 -- 172.21.15.37:0/4002156502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32c4015070 con 0x55dea7af6490 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32bd7fa640 1 -- 172.21.15.37:0/4002156502 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f32d0103910 con 0x55dea7af6490 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 10 client.25354 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 1 -- 172.21.15.37:0/4002156502 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dea7edfdf0 con 0x55dea7af6490 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32bd7fa640 1 -- 172.21.15.37:0/4002156502 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32c4015070 con 0x55dea7af6490 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32bd7fa640 1 -- 172.21.15.37:0/4002156502 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f32d00cc660 con 0x55dea7af6490 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 10 client.25354 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 10 client.25354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 20 client.25354 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dea7addcd0 0x55dea7ee3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 4 client.25354 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.467+0000 7f32e27c6740 1 -- 172.21.15.37:0/4002156502 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dea7e3d540 con 0x55dea7addcd0 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.468+0000 7f32d97ec640 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dea7addcd0 0x55dea7ee3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.468+0000 7f32bd7fa640 10 client.25354 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.468+0000 7f32d97ec640 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dea7addcd0 0x55dea7ee3240 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bed8f77d315f93bb server_cookie=b041d9a7a56c62e7 in_seq=0 out_seq=0 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32bd7fa640 1 -- 172.21.15.37:0/4002156502 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dea7e3d540 con 0x55dea7addcd0 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32bd7fa640 10 client.25354 handle_command_reply: tid=0 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 client.25354 shutdown 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 -- 172.21.15.37:0/4002156502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 msgr2=0x55dea7ed1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 0x55dea7ed1010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32d0103460 tx=0x7f32d00c8390 comp rx=0 tx=0).stop 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 -- 172.21.15.37:0/4002156502 shutdown_connections 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dea7addcd0 0x55dea7ee3240 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32bd7fa640 0 client.25354 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7b1f350 0x55dea7edd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4002156502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 0x55dea7ed1010 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 -- 172.21.15.37:0/4002156502 >> 172.21.15.37:0/4002156502 conn(0x55dea7b13740 msgr2=0x55dea7ec8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:28.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 -- 172.21.15.37:0/4002156502 shutdown_connections 2024-08-31T06:47:28.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.469+0000 7f32e27c6740 1 -- 172.21.15.37:0/4002156502 wait complete. 2024-08-31T06:47:28.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.470+0000 7f32e27c6740 20 client.25354 trim_cache size 0 max 16384 2024-08-31T06:47:28.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32e27c6740 1 Processor -- start 2024-08-31T06:47:28.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32e27c6740 1 -- start start 2024-08-31T06:47:28.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ec9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 0x55dea7ec36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32e27c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b3d20 con 0x55dea7addcd0 2024-08-31T06:47:28.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32e27c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b15f0 con 0x55dea7afe670 2024-08-31T06:47:28.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32e27c6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41af440 con 0x55dea7af6490 2024-08-31T06:47:28.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32d9fed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ec9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32d9fed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ec9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48906/0 (socket says 172.21.15.37:48906) 2024-08-31T06:47:28.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.488+0000 7f32d9fed640 1 -- 172.21.15.37:0/4084172831 learned_addr learned my addr 172.21.15.37:0/4084172831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32da7ee640 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32d9fed640 1 -- 172.21.15.37:0/4084172831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 msgr2=0x55dea7ec36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32d9fed640 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 0x55dea7ec36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32d9fed640 1 -- 172.21.15.37:0/4084172831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 msgr2=0x55dea7ed2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32d9fed640 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32d9fed640 1 -- 172.21.15.37:0/4084172831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dea7ebeb80 con 0x55dea7addcd0 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32d9fed640 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ec9240 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f32d00c9670 tx=0x7f32d002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e6b2900c109cf3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32da7ee640 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32bf7fe640 1 -- 172.21.15.37:0/4084172831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0049070 con 0x55dea7addcd0 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32bf7fe640 1 -- 172.21.15.37:0/4084172831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d00cbf10 con 0x55dea7addcd0 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.489+0000 7f32bf7fe640 1 -- 172.21.15.37:0/4084172831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d00d5670 con 0x55dea7addcd0 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.490+0000 7f32e27c6740 1 -- 172.21.15.37:0/4084172831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 msgr2=0x55dea7ec9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.490+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ec9240 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f32d00c9670 tx=0x7f32d002a410 comp rx=0 tx=0).stop 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.490+0000 7f32e27c6740 1 -- 172.21.15.37:0/4084172831 shutdown_connections 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.490+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7afe670 0x55dea7ed2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.491+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7af6490 0x55dea7ec36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.491+0000 7f32e27c6740 1 --2- 172.21.15.37:0/4084172831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ec9240 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.491+0000 7f32e27c6740 1 -- 172.21.15.37:0/4084172831 >> 172.21.15.37:0/4084172831 conn(0x55dea7b13740 msgr2=0x55dea7ed2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.491+0000 7f32e27c6740 1 -- 172.21.15.37:0/4084172831 shutdown_connections 2024-08-31T06:47:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.491+0000 7f32e27c6740 1 -- 172.21.15.37:0/4084172831 wait complete. 2024-08-31T06:47:28.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.491+0000 7f32e27c6740 1 -- start start 2024-08-31T06:47:28.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.491+0000 7f32e27c6740 1 Processor -- start 2024-08-31T06:47:28.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ed5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 0x55dea7ed6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32e27c6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 0x55dea7f46da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32e27c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41afab0 con 0x55dea7addcd0 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32e27c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b0f20 con 0x55dea7af6490 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32e27c6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f32d41b0180 con 0x55dea7afe670 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32d9fed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ed5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32e27c6740 10 client.0 _ll_register_callbacks cb 0x7f32d01032f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32d9fed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ed5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48918/0 (socket says 172.21.15.37:48918) 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.492+0000 7f32d9fed640 1 -- 172.21.15.37:0/3390272680 learned_addr learned my addr 172.21.15.37:0/3390272680 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32d97ec640 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 0x55dea7ed6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32d9fed640 1 -- 172.21.15.37:0/3390272680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 msgr2=0x55dea7f46da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:28.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32d9fed640 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 0x55dea7f46da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32d9fed640 1 -- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 msgr2=0x55dea7ed6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32d9fed640 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 0x55dea7ed6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32d9fed640 1 -- 172.21.15.37:0/3390272680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dea7f47410 con 0x55dea7addcd0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32d97ec640 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 0x55dea7ed6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32d9fed640 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ed5ce0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f32d00ef2e0 tx=0x7f32d0003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e191faeceb2e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32bd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32bd7fa640 1 -- 172.21.15.37:0/3390272680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0049070 con 0x55dea7addcd0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32bd7fa640 1 -- 172.21.15.37:0/3390272680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f32d0103710 con 0x55dea7addcd0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32e27c6740 1 -- 172.21.15.37:0/3390272680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32d00cbf10 con 0x55dea7addcd0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.493+0000 7f32bd7fa640 1 -- 172.21.15.37:0/3390272680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f32d00cbd50 con 0x55dea7addcd0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32e27c6740 10 client.15804 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32e27c6740 1 -- 172.21.15.37:0/3390272680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dea7f47410 con 0x55dea7addcd0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32bd7fa640 1 -- 172.21.15.37:0/3390272680 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32d00cbf10 con 0x55dea7addcd0 2024-08-31T06:47:28.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32bd7fa640 1 -- 172.21.15.37:0/3390272680 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f32d00cb660 con 0x55dea7addcd0 2024-08-31T06:47:28.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32e27c6740 10 client.15804 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:28.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32e27c6740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:28.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32e27c6740 20 client.15804 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:28.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32e27c6740 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dea7b1f350 0x55dea7f50a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:28.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32e27c6740 4 client.15804 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:47:28.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.494+0000 7f32e27c6740 1 -- 172.21.15.37:0/3390272680 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dea7e38fe0 con 0x55dea7b1f350 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.495+0000 7f32d97ec640 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dea7b1f350 0x55dea7f50a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.495+0000 7f32d97ec640 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dea7b1f350 0x55dea7f50a70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9fbe449e8a54b7a server_cookie=94d78bc4d2d69a2a in_seq=0 out_seq=0 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.496+0000 7f32bd7fa640 10 client.15804 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.497+0000 7f32bd7fa640 1 -- 172.21.15.37:0/3390272680 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dea7e38fe0 con 0x55dea7b1f350 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.497+0000 7f32bd7fa640 10 client.15804 handle_command_reply: tid=0 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.497+0000 7f32e27c6740 1 client.15804 shutdown 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.497+0000 7f32e27c6740 1 -- 172.21.15.37:0/3390272680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 msgr2=0x55dea7ed5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.497+0000 7f32e27c6740 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ed5ce0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f32d00ef2e0 tx=0x7f32d0003e60 comp rx=0 tx=0).stop 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 1 -- 172.21.15.37:0/3390272680 shutdown_connections 2024-08-31T06:47:28.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dea7b1f350 0x55dea7f50a70 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dea7afe670 0x55dea7f46da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32bd7fa640 0 client.15804 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dea7af6490 0x55dea7ed6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 1 --2- 172.21.15.37:0/3390272680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dea7addcd0 0x55dea7ed5ce0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 1 -- 172.21.15.37:0/3390272680 >> 172.21.15.37:0/3390272680 conn(0x55dea7b13740 msgr2=0x55dea7ec9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 1 -- 172.21.15.37:0/3390272680 shutdown_connections 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 1 -- 172.21.15.37:0/3390272680 wait complete. 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.498+0000 7f32e27c6740 20 client.15804 trim_cache size 0 max 16384 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:47:28.501 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:47:28.502 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "83d4af95-2f90-4f54-ad46-35c0bccd0728", 2024-08-31T06:47:28.502 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:47:28.502 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:47:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 -- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f32c00b4d30 msgr2=0x7f32c00b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f32c00b4d30 0x7f32c00b7240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f32cc005f40 tx=0x7f32cc009600 comp rx=0 tx=0).stop 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 -- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 msgr2=0x7f32d419a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 0x7f32d419a140 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009230 tx=0x7f32d0004270 comp rx=0 tx=0).stop 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 -- 172.21.15.37:0/2253797021 shutdown_connections 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f32c00b4d30 0x7f32c00b7240 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32d4108a90 0x7f32d419f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32d4108140 0x7f32d419a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 --2- 172.21.15.37:0/2253797021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32d4102800 0x7f32d419a140 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 -- 172.21.15.37:0/2253797021 >> 172.21.15.37:0/2253797021 conn(0x7f32d40794d0 msgr2=0x7f32d41002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 -- 172.21.15.37:0/2253797021 shutdown_connections 2024-08-31T06:47:28.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:28.499+0000 7f32dc251640 1 -- 172.21.15.37:0/2253797021 wait complete. 2024-08-31T06:47:29.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:47:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:29 smithi037 ceph-mon[18612]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:29 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:47:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:29 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:47:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:29 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:47:29.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:29 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:47:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:29.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:29 smithi106 ceph-mon[22134]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:29.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:29 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:47:29.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:29 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:47:29.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:29 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:47:29.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:29 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:47:29.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:29 smithi066 ceph-mon[22244]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:29.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:29 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:47:29.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:29 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:47:29.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:29 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:47:29.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:29 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:47:30.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 -- 172.21.15.37:0/4283798255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 msgr2=0x7fe6ac104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 --2- 172.21.15.37:0/4283798255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 0x7fe6ac104b60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009900 tx=0x7fe69c02a410 comp rx=0 tx=0).stop 2024-08-31T06:47:30.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 -- 172.21.15.37:0/4283798255 shutdown_connections 2024-08-31T06:47:30.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 --2- 172.21.15.37:0/4283798255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac10dbb0 0x7fe6ac1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 --2- 172.21.15.37:0/4283798255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6ac1050a0 0x7fe6ac10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 --2- 172.21.15.37:0/4283798255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 0x7fe6ac104b60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 -- 172.21.15.37:0/4283798255 >> 172.21.15.37:0/4283798255 conn(0x7fe6ac0794d0 msgr2=0x7fe6ac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:30.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 -- 172.21.15.37:0/4283798255 shutdown_connections 2024-08-31T06:47:30.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.228+0000 7fe6b2336640 1 -- 172.21.15.37:0/4283798255 wait complete. 2024-08-31T06:47:30.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.229+0000 7fe6b2336640 1 Processor -- start 2024-08-31T06:47:30.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.229+0000 7fe6b2336640 1 -- start start 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.229+0000 7fe6b2336640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 0x7fe6ac19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.229+0000 7fe6b2336640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac1050a0 0x7fe6ac19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.229+0000 7fe6abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 0x7fe6ac19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 0x7fe6ac19a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48930/0 (socket says 172.21.15.37:48930) 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6b2336640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6ac10dbb0 0x7fe6ac19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6abfff640 1 -- 172.21.15.37:0/3576365203 learned_addr learned my addr 172.21.15.37:0/3576365203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac1136c0 con 0x7fe6ac104750 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac113540 con 0x7fe6ac1050a0 2024-08-31T06:47:30.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ac113840 con 0x7fe6ac10dbb0 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac1050a0 0x7fe6ac19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6ac10dbb0 0x7fe6ac19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6abfff640 1 -- 172.21.15.37:0/3576365203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6ac10dbb0 msgr2=0x7fe6ac19f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6abfff640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6ac10dbb0 0x7fe6ac19f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6abfff640 1 -- 172.21.15.37:0/3576365203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac1050a0 msgr2=0x7fe6ac19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6abfff640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac1050a0 0x7fe6ac19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6abfff640 1 -- 172.21.15.37:0/3576365203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ac1a00c0 con 0x7fe6ac104750 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.230+0000 7fe6abfff640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 0x7fe6ac19a150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005940 tx=0x7fe69c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.231+0000 7fe6a97fa640 1 -- 172.21.15.37:0/3576365203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c03f030 con 0x7fe6ac104750 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.231+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ac1a0350 con 0x7fe6ac104750 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.231+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ac1a6b10 con 0x7fe6ac104750 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.231+0000 7fe6a97fa640 1 -- 172.21.15.37:0/3576365203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe69c004440 con 0x7fe6ac104750 2024-08-31T06:47:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.231+0000 7fe6a97fa640 1 -- 172.21.15.37:0/3576365203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69c035070 con 0x7fe6ac104750 2024-08-31T06:47:30.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.233+0000 7fe6b88ab740 1 Processor -- start 2024-08-31T06:47:30.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b88ab740 1 -- start start 2024-08-31T06:47:30.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb86800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7c0390 0x55644cb86d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55644cafd630 con 0x55644c7e1070 2024-08-31T06:47:30.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55644caecbc0 con 0x55644c7c0390 2024-08-31T06:47:30.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55644caf0b70 con 0x55644c7b81b0 2024-08-31T06:47:30.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6a97fa640 1 -- 172.21.15.37:0/3576365203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7fe69c042030 con 0x7fe6ac104750 2024-08-31T06:47:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b08d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b08d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb862c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48944/0 (socket says 172.21.15.37:48944) 2024-08-31T06:47:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6b08d3640 1 -- 172.21.15.37:0/1099337061 learned_addr learned my addr 172.21.15.37:0/1099337061 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.234+0000 7fe6abfff640 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb86800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7c0390 0x55644cb86d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6b08d3640 1 -- 172.21.15.37:0/1099337061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 msgr2=0x55644cb86800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb86800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6b08d3640 1 -- 172.21.15.37:0/1099337061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7c0390 msgr2=0x55644cb86d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7c0390 0x55644cb86d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6b08d3640 1 -- 172.21.15.37:0/1099337061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55644c84c650 con 0x55644c7e1070 2024-08-31T06:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7c0390 0x55644cb86d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6a97fa640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe6940b4db0 0x7fe6940b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb862c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4011440 tx=0x7fe6a4011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dae68f134200589 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.235+0000 7fe6927fc640 1 -- 172.21.15.37:0/1099337061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4004d20 con 0x55644c7e1070 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.236+0000 7fe6927fc640 1 -- 172.21.15.37:0/1099337061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a4004050 con 0x55644c7e1070 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.236+0000 7fe6927fc640 1 -- 172.21.15.37:0/1099337061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a400f780 con 0x55644c7e1070 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.236+0000 7fe6a97fa640 1 -- 172.21.15.37:0/3576365203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe69c1057e0 con 0x7fe6ac104750 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.236+0000 7fe6abfff640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe6940b4db0 0x7fe6940b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1099337061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 msgr2=0x55644cb862c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6abfff640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe6940b4db0 0x7fe6940b72c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe69c102f10 tx=0x7fe69c02a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb862c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4011440 tx=0x7fe6a4011900 comp rx=0 tx=0).stop 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1099337061 shutdown_connections 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7c0390 0x55644cb86d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb86800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1099337061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb862c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1099337061 >> 172.21.15.37:0/1099337061 conn(0x55644c7d5460 msgr2=0x55644cb841b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:30.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1099337061 shutdown_connections 2024-08-31T06:47:30.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1099337061 wait complete. 2024-08-31T06:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.237+0000 7fe6b88ab740 1 -- start start 2024-08-31T06:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6b88ab740 1 Processor -- start 2024-08-31T06:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb95e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7c0390 0x55644cb96380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cba2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55644c94f700 con 0x55644c7c0390 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55644ca73700 con 0x55644c7e1070 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55644cb98dd0 con 0x55644c7b81b0 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6b88ab740 10 client.0 _ll_register_callbacks cb 0x55644caa2dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7c0390 0x55644cb96380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7c0390 0x55644cb96380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48958/0 (socket says 172.21.15.37:48958) 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.238+0000 7fe6ab7fe640 1 -- 172.21.15.37:0/1383438962 learned_addr learned my addr 172.21.15.37:0/1383438962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb95e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe6ab7fe640 1 -- 172.21.15.37:0/1383438962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 msgr2=0x55644cb95e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb95e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe6ab7fe640 1 -- 172.21.15.37:0/1383438962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 msgr2=0x55644cba2190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:47:30.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cba2190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe6ab7fe640 1 -- 172.21.15.37:0/1383438962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55644caac8b0 con 0x55644c7c0390 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7c0390 0x55644cb96380 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000baa0 tx=0x7fe6a000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f3968faa76b329 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe68b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.239+0000 7fe68b7fe640 1 -- 172.21.15.37:0/1383438962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a001b640 con 0x55644c7c0390 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe68b7fe640 1 -- 172.21.15.37:0/1383438962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe6a001b7e0 con 0x55644c7c0390 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1383438962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a4004050 con 0x55644c7c0390 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe68b7fe640 1 -- 172.21.15.37:0/1383438962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6a001b9e0 con 0x55644c7c0390 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe6b88ab740 10 client.15816 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1383438962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55644cba4d00 con 0x55644c7c0390 2024-08-31T06:47:30.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe68b7fe640 1 -- 172.21.15.37:0/1383438962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a4004050 con 0x55644c7c0390 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe68b7fe640 1 -- 172.21.15.37:0/1383438962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe6a0019020 con 0x55644c7c0390 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe6b88ab740 10 client.15816 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe6b88ab740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.240+0000 7fe6b88ab740 20 client.15816 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.241+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55644c79f9f0 0x55644cba8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.241+0000 7fe6b88ab740 4 client.15816 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.241+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1383438962 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55644caff580 con 0x55644c79f9f0 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.241+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55644c79f9f0 0x55644cba8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.241+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55644c79f9f0 0x55644cba8310 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e0434d4144d56a server_cookie=c96af0ecf2364a9a in_seq=0 out_seq=0 2024-08-31T06:47:30.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.241+0000 7fe68b7fe640 10 client.15816 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe68b7fe640 1 -- 172.21.15.37:0/1383438962 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55644caff580 con 0x55644c79f9f0 2024-08-31T06:47:30.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe68b7fe640 10 client.15816 handle_command_reply: tid=0 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe6b88ab740 1 client.15816 shutdown 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1383438962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7c0390 msgr2=0x55644cb96380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7c0390 0x55644cb96380 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000baa0 tx=0x7fe6a000bf60 comp rx=0 tx=0).stop 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1383438962 shutdown_connections 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55644c79f9f0 0x55644cba8310 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7c0390 0x55644cb96380 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cba2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.242+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/1383438962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb95e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.243+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1383438962 >> 172.21.15.37:0/1383438962 conn(0x55644c7d5460 msgr2=0x55644cb89450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.243+0000 7fe68b7fe640 0 client.15816 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:30.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.243+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1383438962 shutdown_connections 2024-08-31T06:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.243+0000 7fe6b88ab740 1 -- 172.21.15.37:0/1383438962 wait complete. 2024-08-31T06:47:30.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.243+0000 7fe6b88ab740 20 client.15816 trim_cache size 0 max 16384 2024-08-31T06:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6b88ab740 1 Processor -- start 2024-08-31T06:47:30.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6b88ab740 1 -- start start 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb95e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb97a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c774da0 0x55644cba2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe698010fd0 con 0x55644c7e1070 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe69800e8a0 con 0x55644c774da0 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe69800c6f0 con 0x55644c7b81b0 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb97a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb97a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48968/0 (socket says 172.21.15.37:48968) 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.277+0000 7fe6ab7fe640 1 -- 172.21.15.37:0/2283030901 learned_addr learned my addr 172.21.15.37:0/2283030901 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe6ab7fe640 1 -- 172.21.15.37:0/2283030901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 msgr2=0x55644cb95e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2283030901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb95e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe6ab7fe640 1 -- 172.21.15.37:0/2283030901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c774da0 msgr2=0x55644cba2090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:47:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2283030901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c774da0 0x55644cba2090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe6ab7fe640 1 -- 172.21.15.37:0/2283030901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55644cb94da0 con 0x55644c7e1070 2024-08-31T06:47:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2283030901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb97a70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0011ae0 tx=0x7fe6a0003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d557496355f23ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe691ffb640 1 -- 172.21.15.37:0/2283030901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0031070 con 0x55644c7e1070 2024-08-31T06:47:30.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe691ffb640 1 -- 172.21.15.37:0/2283030901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a0011d50 con 0x55644c7e1070 2024-08-31T06:47:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.278+0000 7fe691ffb640 1 -- 172.21.15.37:0/2283030901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0028070 con 0x55644c7e1070 2024-08-31T06:47:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.279+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2283030901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 msgr2=0x55644cb97a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.279+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2283030901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb97a70 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0011ae0 tx=0x7fe6a0003e90 comp rx=0 tx=0).stop 2024-08-31T06:47:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.280+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2283030901 shutdown_connections 2024-08-31T06:47:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.280+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2283030901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7e1070 0x55644cb97a70 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.280+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2283030901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c774da0 0x55644cba2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.280+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2283030901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c7b81b0 0x55644cb95e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.280+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2283030901 >> 172.21.15.37:0/2283030901 conn(0x55644c7d5460 msgr2=0x55644cb97360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:30.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.280+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2283030901 shutdown_connections 2024-08-31T06:47:30.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.280+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2283030901 wait complete. 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.280+0000 7fe6b88ab740 1 -- start start 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b88ab740 1 Processor -- start 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c774da0 0x55644cb9e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7b81b0 0x55644cb9ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b88ab740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cb9b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe69800cd60 con 0x55644c7b81b0 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe69800e1d0 con 0x55644c7e1070 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b88ab740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe69800d430 con 0x55644c774da0 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b88ab740 10 client.0 _ll_register_callbacks cb 0x7fe6a0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b08d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cb9b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7b81b0 0x55644cb9ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b08d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cb9b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:50350/0 (socket says 172.21.15.37:50350) 2024-08-31T06:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6b08d3640 1 -- 172.21.15.37:0/2715506056 learned_addr learned my addr 172.21.15.37:0/2715506056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.281+0000 7fe6ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7b81b0 0x55644cb9ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48972/0 (socket says 172.21.15.37:48972) 2024-08-31T06:47:30.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c774da0 0x55644cb9e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe6b08d3640 1 -- 172.21.15.37:0/2715506056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c774da0 msgr2=0x55644cb9e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c774da0 0x55644cb9e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe6b08d3640 1 -- 172.21.15.37:0/2715506056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7b81b0 msgr2=0x55644cb9ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7b81b0 0x55644cb9ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe6b08d3640 1 -- 172.21.15.37:0/2715506056 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55644cb9b830 con 0x55644c7e1070 2024-08-31T06:47:30.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7b81b0 0x55644cb9ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe6b08d3640 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cb9b1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4002230 tx=0x7fe6a4009f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d84294bd155f23f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe68b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.282+0000 7fe68b7fe640 1 -- 172.21.15.37:0/2715506056 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a401d040 con 0x55644c7e1070 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.283+0000 7fe68b7fe640 1 -- 172.21.15.37:0/2715506056 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe6a4004c00 con 0x55644c7e1070 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.283+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2715506056 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a0011d50 con 0x55644c7e1070 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.283+0000 7fe68b7fe640 1 -- 172.21.15.37:0/2715506056 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6a4004e00 con 0x55644c7e1070 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.283+0000 7fe6b88ab740 10 client.25379 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.283+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2715506056 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55644cc13b20 con 0x55644c7e1070 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.283+0000 7fe68b7fe640 1 -- 172.21.15.37:0/2715506056 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a0011d50 con 0x55644c7e1070 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.284+0000 7fe68b7fe640 1 -- 172.21.15.37:0/2715506056 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe6a400f6e0 con 0x55644c7e1070 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.284+0000 7fe6b88ab740 10 client.25379 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.284+0000 7fe6b88ab740 10 client.25379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.284+0000 7fe6b88ab740 20 client.25379 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:30.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.284+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55644cc140e0 0x55644cc16500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.284+0000 7fe6b88ab740 4 client.25379 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.284+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2715506056 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55644cafb020 con 0x55644cc140e0 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.284+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55644cc140e0 0x55644cc16500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe68b7fe640 10 client.25379 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6ab7fe640 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55644cc140e0 0x55644cc16500 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=261d5abd89ebddac server_cookie=8c2c6494bc4f6bc0 in_seq=0 out_seq=0 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe68b7fe640 1 -- 172.21.15.37:0/2715506056 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55644cafb020 con 0x55644cc140e0 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe68b7fe640 10 client.25379 handle_command_reply: tid=0 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6b88ab740 1 client.25379 shutdown 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2715506056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 msgr2=0x55644cb9b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cb9b1c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4002230 tx=0x7fe6a4009f50 comp rx=0 tx=0).stop 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2715506056 shutdown_connections 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55644cc140e0 0x55644cc16500 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55644c7b81b0 0x55644cb9ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55644c7e1070 0x55644cb9b1c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.285+0000 7fe6b88ab740 1 --2- 172.21.15.37:0/2715506056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55644c774da0 0x55644cb9e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.290 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:47:30.290 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:47:30.290 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:47:30.290 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:47:30.290 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "83d4af95-2f90-4f54-ad46-35c0bccd0728", 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:47:30.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.286+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2715506056 >> 172.21.15.37:0/2715506056 conn(0x55644c7d5460 msgr2=0x55644cb872f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.286+0000 7fe68b7fe640 0 client.25379 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.286+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2715506056 shutdown_connections 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.286+0000 7fe6b88ab740 1 -- 172.21.15.37:0/2715506056 wait complete. 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.286+0000 7fe6b88ab740 20 client.25379 trim_cache size 0 max 16384 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.286+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe6940b4db0 msgr2=0x7fe6940b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.286+0000 7fe6b2336640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe6940b4db0 0x7fe6940b72c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe69c102f10 tx=0x7fe69c02a410 comp rx=0 tx=0).stop 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 msgr2=0x7fe6ac19a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 0x7fe6ac19a150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe69c005940 tx=0x7fe69c004040 comp rx=0 tx=0).stop 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 shutdown_connections 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe6940b4db0 0x7fe6940b72c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6ac10dbb0 0x7fe6ac19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6ac1050a0 0x7fe6ac19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 --2- 172.21.15.37:0/3576365203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6ac104750 0x7fe6ac19a150 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 >> 172.21.15.37:0/3576365203 conn(0x7fe6ac0794d0 msgr2=0x7fe6ac1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 shutdown_connections 2024-08-31T06:47:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:30.287+0000 7fe6b2336640 1 -- 172.21.15.37:0/3576365203 wait complete. 2024-08-31T06:47:31.124 INFO:tasks.cephfs.filesystem:scrub status for tag:83d4af95-2f90-4f54-ad46-35c0bccd0728 - {'path': '/', 'tag': '83d4af95-2f90-4f54-ad46-35c0bccd0728', 'options': 'recursive,force'} 2024-08-31T06:47:31.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:31 smithi106 ceph-mon[22134]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T06:47:31.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:31 smithi037 ceph-mon[18612]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T06:47:31.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:31 smithi066 ceph-mon[22244]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T06:47:33.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:33 smithi106 ceph-mon[22134]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:47:33.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:33 smithi037 ceph-mon[18612]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:47:33.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:33 smithi066 ceph-mon[22244]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 9 op/s 2024-08-31T06:47:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.005+0000 7faa193a1640 1 -- 172.21.15.37:0/1168814600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa14102f10 msgr2=0x7faa14103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.005+0000 7faa193a1640 1 --2- 172.21.15.37:0/1168814600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa14102f10 0x7faa14103320 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7faa04009900 tx=0x7faa0402a410 comp rx=0 tx=0).stop 2024-08-31T06:47:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.006+0000 7faa193a1640 1 -- 172.21.15.37:0/1168814600 shutdown_connections 2024-08-31T06:47:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.006+0000 7faa193a1640 1 --2- 172.21.15.37:0/1168814600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa14108a20 0x7faa1410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.006+0000 7faa193a1640 1 --2- 172.21.15.37:0/1168814600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa141080d0 0x7faa141084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.006+0000 7faa193a1640 1 --2- 172.21.15.37:0/1168814600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa14102f10 0x7faa14103320 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.006+0000 7faa193a1640 1 -- 172.21.15.37:0/1168814600 >> 172.21.15.37:0/1168814600 conn(0x7faa14079c30 msgr2=0x7faa1407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.006+0000 7faa193a1640 1 -- 172.21.15.37:0/1168814600 shutdown_connections 2024-08-31T06:47:35.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.006+0000 7faa193a1640 1 -- 172.21.15.37:0/1168814600 wait complete. 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa193a1640 1 Processor -- start 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa193a1640 1 -- start start 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa193a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa141080d0 0x7faa1419a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa193a1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa14108a20 0x7faa1419a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa193a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1419fa70 0x7faa1419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa193a1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa141136e0 con 0x7faa1419fa70 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1419fa70 0x7faa1419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa12ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa141080d0 0x7faa1419a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1419fa70 0x7faa1419fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50172/0 (socket says 172.21.15.37:50172) 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.007+0000 7faa137fe640 1 -- 172.21.15.37:0/1901869408 learned_addr learned my addr 172.21.15.37:0/1901869408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:35.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa14113560 con 0x7faa141080d0 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faa14113860 con 0x7faa14108a20 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa127fc640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa14108a20 0x7faa1419a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa12ffd640 1 -- 172.21.15.37:0/1901869408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa14108a20 msgr2=0x7faa1419a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa12ffd640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa14108a20 0x7faa1419a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa12ffd640 1 -- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1419fa70 msgr2=0x7faa1419fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa12ffd640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1419fa70 0x7faa1419fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa12ffd640 1 -- 172.21.15.37:0/1901869408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa141a0650 con 0x7faa141080d0 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa137fe640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1419fa70 0x7faa1419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.008+0000 7faa12ffd640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa141080d0 0x7faa1419a300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa04008000 tx=0x7faa04003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.009+0000 7fa9fbfff640 1 -- 172.21.15.37:0/1901869408 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0403f020 con 0x7faa141080d0 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.009+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa141a6bf0 con 0x7faa141080d0 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.009+0000 7fa9fbfff640 1 -- 172.21.15.37:0/1901869408 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa0403bb00 con 0x7faa141080d0 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.009+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa141a6fa0 con 0x7faa141080d0 2024-08-31T06:47:35.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.009+0000 7fa9fbfff640 1 -- 172.21.15.37:0/1901869408 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04035070 con 0x7faa141080d0 2024-08-31T06:47:35.014 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.012+0000 7faa203e5740 1 Processor -- start 2024-08-31T06:47:35.014 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.012+0000 7faa203e5740 1 -- start start 2024-08-31T06:47:35.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa203e5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe13dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa203e5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd712f0 0x5576fe13e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa203e5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd794d0 0x5576fe13e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa203e5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5576fe0b3000 con 0x5576fdd9a1b0 2024-08-31T06:47:35.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa203e5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5576fe0a2590 con 0x5576fdd712f0 2024-08-31T06:47:35.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa203e5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5576fe0a6540 con 0x5576fdd794d0 2024-08-31T06:47:35.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe13dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7fa9fbfff640 1 -- 172.21.15.37:0/1901869408 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7faa04042020 con 0x7faa141080d0 2024-08-31T06:47:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe13dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50180/0 (socket says 172.21.15.37:50180) 2024-08-31T06:47:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa137fe640 1 -- 172.21.15.37:0/3654464893 learned_addr learned my addr 172.21.15.37:0/3654464893 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa137fe640 1 -- 172.21.15.37:0/3654464893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd794d0 msgr2=0x5576fe13e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa137fe640 1 --2- 172.21.15.37:0/3654464893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd794d0 0x5576fe13e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa137fe640 1 -- 172.21.15.37:0/3654464893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd712f0 msgr2=0x5576fe13e220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:47:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa137fe640 1 --2- 172.21.15.37:0/3654464893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd712f0 0x5576fe13e220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.013+0000 7faa137fe640 1 -- 172.21.15.37:0/3654464893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576fde05790 con 0x5576fdd9a1b0 2024-08-31T06:47:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.014+0000 7faa137fe640 1 --2- 172.21.15.37:0/3654464893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe13dce0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e830 tx=0x7faa0c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82c1e7b905d706d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.014+0000 7fa9f97fa640 1 -- 172.21.15.37:0/3654464893 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c004d20 con 0x5576fdd9a1b0 2024-08-31T06:47:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.014+0000 7fa9fbfff640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9fc0b4db0 0x7fa9fc0b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.014+0000 7fa9f97fa640 1 -- 172.21.15.37:0/3654464893 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa0c005020 con 0x5576fdd9a1b0 2024-08-31T06:47:35.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.014+0000 7fa9f97fa640 1 -- 172.21.15.37:0/3654464893 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c01a600 con 0x5576fdd9a1b0 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.014+0000 7fa9fbfff640 1 -- 172.21.15.37:0/1901869408 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7faa04105d10 con 0x7faa141080d0 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.015+0000 7faa12ffd640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9fc0b4db0 0x7fa9fc0b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.015+0000 7faa203e5740 1 -- 172.21.15.37:0/3654464893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 msgr2=0x5576fe13dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.015+0000 7faa203e5740 1 --2- 172.21.15.37:0/3654464893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe13dce0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e830 tx=0x7faa0c00ecf0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.015+0000 7faa12ffd640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9fc0b4db0 0x7fa9fc0b72c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faa04103440 tx=0x7faa04009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.016+0000 7faa203e5740 1 -- 172.21.15.37:0/3654464893 shutdown_connections 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.016+0000 7faa203e5740 1 --2- 172.21.15.37:0/3654464893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd794d0 0x5576fe13e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.016+0000 7faa203e5740 1 --2- 172.21.15.37:0/3654464893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd712f0 0x5576fe13e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.016+0000 7faa203e5740 1 --2- 172.21.15.37:0/3654464893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe13dce0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.016+0000 7faa203e5740 1 -- 172.21.15.37:0/3654464893 >> 172.21.15.37:0/3654464893 conn(0x5576fdd8e300 msgr2=0x5576fe13bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.016+0000 7faa203e5740 1 -- 172.21.15.37:0/3654464893 shutdown_connections 2024-08-31T06:47:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.016+0000 7faa203e5740 1 -- 172.21.15.37:0/3654464893 wait complete. 2024-08-31T06:47:35.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.016+0000 7faa203e5740 1 -- start start 2024-08-31T06:47:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.017+0000 7faa203e5740 1 Processor -- start 2024-08-31T06:47:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.017+0000 7faa203e5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.017+0000 7faa203e5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe149e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.017+0000 7faa203e5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa137fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa137fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51900/0 (socket says 172.21.15.37:51900) 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa127fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa137fe640 1 -- 172.21.15.37:0/1795333857 learned_addr learned my addr 172.21.15.37:0/1795333857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5576fdfdbab0 con 0x5576fdd9a1b0 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5576fe029680 con 0x5576fdd794d0 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5576fe14c460 con 0x5576fdd712f0 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa137fe640 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa127fc640 1 -- 172.21.15.37:0/1795333857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 msgr2=0x5576fe1498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa127fc640 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa127fc640 1 -- 172.21.15.37:0/1795333857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 msgr2=0x5576fe155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa127fc640 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa127fc640 1 -- 172.21.15.37:0/1795333857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576fde7e620 con 0x5576fdd794d0 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.018+0000 7faa137fe640 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:35.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7faa203e5740 10 client.0 _ll_register_callbacks cb 0x5576fddb1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7faa127fc640 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe149e30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faa141050f0 tx=0x7faa0800bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4233de202da9dfc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7fa9f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:47:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa0c005020 con 0x5576fdd794d0 2024-08-31T06:47:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/1795333857 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08005020 con 0x5576fdd794d0 2024-08-31T06:47:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/1795333857 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7faa080051c0 con 0x5576fdd794d0 2024-08-31T06:47:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/1795333857 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faa08005420 con 0x5576fdd794d0 2024-08-31T06:47:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7faa203e5740 10 client.25388 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:35.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.019+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5576fe1583e0 con 0x5576fdd794d0 2024-08-31T06:47:35.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.020+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/1795333857 <== mon.2 v2:172.21.15.66:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faa080047a0 con 0x5576fdd794d0 2024-08-31T06:47:35.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.020+0000 7faa203e5740 10 client.25388 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.020+0000 7faa203e5740 10 client.25388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.020+0000 7faa203e5740 20 client.25388 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.020+0000 7faa203e5740 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576fdd58d80 0x5576fe15b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.020+0000 7faa203e5740 4 client.25388 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.020+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576fe0b4f50 con 0x5576fdd58d80 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.020+0000 7faa137fe640 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576fdd58d80 0x5576fe15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.021+0000 7fa9f6ff5640 10 client.25388 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.021+0000 7faa137fe640 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576fdd58d80 0x5576fe15b890 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8bbc4c7fbfe536 server_cookie=f7c9d504685cb11b in_seq=0 out_seq=0 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/1795333857 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576fe0b4f50 con 0x5576fdd58d80 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7fa9f6ff5640 10 client.25388 handle_command_reply: tid=0 2024-08-31T06:47:35.027 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 client.25388 shutdown 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 msgr2=0x5576fe149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe149e30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faa141050f0 tx=0x7faa0800bd80 comp rx=0 tx=0).stop 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 shutdown_connections 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576fdd58d80 0x5576fe15b890 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd9a1b0 0x5576fe155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7fa9f6ff5640 0 client.25388 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe149e30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 --2- 172.21.15.37:0/1795333857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.028 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 >> 172.21.15.37:0/1795333857 conn(0x5576fdd8e300 msgr2=0x5576fe13cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:35.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 shutdown_connections 2024-08-31T06:47:35.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 1 -- 172.21.15.37:0/1795333857 wait complete. 2024-08-31T06:47:35.029 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.022+0000 7faa203e5740 20 client.25388 trim_cache size 0 max 16384 2024-08-31T06:47:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.052+0000 7faa203e5740 1 Processor -- start 2024-08-31T06:47:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.052+0000 7faa203e5740 1 -- start start 2024-08-31T06:47:35.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.052+0000 7faa203e5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd58d80 0x5576fe144e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.052+0000 7faa203e5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd712f0 0x5576fe155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.052+0000 7faa203e5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe155b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.052+0000 7faa203e5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa141b2180 con 0x5576fdd712f0 2024-08-31T06:47:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.052+0000 7faa203e5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa141afa50 con 0x5576fdd794d0 2024-08-31T06:47:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.052+0000 7faa203e5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faa141ad8a0 con 0x5576fdd58d80 2024-08-31T06:47:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd712f0 0x5576fe155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd712f0 0x5576fe155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50190/0 (socket says 172.21.15.37:50190) 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 -- 172.21.15.37:0/4150022420 learned_addr learned my addr 172.21.15.37:0/4150022420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa137fe640 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd58d80 0x5576fe144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa137fe640 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 -- 172.21.15.37:0/4150022420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd58d80 msgr2=0x5576fe144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd58d80 0x5576fe144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 -- 172.21.15.37:0/4150022420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 msgr2=0x5576fe155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 -- 172.21.15.37:0/4150022420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576fe147bf0 con 0x5576fdd712f0 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa137fe640 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.053+0000 7faa127fc640 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd712f0 0x5576fe155650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faa08004340 tx=0x7faa08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef962b8919da317 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.054+0000 7fa9f8ff9640 1 -- 172.21.15.37:0/4150022420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa080047a0 con 0x5576fdd712f0 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.054+0000 7fa9f8ff9640 1 -- 172.21.15.37:0/4150022420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa0c005020 con 0x5576fdd712f0 2024-08-31T06:47:35.058 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.054+0000 7fa9f8ff9640 1 -- 172.21.15.37:0/4150022420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa08023900 con 0x5576fdd712f0 2024-08-31T06:47:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.055+0000 7faa203e5740 1 -- 172.21.15.37:0/4150022420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd712f0 msgr2=0x5576fe155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.055+0000 7faa203e5740 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd712f0 0x5576fe155650 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7faa08004340 tx=0x7faa08013000 comp rx=0 tx=0).stop 2024-08-31T06:47:35.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.055+0000 7faa203e5740 1 -- 172.21.15.37:0/4150022420 shutdown_connections 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.055+0000 7faa203e5740 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd712f0 0x5576fe155650 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.055+0000 7faa203e5740 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd794d0 0x5576fe155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.055+0000 7faa203e5740 1 --2- 172.21.15.37:0/4150022420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd58d80 0x5576fe144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.055+0000 7faa203e5740 1 -- 172.21.15.37:0/4150022420 >> 172.21.15.37:0/4150022420 conn(0x5576fdd8e300 msgr2=0x5576fe13a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.056+0000 7faa203e5740 1 -- 172.21.15.37:0/4150022420 shutdown_connections 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.056+0000 7faa203e5740 1 -- 172.21.15.37:0/4150022420 wait complete. 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.056+0000 7faa203e5740 1 -- start start 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.056+0000 7faa203e5740 1 Processor -- start 2024-08-31T06:47:35.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.057+0000 7faa203e5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd58d80 0x5576fe151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.057+0000 7faa203e5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.057+0000 7faa203e5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd794d0 0x5576fe160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.057+0000 7faa203e5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa141adf10 con 0x5576fdd794d0 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.057+0000 7faa203e5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7faa141af380 con 0x5576fdd58d80 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.057+0000 7faa137fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd58d80 0x5576fe151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.057+0000 7faa137fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd58d80 0x5576fe151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:39494/0 (socket says 172.21.15.37:39494) 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.057+0000 7faa137fe640 1 -- 172.21.15.37:0/434300648 learned_addr learned my addr 172.21.15.37:0/434300648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7faa141ae5e0 con 0x5576fdd712f0 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa127fc640 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa137fe640 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd794d0 0x5576fe160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa203e5740 10 client.0 _ll_register_callbacks cb 0x7faa08004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa137fe640 1 -- 172.21.15.37:0/434300648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 msgr2=0x5576fe1609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa137fe640 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.065 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa137fe640 1 -- 172.21.15.37:0/434300648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd794d0 msgr2=0x5576fe160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa137fe640 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd794d0 0x5576fe160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa137fe640 1 -- 172.21.15.37:0/434300648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576fe161420 con 0x5576fdd58d80 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa127fc640 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7faa137fe640 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd58d80 0x5576fe151b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009f40 tx=0x7faa0c02d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e6b556d17dfe44 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.058+0000 7fa9f6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.059+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/434300648 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c020040 con 0x5576fdd58d80 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.059+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/434300648 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7faa0c004a00 con 0x5576fdd58d80 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.059+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa0c005020 con 0x5576fdd58d80 2024-08-31T06:47:35.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.059+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/434300648 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faa0c004c00 con 0x5576fdd58d80 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.059+0000 7faa203e5740 10 client.25394 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.059+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5576fe1c5eb0 con 0x5576fdd58d80 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/434300648 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa0c005020 con 0x5576fdd58d80 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/434300648 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faa0c026040 con 0x5576fdd58d80 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7faa203e5740 10 client.25394 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7faa203e5740 10 client.25394 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7faa203e5740 20 client.25394 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7faa203e5740 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576fdd9a1b0 0x5576fe1c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7faa203e5740 4 client.25394 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576fe0b09f0 con 0x5576fdd9a1b0 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.060+0000 7faa127fc640 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576fdd9a1b0 0x5576fe1c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.061+0000 7fa9f6ff5640 10 client.25394 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:35.067 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.061+0000 7faa127fc640 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576fdd9a1b0 0x5576fe1c84a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6223b94426230691 server_cookie=6a993e69bb3dbc95 in_seq=0 out_seq=0 2024-08-31T06:47:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.065+0000 7fa9f6ff5640 1 -- 172.21.15.37:0/434300648 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5576fe0b09f0 con 0x5576fdd9a1b0 2024-08-31T06:47:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.065+0000 7fa9f6ff5640 10 client.25394 handle_command_reply: tid=0 2024-08-31T06:47:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.065+0000 7faa203e5740 1 client.25394 shutdown 2024-08-31T06:47:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.065+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd58d80 msgr2=0x5576fe151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.065+0000 7faa203e5740 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd58d80 0x5576fe151b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009f40 tx=0x7faa0c02d040 comp rx=0 tx=0).stop 2024-08-31T06:47:35.069 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 shutdown_connections 2024-08-31T06:47:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576fdd9a1b0 0x5576fe1c84a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576fdd794d0 0x5576fe160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7fa9f6ff5640 0 client.25394 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576fdd712f0 0x5576fe1609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 1 --2- 172.21.15.37:0/434300648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576fdd58d80 0x5576fe151b40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 >> 172.21.15.37:0/434300648 conn(0x5576fdd8e300 msgr2=0x5576fe13a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 shutdown_connections 2024-08-31T06:47:35.070 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 1 -- 172.21.15.37:0/434300648 wait complete. 2024-08-31T06:47:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.066+0000 7faa203e5740 20 client.25394 trim_cache size 0 max 16384 2024-08-31T06:47:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:47:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:47:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:47:35.071 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:47:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9fc0b4db0 msgr2=0x7fa9fc0b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9fc0b4db0 0x7fa9fc0b72c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faa04103440 tx=0x7faa04009260 comp rx=0 tx=0).stop 2024-08-31T06:47:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa141080d0 msgr2=0x7faa1419a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa141080d0 0x7faa1419a300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa04008000 tx=0x7faa04003c10 comp rx=0 tx=0).stop 2024-08-31T06:47:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 shutdown_connections 2024-08-31T06:47:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9fc0b4db0 0x7fa9fc0b72c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa1419fa70 0x7faa1419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa14108a20 0x7faa1419a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 --2- 172.21.15.37:0/1901869408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa141080d0 0x7faa1419a300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 >> 172.21.15.37:0/1901869408 conn(0x7faa14079c30 msgr2=0x7faa14106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 shutdown_connections 2024-08-31T06:47:35.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:35.067+0000 7faa193a1640 1 -- 172.21.15.37:0/1901869408 wait complete. 2024-08-31T06:47:35.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:35 smithi106 ceph-mon[22134]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:35.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:35 smithi037 ceph-mon[18612]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:35.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:35 smithi066 ceph-mon[22244]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:37 smithi106 ceph-mon[22134]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-31T06:47:37.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:37 smithi037 ceph-mon[18612]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-31T06:47:37.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:37 smithi066 ceph-mon[22244]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-31T06:47:39.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:39 smithi106 ceph-mon[22134]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:39.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:39 smithi037 ceph-mon[18612]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:39.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:39 smithi066 ceph-mon[22244]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:41.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:41 smithi106 ceph-mon[22134]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:41.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:41 smithi037 ceph-mon[18612]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:41.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:41 smithi066 ceph-mon[22244]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-31T06:47:43.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:47:43.551 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:43.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:43 smithi037 ceph-mon[18612]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T06:47:43.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:43 smithi106 ceph-mon[22134]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T06:47:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:43 smithi066 ceph-mon[22244]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 8 op/s 2024-08-31T06:47:44.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 -- 172.21.15.37:0/97036106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f81050a0 msgr2=0x7f42f810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:44.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 --2- 172.21.15.37:0/97036106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f81050a0 0x7f42f810d5f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009900 tx=0x7f42e402a410 comp rx=0 tx=0).stop 2024-08-31T06:47:44.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 -- 172.21.15.37:0/97036106 shutdown_connections 2024-08-31T06:47:44.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 --2- 172.21.15.37:0/97036106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f81050a0 0x7f42f810d5f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 --2- 172.21.15.37:0/97036106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f810dbb0 0x7f42f81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 --2- 172.21.15.37:0/97036106 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42f8104750 0x7f42f8104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 -- 172.21.15.37:0/97036106 >> 172.21.15.37:0/97036106 conn(0x7f42f80794d0 msgr2=0x7f42f80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:44.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 -- 172.21.15.37:0/97036106 shutdown_connections 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 -- 172.21.15.37:0/97036106 wait complete. 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.075+0000 7f42feaa9640 1 Processor -- start 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42feaa9640 1 -- start start 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42feaa9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f8104750 0x7f42f8197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42feaa9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81050a0 0x7f42f8198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42feaa9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42f810dbb0 0x7f42f819d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42feaa9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42f81114d0 con 0x7f42f8104750 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42feaa9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8111350 con 0x7f42f810dbb0 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42feaa9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f42f8111650 con 0x7f42f81050a0 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42fc845640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f8104750 0x7f42f8197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42fc845640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f8104750 0x7f42f8197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50220/0 (socket says 172.21.15.37:50220) 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42fc845640 1 -- 172.21.15.37:0/2873834562 learned_addr learned my addr 172.21.15.37:0/2873834562 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:44.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.076+0000 7f42f7fff640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81050a0 0x7f42f8198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.077+0000 7f42fd046640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42f810dbb0 0x7f42f819d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.077+0000 7f42f7fff640 1 -- 172.21.15.37:0/2873834562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42f810dbb0 msgr2=0x7f42f819d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.077+0000 7f42f7fff640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42f810dbb0 0x7f42f819d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.077+0000 7f42f7fff640 1 -- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f8104750 msgr2=0x7f42f8197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.077+0000 7f42f7fff640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f8104750 0x7f42f8197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.077+0000 7f42f7fff640 1 -- 172.21.15.37:0/2873834562 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f819df30 con 0x7f42f81050a0 2024-08-31T06:47:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.077+0000 7f42f7fff640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81050a0 0x7f42f8198560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42e402a930 tx=0x7f42e4004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.078+0000 7f42f5ffb640 1 -- 172.21.15.37:0/2873834562 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e403f070 con 0x7f42f81050a0 2024-08-31T06:47:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.078+0000 7f42f5ffb640 1 -- 172.21.15.37:0/2873834562 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42e4003a80 con 0x7f42f81050a0 2024-08-31T06:47:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.078+0000 7f42f5ffb640 1 -- 172.21.15.37:0/2873834562 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4035070 con 0x7f42f81050a0 2024-08-31T06:47:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.078+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f819e1c0 con 0x7f42f81050a0 2024-08-31T06:47:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.079+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f819e620 con 0x7f42f81050a0 2024-08-31T06:47:44.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.080+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f8104b60 con 0x7f42f81050a0 2024-08-31T06:47:44.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.082+0000 7f42f5ffb640 1 -- 172.21.15.37:0/2873834562 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f42e4003c30 con 0x7f42f81050a0 2024-08-31T06:47:44.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.083+0000 7f42f5ffb640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42e80b4d30 0x7f42e80b7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:44.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.083+0000 7f42f5ffb640 1 -- 172.21.15.37:0/2873834562 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f42e4106330 con 0x7f42f81050a0 2024-08-31T06:47:44.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.083+0000 7f42fc845640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42e80b4d30 0x7f42e80b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:44.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.084+0000 7f42fc845640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42e80b4d30 0x7f42e80b7240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f42ec005fd0 tx=0x7f42ec00b4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:44.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.086+0000 7f42f5ffb640 1 -- 172.21.15.37:0/2873834562 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f42e4048070 con 0x7f42f81050a0 2024-08-31T06:47:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.310+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f802e430 con 0x7f42f81050a0 2024-08-31T06:47:44.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:47:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.311+0000 7f42f5ffb640 1 -- 172.21.15.37:0/2873834562 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f42e40ccf90 con 0x7f42f81050a0 2024-08-31T06:47:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:47:44.313 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:47:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42e80b4d30 msgr2=0x7f42e80b7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42e80b4d30 0x7f42e80b7240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f42ec005fd0 tx=0x7f42ec00b4a0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81050a0 msgr2=0x7f42f8198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81050a0 0x7f42f8198560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42e402a930 tx=0x7f42e4004040 comp rx=0 tx=0).stop 2024-08-31T06:47:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 shutdown_connections 2024-08-31T06:47:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42e80b4d30 0x7f42e80b7240 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f42ec005fd0 tx=0x7f42ec00b4a0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42f810dbb0 0x7f42f819d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42f81050a0 0x7f42f8198560 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f42e402a930 tx=0x7f42e4004040 comp rx=0 tx=0).stop 2024-08-31T06:47:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 --2- 172.21.15.37:0/2873834562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42f8104750 0x7f42f8197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 >> 172.21.15.37:0/2873834562 conn(0x7f42f80794d0 msgr2=0x7f42f80ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 shutdown_connections 2024-08-31T06:47:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:44.314+0000 7f42feaa9640 1 -- 172.21.15.37:0/2873834562 wait complete. 2024-08-31T06:47:44.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:44 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2873834562' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:44.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:44 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2873834562' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:44.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:44 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2873834562' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:45.152 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 45065ce7 --release --await' 2024-08-31T06:47:45.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 45065ce7 --release --await 2024-08-31T06:47:45.475 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:45 smithi037 ceph-mon[18612]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T06:47:45.521 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:45.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:45 smithi106 ceph-mon[22134]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T06:47:45.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:45 smithi066 ceph-mon[22244]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-31T06:47:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 -- 172.21.15.37:0/2399984460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 msgr2=0x7fc4741103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/2399984460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 0x7fc4741103f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009ca0 tx=0x7fc46c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 -- 172.21.15.37:0/2399984460 shutdown_connections 2024-08-31T06:47:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/2399984460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 0x7fc4741103f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/2399984460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc474109270 0x7fc474109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/2399984460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc474103930 0x7fc474103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 -- 172.21.15.37:0/2399984460 >> 172.21.15.37:0/2399984460 conn(0x7fc4740ff3a0 msgr2=0x7fc4741017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 -- 172.21.15.37:0/2399984460 shutdown_connections 2024-08-31T06:47:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.050+0000 7fc47c6bc640 1 -- 172.21.15.37:0/2399984460 wait complete. 2024-08-31T06:47:46.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.052+0000 7fc47c6bc640 1 Processor -- start 2024-08-31T06:47:46.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.052+0000 7fc47c6bc640 1 -- start start 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc47c6bc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc474103930 0x7fc47419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc47c6bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc474109270 0x7fc47419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc47c6bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 0x7fc47419f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc47c6bc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc474113780 con 0x7fc474109bc0 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc47c6bc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc474113600 con 0x7fc474109270 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc47c6bc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc474113900 con 0x7fc474103930 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc47a458640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc474103930 0x7fc47419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc479c57640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc474109270 0x7fc47419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc47a458640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc474103930 0x7fc47419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:41030/0 (socket says 172.21.15.37:41030) 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc479c57640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc474109270 0x7fc47419a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:57674/0 (socket says 172.21.15.37:57674) 2024-08-31T06:47:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.053+0000 7fc479c57640 1 -- 172.21.15.37:0/1430104042 learned_addr learned my addr 172.21.15.37:0/1430104042 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc47ac59640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 0x7fc47419f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc479c57640 1 -- 172.21.15.37:0/1430104042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc474103930 msgr2=0x7fc47419a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc479c57640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc474103930 0x7fc47419a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc479c57640 1 -- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 msgr2=0x7fc47419f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc479c57640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 0x7fc47419f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc479c57640 1 -- 172.21.15.37:0/1430104042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4741a0080 con 0x7fc474109270 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc47a458640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc474103930 0x7fc47419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc479c57640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc474109270 0x7fc47419a6b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc46400e9f0 tx=0x7fc46400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc47ac59640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 0x7fc47419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc46b7fe640 1 -- 172.21.15.37:0/1430104042 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46400ccc0 con 0x7fc474109270 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.054+0000 7fc46b7fe640 1 -- 172.21.15.37:0/1430104042 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4640108c0 con 0x7fc474109270 2024-08-31T06:47:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.055+0000 7fc47c6bc640 1 -- 172.21.15.37:0/1430104042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4741a0370 con 0x7fc474109270 2024-08-31T06:47:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.055+0000 7fc47c6bc640 1 -- 172.21.15.37:0/1430104042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4741a6ad0 con 0x7fc474109270 2024-08-31T06:47:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.055+0000 7fc46b7fe640 1 -- 172.21.15.37:0/1430104042 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464018750 con 0x7fc474109270 2024-08-31T06:47:46.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.059+0000 7fc482c31740 1 Processor -- start 2024-08-31T06:47:46.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.059+0000 7fc482c31740 1 -- start start 2024-08-31T06:47:46.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.059+0000 7fc46b7fe640 1 -- 172.21.15.37:0/1430104042 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7fc464010430 con 0x7fc474109270 2024-08-31T06:47:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.060+0000 7fc482c31740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd229b6520 0x55bd22d5bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.060+0000 7fc482c31740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.060+0000 7fc47ac59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd229b6520 0x55bd22d5bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.061+0000 7fc47ac59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd229b6520 0x55bd22d5bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52130/0 (socket says 172.21.15.37:52130) 2024-08-31T06:47:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.061+0000 7fc46b7fe640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4600b4e30 0x7fc4600b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.061+0000 7fc479c57640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4600b4e30 0x7fc4600b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.061+0000 7fc47ac59640 1 -- 172.21.15.37:0/164183731 learned_addr learned my addr 172.21.15.37:0/164183731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.061+0000 7fc46b7fe640 1 -- 172.21.15.37:0/1430104042 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc4640e5bc0 con 0x7fc474109270 2024-08-31T06:47:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.061+0000 7fc47a458640 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.062+0000 7fc482c31740 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d5c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.062+0000 7fc482c31740 1 -- 172.21.15.37:0/164183731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bd22cd2a70 con 0x55bd229b6520 2024-08-31T06:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.062+0000 7fc479c57640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4600b4e30 0x7fc4600b7340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4640e3290 tx=0x7fc4640abfb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.062+0000 7fc482c31740 1 -- 172.21.15.37:0/164183731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bd22cc2000 con 0x55bd22995840 2024-08-31T06:47:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.062+0000 7fc482c31740 1 -- 172.21.15.37:0/164183731 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bd22cc5fb0 con 0x55bd2298d660 2024-08-31T06:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.063+0000 7fc47a458640 1 -- 172.21.15.37:0/164183731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 msgr2=0x55bd22d5c700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.063+0000 7fc47a458640 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d5c700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.063+0000 7fc47a458640 1 -- 172.21.15.37:0/164183731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd229b6520 msgr2=0x55bd22d5bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.063+0000 7fc47a458640 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd229b6520 0x55bd22d5bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.063+0000 7fc47a458640 1 -- 172.21.15.37:0/164183731 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd22a21b00 con 0x55bd2298d660 2024-08-31T06:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.063+0000 7fc47a458640 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c1c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4700103d0 tx=0x7fc470010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b64708ad0a006ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.063+0000 7fc47ac59640 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd229b6520 0x55bd22d5bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.064+0000 7fc468ff9640 1 -- 172.21.15.37:0/164183731 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470004220 con 0x55bd2298d660 2024-08-31T06:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.064+0000 7fc468ff9640 1 -- 172.21.15.37:0/164183731 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4700043c0 con 0x55bd2298d660 2024-08-31T06:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.064+0000 7fc468ff9640 1 -- 172.21.15.37:0/164183731 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470011980 con 0x55bd2298d660 2024-08-31T06:47:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.064+0000 7fc482c31740 1 -- 172.21.15.37:0/164183731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 msgr2=0x55bd22d5c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.064+0000 7fc482c31740 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c1c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4700103d0 tx=0x7fc470010890 comp rx=0 tx=0).stop 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 -- 172.21.15.37:0/164183731 shutdown_connections 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d5c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c1c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 --2- 172.21.15.37:0/164183731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd229b6520 0x55bd22d5bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 -- 172.21.15.37:0/164183731 >> 172.21.15.37:0/164183731 conn(0x55bd229aa910 msgr2=0x55bd22d59b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 -- 172.21.15.37:0/164183731 shutdown_connections 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 -- 172.21.15.37:0/164183731 wait complete. 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 -- start start 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.065+0000 7fc482c31740 1 Processor -- start 2024-08-31T06:47:46.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc482c31740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd2298d660 0x55bd22d67890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc482c31740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d67dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc482c31740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd229b6520 0x55bd22d84960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc482c31740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bd22d6a460 con 0x55bd2298d660 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc482c31740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bd22c83520 con 0x55bd22995840 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc482c31740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bd22d6a5e0 con 0x55bd229b6520 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc482c31740 10 client.0 _ll_register_callbacks cb 0x55bd22cbbc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc47ac59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd2298d660 0x55bd22d67890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc47ac59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd2298d660 0x55bd22d67890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52140/0 (socket says 172.21.15.37:52140) 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc47ac59640 1 -- 172.21.15.37:0/2493206538 learned_addr learned my addr 172.21.15.37:0/2493206538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc47a458640 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d67dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd229b6520 0x55bd22d84960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc47ac59640 1 -- 172.21.15.37:0/2493206538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd229b6520 msgr2=0x55bd22d84960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.066+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd229b6520 0x55bd22d84960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc47ac59640 1 -- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 msgr2=0x55bd22d67dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d67dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc47ac59640 1 -- 172.21.15.37:0/2493206538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd22a98960 con 0x55bd2298d660 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc47a458640 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d67dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd2298d660 0x55bd22d67890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0096c0 tx=0x7fc46c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192209d82ee0fd84 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc45dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc45dffb640 1 -- 172.21.15.37:0/2493206538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c042020 con 0x55bd2298d660 2024-08-31T06:47:46.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc45dffb640 1 -- 172.21.15.37:0/2493206538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc46c003d80 con 0x55bd2298d660 2024-08-31T06:47:46.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.067+0000 7fc482c31740 1 -- 172.21.15.37:0/2493206538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bd22c619a0 con 0x55bd2298d660 2024-08-31T06:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.068+0000 7fc45dffb640 1 -- 172.21.15.37:0/2493206538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc46c004040 con 0x55bd2298d660 2024-08-31T06:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.068+0000 7fc482c31740 10 client.15855 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.068+0000 7fc482c31740 1 -- 172.21.15.37:0/2493206538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bd22d876d0 con 0x55bd2298d660 2024-08-31T06:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.068+0000 7fc45dffb640 1 -- 172.21.15.37:0/2493206538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bd22c619a0 con 0x55bd2298d660 2024-08-31T06:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.068+0000 7fc45dffb640 1 -- 172.21.15.37:0/2493206538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc46c04c070 con 0x55bd2298d660 2024-08-31T06:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.068+0000 7fc482c31740 10 client.15855 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.069+0000 7fc482c31740 10 client.15855 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:47:46.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.069+0000 7fc482c31740 20 client.15855 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.069+0000 7fc482c31740 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bd22974ea0 0x55bd22d8ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.069+0000 7fc482c31740 4 client.15855 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.069+0000 7fc482c31740 1 -- 172.21.15.37:0/2493206538 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd22cd49c0 con 0x55bd22974ea0 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.069+0000 7fc47a458640 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bd22974ea0 0x55bd22d8ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.070+0000 7fc45dffb640 10 client.15855 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.070+0000 7fc47a458640 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bd22974ea0 0x55bd22d8ab40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9993281cb212d875 server_cookie=41965f6568498c11 in_seq=0 out_seq=0 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc45dffb640 1 -- 172.21.15.37:0/2493206538 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bd22cd49c0 con 0x55bd22974ea0 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc45dffb640 10 client.15855 handle_command_reply: tid=0 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 client.15855 shutdown 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 -- 172.21.15.37:0/2493206538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd2298d660 msgr2=0x55bd22d67890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd2298d660 0x55bd22d67890 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0096c0 tx=0x7fc46c009800 comp rx=0 tx=0).stop 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 -- 172.21.15.37:0/2493206538 shutdown_connections 2024-08-31T06:47:46.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bd22974ea0 0x55bd22d8ab40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd229b6520 0x55bd22d84960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d67dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc45dffb640 0 client.15855 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 --2- 172.21.15.37:0/2493206538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd2298d660 0x55bd22d67890 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 -- 172.21.15.37:0/2493206538 >> 172.21.15.37:0/2493206538 conn(0x55bd229aa910 msgr2=0x55bd22d5ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 -- 172.21.15.37:0/2493206538 shutdown_connections 2024-08-31T06:47:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.071+0000 7fc482c31740 1 -- 172.21.15.37:0/2493206538 wait complete. 2024-08-31T06:47:46.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.072+0000 7fc482c31740 20 client.15855 trim_cache size 0 max 16384 2024-08-31T06:47:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.105+0000 7fc482c31740 1 Processor -- start 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.105+0000 7fc482c31740 1 -- start start 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.105+0000 7fc482c31740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22974ea0 0x55bd22d59d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.105+0000 7fc482c31740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.105+0000 7fc482c31740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22995840 0x55bd22d848e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.105+0000 7fc482c31740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4741a7270 con 0x55bd22995840 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.105+0000 7fc482c31740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4740753e0 con 0x55bd22974ea0 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.105+0000 7fc482c31740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc474073230 con 0x55bd2298d660 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47a458640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47a458640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:41072/0 (socket says 172.21.15.37:41072) 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47a458640 1 -- 172.21.15.37:0/2528527535 learned_addr learned my addr 172.21.15.37:0/2528527535 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22974ea0 0x55bd22d59d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22995840 0x55bd22d848e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47ac59640 1 -- 172.21.15.37:0/2528527535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 msgr2=0x55bd22d5c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47ac59640 1 -- 172.21.15.37:0/2528527535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22995840 msgr2=0x55bd22d848e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22995840 0x55bd22d848e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47ac59640 1 -- 172.21.15.37:0/2528527535 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd22d68950 con 0x55bd22974ea0 2024-08-31T06:47:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.106+0000 7fc47ac59640 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22974ea0 0x55bd22d59d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009bf0 tx=0x7fc46c000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3c509482ab84295 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.107+0000 7fc45ffff640 1 -- 172.21.15.37:0/2528527535 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c042070 con 0x55bd22974ea0 2024-08-31T06:47:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.107+0000 7fc45ffff640 1 -- 172.21.15.37:0/2528527535 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc46c031e50 con 0x55bd22974ea0 2024-08-31T06:47:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.107+0000 7fc45ffff640 1 -- 172.21.15.37:0/2528527535 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c053080 con 0x55bd22974ea0 2024-08-31T06:47:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 -- 172.21.15.37:0/2528527535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22974ea0 msgr2=0x55bd22d59d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22974ea0 0x55bd22d59d00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009bf0 tx=0x7fc46c000f40 comp rx=0 tx=0).stop 2024-08-31T06:47:46.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 -- 172.21.15.37:0/2528527535 shutdown_connections 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22995840 0x55bd22d848e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d5c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 --2- 172.21.15.37:0/2528527535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22974ea0 0x55bd22d59d00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 -- 172.21.15.37:0/2528527535 >> 172.21.15.37:0/2528527535 conn(0x55bd229aa910 msgr2=0x55bd22d5bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 -- 172.21.15.37:0/2528527535 shutdown_connections 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 -- 172.21.15.37:0/2528527535 wait complete. 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 -- start start 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.108+0000 7fc482c31740 1 Processor -- start 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc482c31740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22974ea0 0x55bd22d80950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc482c31740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d80e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc482c31740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d7b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc482c31740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4740738a0 con 0x55bd22974ea0 2024-08-31T06:47:46.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc482c31740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc474074d10 con 0x55bd22995840 2024-08-31T06:47:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc482c31740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc474073f70 con 0x55bd2298d660 2024-08-31T06:47:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc482c31740 10 client.0 _ll_register_callbacks cb 0x7fc46c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc47ac59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22974ea0 0x55bd22d80950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc47a458640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d80e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc47a458640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d80e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:41076/0 (socket says 172.21.15.37:41076) 2024-08-31T06:47:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc47a458640 1 -- 172.21.15.37:0/540043851 learned_addr learned my addr 172.21.15.37:0/540043851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.109+0000 7fc47ac59640 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d7b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc47a458640 1 -- 172.21.15.37:0/540043851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 msgr2=0x55bd22d7b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc47a458640 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d7b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc47a458640 1 -- 172.21.15.37:0/540043851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22974ea0 msgr2=0x55bd22d80950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc47a458640 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22974ea0 0x55bd22d80950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc47a458640 1 -- 172.21.15.37:0/540043851 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd22d7be40 con 0x55bd2298d660 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc47ac59640 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22974ea0 0x55bd22d80950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc47a458640 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d80e90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55bd22d5a900 tx=0x7fc47000bba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=200d9d09bb4be56c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc45dffb640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc45dffb640 1 -- 172.21.15.37:0/540043851 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc470042070 con 0x55bd2298d660 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc482c31740 1 -- 172.21.15.37:0/540043851 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc46c031e50 con 0x55bd2298d660 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.110+0000 7fc45dffb640 1 -- 172.21.15.37:0/540043851 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc470004330 con 0x55bd2298d660 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc45dffb640 1 -- 172.21.15.37:0/540043851 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc47004e050 con 0x55bd2298d660 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc482c31740 10 client.25405 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc482c31740 1 -- 172.21.15.37:0/540043851 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bd22df5c40 con 0x55bd2298d660 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc45dffb640 1 -- 172.21.15.37:0/540043851 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc46c031e50 con 0x55bd2298d660 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc45dffb640 1 -- 172.21.15.37:0/540043851 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc470003920 con 0x55bd2298d660 2024-08-31T06:47:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc482c31740 10 client.25405 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc482c31740 10 client.25405 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:47:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc482c31740 20 client.25405 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc482c31740 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bd229b6520 0x55bd22df8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc482c31740 4 client.25405 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "45065ce7", "release": true, "await": true}] 2024-08-31T06:47:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.111+0000 7fc482c31740 1 -- 172.21.15.37:0/540043851 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "quiesce db", "set_id": "45065ce7", "release": true, "await": true}) -- 0x55bd22cd0460 con 0x55bd229b6520 2024-08-31T06:47:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.112+0000 7fc47ac59640 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bd229b6520 0x55bd22df8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.112+0000 7fc47ac59640 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bd229b6520 0x55bd22df8240 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f8b901c0918acf0 server_cookie=24bff7695b18e858 in_seq=0 out_seq=0 2024-08-31T06:47:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.112+0000 7fc45dffb640 10 client.25405 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc45dffb640 1 -- 172.21.15.37:0/540043851 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55bd22cd0460 con 0x55bd229b6520 2024-08-31T06:47:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc45dffb640 10 client.25405 handle_command_reply: tid=0 2024-08-31T06:47:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 client.25405 shutdown 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 -- 172.21.15.37:0/540043851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 msgr2=0x55bd22d80e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d80e90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55bd22d5a900 tx=0x7fc47000bba0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 -- 172.21.15.37:0/540043851 shutdown_connections 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bd229b6520 0x55bd22df8240 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bd22995840 0x55bd22d7b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bd2298d660 0x55bd22d80e90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 --2- 172.21.15.37:0/540043851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bd22974ea0 0x55bd22d80950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 -- 172.21.15.37:0/540043851 >> 172.21.15.37:0/540043851 conn(0x55bd229aa910 msgr2=0x55bd22d59ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc45dffb640 0 client.25405 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 -- 172.21.15.37:0/540043851 shutdown_connections 2024-08-31T06:47:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 1 -- 172.21.15.37:0/540043851 wait complete. 2024-08-31T06:47:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.118+0000 7fc482c31740 20 client.25405 trim_cache size 0 max 16384 2024-08-31T06:47:46.121 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:47:46.121 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 25, 2024-08-31T06:47:46.121 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-31T06:47:46.121 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 4, 2024-08-31T06:47:46.121 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-31T06:47:46.121 INFO:teuthology.orchestra.run.smithi037.stdout: "45065ce7": { 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4, 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 146.4, 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-31T06:47:46.122 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-31T06:47:46.123 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:46.123 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:46.123 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:46.123 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:46.123 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:46.123 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 -- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4600b4e30 msgr2=0x7fc4600b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4600b4e30 0x7fc4600b7340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc4640e3290 tx=0x7fc4640abfb0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 -- 172.21.15.37:0/1430104042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc474109270 msgr2=0x7fc47419a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc474109270 0x7fc47419a6b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc46400e9f0 tx=0x7fc46400eeb0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 -- 172.21.15.37:0/1430104042 shutdown_connections 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4600b4e30 0x7fc4600b7340 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc474109bc0 0x7fc47419f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc474109270 0x7fc47419a6b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 --2- 172.21.15.37:0/1430104042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc474103930 0x7fc47419a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 -- 172.21.15.37:0/1430104042 >> 172.21.15.37:0/1430104042 conn(0x7fc4740ff3a0 msgr2=0x7fc474106860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 -- 172.21.15.37:0/1430104042 shutdown_connections 2024-08-31T06:47:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:46.119+0000 7fc47c6bc640 1 -- 172.21.15.37:0/1430104042 wait complete. 2024-08-31T06:47:46.913 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '45065ce7', total seconds elapsed: 30.0 2024-08-31T06:47:46.914 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.4 2024-08-31T06:47:46.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:47:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:47.594 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:47 smithi037 ceph-mon[18612]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:47.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 -- 172.21.15.37:0/2100421047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 msgr2=0x7fcc541100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:47.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/2100421047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 0x7fcc541100a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c009ca0 tx=0x7fcc4c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 -- 172.21.15.37:0/2100421047 shutdown_connections 2024-08-31T06:47:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/2100421047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 0x7fcc541100a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/2100421047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc54105050 0x7fcc5410d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/2100421047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc54104620 0x7fcc54104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 -- 172.21.15.37:0/2100421047 >> 172.21.15.37:0/2100421047 conn(0x7fcc540794d0 msgr2=0x7fcc540798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 -- 172.21.15.37:0/2100421047 shutdown_connections 2024-08-31T06:47:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.732+0000 7fcc5aedc640 1 -- 172.21.15.37:0/2100421047 wait complete. 2024-08-31T06:47:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.733+0000 7fcc5aedc640 1 Processor -- start 2024-08-31T06:47:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.733+0000 7fcc5aedc640 1 -- start start 2024-08-31T06:47:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc5aedc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc54104620 0x7fcc5419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc5aedc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc54105050 0x7fcc5419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc5aedc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 0x7fcc541a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc5aedc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54103fa0 con 0x7fcc5410dbd0 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc5aedc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54103e20 con 0x7fcc54105050 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc5aedc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54104120 con 0x7fcc54104620 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc59479640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 0x7fcc541a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc59479640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 0x7fcc541a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52188/0 (socket says 172.21.15.37:52188) 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc59479640 1 -- 172.21.15.37:0/3070970545 learned_addr learned my addr 172.21.15.37:0/3070970545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc58c78640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc54104620 0x7fcc5419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc59479640 1 -- 172.21.15.37:0/3070970545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc54104620 msgr2=0x7fcc5419c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc59479640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc54104620 0x7fcc5419c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc59479640 1 -- 172.21.15.37:0/3070970545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc54105050 msgr2=0x7fcc5419c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc53fff640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc54105050 0x7fcc5419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc59479640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc54105050 0x7fcc5419c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.734+0000 7fcc59479640 1 -- 172.21.15.37:0/3070970545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc541a2330 con 0x7fcc5410dbd0 2024-08-31T06:47:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.735+0000 7fcc58c78640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc54104620 0x7fcc5419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.735+0000 7fcc59479640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 0x7fcc541a1c00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c005e30 tx=0x7fcc4c0093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:47.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.735+0000 7fcc51ffb640 1 -- 172.21.15.37:0/3070970545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c032d10 con 0x7fcc5410dbd0 2024-08-31T06:47:47.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.735+0000 7fcc51ffb640 1 -- 172.21.15.37:0/3070970545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc4c032eb0 con 0x7fcc5410dbd0 2024-08-31T06:47:47.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.735+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc541a25c0 con 0x7fcc5410dbd0 2024-08-31T06:47:47.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.735+0000 7fcc51ffb640 1 -- 172.21.15.37:0/3070970545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c030b90 con 0x7fcc5410dbd0 2024-08-31T06:47:47.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.735+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc541a8d80 con 0x7fcc5410dbd0 2024-08-31T06:47:47.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.737+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc54104a30 con 0x7fcc5410dbd0 2024-08-31T06:47:47.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.739+0000 7fcc51ffb640 1 -- 172.21.15.37:0/3070970545 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7fcc4c004040 con 0x7fcc5410dbd0 2024-08-31T06:47:47.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.740+0000 7fcc51ffb640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc440b4db0 0x7fcc440b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:47.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.740+0000 7fcc58c78640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc440b4db0 0x7fcc440b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:47.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.740+0000 7fcc51ffb640 1 -- 172.21.15.37:0/3070970545 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fcc4c106b70 con 0x7fcc5410dbd0 2024-08-31T06:47:47.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.741+0000 7fcc58c78640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc440b4db0 0x7fcc440b72c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcc5406b960 tx=0x7fcc48005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:47.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.745+0000 7fcc51ffb640 1 -- 172.21.15.37:0/3070970545 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcc4c0cd7d0 con 0x7fcc5410dbd0 2024-08-31T06:47:47.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:47 smithi106 ceph-mon[22134]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:47.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:47 smithi066 ceph-mon[22244]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-08-31T06:47:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.971+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc541a9030 con 0x7fcc5410dbd0 2024-08-31T06:47:47.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.971+0000 7fcc51ffb640 1 -- 172.21.15.37:0/3070970545 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fcc4c0cd0d0 con 0x7fcc5410dbd0 2024-08-31T06:47:47.973 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:47:47.973 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:47:47.973 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:47:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc440b4db0 msgr2=0x7fcc440b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc440b4db0 0x7fcc440b72c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fcc5406b960 tx=0x7fcc48005f90 comp rx=0 tx=0).stop 2024-08-31T06:47:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 msgr2=0x7fcc541a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 0x7fcc541a1c00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c005e30 tx=0x7fcc4c0093d0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 shutdown_connections 2024-08-31T06:47:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcc440b4db0 0x7fcc440b72c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc5410dbd0 0x7fcc541a1c00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcc54105050 0x7fcc5419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 --2- 172.21.15.37:0/3070970545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcc54104620 0x7fcc5419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 >> 172.21.15.37:0/3070970545 conn(0x7fcc540794d0 msgr2=0x7fcc54107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 shutdown_connections 2024-08-31T06:47:47.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:47.974+0000 7fcc5aedc640 1 -- 172.21.15.37:0/3070970545 wait complete. 2024-08-31T06:47:48.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 -- 172.21.15.37:0/1648874968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8107960 msgr2=0x7f8da8107d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/1648874968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8107960 0x7f8da8107d70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009900 tx=0x7f8d9c02a410 comp rx=0 tx=0).stop 2024-08-31T06:47:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 -- 172.21.15.37:0/1648874968 shutdown_connections 2024-08-31T06:47:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/1648874968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8107960 0x7f8da8107d70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/1648874968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8da81082b0 0x7f8da810eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/1648874968 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8da8101f20 0x7f8da8102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 -- 172.21.15.37:0/1648874968 >> 172.21.15.37:0/1648874968 conn(0x7f8da8079c30 msgr2=0x7f8da807a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 -- 172.21.15.37:0/1648874968 shutdown_connections 2024-08-31T06:47:48.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.173+0000 7f8dadf2b640 1 -- 172.21.15.37:0/1648874968 wait complete. 2024-08-31T06:47:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.174+0000 7f8dadf2b640 1 Processor -- start 2024-08-31T06:47:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.174+0000 7f8dadf2b640 1 -- start start 2024-08-31T06:47:48.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8dadf2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8101f20 0x7f8da819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8dadf2b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8da81082b0 0x7f8da819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8dadf2b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8da819fbb0 0x7f8da819ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8dadf2b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81115a0 con 0x7f8da8101f20 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8dadf2b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8111420 con 0x7f8da819fbb0 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8dadf2b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8da8111720 con 0x7f8da81082b0 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8101f20 0x7f8da819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8101f20 0x7f8da819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52212/0 (socket says 172.21.15.37:52212) 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da77fe640 1 -- 172.21.15.37:0/3887092006 learned_addr learned my addr 172.21.15.37:0/3887092006 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8da81082b0 0x7f8da819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da7fff640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8da819fbb0 0x7f8da819ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da77fe640 1 -- 172.21.15.37:0/3887092006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8da81082b0 msgr2=0x7f8da819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da77fe640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8da81082b0 0x7f8da819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da77fe640 1 -- 172.21.15.37:0/3887092006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8da819fbb0 msgr2=0x7f8da819ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da77fe640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8da819fbb0 0x7f8da819ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da77fe640 1 -- 172.21.15.37:0/3887092006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8da81a0790 con 0x7f8da8101f20 2024-08-31T06:47:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.175+0000 7f8da7fff640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8da819fbb0 0x7f8da819ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.176+0000 7f8da77fe640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8101f20 0x7f8da819a440 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800ea40 tx=0x7f8d9800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.176+0000 7f8da4ff9640 1 -- 172.21.15.37:0/3887092006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800cd40 con 0x7f8da8101f20 2024-08-31T06:47:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.176+0000 7f8da4ff9640 1 -- 172.21.15.37:0/3887092006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d980054b0 con 0x7f8da8101f20 2024-08-31T06:47:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.176+0000 7f8dadf2b640 1 -- 172.21.15.37:0/3887092006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8da810cad0 con 0x7f8da8101f20 2024-08-31T06:47:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.176+0000 7f8da4ff9640 1 -- 172.21.15.37:0/3887092006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d98016410 con 0x7f8da8101f20 2024-08-31T06:47:48.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.176+0000 7f8dadf2b640 1 -- 172.21.15.37:0/3887092006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8da810cfa0 con 0x7f8da8101f20 2024-08-31T06:47:48.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8db4e98740 1 Processor -- start 2024-08-31T06:47:48.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8db4e98740 1 -- start start 2024-08-31T06:47:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91ec1b0 0x5601e958fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91c32f0 0x5601e9590220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9590760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8db4e98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5601e9505000 con 0x5601e91c32f0 2024-08-31T06:47:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8db4e98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5601e94f4590 con 0x5601e91ec1b0 2024-08-31T06:47:48.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8db4e98740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5601e94f8540 con 0x5601e91cb4d0 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8da4ff9640 1 -- 172.21.15.37:0/3887092006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f8d980165b0 con 0x7f8da8101f20 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91ec1b0 0x5601e958fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9590760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91ec1b0 0x5601e958fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:57758/0 (socket says 172.21.15.37:57758) 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.180+0000 7f8da7fff640 1 -- 172.21.15.37:0/2801176337 learned_addr learned my addr 172.21.15.37:0/2801176337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da77fe640 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91c32f0 0x5601e9590220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da6ffd640 1 -- 172.21.15.37:0/2801176337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91ec1b0 msgr2=0x5601e958fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91ec1b0 0x5601e958fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da6ffd640 1 -- 172.21.15.37:0/2801176337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91c32f0 msgr2=0x5601e9590220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91c32f0 0x5601e9590220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da6ffd640 1 -- 172.21.15.37:0/2801176337 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e9257790 con 0x5601e91cb4d0 2024-08-31T06:47:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da77fe640 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91c32f0 0x5601e9590220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9590760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8da8075440 tx=0x7f8d9c031a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ffb03b4b1b2e11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:48.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da4ff9640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d900b4db0 0x7f8d900b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.181+0000 7f8da7fff640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d900b4db0 0x7f8d900b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.182+0000 7f8da4ff9640 1 -- 172.21.15.37:0/3887092006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f8d980e5550 con 0x7f8da8101f20 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.182+0000 7f8d8dffb640 1 -- 172.21.15.37:0/2801176337 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c035040 con 0x5601e91cb4d0 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.182+0000 7f8d8dffb640 1 -- 172.21.15.37:0/2801176337 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d9c0044c0 con 0x5601e91cb4d0 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.182+0000 7f8d8dffb640 1 -- 172.21.15.37:0/2801176337 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c003bc0 con 0x5601e91cb4d0 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 -- 172.21.15.37:0/2801176337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 msgr2=0x5601e9590760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8da7fff640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d900b4db0 0x7f8d900b72c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8da0012640 tx=0x7f8da0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9590760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8da8075440 tx=0x7f8d9c031a70 comp rx=0 tx=0).stop 2024-08-31T06:47:48.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 -- 172.21.15.37:0/2801176337 shutdown_connections 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91c32f0 0x5601e9590220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9590760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2801176337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91ec1b0 0x5601e958fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 -- 172.21.15.37:0/2801176337 >> 172.21.15.37:0/2801176337 conn(0x5601e91e0300 msgr2=0x5601e958dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 -- 172.21.15.37:0/2801176337 shutdown_connections 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 -- 172.21.15.37:0/2801176337 wait complete. 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.183+0000 7f8db4e98740 1 -- start start 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8db4e98740 1 Processor -- start 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91cb4d0 0x5601e959bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91ec1b0 0x5601e95a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8db4e98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5601e942dab0 con 0x5601e91cb4d0 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8db4e98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5601e947b680 con 0x5601e91c32f0 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8db4e98740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5601e959e400 con 0x5601e91ec1b0 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91cb4d0 0x5601e959bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8da6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91cb4d0 0x5601e959bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52226/0 (socket says 172.21.15.37:52226) 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8da6ffd640 1 -- 172.21.15.37:0/2909305027 learned_addr learned my addr 172.21.15.37:0/2909305027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.184+0000 7f8db4e98740 10 client.0 _ll_register_callbacks cb 0x5601e9203a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8da77fe640 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8da7fff640 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91ec1b0 0x5601e95a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8da6ffd640 1 -- 172.21.15.37:0/2909305027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91ec1b0 msgr2=0x5601e95a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91ec1b0 0x5601e95a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8da6ffd640 1 -- 172.21.15.37:0/2909305027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 msgr2=0x5601e959b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8da6ffd640 1 -- 172.21.15.37:0/2909305027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601e92d0620 con 0x5601e91cb4d0 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91cb4d0 0x5601e959bf40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c031630 tx=0x7f8d9c031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe5bf0ec92e0c28e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8d86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8d86ffd640 1 -- 172.21.15.37:0/2909305027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c035070 con 0x5601e91cb4d0 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8db4e98740 1 -- 172.21.15.37:0/2909305027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5601e9506f50 con 0x5601e91cb4d0 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.185+0000 7f8d86ffd640 1 -- 172.21.15.37:0/2909305027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f8d9c003940 con 0x5601e91cb4d0 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8d86ffd640 1 -- 172.21.15.37:0/2909305027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8d9c003b40 con 0x5601e91cb4d0 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8db4e98740 10 client.15873 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:48.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8db4e98740 1 -- 172.21.15.37:0/2909305027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5601e95aa440 con 0x5601e91cb4d0 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8d86ffd640 1 -- 172.21.15.37:0/2909305027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5601e9506f50 con 0x5601e91cb4d0 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8d86ffd640 1 -- 172.21.15.37:0/2909305027 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8d9c03c700 con 0x5601e91cb4d0 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8db4e98740 10 client.15873 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8db4e98740 10 client.15873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8db4e98740 20 client.15873 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5601e91aad80 0x5601e95ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8db4e98740 4 client.15873 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.186+0000 7f8db4e98740 1 -- 172.21.15.37:0/2909305027 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601e95029f0 con 0x5601e91aad80 2024-08-31T06:47:48.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.187+0000 7f8da77fe640 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5601e91aad80 0x5601e95ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.187+0000 7f8d86ffd640 10 client.15873 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.187+0000 7f8da77fe640 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5601e91aad80 0x5601e95ad7a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6733e64263d648d4 server_cookie=597ea67aadce72f4 in_seq=0 out_seq=0 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.188+0000 7f8d86ffd640 1 -- 172.21.15.37:0/2909305027 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5601e95029f0 con 0x5601e91aad80 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.188+0000 7f8d86ffd640 10 client.15873 handle_command_reply: tid=0 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.188+0000 7f8db4e98740 1 client.15873 shutdown 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.188+0000 7f8db4e98740 1 -- 172.21.15.37:0/2909305027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91cb4d0 msgr2=0x5601e959bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91cb4d0 0x5601e959bf40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c031630 tx=0x7f8d9c031660 comp rx=0 tx=0).stop 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 -- 172.21.15.37:0/2909305027 shutdown_connections 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5601e91aad80 0x5601e95ad7a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8d86ffd640 0 client.15873 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91cb4d0 0x5601e959bf40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91ec1b0 0x5601e95a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 --2- 172.21.15.37:0/2909305027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 -- 172.21.15.37:0/2909305027 >> 172.21.15.37:0/2909305027 conn(0x5601e91e0300 msgr2=0x5601e9590d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:48.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 -- 172.21.15.37:0/2909305027 shutdown_connections 2024-08-31T06:47:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 1 -- 172.21.15.37:0/2909305027 wait complete. 2024-08-31T06:47:48.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.189+0000 7f8db4e98740 20 client.15873 trim_cache size 0 max 16384 2024-08-31T06:47:48.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.218+0000 7f8db4e98740 1 Processor -- start 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.218+0000 7f8db4e98740 1 -- start start 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.218+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91aad80 0x5601e959b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.218+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9594e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8db4e98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81b4390 con 0x5601e91aad80 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8db4e98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81b1c60 con 0x5601e91c32f0 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8db4e98740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81afab0 con 0x5601e91cb4d0 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91aad80 0x5601e959b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91aad80 0x5601e959b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52232/0 (socket says 172.21.15.37:52232) 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 -- 172.21.15.37:0/4248380427 learned_addr learned my addr 172.21.15.37:0/4248380427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:48.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da7fff640 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9594e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 -- 172.21.15.37:0/4248380427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 msgr2=0x5601e9594e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9594e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 -- 172.21.15.37:0/4248380427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 msgr2=0x5601e959bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 -- 172.21.15.37:0/4248380427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601e9591fe0 con 0x5601e91aad80 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da7fff640 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9594e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8da77fe640 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91aad80 0x5601e959b960 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8d980ab810 tx=0x7f8d980e5850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad98917140ad007 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.219+0000 7f8d8d7fa640 1 -- 172.21.15.37:0/4248380427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d980abb10 con 0x5601e91aad80 2024-08-31T06:47:48.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.220+0000 7f8d8d7fa640 1 -- 172.21.15.37:0/4248380427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d980aee50 con 0x5601e91aad80 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.220+0000 7f8d8d7fa640 1 -- 172.21.15.37:0/4248380427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d980a7da0 con 0x5601e91aad80 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.220+0000 7f8db4e98740 1 -- 172.21.15.37:0/4248380427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91aad80 msgr2=0x5601e959b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.220+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91aad80 0x5601e959b960 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8d980ab810 tx=0x7f8d980e5850 comp rx=0 tx=0).stop 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 -- 172.21.15.37:0/4248380427 shutdown_connections 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e9594e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e959bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4248380427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91aad80 0x5601e959b960 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 -- 172.21.15.37:0/4248380427 >> 172.21.15.37:0/4248380427 conn(0x5601e91e0300 msgr2=0x5601e9599fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 -- 172.21.15.37:0/4248380427 shutdown_connections 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 -- 172.21.15.37:0/4248380427 wait complete. 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 -- start start 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.221+0000 7f8db4e98740 1 Processor -- start 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e95adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e95ae550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8db4e98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91ec1b0 0x5601e9615f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8db4e98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81b0120 con 0x5601e91ec1b0 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8db4e98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81b1590 con 0x5601e91c32f0 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8db4e98740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8da81b07f0 con 0x5601e91cb4d0 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8db4e98740 10 client.0 _ll_register_callbacks cb 0x7f8da0009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91ec1b0 0x5601e9615f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91ec1b0 0x5601e9615f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52248/0 (socket says 172.21.15.37:52248) 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da7fff640 1 -- 172.21.15.37:0/4231445035 learned_addr learned my addr 172.21.15.37:0/4231445035 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da6ffd640 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e95ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da77fe640 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e95adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da7fff640 1 -- 172.21.15.37:0/4231445035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 msgr2=0x5601e95ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da7fff640 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e95ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da7fff640 1 -- 172.21.15.37:0/4231445035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 msgr2=0x5601e95adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da7fff640 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e95adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.222+0000 7f8da7fff640 1 -- 172.21.15.37:0/4231445035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601e9616550 con 0x5601e91ec1b0 2024-08-31T06:47:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.223+0000 7f8da7fff640 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91ec1b0 0x5601e9615f10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8da0010a70 tx=0x7f8da0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84785dd3e2f82af server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:48.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.223+0000 7f8d86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:48.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.223+0000 7f8d86ffd640 1 -- 172.21.15.37:0/4231445035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da002a440 con 0x5601e91ec1b0 2024-08-31T06:47:48.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.223+0000 7f8d86ffd640 1 -- 172.21.15.37:0/4231445035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f8da001e400 con 0x5601e91ec1b0 2024-08-31T06:47:48.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.223+0000 7f8db4e98740 1 -- 172.21.15.37:0/4231445035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d980aee50 con 0x5601e91ec1b0 2024-08-31T06:47:48.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.223+0000 7f8d86ffd640 1 -- 172.21.15.37:0/4231445035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8da001e600 con 0x5601e91ec1b0 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.223+0000 7f8db4e98740 10 client.15879 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.223+0000 7f8db4e98740 1 -- 172.21.15.37:0/4231445035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5601e9617700 con 0x5601e91ec1b0 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8d86ffd640 1 -- 172.21.15.37:0/4231445035 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d980aee50 con 0x5601e91ec1b0 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8d86ffd640 1 -- 172.21.15.37:0/4231445035 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8da0028070 con 0x5601e91ec1b0 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8db4e98740 10 client.15879 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8db4e98740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8db4e98740 20 client.15879 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5601e91801c0 0x5601e9619ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8db4e98740 4 client.15879 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8db4e98740 1 -- 172.21.15.37:0/4231445035 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5601e9500130 con 0x5601e91801c0 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.224+0000 7f8da77fe640 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5601e91801c0 0x5601e9619ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.225+0000 7f8d86ffd640 10 client.15879 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:48.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.225+0000 7f8da77fe640 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5601e91801c0 0x5601e9619ef0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d175e0615de82807 server_cookie=7ceef1b2e2c23f23 in_seq=0 out_seq=0 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8d86ffd640 1 -- 172.21.15.37:0/4231445035 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5601e9500130 con 0x5601e91801c0 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8d86ffd640 10 client.15879 handle_command_reply: tid=0 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 client.15879 shutdown 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 -- 172.21.15.37:0/4231445035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91ec1b0 msgr2=0x5601e9615f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91ec1b0 0x5601e9615f10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8da0010a70 tx=0x7f8da0004a40 comp rx=0 tx=0).stop 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 -- 172.21.15.37:0/4231445035 shutdown_connections 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5601e91801c0 0x5601e9619ef0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5601e91ec1b0 0x5601e9615f10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5601e91cb4d0 0x5601e95ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 --2- 172.21.15.37:0/4231445035 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5601e91c32f0 0x5601e95adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 -- 172.21.15.37:0/4231445035 >> 172.21.15.37:0/4231445035 conn(0x5601e91e0300 msgr2=0x5601e9599d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:48.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8d86ffd640 0 client.15879 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 -- 172.21.15.37:0/4231445035 shutdown_connections 2024-08-31T06:47:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 1 -- 172.21.15.37:0/4231445035 wait complete. 2024-08-31T06:47:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.229+0000 7f8db4e98740 20 client.15879 trim_cache size 0 max 16384 2024-08-31T06:47:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:47:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:47:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:47:48.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 -- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d900b4db0 msgr2=0x7f8d900b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d900b4db0 0x7f8d900b72c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8da0012640 tx=0x7f8da0009500 comp rx=0 tx=0).stop 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 -- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8101f20 msgr2=0x7f8da819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8101f20 0x7f8da819a440 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800ea40 tx=0x7f8d9800ef00 comp rx=0 tx=0).stop 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 -- 172.21.15.37:0/3887092006 shutdown_connections 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d900b4db0 0x7f8d900b72c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8da819fbb0 0x7f8da819ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8da81082b0 0x7f8da819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 --2- 172.21.15.37:0/3887092006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8da8101f20 0x7f8da819a440 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:48.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 -- 172.21.15.37:0/3887092006 >> 172.21.15.37:0/3887092006 conn(0x7f8da8079c30 msgr2=0x7f8da81058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 -- 172.21.15.37:0/3887092006 shutdown_connections 2024-08-31T06:47:48.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:47:48.230+0000 7f8dadf2b640 1 -- 172.21.15.37:0/3887092006 wait complete. 2024-08-31T06:47:48.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:48 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:47:48.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:48 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3070970545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:48.800 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0' 2024-08-31T06:47:48.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 146.4 --await-for 45.0 2024-08-31T06:47:48.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:48 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:47:48.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:48 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3070970545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:48.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:48 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:47:48.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:48 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3070970545' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:47:49.216 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:47:49.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:49 smithi037 ceph-mon[18612]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:47:49.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:49 smithi106 ceph-mon[22134]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:47:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 -- 172.21.15.37:0/292949409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d0108a90 msgr2=0x7f15d010f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 --2- 172.21.15.37:0/292949409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d0108a90 0x7f15d010f2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15c8009ca0 tx=0x7f15c802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 -- 172.21.15.37:0/292949409 shutdown_connections 2024-08-31T06:47:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 --2- 172.21.15.37:0/292949409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d0108140 0x7f15d0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 --2- 172.21.15.37:0/292949409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d0108a90 0x7f15d010f2c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 --2- 172.21.15.37:0/292949409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0102800 0x7f15d0102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 -- 172.21.15.37:0/292949409 >> 172.21.15.37:0/292949409 conn(0x7f15d0079470 msgr2=0x7f15d0079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 -- 172.21.15.37:0/292949409 shutdown_connections 2024-08-31T06:47:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.821+0000 7f15d61d8640 1 -- 172.21.15.37:0/292949409 wait complete. 2024-08-31T06:47:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.822+0000 7f15d61d8640 1 Processor -- start 2024-08-31T06:47:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15d61d8640 1 -- start start 2024-08-31T06:47:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15d61d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d0102800 0x7f15d019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d0102800 0x7f15d019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d0102800 0x7f15d019aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52264/0 (socket says 172.21.15.37:52264) 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15cf7fe640 1 -- 172.21.15.37:0/402337969 learned_addr learned my addr 172.21.15.37:0/402337969 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15d61d8640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d0108140 0x7f15d019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15d61d8640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0108a90 0x7f15d019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15d0112660 con 0x7f15d0102800 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.823+0000 7f15ceffd640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d0108140 0x7f15d019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01124e0 con 0x7f15d0108a90 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01127e0 con 0x7f15d0108140 2024-08-31T06:47:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15cffff640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0108a90 0x7f15d019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15cffff640 1 -- 172.21.15.37:0/402337969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d0108140 msgr2=0x7f15d019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15cffff640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d0108140 0x7f15d019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15cffff640 1 -- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d0102800 msgr2=0x7f15d019aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15cffff640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d0102800 0x7f15d019aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15cffff640 1 -- 172.21.15.37:0/402337969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d01a6180 con 0x7f15d0108a90 2024-08-31T06:47:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.824+0000 7f15cffff640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0108a90 0x7f15d019b970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15c8031040 tx=0x7f15c8003f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.825+0000 7f15ccff9640 1 -- 172.21.15.37:0/402337969 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8032c10 con 0x7f15d0108a90 2024-08-31T06:47:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.825+0000 7f15ccff9640 1 -- 172.21.15.37:0/402337969 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c8032db0 con 0x7f15d0108a90 2024-08-31T06:47:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.825+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d01a6410 con 0x7f15d0108a90 2024-08-31T06:47:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.825+0000 7f15ccff9640 1 -- 172.21.15.37:0/402337969 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c8030a20 con 0x7f15d0108a90 2024-08-31T06:47:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.825+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d01a68e0 con 0x7f15d0108a90 2024-08-31T06:47:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.829+0000 7f15ccff9640 1 -- 172.21.15.37:0/402337969 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) ==== 152759+0+0 (secure 0 0 0) 0x7f15c8004680 con 0x7f15d0108a90 2024-08-31T06:47:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.829+0000 7f15dc74d740 1 Processor -- start 2024-08-31T06:47:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.829+0000 7f15dc74d740 1 -- start start 2024-08-31T06:47:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 0x55ce7a338c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f68980 0x55ce7a3391d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a339710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15dc74d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ce7a2ad330 con 0x55ce79f70b60 2024-08-31T06:47:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15dc74d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce7a29c8c0 con 0x55ce79f68980 2024-08-31T06:47:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15dc74d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ce7a2a0870 con 0x55ce79f91840 2024-08-31T06:47:49.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a339710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a339710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52266/0 (socket says 172.21.15.37:52266) 2024-08-31T06:47:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15ceffd640 1 -- 172.21.15.37:0/2764295350 learned_addr learned my addr 172.21.15.37:0/2764295350 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f68980 0x55ce7a3391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15ccff9640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4de0 0x7f15b80b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.830+0000 7f15ceffd640 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 0x55ce7a338c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15cffff640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4de0 0x7f15b80b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15cf7fe640 1 -- 172.21.15.37:0/2764295350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 msgr2=0x55ce7a338c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:49.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 0x55ce7a338c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15cf7fe640 1 -- 172.21.15.37:0/2764295350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 msgr2=0x55ce7a339710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a339710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15cf7fe640 1 -- 172.21.15.37:0/2764295350 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7a254df0 con 0x55ce79f68980 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15ceffd640 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a339710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f68980 0x55ce7a3391d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009cc0 tx=0x7f15c0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973a0b9c6abad767 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15ccff9640 1 -- 172.21.15.37:0/402337969 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f15c8106570 con 0x7f15d0108a90 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15cffff640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4de0 0x7f15b80b72f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15c8103ca0 tx=0x7f15c80cca50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15b5ffb640 1 -- 172.21.15.37:0/2764295350 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c001e070 con 0x55ce79f68980 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15b5ffb640 1 -- 172.21.15.37:0/2764295350 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c0019ac0 con 0x55ce79f68980 2024-08-31T06:47:49.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.831+0000 7f15b5ffb640 1 -- 172.21.15.37:0/2764295350 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c000f970 con 0x55ce79f68980 2024-08-31T06:47:49.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 -- 172.21.15.37:0/2764295350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f68980 msgr2=0x55ce7a3391d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f68980 0x55ce7a3391d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009cc0 tx=0x7f15c0011810 comp rx=0 tx=0).stop 2024-08-31T06:47:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 -- 172.21.15.37:0/2764295350 shutdown_connections 2024-08-31T06:47:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a339710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f68980 0x55ce7a3391d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 --2- 172.21.15.37:0/2764295350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 0x55ce7a338c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 -- 172.21.15.37:0/2764295350 >> 172.21.15.37:0/2764295350 conn(0x55ce79f85990 msgr2=0x55ce7a336b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 -- 172.21.15.37:0/2764295350 shutdown_connections 2024-08-31T06:47:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 -- 172.21.15.37:0/2764295350 wait complete. 2024-08-31T06:47:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.833+0000 7f15dc74d740 1 -- start start 2024-08-31T06:47:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15dc74d740 1 Processor -- start 2024-08-31T06:47:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a348820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f70b60 0x55ce7a348d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 0x55ce7a3492a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15dc74d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ce7a0ff7a0 con 0x55ce79f68980 2024-08-31T06:47:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15dc74d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce7a223240 con 0x55ce79f70b60 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15dc74d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ce7a34b770 con 0x55ce79f91840 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a348820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a348820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52282/0 (socket says 172.21.15.37:52282) 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15dc74d740 10 client.0 _ll_register_callbacks cb 0x55ce79fa9090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.834+0000 7f15ceffd640 1 -- 172.21.15.37:0/885844955 learned_addr learned my addr 172.21.15.37:0/885844955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15ceffd640 1 -- 172.21.15.37:0/885844955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 msgr2=0x55ce7a3492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15ceffd640 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 0x55ce7a3492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15ceffd640 1 -- 172.21.15.37:0/885844955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f70b60 msgr2=0x55ce7a348d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:47:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15ceffd640 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f70b60 0x55ce7a348d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15ceffd640 1 -- 172.21.15.37:0/885844955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7a2592b0 con 0x55ce79f68980 2024-08-31T06:47:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15ceffd640 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a348820 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009e40 tx=0x7f15c4009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d20146035b45975 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:47:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15aeffd640 1 -- 172.21.15.37:0/885844955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4004250 con 0x55ce79f68980 2024-08-31T06:47:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.835+0000 7f15aeffd640 1 -- 172.21.15.37:0/885844955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f15c40043f0 con 0x55ce79f68980 2024-08-31T06:47:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15dc74d740 1 -- 172.21.15.37:0/885844955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c0019ac0 con 0x55ce79f68980 2024-08-31T06:47:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15aeffd640 1 -- 172.21.15.37:0/885844955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15c400e9b0 con 0x55ce79f68980 2024-08-31T06:47:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15dc74d740 10 client.15891 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15dc74d740 1 -- 172.21.15.37:0/885844955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce7a00bb90 con 0x55ce79f68980 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15aeffd640 1 -- 172.21.15.37:0/885844955 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c0019ac0 con 0x55ce79f68980 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15aeffd640 1 -- 172.21.15.37:0/885844955 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15c401b070 con 0x55ce79f68980 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15dc74d740 10 client.15891 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15dc74d740 10 client.15891 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15dc74d740 20 client.15891 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.836+0000 7f15dc74d740 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce79f501c0 0x55ce7a35ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.837+0000 7f15dc74d740 4 client.15891 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.837+0000 7f15dc74d740 1 -- 172.21.15.37:0/885844955 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce7a2af280 con 0x55ce79f501c0 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.837+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce79f501c0 0x55ce7a35ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.837+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce79f501c0 0x55ce7a35ee50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71a7e488447ba5c9 server_cookie=db82de95ebbe8b03 in_seq=0 out_seq=0 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.837+0000 7f15aeffd640 10 client.15891 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.838+0000 7f15aeffd640 1 -- 172.21.15.37:0/885844955 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce7a2af280 con 0x55ce79f501c0 2024-08-31T06:47:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.838+0000 7f15aeffd640 10 client.15891 handle_command_reply: tid=0 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.838+0000 7f15dc74d740 1 client.15891 shutdown 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 -- 172.21.15.37:0/885844955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 msgr2=0x55ce7a348820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a348820 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009e40 tx=0x7f15c4009f30 comp rx=0 tx=0).stop 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 -- 172.21.15.37:0/885844955 shutdown_connections 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce79f501c0 0x55ce7a35ee50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f91840 0x55ce7a3492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f70b60 0x55ce7a348d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 --2- 172.21.15.37:0/885844955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a348820 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15aeffd640 0 client.15891 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 -- 172.21.15.37:0/885844955 >> 172.21.15.37:0/885844955 conn(0x55ce79f85990 msgr2=0x55ce7a335340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 -- 172.21.15.37:0/885844955 shutdown_connections 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 1 -- 172.21.15.37:0/885844955 wait complete. 2024-08-31T06:47:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.839+0000 7f15dc74d740 20 client.15891 trim_cache size 0 max 16384 2024-08-31T06:47:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.857+0000 7f15dc74d740 1 Processor -- start 2024-08-31T06:47:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15dc74d740 1 -- start start 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f68980 0x55ce7a348e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a34a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 0x55ce7a33a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15dc74d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01af860 con 0x55ce79f70b60 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15dc74d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01ad130 con 0x55ce79f91840 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15dc74d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01aaf80 con 0x55ce79f68980 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a34a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a34a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52288/0 (socket says 172.21.15.37:52288) 2024-08-31T06:47:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f68980 0x55ce7a348e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15cf7fe640 1 -- 172.21.15.37:0/175162710 learned_addr learned my addr 172.21.15.37:0/175162710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.858+0000 7f15ceffd640 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 0x55ce7a33a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15cf7fe640 1 -- 172.21.15.37:0/175162710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f68980 msgr2=0x55ce7a348e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f68980 0x55ce7a348e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15cf7fe640 1 -- 172.21.15.37:0/175162710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 msgr2=0x55ce7a33a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 0x55ce7a33a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15cf7fe640 1 -- 172.21.15.37:0/175162710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7a26cd90 con 0x55ce79f70b60 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15ceffd640 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 0x55ce7a33a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a34a700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55ce7a337910 tx=0x7f15c00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abedbab359448fef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15b57fa640 1 -- 172.21.15.37:0/175162710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c001e040 con 0x55ce79f70b60 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.859+0000 7f15b57fa640 1 -- 172.21.15.37:0/175162710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c0032070 con 0x55ce79f70b60 2024-08-31T06:47:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15b57fa640 1 -- 172.21.15.37:0/175162710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004680 con 0x55ce79f70b60 2024-08-31T06:47:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 -- 172.21.15.37:0/175162710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 msgr2=0x55ce7a34a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a34a700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x55ce7a337910 tx=0x7f15c00196c0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 -- 172.21.15.37:0/175162710 shutdown_connections 2024-08-31T06:47:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f70b60 0x55ce7a34a700 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 0x55ce7a33a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 --2- 172.21.15.37:0/175162710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f68980 0x55ce7a348e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 -- 172.21.15.37:0/175162710 >> 172.21.15.37:0/175162710 conn(0x55ce79f85990 msgr2=0x55ce7a339cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 -- 172.21.15.37:0/175162710 shutdown_connections 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.860+0000 7f15dc74d740 1 -- 172.21.15.37:0/175162710 wait complete. 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.861+0000 7f15dc74d740 1 -- start start 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.861+0000 7f15dc74d740 1 Processor -- start 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a357ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f70b60 0x55ce7a358020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15dc74d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 0x55ce7a3c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15dc74d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01ab5f0 con 0x55ce79f68980 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15dc74d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01aca60 con 0x55ce79f91840 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15dc74d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15d01abcc0 con 0x55ce79f70b60 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15dc74d740 10 client.0 _ll_register_callbacks cb 0x7f15c4009370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:47:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a357ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a357ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52290/0 (socket says 172.21.15.37:52290) 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15ceffd640 1 -- 172.21.15.37:0/794680513 learned_addr learned my addr 172.21.15.37:0/794680513 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f70b60 0x55ce7a358020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15cf7fe640 1 -- 172.21.15.37:0/794680513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 msgr2=0x55ce7a3c8860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 0x55ce7a3c8860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15cf7fe640 1 -- 172.21.15.37:0/794680513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 msgr2=0x55ce7a357ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a357ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15cf7fe640 1 -- 172.21.15.37:0/794680513 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7a34baa0 con 0x55ce79f70b60 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.862+0000 7f15ceffd640 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a357ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15cf7fe640 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f70b60 0x55ce7a358020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55ce7a224660 tx=0x7f15c00095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aac5833e6f57ea3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15aeffd640 1 -- 172.21.15.37:0/794680513 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0019a30 con 0x55ce79f70b60 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15aeffd640 1 -- 172.21.15.37:0/794680513 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f15c000f4e0 con 0x55ce79f70b60 2024-08-31T06:47:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15dc74d740 1 -- 172.21.15.37:0/794680513 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15c0032070 con 0x55ce79f70b60 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15aeffd640 1 -- 172.21.15.37:0/794680513 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15c000f700 con 0x55ce79f70b60 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15dc74d740 10 client.25438 fetch_fsmap learned FSMap version 25 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15dc74d740 1 -- 172.21.15.37:0/794680513 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce7a34cd00 con 0x55ce79f70b60 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.863+0000 7f15aeffd640 1 -- 172.21.15.37:0/794680513 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15c001f040 con 0x55ce79f70b60 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.864+0000 7f15aeffd640 1 -- 172.21.15.37:0/794680513 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15c0025040 con 0x55ce79f70b60 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.864+0000 7f15dc74d740 10 client.25438 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.864+0000 7f15dc74d740 10 client.25438 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.864+0000 7f15dc74d740 20 client.25438 populate_metadata read hostname 'smithi037' 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.864+0000 7f15dc74d740 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce79f25570 0x55ce7a34f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.864+0000 7f15dc74d740 4 client.25438 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}] 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.864+0000 7f15dc74d740 1 -- 172.21.15.37:0/794680513 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.4, "await_for": 45.0}) -- 0x7f15c0032070 con 0x55ce79f25570 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.864+0000 7f15ceffd640 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce79f25570 0x55ce7a34f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:47:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.865+0000 7f15aeffd640 10 client.25438 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.865+0000 7f15ceffd640 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce79f25570 0x55ce7a34f250 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc46cae2a683845 server_cookie=e628f9d77fb53d04 in_seq=0 out_seq=0 2024-08-31T06:47:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.871+0000 7f15aeffd640 1 -- 172.21.15.37:0/794680513 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f15c0032070 con 0x55ce79f25570 2024-08-31T06:47:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.871+0000 7f15aeffd640 10 client.25438 handle_command_reply: tid=0 2024-08-31T06:47:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.871+0000 7f15dc74d740 1 client.25438 shutdown 2024-08-31T06:47:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 -- 172.21.15.37:0/794680513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f70b60 msgr2=0x55ce7a358020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f70b60 0x55ce7a358020 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55ce7a224660 tx=0x7f15c00095a0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 -- 172.21.15.37:0/794680513 shutdown_connections 2024-08-31T06:47:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce79f25570 0x55ce7a34f250 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce79f91840 0x55ce7a3c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce79f70b60 0x55ce7a358020 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15aeffd640 0 client.25438 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:47:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 --2- 172.21.15.37:0/794680513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce79f68980 0x55ce7a357ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 -- 172.21.15.37:0/794680513 >> 172.21.15.37:0/794680513 conn(0x55ce79f85990 msgr2=0x55ce7a347830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 -- 172.21.15.37:0/794680513 shutdown_connections 2024-08-31T06:47:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 1 -- 172.21.15.37:0/794680513 wait complete. 2024-08-31T06:47:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.872+0000 7f15dc74d740 20 client.25438 trim_cache size 0 max 16384 2024-08-31T06:47:49.875 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:47:49.875 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 25, 2024-08-31T06:47:49.875 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-31T06:47:49.875 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 6, 2024-08-31T06:47:49.875 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-31T06:47:49.875 INFO:teuthology.orchestra.run.smithi037.stdout: "9ac877b7": { 2024-08-31T06:47:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 6, 2024-08-31T06:47:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-31T06:47:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-31T06:47:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-31T06:47:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-31T06:47:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:47:49.876 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 146.4, 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:49.877 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:49.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:47:49.878 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:47:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4de0 msgr2=0x7f15b80b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4de0 0x7f15b80b72f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15c8103ca0 tx=0x7f15c80cca50 comp rx=0 tx=0).stop 2024-08-31T06:47:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0108a90 msgr2=0x7f15d019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:47:49.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0108a90 0x7f15d019b970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15c8031040 tx=0x7f15c8003f10 comp rx=0 tx=0).stop 2024-08-31T06:47:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 shutdown_connections 2024-08-31T06:47:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15b80b4de0 0x7f15b80b72f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d0108a90 0x7f15d019b970 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15d0108140 0x7f15d019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 --2- 172.21.15.37:0/402337969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15d0102800 0x7f15d019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:47:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 >> 172.21.15.37:0/402337969 conn(0x7f15d0079470 msgr2=0x7f15d01040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:47:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 shutdown_connections 2024-08-31T06:47:49.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:47:49.873+0000 7f15d61d8640 1 -- 172.21.15.37:0/402337969 wait complete. 2024-08-31T06:47:49.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:49 smithi066 ceph-mon[22244]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:47:50.696 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9ac877b7', quiesce took 3.8 seconds. Will release after: 22.599999999999998 2024-08-31T06:47:51.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:51 smithi106 ceph-mon[22134]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:47:51.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:51 smithi106 ceph-mon[22134]: mgrmap e26: x(active, since 9m), standbys: z, y 2024-08-31T06:47:51.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:51 smithi037 ceph-mon[18612]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:47:51.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:51 smithi037 ceph-mon[18612]: mgrmap e26: x(active, since 9m), standbys: z, y 2024-08-31T06:47:51.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:51 smithi066 ceph-mon[22244]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:47:51.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:51 smithi066 ceph-mon[22244]: mgrmap e26: x(active, since 9m), standbys: z, y 2024-08-31T06:47:53.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:53 smithi106 ceph-mon[22134]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-08-31T06:47:53.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:53 smithi037 ceph-mon[18612]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-08-31T06:47:53.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:53 smithi066 ceph-mon[22244]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 8 op/s 2024-08-31T06:47:55.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:55 smithi106 ceph-mon[22134]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-31T06:47:55.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:47:55.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.817 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:55 smithi037 ceph-mon[18612]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-31T06:47:55.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:47:55.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:55 smithi066 ceph-mon[22244]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-31T06:47:55.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:47:55.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:55.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:56.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:47:56.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:47:56.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:56.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:47:56.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:47:56.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:56.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:47:56.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:47:56.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:47:57.360 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 93% (11896/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-08-31T06:47:57.970 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to 'd19e6118f7015f0047264006cb0c873528eb3ae6'. 2024-08-31T06:47:57.970 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:47:57.970 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-31T06:47:57.970 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-31T06:47:57.970 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-08-31T06:47:57.970 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:47:57.971 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at d19e6118f70 Merge PR #44359 into wip-mchangir-testing-20240828.085847-main-debug 2024-08-31T06:47:57.975 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-31T06:47:58.010 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-31T06:47:58.012 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T06:47:58.012 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-31T06:47:58.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:57 smithi106 ceph-mon[22134]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T06:47:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:57 smithi037 ceph-mon[18612]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T06:47:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:57 smithi066 ceph-mon[22244]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T06:47:58.640 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-31T06:47:58.717 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-31T06:47:58.757 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-31T06:47:58.759 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T06:47:58.759 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-31T06:47:58.797 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-31T06:47:58.800 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:47:58.801 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-31T06:47:58.856 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-08-31T06:47:58.858 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-08-31T06:47:58.858 DEBUG:teuthology.orchestra.run.smithi037:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d19e6118f7015f0047264006cb0c873528eb3ae6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-08-31T06:48:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:47:59 smithi106 ceph-mon[22134]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T06:48:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:47:59 smithi037 ceph-mon[18612]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T06:48:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:47:59 smithi066 ceph-mon[22244]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 7 op/s 2024-08-31T06:48:01.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:48:01.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 -- 172.21.15.37:0/1656795216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc460103870 msgr2=0x7fc460103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 --2- 172.21.15.37:0/1656795216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc460103870 0x7fc460103c80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009900 tx=0x7fc45c02a410 comp rx=0 tx=0).stop 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 -- 172.21.15.37:0/1656795216 shutdown_connections 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 --2- 172.21.15.37:0/1656795216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc460109af0 0x7fc460110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 --2- 172.21.15.37:0/1656795216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4601091a0 0x7fc4601095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 --2- 172.21.15.37:0/1656795216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc460103870 0x7fc460103c80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 -- 172.21.15.37:0/1656795216 >> 172.21.15.37:0/1656795216 conn(0x7fc4600ff2b0 msgr2=0x7fc460101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 -- 172.21.15.37:0/1656795216 shutdown_connections 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.332+0000 7fc467d07640 1 -- 172.21.15.37:0/1656795216 wait complete. 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc467d07640 1 Processor -- start 2024-08-31T06:48:01.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc467d07640 1 -- start start 2024-08-31T06:48:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc467d07640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc460103870 0x7fc46019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc467d07640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4601091a0 0x7fc46019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc467d07640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc460109af0 0x7fc46019f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc467d07640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601136c0 con 0x7fc4601091a0 2024-08-31T06:48:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc467d07640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc460113540 con 0x7fc460109af0 2024-08-31T06:48:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc467d07640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc460113840 con 0x7fc460103870 2024-08-31T06:48:01.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc4652a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4601091a0 0x7fc46019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc4652a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4601091a0 0x7fc46019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54232/0 (socket says 172.21.15.37:54232) 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc4652a2640 1 -- 172.21.15.37:0/1042944818 learned_addr learned my addr 172.21.15.37:0/1042944818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc465aa3640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc460103870 0x7fc46019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.333+0000 7fc4662a4640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc460109af0 0x7fc46019f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc4652a2640 1 -- 172.21.15.37:0/1042944818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc460103870 msgr2=0x7fc46019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc4652a2640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc460103870 0x7fc46019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc4652a2640 1 -- 172.21.15.37:0/1042944818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc460109af0 msgr2=0x7fc46019f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc4652a2640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc460109af0 0x7fc46019f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc4652a2640 1 -- 172.21.15.37:0/1042944818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4601a0090 con 0x7fc4601091a0 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc4662a4640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc460109af0 0x7fc46019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc4652a2640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4601091a0 0x7fc46019a700 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc45000d750 tx=0x7fc45000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc456ffd640 1 -- 172.21.15.37:0/1042944818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450017070 con 0x7fc4601091a0 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc467d07640 1 -- 172.21.15.37:0/1042944818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4601a0380 con 0x7fc4601091a0 2024-08-31T06:48:01.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc456ffd640 1 -- 172.21.15.37:0/1042944818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4500054b0 con 0x7fc4601091a0 2024-08-31T06:48:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc467d07640 1 -- 172.21.15.37:0/1042944818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4601a6b10 con 0x7fc4601091a0 2024-08-31T06:48:01.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.334+0000 7fc456ffd640 1 -- 172.21.15.37:0/1042944818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450004bc0 con 0x7fc4601091a0 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.337+0000 7fc46ec70740 1 Processor -- start 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.337+0000 7fc46ec70740 1 -- start start 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.337+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc7f1b0 0x56154c022ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.337+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc562f0 0x56154c023220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.337+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc5e4d0 0x56154c023760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc46ec70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56154bf98000 con 0x56154bc7f1b0 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc46ec70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56154bf87590 con 0x56154bc562f0 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc46ec70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56154bf8b540 con 0x56154bc5e4d0 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc7f1b0 0x56154c022ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc7f1b0 0x56154c022ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54236/0 (socket says 172.21.15.37:54236) 2024-08-31T06:48:01.340 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 -- 172.21.15.37:0/3099107703 learned_addr learned my addr 172.21.15.37:0/3099107703 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc465aa3640 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc562f0 0x56154c023220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc456ffd640 1 -- 172.21.15.37:0/1042944818 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fc450010460 con 0x7fc4601091a0 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 -- 172.21.15.37:0/3099107703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc5e4d0 msgr2=0x56154c023760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc5e4d0 0x56154c023760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 -- 172.21.15.37:0/3099107703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc562f0 msgr2=0x56154c023220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc562f0 0x56154c023220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 -- 172.21.15.37:0/3099107703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154bcea790 con 0x56154bc7f1b0 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc465aa3640 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc562f0 0x56154c023220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.338+0000 7fc4662a4640 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc7f1b0 0x56154c022ce0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc458009ea0 tx=0x7fc458009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc9f401483e11aa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.339+0000 7fc44bfff640 1 -- 172.21.15.37:0/3099107703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458004d20 con 0x56154bc7f1b0 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.339+0000 7fc44bfff640 1 -- 172.21.15.37:0/3099107703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4580054b0 con 0x56154bc7f1b0 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.339+0000 7fc44bfff640 1 -- 172.21.15.37:0/3099107703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458011730 con 0x56154bc7f1b0 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.339+0000 7fc456ffd640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc44c0b4ca0 0x7fc44c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.339+0000 7fc465aa3640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc44c0b4ca0 0x7fc44c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.339+0000 7fc456ffd640 1 -- 172.21.15.37:0/1042944818 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc4500e4f80 con 0x7fc4601091a0 2024-08-31T06:48:01.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc465aa3640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc44c0b4ca0 0x7fc44c0b71b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc45c006010 tx=0x7fc45c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 -- 172.21.15.37:0/3099107703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc7f1b0 msgr2=0x56154c022ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc7f1b0 0x56154c022ce0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc458009ea0 tx=0x7fc458009f90 comp rx=0 tx=0).stop 2024-08-31T06:48:01.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 -- 172.21.15.37:0/3099107703 shutdown_connections 2024-08-31T06:48:01.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc5e4d0 0x56154c023760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc562f0 0x56154c023220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 --2- 172.21.15.37:0/3099107703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc7f1b0 0x56154c022ce0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 -- 172.21.15.37:0/3099107703 >> 172.21.15.37:0/3099107703 conn(0x56154bc73300 msgr2=0x56154c020bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 -- 172.21.15.37:0/3099107703 shutdown_connections 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 -- 172.21.15.37:0/3099107703 wait complete. 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.340+0000 7fc46ec70740 1 -- start start 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc46ec70740 1 Processor -- start 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c02ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc7f1b0 0x56154c03a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc46ec70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56154bec0ab0 con 0x56154bc5e4d0 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc46ec70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56154bf0e680 con 0x56154bc7f1b0 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc46ec70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56154c031460 con 0x56154bc562f0 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc46ec70740 10 client.0 _ll_register_callbacks cb 0x56154bc96a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc4652a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c02ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc4652a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c02ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54246/0 (socket says 172.21.15.37:54246) 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc4652a2640 1 -- 172.21.15.37:0/4050951145 learned_addr learned my addr 172.21.15.37:0/4050951145 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc465aa3640 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.341+0000 7fc4662a4640 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc7f1b0 0x56154c03a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4652a2640 1 -- 172.21.15.37:0/4050951145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 msgr2=0x56154c02e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4652a2640 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4652a2640 1 -- 172.21.15.37:0/4050951145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc7f1b0 msgr2=0x56154c03a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4652a2640 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc7f1b0 0x56154c03a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4652a2640 1 -- 172.21.15.37:0/4050951145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154bd63620 con 0x56154bc5e4d0 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc465aa3640 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4652a2640 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c02ef50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc4500e2d10 tx=0x7fc4500ab000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b53fabe7fb29a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4497fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4497fa640 1 -- 172.21.15.37:0/4050951145 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4500e2e60 con 0x56154bc5e4d0 2024-08-31T06:48:01.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4497fa640 1 -- 172.21.15.37:0/4050951145 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc4500aa910 con 0x56154bc5e4d0 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc46ec70740 1 -- 172.21.15.37:0/4050951145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4580054b0 con 0x56154bc5e4d0 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4497fa640 1 -- 172.21.15.37:0/4050951145 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc450020070 con 0x56154bc5e4d0 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc46ec70740 10 client.15909 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc46ec70740 1 -- 172.21.15.37:0/4050951145 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56154c03d560 con 0x56154bc5e4d0 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4497fa640 1 -- 172.21.15.37:0/4050951145 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4580054b0 con 0x56154bc5e4d0 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.342+0000 7fc4497fa640 1 -- 172.21.15.37:0/4050951145 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc4500d21a0 con 0x56154bc5e4d0 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc46ec70740 10 client.15909 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc46ec70740 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc46ec70740 20 client.15909 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc46ec70740 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56154bc3dd80 0x56154c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc46ec70740 4 client.15909 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc46ec70740 1 -- 172.21.15.37:0/4050951145 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56154bf99f50 con 0x56154bc3dd80 2024-08-31T06:48:01.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc465aa3640 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56154bc3dd80 0x56154c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc4497fa640 10 client.15909 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.343+0000 7fc465aa3640 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56154bc3dd80 0x56154c040a30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84d1d972c6f0c661 server_cookie=b80491df87fca1f in_seq=0 out_seq=0 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.344+0000 7fc4497fa640 1 -- 172.21.15.37:0/4050951145 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56154bf99f50 con 0x56154bc3dd80 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.344+0000 7fc4497fa640 10 client.15909 handle_command_reply: tid=0 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.344+0000 7fc46ec70740 1 client.15909 shutdown 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.344+0000 7fc46ec70740 1 -- 172.21.15.37:0/4050951145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 msgr2=0x56154c02ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.344+0000 7fc46ec70740 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c02ef50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc4500e2d10 tx=0x7fc4500ab000 comp rx=0 tx=0).stop 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 1 -- 172.21.15.37:0/4050951145 shutdown_connections 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56154bc3dd80 0x56154c040a30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c02ef50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc7f1b0 0x56154c03a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc4497fa640 0 client.15909 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:01.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 1 --2- 172.21.15.37:0/4050951145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 1 -- 172.21.15.37:0/4050951145 >> 172.21.15.37:0/4050951145 conn(0x56154bc73300 msgr2=0x56154c023d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 1 -- 172.21.15.37:0/4050951145 shutdown_connections 2024-08-31T06:48:01.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 1 -- 172.21.15.37:0/4050951145 wait complete. 2024-08-31T06:48:01.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.345+0000 7fc46ec70740 20 client.15909 trim_cache size 0 max 16384 2024-08-31T06:48:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.368+0000 7fc46ec70740 1 Processor -- start 2024-08-31T06:48:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.368+0000 7fc46ec70740 1 -- start start 2024-08-31T06:48:01.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.368+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc3dd80 0x56154c0284b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.368+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.368+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c020530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.368+0000 7fc46ec70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601b1cc0 con 0x56154bc5e4d0 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.368+0000 7fc46ec70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601af590 con 0x56154bc3dd80 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.368+0000 7fc46ec70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601ad3e0 con 0x56154bc562f0 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c020530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c020530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54254/0 (socket says 172.21.15.37:54254) 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 -- 172.21.15.37:0/3870635749 learned_addr learned my addr 172.21.15.37:0/3870635749 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc465aa3640 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc3dd80 0x56154c0284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4652a2640 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 -- 172.21.15.37:0/3870635749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 msgr2=0x56154c02dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 -- 172.21.15.37:0/3870635749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc3dd80 msgr2=0x56154c0284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc3dd80 0x56154c0284b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 -- 172.21.15.37:0/3870635749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154c01baa0 con 0x56154bc5e4d0 2024-08-31T06:48:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc465aa3640 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc3dd80 0x56154c0284b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc4662a4640 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c020530 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc458009ea0 tx=0x7fc4580049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7e852f1abd514e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.369+0000 7fc44b7fe640 1 -- 172.21.15.37:0/3870635749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458029070 con 0x56154bc5e4d0 2024-08-31T06:48:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.370+0000 7fc44b7fe640 1 -- 172.21.15.37:0/3870635749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc458004db0 con 0x56154bc5e4d0 2024-08-31T06:48:01.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.370+0000 7fc44b7fe640 1 -- 172.21.15.37:0/3870635749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458011720 con 0x56154bc5e4d0 2024-08-31T06:48:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 -- 172.21.15.37:0/3870635749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 msgr2=0x56154c020530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c020530 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc458009ea0 tx=0x7fc4580049c0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 -- 172.21.15.37:0/3870635749 shutdown_connections 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc5e4d0 0x56154c020530 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c02dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 --2- 172.21.15.37:0/3870635749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc3dd80 0x56154c0284b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 -- 172.21.15.37:0/3870635749 >> 172.21.15.37:0/3870635749 conn(0x56154bc73300 msgr2=0x56154c027da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 -- 172.21.15.37:0/3870635749 shutdown_connections 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 -- 172.21.15.37:0/3870635749 wait complete. 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 -- start start 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.371+0000 7fc46ec70740 1 Processor -- start 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc3dd80 0x56154c0328d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c032e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc46ec70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc5e4d0 0x56154c033370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc46ec70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601ada50 con 0x56154bc3dd80 2024-08-31T06:48:01.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc46ec70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601aeec0 con 0x56154bc5e4d0 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc46ec70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601ae120 con 0x56154bc562f0 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc46ec70740 10 client.0 _ll_register_callbacks cb 0x7fc4500057f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc3dd80 0x56154c0328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc3dd80 0x56154c0328d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54270/0 (socket says 172.21.15.37:54270) 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 -- 172.21.15.37:0/2481406398 learned_addr learned my addr 172.21.15.37:0/2481406398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc4662a4640 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc5e4d0 0x56154c033370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc4652a2640 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c032e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 -- 172.21.15.37:0/2481406398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 msgr2=0x56154c032e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c032e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 -- 172.21.15.37:0/2481406398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc5e4d0 msgr2=0x56154c033370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc5e4d0 0x56154c033370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 -- 172.21.15.37:0/2481406398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154c0aa5d0 con 0x56154bc3dd80 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc465aa3640 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc3dd80 0x56154c0328d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc45c02aa00 tx=0x7fc45c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aecaf5b262681d95 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.372+0000 7fc4497fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc4497fa640 1 -- 172.21.15.37:0/2481406398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c035040 con 0x56154bc3dd80 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc4497fa640 1 -- 172.21.15.37:0/2481406398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc45c05a670 con 0x56154bc3dd80 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 1 -- 172.21.15.37:0/2481406398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc458004db0 con 0x56154bc3dd80 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc4497fa640 1 -- 172.21.15.37:0/2481406398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc45c05a870 con 0x56154bc3dd80 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 10 client.15915 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 1 -- 172.21.15.37:0/2481406398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56154c0ab8f0 con 0x56154bc3dd80 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc4497fa640 1 -- 172.21.15.37:0/2481406398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc458004db0 con 0x56154bc3dd80 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc4497fa640 1 -- 172.21.15.37:0/2481406398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc45c03ca00 con 0x56154bc3dd80 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 10 client.15915 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 20 client.15915 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56154bc7f1b0 0x56154c0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 4 client.15915 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:48:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.373+0000 7fc46ec70740 1 -- 172.21.15.37:0/2481406398 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56154bf959f0 con 0x56154bc7f1b0 2024-08-31T06:48:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.374+0000 7fc4652a2640 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56154bc7f1b0 0x56154c0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.374+0000 7fc4497fa640 10 client.15915 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:01.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:01.374+0000 7fc4652a2640 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56154bc7f1b0 0x56154c0ae090 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed642b46e11f68c server_cookie=ee5cb09a552de2cc in_seq=0 out_seq=0 2024-08-31T06:48:01.401 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:01.790 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:01 smithi037 ceph-mon[18612]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-31T06:48:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 -- 172.21.15.37:0/3648450361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60102830 msgr2=0x7f9c60102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 --2- 172.21.15.37:0/3648450361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60102830 0x7f9c60102c40 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009900 tx=0x7f9c5002a410 comp rx=0 tx=0).stop 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 -- 172.21.15.37:0/3648450361 shutdown_connections 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 --2- 172.21.15.37:0/3648450361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c60108ac0 0x7f9c6010f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 --2- 172.21.15.37:0/3648450361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c60108170 0x7f9c60108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 --2- 172.21.15.37:0/3648450361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60102830 0x7f9c60102c40 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 -- 172.21.15.37:0/3648450361 >> 172.21.15.37:0/3648450361 conn(0x7f9c600794f0 msgr2=0x7f9c60079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 -- 172.21.15.37:0/3648450361 shutdown_connections 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 -- 172.21.15.37:0/3648450361 wait complete. 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 Processor -- start 2024-08-31T06:48:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.883+0000 7f9c6688c640 1 -- start start 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c6688c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c60102830 0x7f9c6019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c6688c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c60108170 0x7f9c6019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c6688c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60108ac0 0x7f9c6019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c6688c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c60113760 con 0x7f9c60108ac0 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c6688c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601135e0 con 0x7f9c60108170 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c6688c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601138e0 con 0x7f9c60102830 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c64e29640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60108ac0 0x7f9c6019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c64e29640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60108ac0 0x7f9c6019f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54298/0 (socket says 172.21.15.37:54298) 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c64e29640 1 -- 172.21.15.37:0/958432989 learned_addr learned my addr 172.21.15.37:0/958432989 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c60102830 0x7f9c6019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c60108170 0x7f9c6019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c64e29640 1 -- 172.21.15.37:0/958432989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c60102830 msgr2=0x7f9c6019a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c64e29640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c60102830 0x7f9c6019a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c64e29640 1 -- 172.21.15.37:0/958432989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c60108170 msgr2=0x7f9c6019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c64e29640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c60108170 0x7f9c6019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.884+0000 7f9c64e29640 1 -- 172.21.15.37:0/958432989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c601a0100 con 0x7f9c60108ac0 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.885+0000 7f9c64e29640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60108ac0 0x7f9c6019f9d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800b970 tx=0x7f9c5800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.885+0000 7f9c5d7fa640 1 -- 172.21.15.37:0/958432989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c58019070 con 0x7f9c60108ac0 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.885+0000 7f9c5d7fa640 1 -- 172.21.15.37:0/958432989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c58014440 con 0x7f9c60108ac0 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.885+0000 7f9c6688c640 1 -- 172.21.15.37:0/958432989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c601a03f0 con 0x7f9c60108ac0 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.885+0000 7f9c5d7fa640 1 -- 172.21.15.37:0/958432989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c580075d0 con 0x7f9c60108ac0 2024-08-31T06:48:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.885+0000 7f9c6688c640 1 -- 172.21.15.37:0/958432989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c601a6b50 con 0x7f9c60108ac0 2024-08-31T06:48:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c6ce01740 1 Processor -- start 2024-08-31T06:48:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c5d7fa640 1 -- 172.21.15.37:0/958432989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f9c5801c070 con 0x7f9c60108ac0 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c6ce01740 1 -- start start 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f363070 0x557e5f7082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f33a1b0 0x557e5f708800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f708d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e5f67f630 con 0x557e5f342390 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557e5f66ebc0 con 0x557e5f363070 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557e5f672b70 con 0x557e5f33a1b0 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c5f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f708d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c5f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f708d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54308/0 (socket says 172.21.15.37:54308) 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.888+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/620330169 learned_addr learned my addr 172.21.15.37:0/620330169 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f33a1b0 0x557e5f708800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f363070 0x557e5f7082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5d7fa640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9c480b4d20 0x7f9c480b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/620330169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f33a1b0 msgr2=0x557e5f708800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f33a1b0 0x557e5f708800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/620330169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f363070 msgr2=0x557e5f7082c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f363070 0x557e5f7082c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/620330169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5f3ce650 con 0x557e5f342390 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c64e29640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9c480b4d20 0x7f9c480b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f708d40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400bfc0 tx=0x7f9c54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c8dab45dfd027b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c5d7fa640 1 -- 172.21.15.37:0/958432989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9c580e4920 con 0x7f9c60108ac0 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c467fc640 1 -- 172.21.15.37:0/620330169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54004250 con 0x557e5f342390 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c467fc640 1 -- 172.21.15.37:0/620330169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c540043f0 con 0x557e5f342390 2024-08-31T06:48:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.889+0000 7f9c467fc640 1 -- 172.21.15.37:0/620330169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54004ce0 con 0x557e5f342390 2024-08-31T06:48:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 -- 172.21.15.37:0/620330169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 msgr2=0x557e5f708d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c64e29640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9c480b4d20 0x7f9c480b7230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9c580e26b0 tx=0x7f9c5806ff50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f708d40 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400bfc0 tx=0x7f9c54004730 comp rx=0 tx=0).stop 2024-08-31T06:48:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 -- 172.21.15.37:0/620330169 shutdown_connections 2024-08-31T06:48:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f708d40 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f33a1b0 0x557e5f708800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/620330169 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f363070 0x557e5f7082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 -- 172.21.15.37:0/620330169 >> 172.21.15.37:0/620330169 conn(0x557e5f357460 msgr2=0x557e5f7061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 -- 172.21.15.37:0/620330169 shutdown_connections 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.890+0000 7f9c6ce01740 1 -- 172.21.15.37:0/620330169 wait complete. 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 1 -- start start 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 1 Processor -- start 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f713aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f342390 0x557e5f714000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f363070 0x557e5f71fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e5f4d1700 con 0x557e5f33a1b0 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557e5f5f5700 con 0x557e5f342390 2024-08-31T06:48:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557e5f716aa0 con 0x557e5f363070 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c6ce01740 10 client.0 _ll_register_callbacks cb 0x557e5f624dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c5f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f713aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c5f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f713aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54316/0 (socket says 172.21.15.37:54316) 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.891+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/3609732076 learned_addr learned my addr 172.21.15.37:0/3609732076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f342390 0x557e5f714000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f363070 0x557e5f71fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/3609732076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f363070 msgr2=0x557e5f71fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f363070 0x557e5f71fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/3609732076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f342390 msgr2=0x557e5f714000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f342390 0x557e5f714000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/3609732076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5f62e8b0 con 0x557e5f33a1b0 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f713aa0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9c54004960 tx=0x7f9c54001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5feca3b2522d1217 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/3609732076 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54005430 con 0x557e5f33a1b0 2024-08-31T06:48:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/3609732076 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9c5402c430 con 0x557e5f33a1b0 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c6ce01740 1 -- 172.21.15.37:0/3609732076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c540043f0 con 0x557e5f33a1b0 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.892+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/3609732076 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c54004e50 con 0x557e5f33a1b0 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c6ce01740 10 client.15927 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c6ce01740 1 -- 172.21.15.37:0/3609732076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557e5f7228e0 con 0x557e5f33a1b0 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/3609732076 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c540043f0 con 0x557e5f33a1b0 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/3609732076 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c5401c030 con 0x557e5f33a1b0 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c6ce01740 10 client.15927 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c6ce01740 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c6ce01740 20 client.15927 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e5f3219f0 0x557e5f725c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c6ce01740 4 client.15927 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c6ce01740 1 -- 172.21.15.37:0/3609732076 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e5f681580 con 0x557e5f3219f0 2024-08-31T06:48:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.893+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e5f3219f0 0x557e5f725c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.894+0000 7f9c3f7fe640 10 client.15927 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.894+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e5f3219f0 0x557e5f725c40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dde31241560a4d0 server_cookie=fc6c73a17688e63e in_seq=0 out_seq=0 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.894+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/3609732076 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e5f681580 con 0x557e5f3219f0 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c3f7fe640 10 client.15927 handle_command_reply: tid=0 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 client.15927 shutdown 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 -- 172.21.15.37:0/3609732076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 msgr2=0x557e5f713aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f713aa0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9c54004960 tx=0x7f9c54001e50 comp rx=0 tx=0).stop 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 -- 172.21.15.37:0/3609732076 shutdown_connections 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e5f3219f0 0x557e5f725c40 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f363070 0x557e5f71fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f342390 0x557e5f714000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c3f7fe640 0 client.15927 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/3609732076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f713aa0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 -- 172.21.15.37:0/3609732076 >> 172.21.15.37:0/3609732076 conn(0x557e5f357460 msgr2=0x557e5f70b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 -- 172.21.15.37:0/3609732076 shutdown_connections 2024-08-31T06:48:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 1 -- 172.21.15.37:0/3609732076 wait complete. 2024-08-31T06:48:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.895+0000 7f9c6ce01740 20 client.15927 trim_cache size 0 max 16384 2024-08-31T06:48:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c6ce01740 1 Processor -- start 2024-08-31T06:48:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c6ce01740 1 -- start start 2024-08-31T06:48:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f3219f0 0x557e5f70bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f71fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f342390 0x557e5f7201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601b1bc0 con 0x557e5f33a1b0 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601af490 con 0x557e5f3219f0 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601ad2e0 con 0x557e5f342390 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f71fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f71fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54318/0 (socket says 172.21.15.37:54318) 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5ffff640 1 -- 172.21.15.37:0/1009044896 learned_addr learned my addr 172.21.15.37:0/1009044896 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/1009044896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f3219f0 0x557e5f70bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5ffff640 1 -- 172.21.15.37:0/1009044896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f342390 msgr2=0x557e5f7201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/1009044896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f342390 0x557e5f7201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5ffff640 1 -- 172.21.15.37:0/1009044896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f3219f0 msgr2=0x557e5f70bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/1009044896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f3219f0 0x557e5f70bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.913+0000 7f9c5ffff640 1 -- 172.21.15.37:0/1009044896 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e5f706db0 con 0x557e5f33a1b0 2024-08-31T06:48:01.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.914+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/1009044896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f71fc90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006010 tx=0x7f9c50004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bba92119cadddb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.914+0000 7f9c45ffb640 1 -- 172.21.15.37:0/1009044896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50035040 con 0x557e5f33a1b0 2024-08-31T06:48:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.914+0000 7f9c45ffb640 1 -- 172.21.15.37:0/1009044896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c500044d0 con 0x557e5f33a1b0 2024-08-31T06:48:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.914+0000 7f9c45ffb640 1 -- 172.21.15.37:0/1009044896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5003c440 con 0x557e5f33a1b0 2024-08-31T06:48:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.914+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1009044896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 msgr2=0x557e5f71fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.914+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1009044896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f71fc90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006010 tx=0x7f9c50004360 comp rx=0 tx=0).stop 2024-08-31T06:48:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1009044896 shutdown_connections 2024-08-31T06:48:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1009044896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f33a1b0 0x557e5f71fc90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1009044896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f342390 0x557e5f7201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1009044896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f3219f0 0x557e5f70bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1009044896 >> 172.21.15.37:0/1009044896 conn(0x557e5f357460 msgr2=0x557e5f70b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1009044896 shutdown_connections 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1009044896 wait complete. 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 -- start start 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.915+0000 7f9c6ce01740 1 Processor -- start 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f3219f0 0x557e5f717e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f33a1b0 0x557e5f7183b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c6ce01740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f7188f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601ad950 con 0x557e5f342390 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601aedc0 con 0x557e5f33a1b0 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c6ce01740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601ae020 con 0x557e5f3219f0 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c6ce01740 10 client.0 _ll_register_callbacks cb 0x7f9c50005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:01.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f7188f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f7188f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54334/0 (socket says 172.21.15.37:54334) 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/1291142603 learned_addr learned my addr 172.21.15.37:0/1291142603 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f33a1b0 0x557e5f7183b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f3219f0 0x557e5f717e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/1291142603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f3219f0 msgr2=0x557e5f717e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f3219f0 0x557e5f717e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f33a1b0 msgr2=0x557e5f7183b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f33a1b0 0x557e5f7183b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 -- 172.21.15.37:0/1291142603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e5f78f570 con 0x557e5f342390 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f33a1b0 0x557e5f7183b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c5f7fe640 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f7188f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9c5402e920 tx=0x7f9c5400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8380db52f5ff10 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.916+0000 7f9c3f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:01.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/1291142603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54004cb0 con 0x557e5f342390 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/1291142603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9c5400b6e0 con 0x557e5f342390 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1291142603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c500044d0 con 0x557e5f342390 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/1291142603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c54045050 con 0x557e5f342390 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 10 client.15933 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1291142603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557e5f790800 con 0x557e5f342390 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/1291142603 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c500044d0 con 0x557e5f342390 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/1291142603 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9c5401c050 con 0x557e5f342390 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 10 client.15933 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 20 client.15933 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e5f363070 0x557e5f792ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 4 client.15933 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:48:01.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.917+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1291142603 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557e5f706710 con 0x557e5f363070 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.918+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e5f363070 0x557e5f792ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.918+0000 7f9c3f7fe640 10 client.15933 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.918+0000 7f9c5ffff640 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e5f363070 0x557e5f792ed0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ddca78a2b84be3b server_cookie=e0becb319924c97a in_seq=0 out_seq=0 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.918+0000 7f9c3f7fe640 1 -- 172.21.15.37:0/1291142603 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x557e5f706710 con 0x557e5f363070 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.918+0000 7f9c3f7fe640 10 client.15933 handle_command_reply: tid=0 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.918+0000 7f9c6ce01740 1 client.15933 shutdown 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1291142603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 msgr2=0x557e5f7188f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f7188f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9c5402e920 tx=0x7f9c5400b910 comp rx=0 tx=0).stop 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1291142603 shutdown_connections 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e5f363070 0x557e5f792ed0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e5f342390 0x557e5f7188f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e5f33a1b0 0x557e5f7183b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 --2- 172.21.15.37:0/1291142603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e5f3219f0 0x557e5f717e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1291142603 >> 172.21.15.37:0/1291142603 conn(0x557e5f357460 msgr2=0x557e5f709280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c3f7fe640 0 client.15933 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:01.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1291142603 shutdown_connections 2024-08-31T06:48:01.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 1 -- 172.21.15.37:0/1291142603 wait complete. 2024-08-31T06:48:01.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.919+0000 7f9c6ce01740 20 client.15933 trim_cache size 0 max 16384 2024-08-31T06:48:01.925 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:48:01.925 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:48:01.925 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:48:01.925 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:48:01.926 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:48:01.927 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:48:01.927 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:48:01.927 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:01.927 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:01.927 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:48:01.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 -- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9c480b4d20 msgr2=0x7f9c480b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9c480b4d20 0x7f9c480b7230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9c580e26b0 tx=0x7f9c5806ff50 comp rx=0 tx=0).stop 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 -- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60108ac0 msgr2=0x7f9c6019f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60108ac0 0x7f9c6019f9d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800b970 tx=0x7f9c5800be30 comp rx=0 tx=0).stop 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 -- 172.21.15.37:0/958432989 shutdown_connections 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9c480b4d20 0x7f9c480b7230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c60108ac0 0x7f9c6019f9d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c60108170 0x7f9c6019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 --2- 172.21.15.37:0/958432989 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c60102830 0x7f9c6019a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 -- 172.21.15.37:0/958432989 >> 172.21.15.37:0/958432989 conn(0x7f9c600794f0 msgr2=0x7f9c60101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 -- 172.21.15.37:0/958432989 shutdown_connections 2024-08-31T06:48:01.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:01.920+0000 7f9c6688c640 1 -- 172.21.15.37:0/958432989 wait complete. 2024-08-31T06:48:01.939 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:01 smithi066 ceph-mon[22244]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-31T06:48:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:01 smithi106 ceph-mon[22134]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 767 B/s wr, 6 op/s 2024-08-31T06:48:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.582+0000 7fc4497fa640 1 -- 172.21.15.37:0/2481406398 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56154bf959f0 con 0x56154bc7f1b0 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.582+0000 7fc4497fa640 10 client.15915 handle_command_reply: tid=0 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.582+0000 7fc46ec70740 1 client.15915 shutdown 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 -- 172.21.15.37:0/2481406398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc3dd80 msgr2=0x56154c0328d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc3dd80 0x56154c0328d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc45c02aa00 tx=0x7fc45c009260 comp rx=0 tx=0).stop 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 -- 172.21.15.37:0/2481406398 shutdown_connections 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56154bc7f1b0 0x56154c0ae090 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56154bc5e4d0 0x56154c033370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56154bc562f0 0x56154c032e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 --2- 172.21.15.37:0/2481406398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154bc3dd80 0x56154c0328d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc4497fa640 0 client.15915 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 -- 172.21.15.37:0/2481406398 >> 172.21.15.37:0/2481406398 conn(0x56154bc73300 msgr2=0x56154c020530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 -- 172.21.15.37:0/2481406398 shutdown_connections 2024-08-31T06:48:02.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 1 -- 172.21.15.37:0/2481406398 wait complete. 2024-08-31T06:48:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.583+0000 7fc46ec70740 20 client.15915 trim_cache size 0 max 16384 2024-08-31T06:48:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:48:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:48:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:48:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 -- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc44c0b4ca0 msgr2=0x7fc44c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc44c0b4ca0 0x7fc44c0b71b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc45c006010 tx=0x7fc45c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 -- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4601091a0 msgr2=0x7fc46019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4601091a0 0x7fc46019a700 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc45000d750 tx=0x7fc45000dc10 comp rx=0 tx=0).stop 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 -- 172.21.15.37:0/1042944818 shutdown_connections 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc44c0b4ca0 0x7fc44c0b71b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4601091a0 0x7fc46019a700 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc460109af0 0x7fc46019f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 --2- 172.21.15.37:0/1042944818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc460103870 0x7fc46019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 -- 172.21.15.37:0/1042944818 >> 172.21.15.37:0/1042944818 conn(0x7fc4600ff2b0 msgr2=0x7fc4601016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 -- 172.21.15.37:0/1042944818 shutdown_connections 2024-08-31T06:48:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:02.584+0000 7fc467d07640 1 -- 172.21.15.37:0/1042944818 wait complete. 2024-08-31T06:48:02.676 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:48:02.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:48:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.414+0000 7f0a49c89640 1 -- 172.21.15.37:0/2338468045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44102880 msgr2=0x7f0a44102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.414+0000 7f0a49c89640 1 --2- 172.21.15.37:0/2338468045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44102880 0x7f0a44102c90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009900 tx=0x7f0a3402a410 comp rx=0 tx=0).stop 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.414+0000 7f0a49c89640 1 -- 172.21.15.37:0/2338468045 shutdown_connections 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.414+0000 7f0a49c89640 1 --2- 172.21.15.37:0/2338468045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a44108b10 0x7f0a4410f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.414+0000 7f0a49c89640 1 --2- 172.21.15.37:0/2338468045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a441081c0 0x7f0a441085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.414+0000 7f0a49c89640 1 --2- 172.21.15.37:0/2338468045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44102880 0x7f0a44102c90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.415+0000 7f0a49c89640 1 -- 172.21.15.37:0/2338468045 >> 172.21.15.37:0/2338468045 conn(0x7f0a44079510 msgr2=0x7f0a44079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.415+0000 7f0a49c89640 1 -- 172.21.15.37:0/2338468045 shutdown_connections 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.415+0000 7f0a49c89640 1 -- 172.21.15.37:0/2338468045 wait complete. 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.415+0000 7f0a49c89640 1 Processor -- start 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.415+0000 7f0a49c89640 1 -- start start 2024-08-31T06:48:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a49c89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a44102880 0x7f0a4419b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a49c89640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a441081c0 0x7f0a4419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a49c89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44108b10 0x7f0a4419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a49c89640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44112690 con 0x7f0a44108b10 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a49c89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44112510 con 0x7f0a44102880 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a49c89640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44112810 con 0x7f0a441081c0 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44108b10 0x7f0a4419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44108b10 0x7f0a4419bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54350/0 (socket says 172.21.15.37:54350) 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 -- 172.21.15.37:0/1682797923 learned_addr learned my addr 172.21.15.37:0/1682797923 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a3affd640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a441081c0 0x7f0a4419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a437fe640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a44102880 0x7f0a4419b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 -- 172.21.15.37:0/1682797923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a441081c0 msgr2=0x7f0a4419b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a441081c0 0x7f0a4419b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 -- 172.21.15.37:0/1682797923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a44102880 msgr2=0x7f0a4419b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a44102880 0x7f0a4419b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 -- 172.21.15.37:0/1682797923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a441a6350 con 0x7f0a44108b10 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a437fe640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a44102880 0x7f0a4419b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.416+0000 7f0a43fff640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44108b10 0x7f0a4419bac0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00eaa0 tx=0x7f0a3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.417+0000 7f0a417fa640 1 -- 172.21.15.37:0/1682797923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00cdb0 con 0x7f0a44108b10 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.417+0000 7f0a417fa640 1 -- 172.21.15.37:0/1682797923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a3c005020 con 0x7f0a44108b10 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.417+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a441a6640 con 0x7f0a44108b10 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.417+0000 7f0a417fa640 1 -- 172.21.15.37:0/1682797923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0116d0 con 0x7f0a44108b10 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.417+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a441a6bd0 con 0x7f0a44108b10 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.418+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a44103b00 con 0x7f0a44108b10 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.420+0000 7f0a417fa640 1 -- 172.21.15.37:0/1682797923 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f0a3c0051d0 con 0x7f0a44108b10 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.420+0000 7f0a417fa640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0a300b4d20 0x7f0a300b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.420+0000 7f0a437fe640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0a300b4d20 0x7f0a300b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.420+0000 7f0a417fa640 1 -- 172.21.15.37:0/1682797923 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0a3c0e5980 con 0x7f0a44108b10 2024-08-31T06:48:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.421+0000 7f0a437fe640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0a300b4d20 0x7f0a300b7230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0a34000c00 tx=0x7f0a34032c80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.424+0000 7f0a417fa640 1 -- 172.21.15.37:0/1682797923 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0a3c016030 con 0x7f0a44108b10 2024-08-31T06:48:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.647+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a44102c90 con 0x7f0a44108b10 2024-08-31T06:48:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.648+0000 7f0a417fa640 1 -- 172.21.15.37:0/1682797923 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f0a3c0ac830 con 0x7f0a44108b10 2024-08-31T06:48:03.649 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:48:03.649 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:48:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:48:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0a300b4d20 msgr2=0x7f0a300b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0a300b4d20 0x7f0a300b7230 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0a34000c00 tx=0x7f0a34032c80 comp rx=0 tx=0).stop 2024-08-31T06:48:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44108b10 msgr2=0x7f0a4419bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44108b10 0x7f0a4419bac0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c00eaa0 tx=0x7f0a3c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:48:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 shutdown_connections 2024-08-31T06:48:03.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0a300b4d20 0x7f0a300b7230 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a44108b10 0x7f0a4419bac0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a441081c0 0x7f0a4419b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 --2- 172.21.15.37:0/1682797923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a44102880 0x7f0a4419b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 >> 172.21.15.37:0/1682797923 conn(0x7f0a44079510 msgr2=0x7f0a441063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 shutdown_connections 2024-08-31T06:48:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:03.650+0000 7f0a49c89640 1 -- 172.21.15.37:0/1682797923 wait complete. 2024-08-31T06:48:04.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:03 smithi037 ceph-mon[18612]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-31T06:48:04.002 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:03 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1682797923' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:04.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:03 smithi106 ceph-mon[22134]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-31T06:48:04.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:03 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1682797923' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:04.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:03 smithi066 ceph-mon[22244]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-31T06:48:04.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:03 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1682797923' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:04.347 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:48:04.607 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 -- 172.21.15.37:0/3959876342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 msgr2=0x7fd51010f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 --2- 172.21.15.37:0/3959876342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 0x7fd51010f0e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd508009ca0 tx=0x7fd50802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 -- 172.21.15.37:0/3959876342 shutdown_connections 2024-08-31T06:48:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 --2- 172.21.15.37:0/3959876342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 0x7fd51010f0e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 --2- 172.21.15.37:0/3959876342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd510107f60 0x7fd510108370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 --2- 172.21.15.37:0/3959876342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd510102620 0x7fd510102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 -- 172.21.15.37:0/3959876342 >> 172.21.15.37:0/3959876342 conn(0x7fd5100fe070 msgr2=0x7fd5101004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:05.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 -- 172.21.15.37:0/3959876342 shutdown_connections 2024-08-31T06:48:05.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 -- 172.21.15.37:0/3959876342 wait complete. 2024-08-31T06:48:05.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.099+0000 7fd50ffff640 1 Processor -- start 2024-08-31T06:48:05.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50ffff640 1 -- start start 2024-08-31T06:48:05.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd510102620 0x7fd510199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd510107f60 0x7fd51019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 0x7fd51019f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50ffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd510113570 con 0x7fd5101088b0 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50ffff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101133f0 con 0x7fd510102620 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50ffff640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101136f0 con 0x7fd510107f60 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 0x7fd51019f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 0x7fd51019f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36572/0 (socket says 172.21.15.37:36572) 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50f7fe640 1 -- 172.21.15.37:0/342984143 learned_addr learned my addr 172.21.15.37:0/342984143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50effd640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd510102620 0x7fd510199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd510107f60 0x7fd51019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50f7fe640 1 -- 172.21.15.37:0/342984143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd510107f60 msgr2=0x7fd51019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50f7fe640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd510107f60 0x7fd51019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50f7fe640 1 -- 172.21.15.37:0/342984143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd510102620 msgr2=0x7fd510199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50f7fe640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd510102620 0x7fd510199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.100+0000 7fd50f7fe640 1 -- 172.21.15.37:0/342984143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51019fdd0 con 0x7fd5101088b0 2024-08-31T06:48:05.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.101+0000 7fd50f7fe640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 0x7fd51019f760 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd508005cc0 tx=0x7fd508032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.101+0000 7fd4f7fff640 1 -- 172.21.15.37:0/342984143 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508004040 con 0x7fd5101088b0 2024-08-31T06:48:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.101+0000 7fd4f7fff640 1 -- 172.21.15.37:0/342984143 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd508004670 con 0x7fd5101088b0 2024-08-31T06:48:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.101+0000 7fd50ffff640 1 -- 172.21.15.37:0/342984143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5101a0060 con 0x7fd5101088b0 2024-08-31T06:48:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.101+0000 7fd4f7fff640 1 -- 172.21.15.37:0/342984143 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508030cc0 con 0x7fd5101088b0 2024-08-31T06:48:05.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.101+0000 7fd50ffff640 1 -- 172.21.15.37:0/342984143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5101a68e0 con 0x7fd5101088b0 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.103+0000 7fd51b977740 1 Processor -- start 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.103+0000 7fd4f7fff640 1 -- 172.21.15.37:0/342984143 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fd5080041e0 con 0x7fd5101088b0 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.103+0000 7fd51b977740 1 -- start start 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd51b977740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a6c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd51b977740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd51b977740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a6d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd51b977740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560e079df680 con 0x560e0769a1b0 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd51b977740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560e079cec10 con 0x560e076a2390 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd51b977740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560e079d2bc0 con 0x560e076c3070 2024-08-31T06:48:05.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36578/0 (socket says 172.21.15.37:36578) 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50effd640 1 -- 172.21.15.37:0/2449616726 learned_addr learned my addr 172.21.15.37:0/2449616726 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd4f7fff640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4f80b4d50 0x7fd4f80b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a6c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a6d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50effd640 1 -- 172.21.15.37:0/2449616726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 msgr2=0x560e07a6c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50effd640 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a6c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50f7fe640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4f80b4d50 0x7fd4f80b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50effd640 1 -- 172.21.15.37:0/2449616726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 msgr2=0x560e07a6d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50effd640 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a6d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50effd640 1 -- 172.21.15.37:0/2449616726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e0772e650 con 0x560e0769a1b0 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.104+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a6c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:05.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.105+0000 7fd4f7fff640 1 -- 172.21.15.37:0/342984143 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd508106990 con 0x7fd5101088b0 2024-08-31T06:48:05.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.105+0000 7fd50effd640 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6ce40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd50000cc60 tx=0x7fd50000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6233ef18f698482 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:05.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.105+0000 7fd4f57fa640 1 -- 172.21.15.37:0/2449616726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500014070 con 0x560e0769a1b0 2024-08-31T06:48:05.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.105+0000 7fd4f57fa640 1 -- 172.21.15.37:0/2449616726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5000047a0 con 0x560e0769a1b0 2024-08-31T06:48:05.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.105+0000 7fd50f7fe640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4f80b4d50 0x7fd4f80b7260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd508104720 tx=0x7fd5080c9070 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:05.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.105+0000 7fd4f57fa640 1 -- 172.21.15.37:0/2449616726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500010690 con 0x560e0769a1b0 2024-08-31T06:48:05.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 -- 172.21.15.37:0/2449616726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 msgr2=0x560e07a6ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6ce40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fd50000cc60 tx=0x7fd50000e720 comp rx=0 tx=0).stop 2024-08-31T06:48:05.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 -- 172.21.15.37:0/2449616726 shutdown_connections 2024-08-31T06:48:05.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6ce40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a6d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 --2- 172.21.15.37:0/2449616726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a6c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 -- 172.21.15.37:0/2449616726 >> 172.21.15.37:0/2449616726 conn(0x560e076b7460 msgr2=0x560e07a6a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 -- 172.21.15.37:0/2449616726 shutdown_connections 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 -- 172.21.15.37:0/2449616726 wait complete. 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 -- start start 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.106+0000 7fd51b977740 1 Processor -- start 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd51b977740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a78120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd51b977740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a786c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd51b977740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a843d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd51b977740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560e07831700 con 0x560e0769a1b0 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd51b977740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560e07955750 con 0x560e076a2390 2024-08-31T06:48:05.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd51b977740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560e07a7b0e0 con 0x560e076c3070 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd51b977740 10 client.0 _ll_register_callbacks cb 0x560e07984e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a78120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a78120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36590/0 (socket says 172.21.15.37:36590) 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 -- 172.21.15.37:0/1986632650 learned_addr learned my addr 172.21.15.37:0/1986632650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 -- 172.21.15.37:0/1986632650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 msgr2=0x560e07a843d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a843d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 -- 172.21.15.37:0/1986632650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 msgr2=0x560e07a786c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50effd640 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a786c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 -- 172.21.15.37:0/1986632650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e0798e900 con 0x560e0769a1b0 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a78120 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd51006b240 tx=0x7fd504013e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f5411ca13a29db server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd4f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:05.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.107+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/1986632650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5040130d0 con 0x560e0769a1b0 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/1986632650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd504004020 con 0x560e0769a1b0 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 1 -- 172.21.15.37:0/1986632650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5000047a0 con 0x560e0769a1b0 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/1986632650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd504013270 con 0x560e0769a1b0 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 10 client.15951 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 1 -- 172.21.15.37:0/1986632650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e07a86f40 con 0x560e0769a1b0 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/1986632650 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5000047a0 con 0x560e0769a1b0 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/1986632650 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd5040047a0 con 0x560e0769a1b0 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 10 client.15951 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 10 client.15951 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 20 client.15951 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560e076819f0 0x560e07a8a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 4 client.15951 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.108+0000 7fd51b977740 1 -- 172.21.15.37:0/1986632650 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e079e15d0 con 0x560e076819f0 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.109+0000 7fd50effd640 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560e076819f0 0x560e07a8a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.109+0000 7fd50effd640 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560e076819f0 0x560e07a8a4f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52a3ffc04f48ca83 server_cookie=e007cbb93f844669 in_seq=0 out_seq=0 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.109+0000 7fd4f2ff5640 10 client.15951 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/1986632650 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560e079e15d0 con 0x560e076819f0 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd4f2ff5640 10 client.15951 handle_command_reply: tid=0 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 client.15951 shutdown 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 -- 172.21.15.37:0/1986632650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 msgr2=0x560e07a78120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a78120 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd51006b240 tx=0x7fd504013e20 comp rx=0 tx=0).stop 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 -- 172.21.15.37:0/1986632650 shutdown_connections 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560e076819f0 0x560e07a8a4f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a843d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a786c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 --2- 172.21.15.37:0/1986632650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a78120 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 -- 172.21.15.37:0/1986632650 >> 172.21.15.37:0/1986632650 conn(0x560e076b7460 msgr2=0x560e07a6fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd4f2ff5640 0 client.15951 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:48:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 -- 172.21.15.37:0/1986632650 shutdown_connections 2024-08-31T06:48:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 1 -- 172.21.15.37:0/1986632650 wait complete. 2024-08-31T06:48:05.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.110+0000 7fd51b977740 20 client.15951 trim_cache size 0 max 16384 2024-08-31T06:48:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.123+0000 7fd51b977740 1 Processor -- start 2024-08-31T06:48:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.123+0000 7fd51b977740 1 -- start start 2024-08-31T06:48:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd51b977740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd51b977740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a842d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd51b977740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a84810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd51b977740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101af7c0 con 0x560e0769a1b0 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd51b977740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101ad090 con 0x560e076a2390 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd51b977740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101aaee0 con 0x560e076c3070 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36606/0 (socket says 172.21.15.37:36606) 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 -- 172.21.15.37:0/161516619 learned_addr learned my addr 172.21.15.37:0/161516619 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50effd640 1 --2- 172.21.15.37:0/161516619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a842d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 -- 172.21.15.37:0/161516619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 msgr2=0x560e07a84810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/161516619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a84810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 -- 172.21.15.37:0/161516619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 msgr2=0x560e07a842d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/161516619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a842d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 -- 172.21.15.37:0/161516619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e07a793e0 con 0x560e0769a1b0 2024-08-31T06:48:05.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/161516619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6e040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd504005d90 tx=0x7fd50400d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9318042d4f16e014 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd4f4ff9640 1 -- 172.21.15.37:0/161516619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504027070 con 0x560e0769a1b0 2024-08-31T06:48:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd4f4ff9640 1 -- 172.21.15.37:0/161516619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd504004730 con 0x560e0769a1b0 2024-08-31T06:48:05.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.124+0000 7fd4f4ff9640 1 -- 172.21.15.37:0/161516619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504000e60 con 0x560e0769a1b0 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 -- 172.21.15.37:0/161516619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 msgr2=0x560e07a6e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 --2- 172.21.15.37:0/161516619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6e040 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd504005d90 tx=0x7fd50400d870 comp rx=0 tx=0).stop 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 -- 172.21.15.37:0/161516619 shutdown_connections 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 --2- 172.21.15.37:0/161516619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076c3070 0x560e07a84810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 --2- 172.21.15.37:0/161516619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076a2390 0x560e07a842d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 --2- 172.21.15.37:0/161516619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a6e040 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 -- 172.21.15.37:0/161516619 >> 172.21.15.37:0/161516619 conn(0x560e076b7460 msgr2=0x560e07a6d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 -- 172.21.15.37:0/161516619 shutdown_connections 2024-08-31T06:48:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.125+0000 7fd51b977740 1 -- 172.21.15.37:0/161516619 wait complete. 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 1 -- start start 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 1 Processor -- start 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a80340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076a2390 0x560e07a80880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076c3070 0x560e07a7b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101ab550 con 0x560e0769a1b0 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101ac9c0 con 0x560e076c3070 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101abc20 con 0x560e076a2390 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd51b977740 10 client.0 _ll_register_callbacks cb 0x7fd50400d670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd50e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a80340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd50e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a80340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36620/0 (socket says 172.21.15.37:36620) 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd50e7fc640 1 -- 172.21.15.37:0/227372876 learned_addr learned my addr 172.21.15.37:0/227372876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd50effd640 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076a2390 0x560e07a80880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.126+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076c3070 0x560e07a7b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd50e7fc640 1 -- 172.21.15.37:0/227372876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076a2390 msgr2=0x560e07a80880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076a2390 0x560e07a80880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd50e7fc640 1 -- 172.21.15.37:0/227372876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076c3070 msgr2=0x560e07a7b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076c3070 0x560e07a7b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd50e7fc640 1 -- 172.21.15.37:0/227372876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e07a7b830 con 0x560e0769a1b0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd50e7fc640 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a80340 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd504006010 tx=0x7fd504013760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3aa38dbea507d9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd4f2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/227372876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504027070 con 0x560e0769a1b0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/227372876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd504003800 con 0x560e0769a1b0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd51b977740 1 -- 172.21.15.37:0/227372876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd504004730 con 0x560e0769a1b0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/227372876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd504003a00 con 0x560e0769a1b0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd51b977740 10 client.15957 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd51b977740 1 -- 172.21.15.37:0/227372876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e07af5510 con 0x560e0769a1b0 2024-08-31T06:48:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.127+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/227372876 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd504004730 con 0x560e0769a1b0 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/227372876 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd504037440 con 0x560e0769a1b0 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd51b977740 10 client.15957 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd51b977740 10 client.15957 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd51b977740 20 client.15957 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd51b977740 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560e07656da0 0x560e07af7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd51b977740 4 client.15957 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd51b977740 1 -- 172.21.15.37:0/227372876 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e079dd070 con 0x560e07656da0 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd50effd640 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560e07656da0 0x560e07af7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd50effd640 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560e07656da0 0x560e07af7b30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1acc292c38160981 server_cookie=21f484f570b873f2 in_seq=0 out_seq=0 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.128+0000 7fd4f2ff5640 10 client.15957 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd4f2ff5640 1 -- 172.21.15.37:0/227372876 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e079dd070 con 0x560e07656da0 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd4f2ff5640 10 client.15957 handle_command_reply: tid=0 2024-08-31T06:48:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 client.15957 shutdown 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 -- 172.21.15.37:0/227372876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 msgr2=0x560e07a80340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a80340 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd504006010 tx=0x7fd504013760 comp rx=0 tx=0).stop 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 -- 172.21.15.37:0/227372876 shutdown_connections 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560e07656da0 0x560e07af7b30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e076c3070 0x560e07a7b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560e076a2390 0x560e07a80880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 --2- 172.21.15.37:0/227372876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e0769a1b0 0x560e07a80340 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 -- 172.21.15.37:0/227372876 >> 172.21.15.37:0/227372876 conn(0x560e076b7460 msgr2=0x560e07a6a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd4f2ff5640 0 client.15957 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 -- 172.21.15.37:0/227372876 shutdown_connections 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 1 -- 172.21.15.37:0/227372876 wait complete. 2024-08-31T06:48:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.129+0000 7fd51b977740 20 client.15957 trim_cache size 0 max 16384 2024-08-31T06:48:05.135 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:48:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 -- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4f80b4d50 msgr2=0x7fd4f80b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4f80b4d50 0x7fd4f80b7260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd508104720 tx=0x7fd5080c9070 comp rx=0 tx=0).stop 2024-08-31T06:48:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 -- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 msgr2=0x7fd51019f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 0x7fd51019f760 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd508005cc0 tx=0x7fd508032c40 comp rx=0 tx=0).stop 2024-08-31T06:48:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 -- 172.21.15.37:0/342984143 shutdown_connections 2024-08-31T06:48:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4f80b4d50 0x7fd4f80b7260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5101088b0 0x7fd51019f760 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd510107f60 0x7fd51019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 --2- 172.21.15.37:0/342984143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd510102620 0x7fd510199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 -- 172.21.15.37:0/342984143 >> 172.21.15.37:0/342984143 conn(0x7fd5100fe070 msgr2=0x7fd510100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 -- 172.21.15.37:0/342984143 shutdown_connections 2024-08-31T06:48:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:05.130+0000 7fd50ffff640 1 -- 172.21.15.37:0/342984143 wait complete. 2024-08-31T06:48:05.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:48:06.064 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:06.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:05 smithi106 ceph-mon[22134]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:48:06.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:05 smithi037 ceph-mon[18612]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:48:06.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:05 smithi066 ceph-mon[22244]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:48:06.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 -- 172.21.15.37:0/3896319849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 msgr2=0x7f0d1410fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 --2- 172.21.15.37:0/3896319849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 0x7f0d1410fa60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009900 tx=0x7f0d0802a480 comp rx=0 tx=0).stop 2024-08-31T06:48:06.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 -- 172.21.15.37:0/3896319849 shutdown_connections 2024-08-31T06:48:06.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 --2- 172.21.15.37:0/3896319849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 0x7f0d1410fa60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 --2- 172.21.15.37:0/3896319849 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d1410ffa0 0x7f0d141123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 --2- 172.21.15.37:0/3896319849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d141023f0 0x7f0d14102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 -- 172.21.15.37:0/3896319849 >> 172.21.15.37:0/3896319849 conn(0x7f0d140794d0 msgr2=0x7f0d140798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:06.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 -- 172.21.15.37:0/3896319849 shutdown_connections 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.572+0000 7f0d195f0640 1 -- 172.21.15.37:0/3896319849 wait complete. 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d195f0640 1 Processor -- start 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d195f0640 1 -- start start 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d195f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d141023f0 0x7f0d1419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d195f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 0x7f0d1419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d195f0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d1410ffa0 0x7f0d141a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d195f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141158c0 con 0x7f0d14102d40 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d195f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d14115740 con 0x7f0d141023f0 2024-08-31T06:48:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d195f0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0d14115a40 con 0x7f0d1410ffa0 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 0x7f0d1419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 0x7f0d1419c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36640/0 (socket says 172.21.15.37:36640) 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d127fc640 1 -- 172.21.15.37:0/788851433 learned_addr learned my addr 172.21.15.37:0/788851433 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d141023f0 0x7f0d1419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.573+0000 7f0d137fe640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d1410ffa0 0x7f0d141a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d127fc640 1 -- 172.21.15.37:0/788851433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d1410ffa0 msgr2=0x7f0d141a1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d127fc640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d1410ffa0 0x7f0d141a1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d127fc640 1 -- 172.21.15.37:0/788851433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d141023f0 msgr2=0x7f0d1419c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d127fc640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d141023f0 0x7f0d1419c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d127fc640 1 -- 172.21.15.37:0/788851433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d141a2280 con 0x7f0d14102d40 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d141023f0 0x7f0d1419c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d127fc640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 0x7f0d1419c8b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009230 tx=0x7f0d08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:06.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0cfbfff640 1 -- 172.21.15.37:0/788851433 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0803f030 con 0x7f0d14102d40 2024-08-31T06:48:06.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0cfbfff640 1 -- 172.21.15.37:0/788851433 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d08003a80 con 0x7f0d14102d40 2024-08-31T06:48:06.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d195f0640 1 -- 172.21.15.37:0/788851433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d141a2510 con 0x7f0d14102d40 2024-08-31T06:48:06.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0cfbfff640 1 -- 172.21.15.37:0/788851433 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08035070 con 0x7f0d14102d40 2024-08-31T06:48:06.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.574+0000 7f0d195f0640 1 -- 172.21.15.37:0/788851433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d141a8cd0 con 0x7f0d14102d40 2024-08-31T06:48:06.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d1fb65740 1 Processor -- start 2024-08-31T06:48:06.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d1fb65740 1 -- start start 2024-08-31T06:48:06.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0cfbfff640 1 -- 172.21.15.37:0/788851433 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f0d08042030 con 0x7f0d14102d40 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faab5070 0x5643fae5a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae5a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae5ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5643fadd1680 con 0x5643faa8c1b0 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5643fadc0c10 con 0x5643faa94390 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5643fadc4bc0 con 0x5643faab5070 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d12ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae5a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d12ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae5a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36644/0 (socket says 172.21.15.37:36644) 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.577+0000 7f0d12ffd640 1 -- 172.21.15.37:0/407022836 learned_addr learned my addr 172.21.15.37:0/407022836 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d137fe640 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faab5070 0x5643fae5a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d127fc640 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae5ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d12ffd640 1 -- 172.21.15.37:0/407022836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faab5070 msgr2=0x5643fae5a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:06.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faab5070 0x5643fae5a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d12ffd640 1 -- 172.21.15.37:0/407022836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 msgr2=0x5643fae5ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae5ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d12ffd640 1 -- 172.21.15.37:0/407022836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643fab20650 con 0x5643faa8c1b0 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d127fc640 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae5ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae5a850 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400af40 tx=0x7f0d0400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9e6ca2c1634090 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0cfbfff640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0cfc0b4d20 0x7f0cfc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0cf97fa640 1 -- 172.21.15.37:0/407022836 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04004d20 con 0x5643faa8c1b0 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0d137fe640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0cfc0b4d20 0x7f0cfc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0cf97fa640 1 -- 172.21.15.37:0/407022836 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d04011ae0 con 0x5643faa8c1b0 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0cf97fa640 1 -- 172.21.15.37:0/407022836 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d04005570 con 0x5643faa8c1b0 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.578+0000 7f0cfbfff640 1 -- 172.21.15.37:0/788851433 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0d08105a40 con 0x7f0d14102d40 2024-08-31T06:48:06.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 -- 172.21.15.37:0/407022836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 msgr2=0x5643fae5a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d137fe640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0cfc0b4d20 0x7f0cfc0b7230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00b710 tx=0x7f0d0c00b2e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae5a850 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0d0400af40 tx=0x7f0d0400f7f0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 -- 172.21.15.37:0/407022836 shutdown_connections 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae5a850 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae5ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/407022836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faab5070 0x5643fae5a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 -- 172.21.15.37:0/407022836 >> 172.21.15.37:0/407022836 conn(0x5643faaa9460 msgr2=0x5643fae58200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 -- 172.21.15.37:0/407022836 shutdown_connections 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.579+0000 7f0d1fb65740 1 -- 172.21.15.37:0/407022836 wait complete. 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 1 -- start start 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 1 Processor -- start 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa8c1b0 0x5643fae65a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa94390 0x5643fae65fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faab5070 0x5643fae71e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5643fac23700 con 0x5643faa94390 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5643fad47750 con 0x5643faab5070 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5643fae68af0 con 0x5643faa8c1b0 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d1fb65740 10 client.0 _ll_register_callbacks cb 0x5643fad76e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa94390 0x5643fae65fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.580+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa94390 0x5643fae65fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36646/0 (socket says 172.21.15.37:36646) 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d127fc640 1 -- 172.21.15.37:0/817999824 learned_addr learned my addr 172.21.15.37:0/817999824 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa8c1b0 0x5643fae65a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d137fe640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faab5070 0x5643fae71e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d127fc640 1 -- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa8c1b0 msgr2=0x5643fae65a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d127fc640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa8c1b0 0x5643fae65a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d127fc640 1 -- 172.21.15.37:0/817999824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faab5070 msgr2=0x5643fae71e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:06.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d127fc640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faab5070 0x5643fae71e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d127fc640 1 -- 172.21.15.37:0/817999824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643fad80900 con 0x5643faa94390 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d137fe640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faab5070 0x5643fae71e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa8c1b0 0x5643fae65a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d127fc640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa94390 0x5643fae65fa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0d080cbe70 tx=0x7f0d080cc000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ceba27670420642 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0cf6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/817999824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08049070 con 0x5643faa94390 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/817999824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0d08103450 con 0x5643faa94390 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d1fb65740 1 -- 172.21.15.37:0/817999824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d04011ae0 con 0x5643faa94390 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/817999824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d08103650 con 0x5643faa94390 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d1fb65740 10 client.15969 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.581+0000 7f0d1fb65740 1 -- 172.21.15.37:0/817999824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5643fae74890 con 0x5643faa94390 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/817999824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d04011ae0 con 0x5643faa94390 2024-08-31T06:48:06.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/817999824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d080d5000 con 0x5643faa94390 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0d1fb65740 10 client.15969 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0d1fb65740 10 client.15969 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0d1fb65740 20 client.15969 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5643faa739f0 0x5643fae77df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0d1fb65740 4 client.15969 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0d1fb65740 1 -- 172.21.15.37:0/817999824 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643fadd35d0 con 0x5643faa739f0 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.582+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5643faa739f0 0x5643fae77df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.583+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5643faa739f0 0x5643fae77df0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b7a0b82652b3b82d server_cookie=2f9f750ddcfeb432 in_seq=0 out_seq=0 2024-08-31T06:48:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.583+0000 7f0cf6ff5640 10 client.15969 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:48:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.583+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/817999824 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643fadd35d0 con 0x5643faa739f0 2024-08-31T06:48:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0cf6ff5640 10 client.15969 handle_command_reply: tid=0 2024-08-31T06:48:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 client.15969 shutdown 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 -- 172.21.15.37:0/817999824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa94390 msgr2=0x5643fae65fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa94390 0x5643fae65fa0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0d080cbe70 tx=0x7f0d080cc000 comp rx=0 tx=0).stop 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 -- 172.21.15.37:0/817999824 shutdown_connections 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5643faa739f0 0x5643fae77df0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa94390 0x5643fae65fa0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0cf6ff5640 0 client.15969 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faab5070 0x5643fae71e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/817999824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa8c1b0 0x5643fae65a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 -- 172.21.15.37:0/817999824 >> 172.21.15.37:0/817999824 conn(0x5643faaa9460 msgr2=0x5643fae5d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 -- 172.21.15.37:0/817999824 shutdown_connections 2024-08-31T06:48:06.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 1 -- 172.21.15.37:0/817999824 wait complete. 2024-08-31T06:48:06.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.584+0000 7f0d1fb65740 20 client.15969 trim_cache size 0 max 16384 2024-08-31T06:48:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.598+0000 7f0d1fb65740 1 Processor -- start 2024-08-31T06:48:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.598+0000 7f0d1fb65740 1 -- start start 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa739f0 0x5643fae5db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae62c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae63190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141b3df0 con 0x5643faa8c1b0 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141b16c0 con 0x5643faa94390 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141af510 con 0x5643faa739f0 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae62c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae62c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36654/0 (socket says 172.21.15.37:36654) 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 -- 172.21.15.37:0/3797937747 learned_addr learned my addr 172.21.15.37:0/3797937747 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa739f0 0x5643fae5db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d137fe640 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae63190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 -- 172.21.15.37:0/3797937747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa739f0 msgr2=0x5643fae5db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa739f0 0x5643fae5db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 -- 172.21.15.37:0/3797937747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 msgr2=0x5643fae63190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae63190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 -- 172.21.15.37:0/3797937747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643fae5cba0 con 0x5643faa8c1b0 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa739f0 0x5643fae5db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.599+0000 7f0d127fc640 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae62c50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0d080c93e0 tx=0x7f0d080cc070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82a9a00092254b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0cf8ff9640 1 -- 172.21.15.37:0/3797937747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d080cc870 con 0x5643faa8c1b0 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0cf8ff9640 1 -- 172.21.15.37:0/3797937747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d080cc170 con 0x5643faa8c1b0 2024-08-31T06:48:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0cf8ff9640 1 -- 172.21.15.37:0/3797937747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d080d5160 con 0x5643faa8c1b0 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 -- 172.21.15.37:0/3797937747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 msgr2=0x5643fae62c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae62c50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0d080c93e0 tx=0x7f0d080cc070 comp rx=0 tx=0).stop 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 -- 172.21.15.37:0/3797937747 shutdown_connections 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae62c50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa94390 0x5643fae63190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/3797937747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa739f0 0x5643fae5db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 -- 172.21.15.37:0/3797937747 >> 172.21.15.37:0/3797937747 conn(0x5643faaa9460 msgr2=0x5643fae5d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 -- 172.21.15.37:0/3797937747 shutdown_connections 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.600+0000 7f0d1fb65740 1 -- 172.21.15.37:0/3797937747 wait complete. 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 1 -- start start 2024-08-31T06:48:06.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 1 Processor -- start 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa739f0 0x5643fae6e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae6ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa94390 0x5643fae6b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141afb80 con 0x5643faa8c1b0 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141b0ff0 con 0x5643faa739f0 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0d141b0250 con 0x5643faa94390 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d1fb65740 10 client.0 _ll_register_callbacks cb 0x7f0d08005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae6ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d127fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae6ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36658/0 (socket says 172.21.15.37:36658) 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d127fc640 1 -- 172.21.15.37:0/1735837416 learned_addr learned my addr 172.21.15.37:0/1735837416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d137fe640 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa94390 0x5643fae6b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.601+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa739f0 0x5643fae6e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d127fc640 1 -- 172.21.15.37:0/1735837416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa94390 msgr2=0x5643fae6b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d127fc640 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa94390 0x5643fae6b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d127fc640 1 -- 172.21.15.37:0/1735837416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa739f0 msgr2=0x5643fae6e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d127fc640 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa739f0 0x5643fae6e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d127fc640 1 -- 172.21.15.37:0/1735837416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643fae6b9a0 con 0x5643faa8c1b0 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d127fc640 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae6ab70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0d08003fa0 tx=0x7f0d080c80b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e89f2294b0125a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0cf6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/1735837416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d08103660 con 0x5643faa8c1b0 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/1735837416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0d080cb6a0 con 0x5643faa8c1b0 2024-08-31T06:48:06.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d1fb65740 1 -- 172.21.15.37:0/1735837416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d080cc170 con 0x5643faa8c1b0 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/1735837416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d080cc870 con 0x5643faa8c1b0 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d1fb65740 10 client.15975 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.602+0000 7f0d1fb65740 1 -- 172.21.15.37:0/1735837416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5643faee3870 con 0x5643faa8c1b0 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/1735837416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d080a8070 con 0x5643faa8c1b0 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/1735837416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d080ed320 con 0x5643faa8c1b0 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0d1fb65740 10 client.15975 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0d1fb65740 10 client.15975 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0d1fb65740 20 client.15975 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5643faab5070 0x5643faee5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0d1fb65740 4 client.15975 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0d1fb65740 1 -- 172.21.15.37:0/1735837416 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643fadcf070 con 0x5643faab5070 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5643faab5070 0x5643faee5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0cf6ff5640 10 client.15975 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:48:06.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.603+0000 7f0d12ffd640 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5643faab5070 0x5643faee5cd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a694c613c85ff432 server_cookie=32853bc9481c1bde in_seq=0 out_seq=0 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0cf6ff5640 1 -- 172.21.15.37:0/1735837416 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643fadcf070 con 0x5643faab5070 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0cf6ff5640 10 client.15975 handle_command_reply: tid=0 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 client.15975 shutdown 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 -- 172.21.15.37:0/1735837416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 msgr2=0x5643fae6ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae6ab70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0d08003fa0 tx=0x7f0d080c80b0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 -- 172.21.15.37:0/1735837416 shutdown_connections 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5643faab5070 0x5643faee5cd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5643faa8c1b0 0x5643fae6ab70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643faa94390 0x5643fae6b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 --2- 172.21.15.37:0/1735837416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5643faa739f0 0x5643fae6e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 -- 172.21.15.37:0/1735837416 >> 172.21.15.37:0/1735837416 conn(0x5643faaa9460 msgr2=0x5643fae5b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:06.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0cf6ff5640 0 client.15975 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:48:06.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 -- 172.21.15.37:0/1735837416 shutdown_connections 2024-08-31T06:48:06.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 1 -- 172.21.15.37:0/1735837416 wait complete. 2024-08-31T06:48:06.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.604+0000 7f0d1fb65740 20 client.15975 trim_cache size 0 max 16384 2024-08-31T06:48:06.611 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:48:06.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 -- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0cfc0b4d20 msgr2=0x7f0cfc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0cfc0b4d20 0x7f0cfc0b7230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00b710 tx=0x7f0d0c00b2e0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 -- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 msgr2=0x7f0d1419c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 0x7f0d1419c8b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0d08009230 tx=0x7f0d08004270 comp rx=0 tx=0).stop 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 -- 172.21.15.37:0/788851433 shutdown_connections 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0cfc0b4d20 0x7f0cfc0b7230 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d14102d40 0x7f0d1419c8b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d1410ffa0 0x7f0d141a1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 --2- 172.21.15.37:0/788851433 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d141023f0 0x7f0d1419c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 -- 172.21.15.37:0/788851433 >> 172.21.15.37:0/788851433 conn(0x7f0d140794d0 msgr2=0x7f0d141114b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 -- 172.21.15.37:0/788851433 shutdown_connections 2024-08-31T06:48:06.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:06.605+0000 7f0d195f0640 1 -- 172.21.15.37:0/788851433 wait complete. 2024-08-31T06:48:07.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:48:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:07.927 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:07 smithi037 ceph-mon[18612]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T06:48:08.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:07 smithi106 ceph-mon[22134]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 -- 172.21.15.37:0/1875937928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104102840 msgr2=0x7fd104102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/1875937928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104102840 0x7fd104102c50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd100009900 tx=0x7fd10002a410 comp rx=0 tx=0).stop 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 -- 172.21.15.37:0/1875937928 shutdown_connections 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/1875937928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd104108ad0 0x7fd10410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/1875937928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd104108180 0x7fd104108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/1875937928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104102840 0x7fd104102c50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 -- 172.21.15.37:0/1875937928 >> 172.21.15.37:0/1875937928 conn(0x7fd1040794f0 msgr2=0x7fd104079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 -- 172.21.15.37:0/1875937928 shutdown_connections 2024-08-31T06:48:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 -- 172.21.15.37:0/1875937928 wait complete. 2024-08-31T06:48:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 Processor -- start 2024-08-31T06:48:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.131+0000 7fd10bcd3640 1 -- start start 2024-08-31T06:48:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10bcd3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd104102840 0x7fd10419a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10bcd3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104108180 0x7fd10419a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10bcd3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd104108ad0 0x7fd10419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10bcd3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd104113790 con 0x7fd104108180 2024-08-31T06:48:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10bcd3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd104113610 con 0x7fd104108ad0 2024-08-31T06:48:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10bcd3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd104113910 con 0x7fd104102840 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104108180 0x7fd10419a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104108180 0x7fd10419a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36674/0 (socket says 172.21.15.37:36674) 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 -- 172.21.15.37:0/3755342725 learned_addr learned my addr 172.21.15.37:0/3755342725 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd109a6f640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd104102840 0x7fd10419a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10a270640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd104108ad0 0x7fd10419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 -- 172.21.15.37:0/3755342725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd104102840 msgr2=0x7fd10419a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd104102840 0x7fd10419a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 -- 172.21.15.37:0/3755342725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd104108ad0 msgr2=0x7fd10419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd104108ad0 0x7fd10419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 -- 172.21.15.37:0/3755342725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1041a01b0 con 0x7fd104108180 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.132+0000 7fd10926e640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104108180 0x7fd10419a7e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400e9c0 tx=0x7fd0f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.133+0000 7fd0faffd640 1 -- 172.21.15.37:0/3755342725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f400ccc0 con 0x7fd104108180 2024-08-31T06:48:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.133+0000 7fd0faffd640 1 -- 172.21.15.37:0/3755342725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0f40054b0 con 0x7fd104108180 2024-08-31T06:48:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.133+0000 7fd10bcd3640 1 -- 172.21.15.37:0/3755342725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1041a04a0 con 0x7fd104108180 2024-08-31T06:48:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.133+0000 7fd0faffd640 1 -- 172.21.15.37:0/3755342725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4010430 con 0x7fd104108180 2024-08-31T06:48:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.133+0000 7fd10bcd3640 1 -- 172.21.15.37:0/3755342725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1041a6c00 con 0x7fd104108180 2024-08-31T06:48:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.135+0000 7fd112248740 1 Processor -- start 2024-08-31T06:48:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd112248740 1 -- start start 2024-08-31T06:48:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd0faffd640 1 -- 172.21.15.37:0/3755342725 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fd0f4004f00 con 0x7fd104108180 2024-08-31T06:48:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd112248740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0854070 0x5589a0bf9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd112248740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 0x5589a0bf9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd112248740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0833390 0x5589a0bf9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd112248740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5589a0b70680 con 0x5589a0854070 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd112248740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5589a0b5fc10 con 0x5589a0833390 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd112248740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5589a0b63bc0 con 0x5589a082b1b0 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd10a270640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0854070 0x5589a0bf9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd10a270640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0854070 0x5589a0bf9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36680/0 (socket says 172.21.15.37:36680) 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd10a270640 1 -- 172.21.15.37:0/2343945434 learned_addr learned my addr 172.21.15.37:0/2343945434 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd10926e640 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0833390 0x5589a0bf9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.136+0000 7fd109a6f640 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 0x5589a0bf9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd10a270640 1 -- 172.21.15.37:0/2343945434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 msgr2=0x5589a0bf9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd10a270640 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 0x5589a0bf9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd10a270640 1 -- 172.21.15.37:0/2343945434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0833390 msgr2=0x5589a0bf9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd10a270640 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0833390 0x5589a0bf9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd10a270640 1 -- 172.21.15.37:0/2343945434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a08bf650 con 0x5589a0854070 2024-08-31T06:48:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd10926e640 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0833390 0x5589a0bf9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd0faffd640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0f00b4ca0 0x7fd0f00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd10a270640 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0854070 0x5589a0bf9310 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009f20 tx=0x7fd0fc00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4991070a7abac2b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd109a6f640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0f00b4ca0 0x7fd0f00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd0faffd640 1 -- 172.21.15.37:0/3755342725 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd0f40e59c0 con 0x7fd104108180 2024-08-31T06:48:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd0effff640 1 -- 172.21.15.37:0/2343945434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc015070 con 0x5589a0854070 2024-08-31T06:48:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd0effff640 1 -- 172.21.15.37:0/2343945434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0fc01aaf0 con 0x5589a0854070 2024-08-31T06:48:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.137+0000 7fd0effff640 1 -- 172.21.15.37:0/2343945434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc011ab0 con 0x5589a0854070 2024-08-31T06:48:08.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:07 smithi066 ceph-mon[22244]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.138+0000 7fd112248740 1 -- 172.21.15.37:0/2343945434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0854070 msgr2=0x5589a0bf9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.138+0000 7fd109a6f640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0f00b4ca0 0x7fd0f00b71b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd100006010 tx=0x7fd100009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.138+0000 7fd112248740 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0854070 0x5589a0bf9310 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc009f20 tx=0x7fd0fc00f7f0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.138+0000 7fd112248740 1 -- 172.21.15.37:0/2343945434 shutdown_connections 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.138+0000 7fd112248740 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0833390 0x5589a0bf9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.138+0000 7fd112248740 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 0x5589a0bf9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.138+0000 7fd112248740 1 --2- 172.21.15.37:0/2343945434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0854070 0x5589a0bf9310 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.138+0000 7fd112248740 1 -- 172.21.15.37:0/2343945434 >> 172.21.15.37:0/2343945434 conn(0x5589a0848460 msgr2=0x5589a0bf7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 -- 172.21.15.37:0/2343945434 shutdown_connections 2024-08-31T06:48:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 -- 172.21.15.37:0/2343945434 wait complete. 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 -- start start 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 Processor -- start 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 0x5589a0c04b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c05090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0854070 0x5589a0c10de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5589a09c2700 con 0x5589a0833390 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5589a0ae6750 con 0x5589a0854070 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.139+0000 7fd112248740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5589a0c07af0 con 0x5589a082b1b0 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd112248740 10 client.0 _ll_register_callbacks cb 0x5589a0b15e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c05090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c05090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36684/0 (socket says 172.21.15.37:36684) 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 -- 172.21.15.37:0/3384240400 learned_addr learned my addr 172.21.15.37:0/3384240400 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd109a6f640 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 0x5589a0c04b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10a270640 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0854070 0x5589a0c10de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 -- 172.21.15.37:0/3384240400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 msgr2=0x5589a0c04b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 0x5589a0c04b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 -- 172.21.15.37:0/3384240400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0854070 msgr2=0x5589a0c10de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0854070 0x5589a0c10de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 -- 172.21.15.37:0/3384240400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a0b1f900 con 0x5589a0833390 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd10926e640 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c05090 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400cfd0 tx=0x7fd0f4005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efdd9061b70d9e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd0ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/3384240400 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40abec0 con 0x5589a0833390 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/3384240400 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd0f40a8380 con 0x5589a0833390 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.140+0000 7fd112248740 1 -- 172.21.15.37:0/3384240400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0fc01aaf0 con 0x5589a0833390 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/3384240400 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0f40ab860 con 0x5589a0833390 2024-08-31T06:48:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd112248740 10 client.15987 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd112248740 1 -- 172.21.15.37:0/3384240400 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5589a0c139b0 con 0x5589a0833390 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/3384240400 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0fc01aaf0 con 0x5589a0833390 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/3384240400 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0f40d2070 con 0x5589a0833390 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd112248740 10 client.15987 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd112248740 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd112248740 20 client.15987 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd112248740 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5589a08129f0 0x5589a0c16f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd112248740 4 client.15987 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd112248740 1 -- 172.21.15.37:0/3384240400 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589a0b725d0 con 0x5589a08129f0 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.141+0000 7fd109a6f640 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5589a08129f0 0x5589a0c16f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.142+0000 7fd0ed7fa640 10 client.15987 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.142+0000 7fd109a6f640 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5589a08129f0 0x5589a0c16f50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cba57ef08dcf2466 server_cookie=c9b8c677dcfc2618 in_seq=0 out_seq=0 2024-08-31T06:48:08.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.142+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/3384240400 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589a0b725d0 con 0x5589a08129f0 2024-08-31T06:48:08.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd0ed7fa640 10 client.15987 handle_command_reply: tid=0 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 client.15987 shutdown 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 -- 172.21.15.37:0/3384240400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 msgr2=0x5589a0c05090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c05090 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400cfd0 tx=0x7fd0f4005720 comp rx=0 tx=0).stop 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 -- 172.21.15.37:0/3384240400 shutdown_connections 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5589a08129f0 0x5589a0c16f50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c05090 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a0854070 0x5589a0c10de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 --2- 172.21.15.37:0/3384240400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a082b1b0 0x5589a0c04b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd0ed7fa640 0 client.15987 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 -- 172.21.15.37:0/3384240400 >> 172.21.15.37:0/3384240400 conn(0x5589a0848460 msgr2=0x5589a0bfc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 -- 172.21.15.37:0/3384240400 shutdown_connections 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 1 -- 172.21.15.37:0/3384240400 wait complete. 2024-08-31T06:48:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.143+0000 7fd112248740 20 client.15987 trim_cache size 0 max 16384 2024-08-31T06:48:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.156+0000 7fd112248740 1 Processor -- start 2024-08-31T06:48:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.156+0000 7fd112248740 1 -- start start 2024-08-31T06:48:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.156+0000 7fd112248740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0bfad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd112248740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c066d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd112248740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 0x5589a0c01d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd112248740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041afba0 con 0x5589a0833390 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd112248740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041ad470 con 0x5589a082b1b0 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd112248740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041ab2c0 con 0x5589a0854070 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c066d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c066d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36690/0 (socket says 172.21.15.37:36690) 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 -- 172.21.15.37:0/1059500356 learned_addr learned my addr 172.21.15.37:0/1059500356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 -- 172.21.15.37:0/1059500356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 msgr2=0x5589a0c01d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 0x5589a0c01d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd109a6f640 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0bfad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 -- 172.21.15.37:0/1059500356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 msgr2=0x5589a0bfad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0bfad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 -- 172.21.15.37:0/1059500356 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a0bfb600 con 0x5589a0833390 2024-08-31T06:48:08.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd109a6f640 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0bfad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:08.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd10926e640 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c066d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40b5430 tx=0x7fd0f40e5d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f278d729ed2d8fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:08.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd0ef7fe640 1 -- 172.21.15.37:0/1059500356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40aba40 con 0x5589a0833390 2024-08-31T06:48:08.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd0ef7fe640 1 -- 172.21.15.37:0/1059500356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0f40abc00 con 0x5589a0833390 2024-08-31T06:48:08.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.157+0000 7fd0ef7fe640 1 -- 172.21.15.37:0/1059500356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40ac0f0 con 0x5589a0833390 2024-08-31T06:48:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 -- 172.21.15.37:0/1059500356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 msgr2=0x5589a0c066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c066d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40b5430 tx=0x7fd0f40e5d50 comp rx=0 tx=0).stop 2024-08-31T06:48:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 -- 172.21.15.37:0/1059500356 shutdown_connections 2024-08-31T06:48:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c066d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 0x5589a0c01d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 --2- 172.21.15.37:0/1059500356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0bfad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 -- 172.21.15.37:0/1059500356 >> 172.21.15.37:0/1059500356 conn(0x5589a0848460 msgr2=0x5589a0c05fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 -- 172.21.15.37:0/1059500356 shutdown_connections 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 -- 172.21.15.37:0/1059500356 wait complete. 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.158+0000 7fd112248740 1 -- start start 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd112248740 1 Processor -- start 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd112248740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0c09d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd112248740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c0a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd112248740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 0x5589a0c0a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd112248740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041ab930 con 0x5589a0833390 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd112248740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041acda0 con 0x5589a082b1b0 2024-08-31T06:48:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd112248740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041ac000 con 0x5589a0854070 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd112248740 10 client.0 _ll_register_callbacks cb 0x7fd0f40e9200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd10926e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c0a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd10926e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c0a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36694/0 (socket says 172.21.15.37:36694) 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd10926e640 1 -- 172.21.15.37:0/2229653295 learned_addr learned my addr 172.21.15.37:0/2229653295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd109a6f640 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0c09d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.159+0000 7fd10a270640 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 0x5589a0c0a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd10926e640 1 -- 172.21.15.37:0/2229653295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 msgr2=0x5589a0c0a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd10926e640 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 0x5589a0c0a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd10926e640 1 -- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 msgr2=0x5589a0c09d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd10926e640 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0c09d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd10926e640 1 -- 172.21.15.37:0/2229653295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a0c818a0 con 0x5589a0833390 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd109a6f640 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0c09d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:08.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd10926e640 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c0a270 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4093010 tx=0x7fd0f400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7951a499dc7c5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd0ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/2229653295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40aba40 con 0x5589a0833390 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/2229653295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd0f40a86e0 con 0x5589a0833390 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd112248740 1 -- 172.21.15.37:0/2229653295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0f40abc00 con 0x5589a0833390 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/2229653295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0f40cd050 con 0x5589a0833390 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd112248740 10 client.15993 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd112248740 1 -- 172.21.15.37:0/2229653295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5589a0c82a90 con 0x5589a0833390 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/2229653295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0f40abc00 con 0x5589a0833390 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.160+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/2229653295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0f40a7b80 con 0x5589a0833390 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd112248740 10 client.15993 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd112248740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd112248740 20 client.15993 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:08.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd112248740 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5589a07e7da0 0x5589a0c84f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd112248740 4 client.15993 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd112248740 1 -- 172.21.15.37:0/2229653295 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589a0b6e070 con 0x5589a07e7da0 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd109a6f640 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5589a07e7da0 0x5589a0c84f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd0ed7fa640 10 client.15993 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.161+0000 7fd109a6f640 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5589a07e7da0 0x5589a0c84f80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c05a61abdd6211 server_cookie=bec3476011fbd443 in_seq=0 out_seq=0 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd0ed7fa640 1 -- 172.21.15.37:0/2229653295 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589a0b6e070 con 0x5589a07e7da0 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd0ed7fa640 10 client.15993 handle_command_reply: tid=0 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 client.15993 shutdown 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 -- 172.21.15.37:0/2229653295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 msgr2=0x5589a0c0a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c0a270 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4093010 tx=0x7fd0f400cf40 comp rx=0 tx=0).stop 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 -- 172.21.15.37:0/2229653295 shutdown_connections 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5589a07e7da0 0x5589a0c84f80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589a0833390 0x5589a0c0a270 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5589a0854070 0x5589a0c0a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd0ed7fa640 0 client.15993 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 --2- 172.21.15.37:0/2229653295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5589a082b1b0 0x5589a0c09d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 -- 172.21.15.37:0/2229653295 >> 172.21.15.37:0/2229653295 conn(0x5589a0848460 msgr2=0x5589a0c068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 -- 172.21.15.37:0/2229653295 shutdown_connections 2024-08-31T06:48:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 1 -- 172.21.15.37:0/2229653295 wait complete. 2024-08-31T06:48:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.162+0000 7fd112248740 20 client.15993 trim_cache size 0 max 16384 2024-08-31T06:48:08.168 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 -- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0f00b4ca0 msgr2=0x7fd0f00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0f00b4ca0 0x7fd0f00b71b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd100006010 tx=0x7fd100009560 comp rx=0 tx=0).stop 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 -- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104108180 msgr2=0x7fd10419a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104108180 0x7fd10419a7e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400e9c0 tx=0x7fd0f400ee80 comp rx=0 tx=0).stop 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 -- 172.21.15.37:0/3755342725 shutdown_connections 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd0f00b4ca0 0x7fd0f00b71b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd104108180 0x7fd10419a7e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd104108ad0 0x7fd10419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 --2- 172.21.15.37:0/3755342725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd104102840 0x7fd10419a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:08.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 -- 172.21.15.37:0/3755342725 >> 172.21.15.37:0/3755342725 conn(0x7fd1040794f0 msgr2=0x7fd104106330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:08.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 -- 172.21.15.37:0/3755342725 shutdown_connections 2024-08-31T06:48:08.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:08.163+0000 7fd10bcd3640 1 -- 172.21.15.37:0/3755342725 wait complete. 2024-08-31T06:48:09.865 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:48:09.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:48:10.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:09 smithi106 ceph-mon[22134]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T06:48:10.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:09 smithi037 ceph-mon[18612]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T06:48:10.130 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:10.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:09 smithi066 ceph-mon[22244]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-31T06:48:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.615+0000 7f4b8f138640 1 -- 172.21.15.37:0/2907010381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109b90 msgr2=0x7f4b881103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 --2- 172.21.15.37:0/2907010381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109b90 0x7f4b881103c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009ca0 tx=0x7f4b8002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 -- 172.21.15.37:0/2907010381 shutdown_connections 2024-08-31T06:48:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 --2- 172.21.15.37:0/2907010381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109b90 0x7f4b881103c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 --2- 172.21.15.37:0/2907010381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b88109240 0x7f4b88109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 --2- 172.21.15.37:0/2907010381 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b88103900 0x7f4b88103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 -- 172.21.15.37:0/2907010381 >> 172.21.15.37:0/2907010381 conn(0x7f4b8807b5f0 msgr2=0x7f4b8807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 -- 172.21.15.37:0/2907010381 shutdown_connections 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 -- 172.21.15.37:0/2907010381 wait complete. 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 Processor -- start 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.616+0000 7f4b8f138640 1 -- start start 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8f138640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b88103900 0x7f4b8819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8f138640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109240 0x7f4b8819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8f138640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b88109b90 0x7f4b8819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8f138640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b88113750 con 0x7f4b88109240 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8f138640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881135d0 con 0x7f4b88109b90 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8f138640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881138d0 con 0x7f4b88103900 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109240 0x7f4b8819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109240 0x7f4b8819a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36720/0 (socket says 172.21.15.37:36720) 2024-08-31T06:48:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 -- 172.21.15.37:0/4194954458 learned_addr learned my addr 172.21.15.37:0/4194954458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b88109b90 0x7f4b8819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b88103900 0x7f4b8819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 -- 172.21.15.37:0/4194954458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b88103900 msgr2=0x7f4b8819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b88103900 0x7f4b8819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 -- 172.21.15.37:0/4194954458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b88109b90 msgr2=0x7f4b8819faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b88109b90 0x7f4b8819faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 -- 172.21.15.37:0/4194954458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b881a01d0 con 0x7f4b88109240 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b88109b90 0x7f4b8819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b87fff640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109240 0x7f4b8819a800 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00d750 tx=0x7f4b7c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.617+0000 7f4b85ffb640 1 -- 172.21.15.37:0/4194954458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c017070 con 0x7f4b88109240 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.618+0000 7f4b85ffb640 1 -- 172.21.15.37:0/4194954458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b7c0054b0 con 0x7f4b88109240 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.618+0000 7f4b8f138640 1 -- 172.21.15.37:0/4194954458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b881a04c0 con 0x7f4b88109240 2024-08-31T06:48:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.618+0000 7f4b85ffb640 1 -- 172.21.15.37:0/4194954458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c004bc0 con 0x7f4b88109240 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.618+0000 7f4b8f138640 1 -- 172.21.15.37:0/4194954458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b881a6c20 con 0x7f4b88109240 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.620+0000 7f4b956ad740 1 Processor -- start 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.620+0000 7f4b85ffb640 1 -- 172.21.15.37:0/4194954458 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f4b7c009c30 con 0x7f4b88109240 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.620+0000 7f4b956ad740 1 -- start start 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cbd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98ee490 0x55cbd9cbdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 0x55cbd9cbe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b956ad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cbd9c335f0 con 0x55cbd98ee490 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b956ad740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cbd9c22b80 con 0x55cbd9917350 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b956ad740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55cbd9c26b30 con 0x55cbd98f6670 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98ee490 0x55cbd9cbdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98ee490 0x55cbd9cbdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36736/0 (socket says 172.21.15.37:36736) 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 -- 172.21.15.37:0/1425372443 learned_addr learned my addr 172.21.15.37:0/1425372443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b87fff640 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 0x55cbd9cbe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cbd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 -- 172.21.15.37:0/1425372443 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 msgr2=0x55cbd9cbe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 0x55cbd9cbe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 -- 172.21.15.37:0/1425372443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 msgr2=0x55cbd9cbd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cbd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 -- 172.21.15.37:0/1425372443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbd9982930 con 0x55cbd98ee490 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b85ffb640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4b700b4ca0 0x7f4b700b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cbd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4b700b4ca0 0x7f4b700b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98ee490 0x55cbd9cbdcc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800bcb0 tx=0x7f4b7800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cece0a1436ba8a66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.621+0000 7f4b85ffb640 1 -- 172.21.15.37:0/4194954458 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f4b7c0e4fc0 con 0x7f4b88109240 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.622+0000 7f4b6effd640 1 -- 172.21.15.37:0/1425372443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78015070 con 0x55cbd98ee490 2024-08-31T06:48:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.622+0000 7f4b6effd640 1 -- 172.21.15.37:0/1425372443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b7801a8f0 con 0x55cbd98ee490 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.622+0000 7f4b6effd640 1 -- 172.21.15.37:0/1425372443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b78011860 con 0x55cbd98ee490 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.622+0000 7f4b956ad740 1 -- 172.21.15.37:0/1425372443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98ee490 msgr2=0x55cbd9cbdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.622+0000 7f4b956ad740 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98ee490 0x55cbd9cbdcc0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800bcb0 tx=0x7f4b7800f730 comp rx=0 tx=0).stop 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.622+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4b700b4ca0 0x7f4b700b71b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4b80005cc0 tx=0x7f4b80005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 -- 172.21.15.37:0/1425372443 shutdown_connections 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98ee490 0x55cbd9cbdcc0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 0x55cbd9cbe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 --2- 172.21.15.37:0/1425372443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cbd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 -- 172.21.15.37:0/1425372443 >> 172.21.15.37:0/1425372443 conn(0x55cbd990b740 msgr2=0x55cbd9cbb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 -- 172.21.15.37:0/1425372443 shutdown_connections 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 -- 172.21.15.37:0/1425372443 wait complete. 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 -- start start 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.623+0000 7f4b956ad740 1 Processor -- start 2024-08-31T06:48:10.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98ee490 0x55cbd9cc8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 0x55cbd9cc9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9cd5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b956ad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cbd9a85890 con 0x55cbd9917350 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b956ad740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cbd9ba9790 con 0x55cbd98ee490 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b956ad740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55cbd9ccbf60 con 0x55cbd98f6670 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b956ad740 10 client.0 _ll_register_callbacks cb 0x55cbd992eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9cd5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9cd5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36738/0 (socket says 172.21.15.37:36738) 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 -- 172.21.15.37:0/3809895135 learned_addr learned my addr 172.21.15.37:0/3809895135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98ee490 0x55cbd9cc8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b87fff640 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 0x55cbd9cc9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 -- 172.21.15.37:0/3809895135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 msgr2=0x55cbd9cc9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 0x55cbd9cc9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 -- 172.21.15.37:0/3809895135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98ee490 msgr2=0x55cbd9cc8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98ee490 0x55cbd9cc8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 -- 172.21.15.37:0/3809895135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbd9be0f30 con 0x55cbd9917350 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9cd5280 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4b80035000 tx=0x7f4b800095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7caef42995333e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b67fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b67fff640 1 -- 172.21.15.37:0/3809895135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8004e070 con 0x55cbd9917350 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b67fff640 1 -- 172.21.15.37:0/3809895135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f4b800305c0 con 0x55cbd9917350 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.624+0000 7f4b956ad740 1 -- 172.21.15.37:0/3809895135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b7801a8f0 con 0x55cbd9917350 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b67fff640 1 -- 172.21.15.37:0/3809895135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b80031760 con 0x55cbd9917350 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b956ad740 10 client.16005 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b956ad740 1 -- 172.21.15.37:0/3809895135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbd9cd7ce0 con 0x55cbd9917350 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b67fff640 1 -- 172.21.15.37:0/3809895135 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b7801a8f0 con 0x55cbd9917350 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b67fff640 1 -- 172.21.15.37:0/3809895135 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b80043040 con 0x55cbd9917350 2024-08-31T06:48:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b956ad740 10 client.16005 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b956ad740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b956ad740 20 client.16005 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cbd98d5cd0 0x55cbd9cdb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b956ad740 4 client.16005 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b956ad740 1 -- 172.21.15.37:0/3809895135 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbd9c35540 con 0x55cbd98d5cd0 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.625+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cbd98d5cd0 0x55cbd9cdb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.626+0000 7f4b67fff640 10 client.16005 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.626+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cbd98d5cd0 0x55cbd9cdb220 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a98a6155d1d19e4f server_cookie=b07abc8151f38426 in_seq=0 out_seq=0 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b67fff640 1 -- 172.21.15.37:0/3809895135 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cbd9c35540 con 0x55cbd98d5cd0 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b67fff640 10 client.16005 handle_command_reply: tid=0 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 client.16005 shutdown 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 -- 172.21.15.37:0/3809895135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 msgr2=0x55cbd9cd5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9cd5280 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4b80035000 tx=0x7f4b800095c0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 -- 172.21.15.37:0/3809895135 shutdown_connections 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cbd98d5cd0 0x55cbd9cdb220 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9cd5280 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98f6670 0x55cbd9cc9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b67fff640 0 client.16005 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3809895135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98ee490 0x55cbd9cc8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 -- 172.21.15.37:0/3809895135 >> 172.21.15.37:0/3809895135 conn(0x55cbd990b740 msgr2=0x55cbd9cc0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 -- 172.21.15.37:0/3809895135 shutdown_connections 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 1 -- 172.21.15.37:0/3809895135 wait complete. 2024-08-31T06:48:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.627+0000 7f4b956ad740 20 client.16005 trim_cache size 0 max 16384 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.647+0000 7f4b956ad740 1 Processor -- start 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.647+0000 7f4b956ad740 1 -- start start 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cbb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98f6670 0x55cbd9cd5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cd56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b956ad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881b1c80 con 0x55cbd98f6670 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b956ad740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881af550 con 0x55cbd9917350 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b956ad740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881ad3a0 con 0x55cbd98ee490 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98f6670 0x55cbd9cd5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98f6670 0x55cbd9cd5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36746/0 (socket says 172.21.15.37:36746) 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 -- 172.21.15.37:0/3601082654 learned_addr learned my addr 172.21.15.37:0/3601082654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cd56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cbb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 -- 172.21.15.37:0/3601082654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 msgr2=0x55cbd9cbb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cbb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 -- 172.21.15.37:0/3601082654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 msgr2=0x55cbd9cd56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cd56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 -- 172.21.15.37:0/3601082654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbd9cbfa70 con 0x55cbd98f6670 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.648+0000 7f4b87fff640 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98f6670 0x55cbd9cd5180 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0e2750 tx=0x7f4b7c0e8620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877d82ed6449b7ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.649+0000 7f4b6e7fc640 1 -- 172.21.15.37:0/3601082654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c020040 con 0x55cbd98f6670 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.649+0000 7f4b6e7fc640 1 -- 172.21.15.37:0/3601082654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b7c0b42f0 con 0x55cbd98f6670 2024-08-31T06:48:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.649+0000 7f4b6e7fc640 1 -- 172.21.15.37:0/3601082654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0aff00 con 0x55cbd98f6670 2024-08-31T06:48:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.649+0000 7f4b956ad740 1 -- 172.21.15.37:0/3601082654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98f6670 msgr2=0x55cbd9cd5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98f6670 0x55cbd9cd5180 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c0e2750 tx=0x7f4b7c0e8620 comp rx=0 tx=0).stop 2024-08-31T06:48:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 -- 172.21.15.37:0/3601082654 shutdown_connections 2024-08-31T06:48:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd98f6670 0x55cbd9cd5180 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd9917350 0x55cbd9cd56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 --2- 172.21.15.37:0/3601082654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cbb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 -- 172.21.15.37:0/3601082654 >> 172.21.15.37:0/3601082654 conn(0x55cbd990b740 msgr2=0x55cbd9cbafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 -- 172.21.15.37:0/3601082654 shutdown_connections 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 -- 172.21.15.37:0/3601082654 wait complete. 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 -- start start 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.650+0000 7f4b956ad740 1 Processor -- start 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cd1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98f6670 0x55cbd9cd1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b956ad740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9d3f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b956ad740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881ada10 con 0x55cbd9917350 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b956ad740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881aee80 con 0x55cbd98f6670 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b956ad740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4b881ae0e0 con 0x55cbd98ee490 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b956ad740 10 client.0 _ll_register_callbacks cb 0x7f4b80009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9d3f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8ced4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cd1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9d3f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36762/0 (socket says 172.21.15.37:36762) 2024-08-31T06:48:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 -- 172.21.15.37:0/4159224985 learned_addr learned my addr 172.21.15.37:0/4159224985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b87fff640 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98f6670 0x55cbd9cd1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 -- 172.21.15.37:0/4159224985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 msgr2=0x55cbd9cd1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cd1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 -- 172.21.15.37:0/4159224985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98f6670 msgr2=0x55cbd9cd1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98f6670 0x55cbd9cd1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 -- 172.21.15.37:0/4159224985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbd9d3fc80 con 0x55cbd9917350 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cd1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b8d6d5640 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9d3f4f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4b80045a00 tx=0x7f4b80003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178e827a3bf6c0ba server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.651+0000 7f4b67fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b67fff640 1 -- 172.21.15.37:0/4159224985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b80063060 con 0x55cbd9917350 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 1 -- 172.21.15.37:0/4159224985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cbd9c30fe0 con 0x55cbd9917350 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b67fff640 1 -- 172.21.15.37:0/4159224985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f4b80045a80 con 0x55cbd9917350 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b67fff640 1 -- 172.21.15.37:0/4159224985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b8004e070 con 0x55cbd9917350 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 10 client.16011 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 1 -- 172.21.15.37:0/4159224985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cbd9d4ab90 con 0x55cbd9917350 2024-08-31T06:48:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b67fff640 1 -- 172.21.15.37:0/4159224985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cbd9c30fe0 con 0x55cbd9917350 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b67fff640 1 -- 172.21.15.37:0/4159224985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b80043050 con 0x55cbd9917350 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 10 client.16011 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 20 client.16011 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cbd98ab080 0x55cbd9d4d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 4 client.16011 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.652+0000 7f4b956ad740 1 -- 172.21.15.37:0/4159224985 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cbd9c2e720 con 0x55cbd98ab080 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.653+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cbd98ab080 0x55cbd9d4d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.653+0000 7f4b67fff640 10 client.16011 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.653+0000 7f4b8ced4640 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cbd98ab080 0x55cbd9d4d350 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3367d9cb00b3059 server_cookie=44aa6a6f0dbade1e in_seq=0 out_seq=0 2024-08-31T06:48:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b67fff640 1 -- 172.21.15.37:0/4159224985 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cbd9c2e720 con 0x55cbd98ab080 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b67fff640 10 client.16011 handle_command_reply: tid=0 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 client.16011 shutdown 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 -- 172.21.15.37:0/4159224985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 msgr2=0x55cbd9d3f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9d3f4f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4b80045a00 tx=0x7f4b80003de0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 -- 172.21.15.37:0/4159224985 shutdown_connections 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cbd98ab080 0x55cbd9d4d350 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cbd9917350 0x55cbd9d3f4f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cbd98f6670 0x55cbd9cd1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 --2- 172.21.15.37:0/4159224985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cbd98ee490 0x55cbd9cd1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 -- 172.21.15.37:0/4159224985 >> 172.21.15.37:0/4159224985 conn(0x55cbd990b740 msgr2=0x55cbd9cc0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b67fff640 0 client.16011 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 -- 172.21.15.37:0/4159224985 shutdown_connections 2024-08-31T06:48:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.655+0000 7f4b956ad740 1 -- 172.21.15.37:0/4159224985 wait complete. 2024-08-31T06:48:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b956ad740 20 client.16011 trim_cache size 0 max 16384 2024-08-31T06:48:10.661 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:48:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:48:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "ed2cc30c-a429-4a5d-b939-87f726e6372c", 2024-08-31T06:48:10.661 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:48:10.661 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 -- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4b700b4ca0 msgr2=0x7f4b700b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4b700b4ca0 0x7f4b700b71b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4b80005cc0 tx=0x7f4b80005d80 comp rx=0 tx=0).stop 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 -- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109240 msgr2=0x7f4b8819a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109240 0x7f4b8819a800 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00d750 tx=0x7f4b7c00dc10 comp rx=0 tx=0).stop 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 -- 172.21.15.37:0/4194954458 shutdown_connections 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4b700b4ca0 0x7f4b700b71b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b88109240 0x7f4b8819a800 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b88109b90 0x7f4b8819faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 --2- 172.21.15.37:0/4194954458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b88103900 0x7f4b8819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 -- 172.21.15.37:0/4194954458 >> 172.21.15.37:0/4194954458 conn(0x7f4b8807b5f0 msgr2=0x7f4b88107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 -- 172.21.15.37:0/4194954458 shutdown_connections 2024-08-31T06:48:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:10.656+0000 7f4b8f138640 1 -- 172.21.15.37:0/4194954458 wait complete. 2024-08-31T06:48:11.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:48:11.598 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:11.963 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:11 smithi037 ceph-mon[18612]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-31T06:48:11.963 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:11 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:48:11.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:11 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:48:11.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:11 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:48:11.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:11 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:48:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 -- 172.21.15.37:0/3658695335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108ab0 msgr2=0x7f246410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 --2- 172.21.15.37:0/3658695335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108ab0 0x7f246410f2e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f245c009ca0 tx=0x7f245c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 -- 172.21.15.37:0/3658695335 shutdown_connections 2024-08-31T06:48:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 --2- 172.21.15.37:0/3658695335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108ab0 0x7f246410f2e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 --2- 172.21.15.37:0/3658695335 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2464108160 0x7f2464108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 --2- 172.21.15.37:0/3658695335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2464102820 0x7f2464102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 -- 172.21.15.37:0/3658695335 >> 172.21.15.37:0/3658695335 conn(0x7f24640794e0 msgr2=0x7f24640798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 -- 172.21.15.37:0/3658695335 shutdown_connections 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.054+0000 7f246aced640 1 -- 172.21.15.37:0/3658695335 wait complete. 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f246aced640 1 Processor -- start 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f246aced640 1 -- start start 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f246aced640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2464102820 0x7f246419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f246aced640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108160 0x7f246419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f246aced640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2464108ab0 0x7f246419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f246aced640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2464113720 con 0x7f2464108160 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f246aced640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24641135a0 con 0x7f2464108ab0 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f246aced640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f24641138a0 con 0x7f2464102820 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f2463fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108160 0x7f246419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f2463fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108160 0x7f246419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36772/0 (socket says 172.21.15.37:36772) 2024-08-31T06:48:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.055+0000 7f2463fff640 1 -- 172.21.15.37:0/679185414 learned_addr learned my addr 172.21.15.37:0/679185414 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f246928a640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2464108ab0 0x7f246419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2468a89640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2464102820 0x7f246419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2463fff640 1 -- 172.21.15.37:0/679185414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2464102820 msgr2=0x7f246419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2463fff640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2464102820 0x7f246419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2463fff640 1 -- 172.21.15.37:0/679185414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2464108ab0 msgr2=0x7f246419f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2463fff640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2464108ab0 0x7f246419f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2463fff640 1 -- 172.21.15.37:0/679185414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f246419ffa0 con 0x7f2464108160 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f246928a640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2464108ab0 0x7f246419f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2463fff640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108160 0x7f246419a690 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f244c00c970 tx=0x7f244c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2461ffb640 1 -- 172.21.15.37:0/679185414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c014070 con 0x7f2464108160 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f246aced640 1 -- 172.21.15.37:0/679185414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24641a0290 con 0x7f2464108160 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2461ffb640 1 -- 172.21.15.37:0/679185414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f244c004440 con 0x7f2464108160 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f2461ffb640 1 -- 172.21.15.37:0/679185414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c003d40 con 0x7f2464108160 2024-08-31T06:48:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.056+0000 7f246aced640 1 -- 172.21.15.37:0/679185414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24641a6ab0 con 0x7f2464108160 2024-08-31T06:48:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2471262740 1 Processor -- start 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2471262740 1 -- start start 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2461ffb640 1 -- 172.21.15.37:0/679185414 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f244c017070 con 0x7f2464108160 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2471262740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cfe070 0x5604f90a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2471262740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2471262740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cdd390 0x5604f90a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2471262740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5604f901a630 con 0x5604f8cd51b0 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2471262740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5604f9009bc0 con 0x5604f8cfe070 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2471262740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5604f900db70 con 0x5604f8cdd390 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2468a89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2468a89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90a3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36776/0 (socket says 172.21.15.37:36776) 2024-08-31T06:48:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.059+0000 7f2468a89640 1 -- 172.21.15.37:0/24532399 learned_addr learned my addr 172.21.15.37:0/24532399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2463fff640 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cdd390 0x5604f90a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f246928a640 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cfe070 0x5604f90a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2468a89640 1 -- 172.21.15.37:0/24532399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cdd390 msgr2=0x5604f90a3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2468a89640 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cdd390 0x5604f90a3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2468a89640 1 -- 172.21.15.37:0/24532399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cfe070 msgr2=0x5604f90a32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2468a89640 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cfe070 0x5604f90a32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2468a89640 1 -- 172.21.15.37:0/24532399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f8d69650 con 0x5604f8cd51b0 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2461ffb640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f24500b4cd0 0x7f24500b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2468a89640 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90a3800 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f245400bcb0 tx=0x7f245400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9135c46480ef8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f246928a640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f24500b4cd0 0x7f24500b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f2461ffb640 1 -- 172.21.15.37:0/679185414 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f244c0e5110 con 0x7f2464108160 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f245affd640 1 -- 172.21.15.37:0/24532399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454015070 con 0x5604f8cd51b0 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f245affd640 1 -- 172.21.15.37:0/24532399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f245401a8f0 con 0x5604f8cd51b0 2024-08-31T06:48:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.060+0000 7f245affd640 1 -- 172.21.15.37:0/24532399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454011900 con 0x5604f8cd51b0 2024-08-31T06:48:12.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 -- 172.21.15.37:0/24532399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 msgr2=0x5604f90a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f246928a640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f24500b4cd0 0x7f24500b71e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f245c005cc0 tx=0x7f245c005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:12.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90a3800 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f245400bcb0 tx=0x7f245400f730 comp rx=0 tx=0).stop 2024-08-31T06:48:12.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 -- 172.21.15.37:0/24532399 shutdown_connections 2024-08-31T06:48:12.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90a3800 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cdd390 0x5604f90a3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 --2- 172.21.15.37:0/24532399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cfe070 0x5604f90a32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 -- 172.21.15.37:0/24532399 >> 172.21.15.37:0/24532399 conn(0x5604f8cf2460 msgr2=0x5604f90a11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 -- 172.21.15.37:0/24532399 shutdown_connections 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.061+0000 7f2471262740 1 -- 172.21.15.37:0/24532399 wait complete. 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 1 -- start start 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 1 Processor -- start 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cd51b0 0x5604f90aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 0x5604f90aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cfe070 0x5604f90bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5604f8e6c700 con 0x5604f8cfe070 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5604f8f90700 con 0x5604f8cdd390 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5604f90b1aa0 con 0x5604f8cd51b0 2024-08-31T06:48:12.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2471262740 10 client.0 _ll_register_callbacks cb 0x5604f8fbfdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f246928a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cfe070 0x5604f90bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.062+0000 7f2468a89640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cd51b0 0x5604f90aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2463fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 0x5604f90aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2468a89640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cd51b0 0x5604f90aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:39210/0 (socket says 172.21.15.37:39210) 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f246928a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cfe070 0x5604f90bad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36790/0 (socket says 172.21.15.37:36790) 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2468a89640 1 -- 172.21.15.37:0/918570941 learned_addr learned my addr 172.21.15.37:0/918570941 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f246928a640 1 -- 172.21.15.37:0/918570941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cd51b0 msgr2=0x5604f90aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f246928a640 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cd51b0 0x5604f90aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f246928a640 1 -- 172.21.15.37:0/918570941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 msgr2=0x5604f90aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f246928a640 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 0x5604f90aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f246928a640 1 -- 172.21.15.37:0/918570941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604f8fc98b0 con 0x5604f8cfe070 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2468a89640 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cd51b0 0x5604f90aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f246928a640 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cfe070 0x5604f90bad90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f245c006010 tx=0x7f245c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc92208ec8e964f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2443fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2443fff640 1 -- 172.21.15.37:0/918570941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c04f070 con 0x5604f8cfe070 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2443fff640 1 -- 172.21.15.37:0/918570941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f245c004790 con 0x5604f8cfe070 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2471262740 1 -- 172.21.15.37:0/918570941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f245401a8f0 con 0x5604f8cfe070 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.063+0000 7f2443fff640 1 -- 172.21.15.37:0/918570941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f245c0305c0 con 0x5604f8cfe070 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2471262740 10 client.16023 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2471262740 1 -- 172.21.15.37:0/918570941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5604f90bd7e0 con 0x5604f8cfe070 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2443fff640 1 -- 172.21.15.37:0/918570941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f245401a8f0 con 0x5604f8cfe070 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2443fff640 1 -- 172.21.15.37:0/918570941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f245c044040 con 0x5604f8cfe070 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2471262740 10 client.16023 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2471262740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2471262740 20 client.16023 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2471262740 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5604f8cbc9f0 0x5604f90c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2471262740 4 client.16023 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2471262740 1 -- 172.21.15.37:0/918570941 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604f901c580 con 0x5604f8cbc9f0 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.064+0000 7f2468a89640 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5604f8cbc9f0 0x5604f90c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.065+0000 7f2443fff640 10 client.16023 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.065+0000 7f2468a89640 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5604f8cbc9f0 0x5604f90c0d20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bb96f7d67a8d776 server_cookie=5ea17df8fe263ca4 in_seq=0 out_seq=0 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2443fff640 1 -- 172.21.15.37:0/918570941 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604f901c580 con 0x5604f8cbc9f0 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2443fff640 10 client.16023 handle_command_reply: tid=0 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 client.16023 shutdown 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 -- 172.21.15.37:0/918570941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cfe070 msgr2=0x5604f90bad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cfe070 0x5604f90bad90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f245c006010 tx=0x7f245c0095c0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 -- 172.21.15.37:0/918570941 shutdown_connections 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5604f8cbc9f0 0x5604f90c0d20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cfe070 0x5604f90bad90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 0x5604f90aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2443fff640 0 client.16023 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 --2- 172.21.15.37:0/918570941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cd51b0 0x5604f90aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 -- 172.21.15.37:0/918570941 >> 172.21.15.37:0/918570941 conn(0x5604f8cf2460 msgr2=0x5604f90a64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 -- 172.21.15.37:0/918570941 shutdown_connections 2024-08-31T06:48:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 1 -- 172.21.15.37:0/918570941 wait complete. 2024-08-31T06:48:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.066+0000 7f2471262740 20 client.16023 trim_cache size 0 max 16384 2024-08-31T06:48:12.072 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:11 smithi106 ceph-mon[22134]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-31T06:48:12.072 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:11 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:48:12.072 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:11 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:48:12.073 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:11 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:48:12.073 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:11 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:48:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2471262740 1 Processor -- start 2024-08-31T06:48:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2471262740 1 -- start start 2024-08-31T06:48:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2471262740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cd51b0 0x5604f90a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2471262740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cdd390 0x5604f90ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2471262740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 0x5604f90abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2471262740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24641b1be0 con 0x5604f8cdd390 2024-08-31T06:48:12.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2471262740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24641af4b0 con 0x5604f8cd51b0 2024-08-31T06:48:12.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2471262740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f24641ad300 con 0x5604f8cfe070 2024-08-31T06:48:12.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2463fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cdd390 0x5604f90ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2463fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cdd390 0x5604f90ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36806/0 (socket says 172.21.15.37:36806) 2024-08-31T06:48:12.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.084+0000 7f2463fff640 1 -- 172.21.15.37:0/595382625 learned_addr learned my addr 172.21.15.37:0/595382625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f2463fff640 1 -- 172.21.15.37:0/595382625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 msgr2=0x5604f90abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f2463fff640 1 --2- 172.21.15.37:0/595382625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 0x5604f90abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f2468a89640 1 --2- 172.21.15.37:0/595382625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cd51b0 0x5604f90a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f2463fff640 1 -- 172.21.15.37:0/595382625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cd51b0 msgr2=0x5604f90a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f2463fff640 1 --2- 172.21.15.37:0/595382625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cd51b0 0x5604f90a6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f2463fff640 1 -- 172.21.15.37:0/595382625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604f90ad960 con 0x5604f8cdd390 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f2463fff640 1 --2- 172.21.15.37:0/595382625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cdd390 0x5604f90ae970 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f244c0a78c0 tx=0x7f244c0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfab3869a55fb080 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f245a7fc640 1 -- 172.21.15.37:0/595382625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0ab350 con 0x5604f8cdd390 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f245a7fc640 1 -- 172.21.15.37:0/595382625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f244c0abf40 con 0x5604f8cdd390 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.085+0000 7f245a7fc640 1 -- 172.21.15.37:0/595382625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244c0a7ad0 con 0x5604f8cdd390 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 -- 172.21.15.37:0/595382625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cdd390 msgr2=0x5604f90ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 --2- 172.21.15.37:0/595382625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cdd390 0x5604f90ae970 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f244c0a78c0 tx=0x7f244c0045f0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 -- 172.21.15.37:0/595382625 shutdown_connections 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 --2- 172.21.15.37:0/595382625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cdd390 0x5604f90ae970 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 --2- 172.21.15.37:0/595382625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 0x5604f90abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 --2- 172.21.15.37:0/595382625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cd51b0 0x5604f90a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 -- 172.21.15.37:0/595382625 >> 172.21.15.37:0/595382625 conn(0x5604f8cf2460 msgr2=0x5604f90a63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 -- 172.21.15.37:0/595382625 shutdown_connections 2024-08-31T06:48:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 -- 172.21.15.37:0/595382625 wait complete. 2024-08-31T06:48:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 -- start start 2024-08-31T06:48:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.086+0000 7f2471262740 1 Processor -- start 2024-08-31T06:48:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2471262740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2471262740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 0x5604f90b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2471262740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 0x5604f90b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2471262740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24641ad970 con 0x5604f8cd51b0 2024-08-31T06:48:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2471262740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f24641aede0 con 0x5604f8cdd390 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2471262740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f24641ae040 con 0x5604f8cfe070 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2471262740 10 client.0 _ll_register_callbacks cb 0x7f245c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36822/0 (socket says 172.21.15.37:36822) 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 -- 172.21.15.37:0/3514134564 learned_addr learned my addr 172.21.15.37:0/3514134564 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2463fff640 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 0x5604f90b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f246928a640 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 0x5604f90b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 -- 172.21.15.37:0/3514134564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 msgr2=0x5604f90b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 0x5604f90b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 -- 172.21.15.37:0/3514134564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 msgr2=0x5604f90b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 0x5604f90b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 -- 172.21.15.37:0/3514134564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604f90b4230 con 0x5604f8cd51b0 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2468a89640 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90b72c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2454004600 tx=0x7f245400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e428770aa950f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.087+0000 7f2443fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2443fff640 1 -- 172.21.15.37:0/3514134564 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454015040 con 0x5604f8cd51b0 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2443fff640 1 -- 172.21.15.37:0/3514134564 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f2454005040 con 0x5604f8cd51b0 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 1 -- 172.21.15.37:0/3514134564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f244c0abf40 con 0x5604f8cd51b0 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2443fff640 1 -- 172.21.15.37:0/3514134564 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2454005240 con 0x5604f8cd51b0 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 10 client.16029 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 1 -- 172.21.15.37:0/3514134564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5604f912c420 con 0x5604f8cd51b0 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2443fff640 1 -- 172.21.15.37:0/3514134564 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f244c0abf40 con 0x5604f8cd51b0 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2443fff640 1 -- 172.21.15.37:0/3514134564 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f24540115f0 con 0x5604f8cd51b0 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 10 client.16029 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 20 client.16029 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5604f8c91da0 0x5604f912e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 4 client.16029 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.088+0000 7f2471262740 1 -- 172.21.15.37:0/3514134564 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5604f9018020 con 0x5604f8c91da0 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.089+0000 7f2463fff640 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5604f8c91da0 0x5604f912e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.089+0000 7f2443fff640 10 client.16029 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.089+0000 7f2463fff640 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5604f8c91da0 0x5604f912e8d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b1028fad7e3dd5 server_cookie=c87e339308e27fa3 in_seq=0 out_seq=0 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.089+0000 7f2443fff640 1 -- 172.21.15.37:0/3514134564 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x5604f9018020 con 0x5604f8c91da0 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.089+0000 7f2443fff640 10 client.16029 handle_command_reply: tid=0 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.089+0000 7f2471262740 1 client.16029 shutdown 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 -- 172.21.15.37:0/3514134564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 msgr2=0x5604f90b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90b72c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2454004600 tx=0x7f245400bf00 comp rx=0 tx=0).stop 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 -- 172.21.15.37:0/3514134564 shutdown_connections 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5604f8c91da0 0x5604f912e8d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5604f8cfe070 0x5604f90b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5604f8cdd390 0x5604f90b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2443fff640 0 client.16029 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 --2- 172.21.15.37:0/3514134564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604f8cd51b0 0x5604f90b72c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 -- 172.21.15.37:0/3514134564 >> 172.21.15.37:0/3514134564 conn(0x5604f8cf2460 msgr2=0x5604f90a42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 -- 172.21.15.37:0/3514134564 shutdown_connections 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 1 -- 172.21.15.37:0/3514134564 wait complete. 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f2471262740 20 client.16029 trim_cache size 0 max 16384 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:48:12.096 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "ed2cc30c-a429-4a5d-b939-87f726e6372c", 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:48:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:48:12.098 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:48:12.099 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:48:12.099 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:48:12.099 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:12.099 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:12.099 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:48:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f246aced640 1 -- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f24500b4cd0 msgr2=0x7f24500b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.090+0000 7f246aced640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f24500b4cd0 0x7f24500b71e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f245c005cc0 tx=0x7f245c005c30 comp rx=0 tx=0).stop 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 -- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108160 msgr2=0x7f246419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108160 0x7f246419a690 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f244c00c970 tx=0x7f244c00ce30 comp rx=0 tx=0).stop 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 -- 172.21.15.37:0/679185414 shutdown_connections 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f24500b4cd0 0x7f24500b71e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2464108160 0x7f246419a690 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2464108ab0 0x7f246419f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 --2- 172.21.15.37:0/679185414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2464102820 0x7f246419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 -- 172.21.15.37:0/679185414 >> 172.21.15.37:0/679185414 conn(0x7f24640794e0 msgr2=0x7f24641041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 -- 172.21.15.37:0/679185414 shutdown_connections 2024-08-31T06:48:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:12.091+0000 7f246aced640 1 -- 172.21.15.37:0/679185414 wait complete. 2024-08-31T06:48:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:11 smithi066 ceph-mon[22244]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-31T06:48:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:11 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:48:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:11 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:48:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:11 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:48:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:11 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:48:12.787 INFO:tasks.cephfs.filesystem:scrub status for tag:ed2cc30c-a429-4a5d-b939-87f726e6372c - {'path': '/', 'tag': 'ed2cc30c-a429-4a5d-b939-87f726e6372c', 'options': 'recursive,force'} 2024-08-31T06:48:13.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:48:13.555 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:13.963 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:13 smithi037 ceph-mon[18612]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-31T06:48:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 -- 172.21.15.37:0/3820390723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109c50 msgr2=0x7fcae8110480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/3820390723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109c50 0x7fcae8110480 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcae0009ca0 tx=0x7fcae002a8e0 comp rx=0 tx=0).stop 2024-08-31T06:48:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 -- 172.21.15.37:0/3820390723 shutdown_connections 2024-08-31T06:48:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/3820390723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109c50 0x7fcae8110480 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/3820390723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcae8109300 0x7fcae8109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/3820390723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae8101e20 0x7fcae8102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 -- 172.21.15.37:0/3820390723 >> 172.21.15.37:0/3820390723 conn(0x7fcae8079c60 msgr2=0x7fcae807a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 -- 172.21.15.37:0/3820390723 shutdown_connections 2024-08-31T06:48:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.978+0000 7fcaefcd5640 1 -- 172.21.15.37:0/3820390723 wait complete. 2024-08-31T06:48:13.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.979+0000 7fcaefcd5640 1 Processor -- start 2024-08-31T06:48:13.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.979+0000 7fcaefcd5640 1 -- start start 2024-08-31T06:48:13.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.979+0000 7fcaefcd5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcae8101e20 0x7fcae819a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:13.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.979+0000 7fcaefcd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109300 0x7fcae819a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:13.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.979+0000 7fcaefcd5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae8109c50 0x7fcae819fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.979+0000 7fcaefcd5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcae8113800 con 0x7fcae8109300 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.979+0000 7fcaefcd5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcae8113680 con 0x7fcae8109c50 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.979+0000 7fcaefcd5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcae8113980 con 0x7fcae8101e20 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109300 0x7fcae819a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109300 0x7fcae819a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36832/0 (socket says 172.21.15.37:36832) 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 -- 172.21.15.37:0/302601173 learned_addr learned my addr 172.21.15.37:0/302601173 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaeda71640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcae8101e20 0x7fcae819a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaee272640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae8109c50 0x7fcae819fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 -- 172.21.15.37:0/302601173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcae8101e20 msgr2=0x7fcae819a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcae8101e20 0x7fcae819a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 -- 172.21.15.37:0/302601173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae8109c50 msgr2=0x7fcae819fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae8109c50 0x7fcae819fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:13.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 -- 172.21.15.37:0/302601173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcae81a0140 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaee272640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae8109c50 0x7fcae819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaeda71640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcae8101e20 0x7fcae819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaed270640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109300 0x7fcae819a770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcad8006fd0 tx=0x7fcad800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcadeffd640 1 -- 172.21.15.37:0/302601173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8011830 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcae81a0430 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcadeffd640 1 -- 172.21.15.37:0/302601173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcad8016070 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcadeffd640 1 -- 172.21.15.37:0/302601173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad8010d30 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.980+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcae81a6b90 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.982+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcae8102230 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.983+0000 7fcadeffd640 1 -- 172.21.15.37:0/302601173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fcad80119d0 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.984+0000 7fcadeffd640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcad40b4ca0 0x7fcad40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.984+0000 7fcaeda71640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcad40b4ca0 0x7fcad40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.984+0000 7fcadeffd640 1 -- 172.21.15.37:0/302601173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fcad80e4b60 con 0x7fcae8109300 2024-08-31T06:48:13.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.984+0000 7fcaeda71640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcad40b4ca0 0x7fcad40b71b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcae40058c0 tx=0x7fcae4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:13.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:13.988+0000 7fcadeffd640 1 -- 172.21.15.37:0/302601173 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fcad80ab990 con 0x7fcae8109300 2024-08-31T06:48:14.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:13 smithi106 ceph-mon[22134]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-31T06:48:14.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:13 smithi066 ceph-mon[22244]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-31T06:48:14.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.210+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcae802e430 con 0x7fcae8109300 2024-08-31T06:48:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.211+0000 7fcadeffd640 1 -- 172.21.15.37:0/302601173 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fcad80ab290 con 0x7fcae8109300 2024-08-31T06:48:14.212 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:48:14.212 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:48:14.213 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:48:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcad40b4ca0 msgr2=0x7fcad40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcad40b4ca0 0x7fcad40b71b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcae40058c0 tx=0x7fcae4005850 comp rx=0 tx=0).stop 2024-08-31T06:48:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109300 msgr2=0x7fcae819a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109300 0x7fcae819a770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcad8006fd0 tx=0x7fcad800b8e0 comp rx=0 tx=0).stop 2024-08-31T06:48:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 shutdown_connections 2024-08-31T06:48:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcad40b4ca0 0x7fcad40b71b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae8109300 0x7fcae819a770 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae8109c50 0x7fcae819fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 --2- 172.21.15.37:0/302601173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcae8101e20 0x7fcae819a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 >> 172.21.15.37:0/302601173 conn(0x7fcae8079c60 msgr2=0x7fcae8107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.213+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 shutdown_connections 2024-08-31T06:48:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:14.214+0000 7fcaefcd5640 1 -- 172.21.15.37:0/302601173 wait complete. 2024-08-31T06:48:14.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:14 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/302601173' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:14.906 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 9ac877b7 --release --await' 2024-08-31T06:48:14.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 9ac877b7 --release --await 2024-08-31T06:48:15.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:14 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/302601173' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:15.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:14 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/302601173' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:15.160 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:15.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 -- 172.21.15.37:0/3433403958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc103940 msgr2=0x7feecc103d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 --2- 172.21.15.37:0/3433403958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc103940 0x7feecc103d50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feebc009900 tx=0x7feebc02a410 comp rx=0 tx=0).stop 2024-08-31T06:48:15.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 -- 172.21.15.37:0/3433403958 shutdown_connections 2024-08-31T06:48:15.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 --2- 172.21.15.37:0/3433403958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feecc109bd0 0x7feecc110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 --2- 172.21.15.37:0/3433403958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc109280 0x7feecc109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 --2- 172.21.15.37:0/3433403958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc103940 0x7feecc103d50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 -- 172.21.15.37:0/3433403958 >> 172.21.15.37:0/3433403958 conn(0x7feecc0ff3d0 msgr2=0x7feecc101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 -- 172.21.15.37:0/3433403958 shutdown_connections 2024-08-31T06:48:15.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.656+0000 7feed1d27640 1 -- 172.21.15.37:0/3433403958 wait complete. 2024-08-31T06:48:15.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feed1d27640 1 Processor -- start 2024-08-31T06:48:15.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feed1d27640 1 -- start start 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feed1d27640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc103940 0x7feecc19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feed1d27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc109280 0x7feecc19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feed1d27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feecc109bd0 0x7feecc19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feed1d27640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feecc113740 con 0x7feecc109280 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feed1d27640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1135c0 con 0x7feecc109bd0 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feed1d27640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1138c0 con 0x7feecc103940 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feecaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc109280 0x7feecc19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feecaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc109280 0x7feecc19a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37520/0 (socket says 172.21.15.37:37520) 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feecaffd640 1 -- 172.21.15.37:0/3909724151 learned_addr learned my addr 172.21.15.37:0/3909724151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feecb7fe640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc103940 0x7feecc19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.657+0000 7feecbfff640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feecc109bd0 0x7feecc19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feecaffd640 1 -- 172.21.15.37:0/3909724151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc103940 msgr2=0x7feecc19a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feecaffd640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc103940 0x7feecc19a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feecaffd640 1 -- 172.21.15.37:0/3909724151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feecc109bd0 msgr2=0x7feecc19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feecaffd640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feecc109bd0 0x7feecc19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feecaffd640 1 -- 172.21.15.37:0/3909724151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc1a01a0 con 0x7feecc109280 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feecbfff640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feecc109bd0 0x7feecc19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feecb7fe640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc103940 0x7feecc19a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feecaffd640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc109280 0x7feecc19a7d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feec000c970 tx=0x7feec000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feec8ff9640 1 -- 172.21.15.37:0/3909724151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0004220 con 0x7feecc109280 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feec8ff9640 1 -- 172.21.15.37:0/3909724151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feec0007e40 con 0x7feecc109280 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feed1d27640 1 -- 172.21.15.37:0/3909724151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc1a0490 con 0x7feecc109280 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feec8ff9640 1 -- 172.21.15.37:0/3909724151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec00047a0 con 0x7feecc109280 2024-08-31T06:48:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.658+0000 7feed1d27640 1 -- 172.21.15.37:0/3909724151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc1a6bf0 con 0x7feecc109280 2024-08-31T06:48:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feed829c740 1 Processor -- start 2024-08-31T06:48:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feed829c740 1 -- start start 2024-08-31T06:48:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feec8ff9640 1 -- 172.21.15.37:0/3909724151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7feec00079b0 con 0x7feecc109280 2024-08-31T06:48:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feed829c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcdd2cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feed829c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd2d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feed829c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd2d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feed829c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560bcdca3a70 con 0x560bcd95e660 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feed829c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560bcdc93000 con 0x560bcd966840 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feed829c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560bcdc96fb0 con 0x560bcd987520 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feecb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd2d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.661+0000 7feecb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd2d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37532/0 (socket says 172.21.15.37:37532) 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecb7fe640 1 -- 172.21.15.37:0/1850402618 learned_addr learned my addr 172.21.15.37:0/1850402618 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecbfff640 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcdd2cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecaffd640 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd2d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecb7fe640 1 -- 172.21.15.37:0/1850402618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 msgr2=0x560bcdd2cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecb7fe640 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcdd2cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecb7fe640 1 -- 172.21.15.37:0/1850402618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 msgr2=0x560bcdd2d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecb7fe640 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd2d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecb7fe640 1 -- 172.21.15.37:0/1850402618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bcd9f2b00 con 0x560bcd95e660 2024-08-31T06:48:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecaffd640 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd2d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feecb7fe640 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd2d1c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feebc0096c0 tx=0x7feebc031d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52abdf7cd90cec88 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.662+0000 7feec8ff9640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feeb40b4ca0 0x7feeb40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.663+0000 7feeb1ffb640 1 -- 172.21.15.37:0/1850402618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc035030 con 0x560bcd95e660 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.663+0000 7feecbfff640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feeb40b4ca0 0x7feeb40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.663+0000 7feeb1ffb640 1 -- 172.21.15.37:0/1850402618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feebc0044c0 con 0x560bcd95e660 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.663+0000 7feeb1ffb640 1 -- 172.21.15.37:0/1850402618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc003bc0 con 0x560bcd95e660 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.663+0000 7feec8ff9640 1 -- 172.21.15.37:0/3909724151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7feec00e4f70 con 0x7feecc109280 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.663+0000 7feed829c740 1 -- 172.21.15.37:0/1850402618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 msgr2=0x560bcdd2d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.663+0000 7feed829c740 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd2d1c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feebc0096c0 tx=0x7feebc031d60 comp rx=0 tx=0).stop 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.663+0000 7feecbfff640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feeb40b4ca0 0x7feeb40b71b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feec400af00 tx=0x7feec400a6b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 -- 172.21.15.37:0/1850402618 shutdown_connections 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd2d1c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd2d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 --2- 172.21.15.37:0/1850402618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcdd2cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 -- 172.21.15.37:0/1850402618 >> 172.21.15.37:0/1850402618 conn(0x560bcd97b910 msgr2=0x560bcdd2ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 -- 172.21.15.37:0/1850402618 shutdown_connections 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 -- 172.21.15.37:0/1850402618 wait complete. 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 -- start start 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.664+0000 7feed829c740 1 Processor -- start 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feed829c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd95e660 0x560bcdd38880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feed829c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd966840 0x560bcdd38dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feed829c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd987520 0x560bcdd448d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feed829c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560bcdd3b400 con 0x560bcd966840 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feed829c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560bcdc54520 con 0x560bcd987520 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feed829c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560bcdd3b580 con 0x560bcd95e660 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd966840 0x560bcdd38dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feed829c740 10 client.0 _ll_register_callbacks cb 0x560bcdc8cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd966840 0x560bcdd38dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37538/0 (socket says 172.21.15.37:37538) 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 -- 172.21.15.37:0/65161436 learned_addr learned my addr 172.21.15.37:0/65161436 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecbfff640 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd987520 0x560bcdd448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecb7fe640 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd95e660 0x560bcdd38880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 -- 172.21.15.37:0/65161436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd95e660 msgr2=0x560bcdd38880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd95e660 0x560bcdd38880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 -- 172.21.15.37:0/65161436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd987520 msgr2=0x560bcdd448d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd987520 0x560bcdd448d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 -- 172.21.15.37:0/65161436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bcda69960 con 0x560bcd966840 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feecaffd640 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd966840 0x560bcdd38dc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7feec00a8910 tx=0x7feec00a7560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbedd89ac89b5fe3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.665+0000 7feeaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feeaaffd640 1 -- 172.21.15.37:0/65161436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec001d030 con 0x560bcd966840 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feeaaffd640 1 -- 172.21.15.37:0/65161436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7feec00aa900 con 0x560bcd966840 2024-08-31T06:48:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 1 -- 172.21.15.37:0/65161436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560bcdc329a0 con 0x560bcd966840 2024-08-31T06:48:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feeaaffd640 1 -- 172.21.15.37:0/65161436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feec00aae10 con 0x560bcd966840 2024-08-31T06:48:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 10 client.16047 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 1 -- 172.21.15.37:0/65161436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560bcdd47660 con 0x560bcd966840 2024-08-31T06:48:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feeaaffd640 1 -- 172.21.15.37:0/65161436 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560bcdc329a0 con 0x560bcd966840 2024-08-31T06:48:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feeaaffd640 1 -- 172.21.15.37:0/65161436 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feec0020060 con 0x560bcd966840 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 10 client.16047 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 10 client.16047 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 20 client.16047 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560bcd945ea0 0x560bcdd4ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 4 client.16047 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.666+0000 7feed829c740 1 -- 172.21.15.37:0/65161436 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bcdca59c0 con 0x560bcd945ea0 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.667+0000 7feecb7fe640 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560bcd945ea0 0x560bcdd4ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.667+0000 7feecb7fe640 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560bcd945ea0 0x560bcdd4ac70 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25acc7774e043757 server_cookie=76ca35b2cfefe0d6 in_seq=0 out_seq=0 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.667+0000 7feeaaffd640 10 client.16047 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feeaaffd640 1 -- 172.21.15.37:0/65161436 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560bcdca59c0 con 0x560bcd945ea0 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feeaaffd640 10 client.16047 handle_command_reply: tid=0 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 client.16047 shutdown 2024-08-31T06:48:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 -- 172.21.15.37:0/65161436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd966840 msgr2=0x560bcdd38dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd966840 0x560bcdd38dc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7feec00a8910 tx=0x7feec00a7560 comp rx=0 tx=0).stop 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 -- 172.21.15.37:0/65161436 shutdown_connections 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560bcd945ea0 0x560bcdd4ac70 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd966840 0x560bcdd38dc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd987520 0x560bcdd448d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 --2- 172.21.15.37:0/65161436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd95e660 0x560bcdd38880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 -- 172.21.15.37:0/65161436 >> 172.21.15.37:0/65161436 conn(0x560bcd97b910 msgr2=0x560bcdd2fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feeaaffd640 0 client.16047 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 -- 172.21.15.37:0/65161436 shutdown_connections 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 1 -- 172.21.15.37:0/65161436 wait complete. 2024-08-31T06:48:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.668+0000 7feed829c740 20 client.16047 trim_cache size 0 max 16384 2024-08-31T06:48:15.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feed829c740 1 Processor -- start 2024-08-31T06:48:15.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feed829c740 1 -- start start 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 -- 172.21.15.37:0/324078255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4108a20 msgr2=0x7f69c410f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 --2- 172.21.15.37:0/324078255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4108a20 0x7f69c410f250 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009900 tx=0x7f69bc02a410 comp rx=0 tx=0).stop 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 -- 172.21.15.37:0/324078255 shutdown_connections 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 --2- 172.21.15.37:0/324078255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4108a20 0x7f69c410f250 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 --2- 172.21.15.37:0/324078255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69c41080d0 0x7f69c41084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 --2- 172.21.15.37:0/324078255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c4102f10 0x7f69c4103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 -- 172.21.15.37:0/324078255 >> 172.21.15.37:0/324078255 conn(0x7f69c4079c30 msgr2=0x7f69c407a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 -- 172.21.15.37:0/324078255 shutdown_connections 2024-08-31T06:48:15.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.689+0000 7f69cadcf640 1 -- 172.21.15.37:0/324078255 wait complete. 2024-08-31T06:48:15.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feed829c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd44840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feed829c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd38ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feed829c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcdd31d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feed829c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1b1bb0 con 0x560bcd95e660 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feed829c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1af480 con 0x560bcd966840 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feed829c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1ad2d0 con 0x560bcd987520 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feecb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd44840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feecb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd44840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37566/0 (socket says 172.21.15.37:37566) 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feecb7fe640 1 -- 172.21.15.37:0/2861007414 learned_addr learned my addr 172.21.15.37:0/2861007414 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feecaffd640 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd38ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.689+0000 7feecbfff640 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcdd31d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feecb7fe640 1 -- 172.21.15.37:0/2861007414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 msgr2=0x560bcdd31d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feecb7fe640 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcdd31d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feecb7fe640 1 -- 172.21.15.37:0/2861007414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 msgr2=0x560bcdd38ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feecb7fe640 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd38ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feecb7fe640 1 -- 172.21.15.37:0/2861007414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bcdd33ea0 con 0x560bcd95e660 2024-08-31T06:48:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feecaffd640 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd38ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feecb7fe640 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd44840 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feebc009900 tx=0x7feebc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e7d5df9775db49 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.690+0000 7f69cadcf640 1 Processor -- start 2024-08-31T06:48:15.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.690+0000 7f69cadcf640 1 -- start start 2024-08-31T06:48:15.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feeb17fa640 1 -- 172.21.15.37:0/2861007414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc035040 con 0x560bcd95e660 2024-08-31T06:48:15.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feeb17fa640 1 -- 172.21.15.37:0/2861007414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feebc03c8d0 con 0x560bcd95e660 2024-08-31T06:48:15.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.690+0000 7feeb17fa640 1 -- 172.21.15.37:0/2861007414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc050680 con 0x560bcd95e660 2024-08-31T06:48:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.690+0000 7f69cadcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4102f10 0x7f69c419a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.690+0000 7f69cadcf640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c41080d0 0x7f69c419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4102f10 0x7f69c419a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4102f10 0x7f69c419a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37580/0 (socket says 172.21.15.37:37580) 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 -- 172.21.15.37:0/1615009088 learned_addr learned my addr 172.21.15.37:0/1615009088 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69cadcf640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69c4108a20 0x7f69c419f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69c4112580 con 0x7f69c4102f10 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69c4112400 con 0x7f69c4108a20 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f69c4112700 con 0x7f69c41080d0 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c3fff640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c41080d0 0x7f69c419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c936c640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69c4108a20 0x7f69c419f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 -- 172.21.15.37:0/1615009088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c41080d0 msgr2=0x7f69c419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c41080d0 0x7f69c419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 -- 172.21.15.37:0/1615009088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69c4108a20 msgr2=0x7f69c419f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69c4108a20 0x7f69c419f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 -- 172.21.15.37:0/1615009088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c41a0040 con 0x7f69c4102f10 2024-08-31T06:48:15.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c936c640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69c4108a20 0x7f69c419f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:15.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 -- 172.21.15.37:0/2861007414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 msgr2=0x560bcdd44840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd44840 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7feebc009900 tx=0x7feebc005e80 comp rx=0 tx=0).stop 2024-08-31T06:48:15.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 -- 172.21.15.37:0/2861007414 shutdown_connections 2024-08-31T06:48:15.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcdd31d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd38ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 --2- 172.21.15.37:0/2861007414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd44840 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 -- 172.21.15.37:0/2861007414 >> 172.21.15.37:0/2861007414 conn(0x560bcd97b910 msgr2=0x560bcdd2a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.691+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4102f10 0x7f69c419a110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00d950 tx=0x7f69ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 -- 172.21.15.37:0/2861007414 shutdown_connections 2024-08-31T06:48:15.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.691+0000 7feed829c740 1 -- 172.21.15.37:0/2861007414 wait complete. 2024-08-31T06:48:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.692+0000 7f69c1ffb640 1 -- 172.21.15.37:0/1615009088 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac017030 con 0x7f69c4102f10 2024-08-31T06:48:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.692+0000 7f69c1ffb640 1 -- 172.21.15.37:0/1615009088 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69ac004020 con 0x7f69c4102f10 2024-08-31T06:48:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.692+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c41a0330 con 0x7f69c4102f10 2024-08-31T06:48:15.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.692+0000 7f69c1ffb640 1 -- 172.21.15.37:0/1615009088 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0055d0 con 0x7f69c4102f10 2024-08-31T06:48:15.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.692+0000 7feed829c740 1 -- start start 2024-08-31T06:48:15.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.692+0000 7feed829c740 1 Processor -- start 2024-08-31T06:48:15.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.692+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c41a6ac0 con 0x7f69c4102f10 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feed829c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd4c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feed829c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd4c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feed829c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcddb43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feed829c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1ad940 con 0x560bcd95e660 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feed829c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1aedb0 con 0x560bcd966840 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feed829c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1ae010 con 0x560bcd987520 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feed829c740 10 client.0 _ll_register_callbacks cb 0x7feec00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feecaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd4c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feecbfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcddb43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feecaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd4c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:42172/0 (socket says 172.21.15.37:42172) 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feecaffd640 1 -- 172.21.15.37:0/1221084040 learned_addr learned my addr 172.21.15.37:0/1221084040 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feecaffd640 1 -- 172.21.15.37:0/1221084040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 msgr2=0x560bcddb43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feecaffd640 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcddb43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feecaffd640 1 -- 172.21.15.37:0/1221084040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 msgr2=0x560bcdd4c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.693+0000 7feecaffd640 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd4c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feecaffd640 1 -- 172.21.15.37:0/1221084040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bcddb4930 con 0x560bcd966840 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feecaffd640 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd4c620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feec00b0080 tx=0x7feec00e85d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0314b6d07db4604 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feeaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feeaaffd640 1 -- 172.21.15.37:0/1221084040 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec001d070 con 0x560bcd966840 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feeaaffd640 1 -- 172.21.15.37:0/1221084040 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7feec00a7c90 con 0x560bcd966840 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feed829c740 1 -- 172.21.15.37:0/1221084040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feebc03c8d0 con 0x560bcd966840 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feeaaffd640 1 -- 172.21.15.37:0/1221084040 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feec0007ca0 con 0x560bcd966840 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feed829c740 10 client.25556 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:15.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.694+0000 7feed829c740 1 -- 172.21.15.37:0/1221084040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560bcddb5b20 con 0x560bcd966840 2024-08-31T06:48:15.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feeaaffd640 1 -- 172.21.15.37:0/1221084040 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feebc03c8d0 con 0x560bcd966840 2024-08-31T06:48:15.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feeaaffd640 1 -- 172.21.15.37:0/1221084040 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feec005b1b0 con 0x560bcd966840 2024-08-31T06:48:15.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feed829c740 10 client.25556 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:15.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feed829c740 10 client.25556 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:48:15.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feed829c740 20 client.25556 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:15.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feed829c740 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560bcd91b250 0x560bcddb8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69d1e1d740 1 Processor -- start 2024-08-31T06:48:15.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feed829c740 4 client.25556 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9ac877b7", "release": true, "await": true}] 2024-08-31T06:48:15.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feed829c740 1 -- 172.21.15.37:0/1221084040 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9ac877b7", "release": true, "await": true}) -- 0x560bcdca1460 con 0x560bcd91b250 2024-08-31T06:48:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69d1e1d740 1 -- start start 2024-08-31T06:48:15.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.695+0000 7feecb7fe640 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560bcd91b250 0x560bcddb8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 0x55695f4820f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f482630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 0x55695f482b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69c1ffb640 1 -- 172.21.15.37:0/1615009088 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f69ac009a30 con 0x7f69c4102f10 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55695f3f3000 con 0x55695f0b12f0 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55695f3e2590 con 0x55695f0b94d0 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.695+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55695f3e6540 con 0x55695f0da1b0 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f482630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f482630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37602/0 (socket says 172.21.15.37:37602) 2024-08-31T06:48:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 -- 172.21.15.37:0/1720931397 learned_addr learned my addr 172.21.15.37:0/1720931397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c936c640 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 0x55695f4820f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c3fff640 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 0x55695f482b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.696+0000 7feecb7fe640 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560bcd91b250 0x560bcddb8330 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1556e65822fdf4fa server_cookie=dbfe169d1d08942d in_seq=0 out_seq=0 2024-08-31T06:48:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 -- 172.21.15.37:0/1720931397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 msgr2=0x55695f4820f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 0x55695f4820f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.696+0000 7feeaaffd640 10 client.25556 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 -- 172.21.15.37:0/1720931397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 msgr2=0x55695f482b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 0x55695f482b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 -- 172.21.15.37:0/1720931397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695f145790 con 0x55695f0b12f0 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f482630 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0e2670 tx=0x7f69ac0ed570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f3c0a9aa108d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.696+0000 7f69c1ffb640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69b00b4d20 0x7f69b00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.697+0000 7f69c936c640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69b00b4d20 0x7f69b00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.697+0000 7f69c1ffb640 1 -- 172.21.15.37:0/1615009088 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f69ac0e4f70 con 0x7f69c4102f10 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.697+0000 7f69baffd640 1 -- 172.21.15.37:0/1720931397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0f8070 con 0x55695f0b12f0 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.697+0000 7f69baffd640 1 -- 172.21.15.37:0/1720931397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69ac0ab1b0 con 0x55695f0b12f0 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.697+0000 7f69baffd640 1 -- 172.21.15.37:0/1720931397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0aaff0 con 0x55695f0b12f0 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 -- 172.21.15.37:0/1720931397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 msgr2=0x55695f482630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69c936c640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69b00b4d20 0x7f69b00b7230 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005940 tx=0x7f69bc0058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f482630 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0e2670 tx=0x7f69ac0ed570 comp rx=0 tx=0).stop 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 -- 172.21.15.37:0/1720931397 shutdown_connections 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f482630 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 0x55695f482b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/1720931397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 0x55695f4820f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 -- 172.21.15.37:0/1720931397 >> 172.21.15.37:0/1720931397 conn(0x55695f0ce300 msgr2=0x55695f47ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 -- 172.21.15.37:0/1720931397 shutdown_connections 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 -- 172.21.15.37:0/1720931397 wait complete. 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 -- start start 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.698+0000 7f69d1e1d740 1 Processor -- start 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f48dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 0x55695f48e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 0x55695f499b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55695f31bab0 con 0x55695f0b12f0 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55695f369680 con 0x55695f0b94d0 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55695f490870 con 0x55695f0da1b0 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69d1e1d740 10 client.0 _ll_register_callbacks cb 0x55695f0f1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f48dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f48dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37612/0 (socket says 172.21.15.37:37612) 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 -- 172.21.15.37:0/2993753469 learned_addr learned my addr 172.21.15.37:0/2993753469 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c3fff640 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 0x55695f48e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c936c640 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 0x55695f499b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 -- 172.21.15.37:0/2993753469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 msgr2=0x55695f499b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 0x55695f499b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 -- 172.21.15.37:0/2993753469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 msgr2=0x55695f48e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 0x55695f48e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 -- 172.21.15.37:0/2993753469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695f1be620 con 0x55695f0b12f0 2024-08-31T06:48:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f48dd10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0e27b0 tx=0x7f69ac0e85f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fc4477b1f6f3f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.699+0000 7f69a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69a3fff640 1 -- 172.21.15.37:0/2993753469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0aae10 con 0x55695f0b12f0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69a3fff640 1 -- 172.21.15.37:0/2993753469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f69ac0041d0 con 0x55695f0b12f0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2993753469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69ac0ab1b0 con 0x55695f0b12f0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69a3fff640 1 -- 172.21.15.37:0/2993753469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69ac0aaff0 con 0x55695f0b12f0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 10 client.16062 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2993753469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55695f49c910 con 0x55695f0b12f0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69a3fff640 1 -- 172.21.15.37:0/2993753469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69ac0ab1b0 con 0x55695f0b12f0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69a3fff640 1 -- 172.21.15.37:0/2993753469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f69ac0e2980 con 0x55695f0b12f0 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 10 client.16062 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 10 client.16062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 20 client.16062 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55695f098d80 0x55695f49fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 4 client.16062 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2993753469 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55695f3f4f50 con 0x55695f098d80 2024-08-31T06:48:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.700+0000 7f69c3fff640 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55695f098d80 0x55695f49fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.701+0000 7f69c3fff640 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55695f098d80 0x55695f49fc70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5524f8de080ae81b server_cookie=bd6b2a1d178a1484 in_seq=0 out_seq=0 2024-08-31T06:48:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.701+0000 7f69a3fff640 10 client.16062 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:15.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feeaaffd640 1 -- 172.21.15.37:0/1221084040 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560bcdca1460 con 0x560bcd91b250 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feeaaffd640 10 client.25556 handle_command_reply: tid=0 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 client.25556 shutdown 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 -- 172.21.15.37:0/1221084040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 msgr2=0x560bcdd4c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd4c620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feec00b0080 tx=0x7feec00e85d0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 -- 172.21.15.37:0/1221084040 shutdown_connections 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560bcd91b250 0x560bcddb8330 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560bcd987520 0x560bcddb43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560bcd966840 0x560bcdd4c620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feeaaffd640 0 client.25556 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 --2- 172.21.15.37:0/1221084040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560bcd95e660 0x560bcdd4c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 -- 172.21.15.37:0/1221084040 >> 172.21.15.37:0/1221084040 conn(0x560bcd97b910 msgr2=0x560bcdd31d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.704+0000 7f69a3fff640 1 -- 172.21.15.37:0/2993753469 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55695f3f4f50 con 0x55695f098d80 2024-08-31T06:48:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.704+0000 7f69a3fff640 10 client.16062 handle_command_reply: tid=0 2024-08-31T06:48:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.704+0000 7f69d1e1d740 1 client.16062 shutdown 2024-08-31T06:48:15.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 -- 172.21.15.37:0/1221084040 shutdown_connections 2024-08-31T06:48:15.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.704+0000 7feed829c740 1 -- 172.21.15.37:0/1221084040 wait complete. 2024-08-31T06:48:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2993753469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 msgr2=0x55695f48dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f48dd10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0e27b0 tx=0x7f69ac0e85f0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed829c740 20 client.25556 trim_cache size 0 max 16384 2024-08-31T06:48:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2993753469 shutdown_connections 2024-08-31T06:48:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55695f098d80 0x55695f49fc70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69a3fff640 0 client.16062 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0da1b0 0x55695f499b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b94d0 0x55695f48e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2993753469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f48dd10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2993753469 >> 172.21.15.37:0/2993753469 conn(0x55695f0ce300 msgr2=0x55695f483120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2993753469 shutdown_connections 2024-08-31T06:48:15.721 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:48:15.721 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 25, 2024-08-31T06:48:15.721 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-31T06:48:15.721 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 8, 2024-08-31T06:48:15.721 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "9ac877b7": { 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 8, 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 146.4, 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-31T06:48:15.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-31T06:48:15.723 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-31T06:48:15.723 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:15.723 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:15.723 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:15.723 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:15.723 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:15.723 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:48:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2993753469 wait complete. 2024-08-31T06:48:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.705+0000 7f69d1e1d740 20 client.16062 trim_cache size 0 max 16384 2024-08-31T06:48:15.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 -- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feeb40b4ca0 msgr2=0x7feeb40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feeb40b4ca0 0x7feeb40b71b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feec400af00 tx=0x7feec400a6b0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 -- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc109280 msgr2=0x7feecc19a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc109280 0x7feecc19a7d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feec000c970 tx=0x7feec000ce30 comp rx=0 tx=0).stop 2024-08-31T06:48:15.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 -- 172.21.15.37:0/3909724151 shutdown_connections 2024-08-31T06:48:15.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feeb40b4ca0 0x7feeb40b71b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feecc109280 0x7feecc19a7d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feecc109bd0 0x7feecc19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 --2- 172.21.15.37:0/3909724151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feecc103940 0x7feecc19a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.705+0000 7feed1d27640 1 -- 172.21.15.37:0/3909724151 >> 172.21.15.37:0/3909724151 conn(0x7feecc0ff3d0 msgr2=0x7feecc1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.706+0000 7feed1d27640 1 -- 172.21.15.37:0/3909724151 shutdown_connections 2024-08-31T06:48:15.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:15.706+0000 7feed1d27640 1 -- 172.21.15.37:0/3909724151 wait complete. 2024-08-31T06:48:15.725 INFO:tasks.workunit.client.0.smithi037.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69d1e1d740 1 Processor -- start 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69d1e1d740 1 -- start start 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f098d80 0x55695f499b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f47f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 0x55695f47fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69c41afaa0 con 0x55695f0b12f0 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69c41ad370 con 0x55695f098d80 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f69c41ab1e0 con 0x55695f0b94d0 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f47f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f47f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37618/0 (socket says 172.21.15.37:37618) 2024-08-31T06:48:15.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c3fff640 1 -- 172.21.15.37:0/10807806 learned_addr learned my addr 172.21.15.37:0/10807806 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c936c640 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 0x55695f47fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f098d80 0x55695f499b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c3fff640 1 -- 172.21.15.37:0/10807806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 msgr2=0x55695f47fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c3fff640 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 0x55695f47fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c3fff640 1 -- 172.21.15.37:0/10807806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f098d80 msgr2=0x55695f499b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c3fff640 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f098d80 0x55695f499b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.721+0000 7f69c3fff640 1 -- 172.21.15.37:0/10807806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695f479f60 con 0x55695f0b12f0 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.722+0000 7f69c3fff640 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f47f7f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f69b4005fd0 tx=0x7f69b4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17d4fb8ee09455 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.722+0000 7f69ba7fc640 1 -- 172.21.15.37:0/10807806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b40122d0 con 0x55695f0b12f0 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.722+0000 7f69ba7fc640 1 -- 172.21.15.37:0/10807806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69b400f840 con 0x55695f0b12f0 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.722+0000 7f69ba7fc640 1 -- 172.21.15.37:0/10807806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4005420 con 0x55695f0b12f0 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 -- 172.21.15.37:0/10807806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 msgr2=0x55695f47f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f47f7f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f69b4005fd0 tx=0x7f69b4009500 comp rx=0 tx=0).stop 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 -- 172.21.15.37:0/10807806 shutdown_connections 2024-08-31T06:48:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f0b12f0 0x55695f47f7f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 0x55695f47fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/10807806 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f098d80 0x55695f499b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 -- 172.21.15.37:0/10807806 >> 172.21.15.37:0/10807806 conn(0x55695f0ce300 msgr2=0x55695f48c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 -- 172.21.15.37:0/10807806 shutdown_connections 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 -- 172.21.15.37:0/10807806 wait complete. 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 -- start start 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.723+0000 7f69d1e1d740 1 Processor -- start 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f098d80 0x55695f4a3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b12f0 0x55695f4a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69d1e1d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 0x55695f4a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69c41ab830 con 0x55695f098d80 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69c41acca0 con 0x55695f0b12f0 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69d1e1d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f69c41abf00 con 0x55695f0b94d0 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69d1e1d740 10 client.0 _ll_register_callbacks cb 0x7f69ac0f6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c8b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f098d80 0x55695f4a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c8b6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f098d80 0x55695f4a3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37634/0 (socket says 172.21.15.37:37634) 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c8b6b640 1 -- 172.21.15.37:0/2579599202 learned_addr learned my addr 172.21.15.37:0/2579599202 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c936c640 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 0x55695f4a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c3fff640 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b12f0 0x55695f4a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c8b6b640 1 -- 172.21.15.37:0/2579599202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 msgr2=0x55695f4a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 0x55695f4a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c8b6b640 1 -- 172.21.15.37:0/2579599202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b12f0 msgr2=0x55695f4a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b12f0 0x55695f4a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.724+0000 7f69c8b6b640 1 -- 172.21.15.37:0/2579599202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695f5093f0 con 0x55695f098d80 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69c8b6b640 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f098d80 0x55695f4a3610 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f69ac000c00 tx=0x7f69ac0043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1a512783251588 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69a3fff640 1 -- 172.21.15.37:0/2579599202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0a7560 con 0x55695f098d80 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69a3fff640 1 -- 172.21.15.37:0/2579599202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f69ac0a7c90 con 0x55695f098d80 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2579599202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69b400f840 con 0x55695f098d80 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69a3fff640 1 -- 172.21.15.37:0/2579599202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69ac0aae10 con 0x55695f098d80 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69d1e1d740 10 client.16068 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2579599202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55695f50a4d0 con 0x55695f098d80 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69a3fff640 1 -- 172.21.15.37:0/2579599202 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69b400f840 con 0x55695f098d80 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.725+0000 7f69a3fff640 1 -- 172.21.15.37:0/2579599202 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f69ac05b1f0 con 0x55695f098d80 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69d1e1d740 10 client.16068 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69d1e1d740 10 client.16068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69d1e1d740 20 client.16068 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55695f0da1b0 0x55695f50ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69d1e1d740 4 client.16068 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2579599202 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55695f3f09f0 con 0x55695f0da1b0 2024-08-31T06:48:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69c3fff640 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55695f0da1b0 0x55695f50ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69a3fff640 10 client.16068 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.726+0000 7f69c3fff640 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55695f0da1b0 0x55695f50ca10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7330259eef67b4e server_cookie=b5fa1d0b172bce08 in_seq=0 out_seq=0 2024-08-31T06:48:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69a3fff640 1 -- 172.21.15.37:0/2579599202 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55695f3f09f0 con 0x55695f0da1b0 2024-08-31T06:48:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69a3fff640 10 client.16068 handle_command_reply: tid=0 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 client.16068 shutdown 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2579599202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f098d80 msgr2=0x55695f4a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f098d80 0x55695f4a3610 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f69ac000c00 tx=0x7f69ac0043e0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2579599202 shutdown_connections 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55695f0da1b0 0x55695f50ca10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55695f0b94d0 0x55695f4a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69a3fff640 0 client.16068 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55695f0b12f0 0x55695f4a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 --2- 172.21.15.37:0/2579599202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55695f098d80 0x55695f4a3610 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2579599202 >> 172.21.15.37:0/2579599202 conn(0x55695f0ce300 msgr2=0x55695f47f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2579599202 shutdown_connections 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 1 -- 172.21.15.37:0/2579599202 wait complete. 2024-08-31T06:48:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.735+0000 7f69d1e1d740 20 client.16068 trim_cache size 0 max 16384 2024-08-31T06:48:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:48:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:48:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:48:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69b00b4d20 msgr2=0x7f69b00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69b00b4d20 0x7f69b00b7230 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f69bc005940 tx=0x7f69bc0058b0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4102f10 msgr2=0x7f69c419a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4102f10 0x7f69c419a110 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00d950 tx=0x7f69ac00de10 comp rx=0 tx=0).stop 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 shutdown_connections 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69b00b4d20 0x7f69b00b7230 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69c4108a20 0x7f69c419f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69c41080d0 0x7f69c419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 --2- 172.21.15.37:0/1615009088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69c4102f10 0x7f69c419a110 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 >> 172.21.15.37:0/1615009088 conn(0x7f69c4079c30 msgr2=0x7f69c4100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:15.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 shutdown_connections 2024-08-31T06:48:15.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:15.736+0000 7f69cadcf640 1 -- 172.21.15.37:0/1615009088 wait complete. 2024-08-31T06:48:15.808 INFO:tasks.workunit.client.0.smithi037.stderr:--2024-08-31 06:48:15-- http://download.ceph.com/qa/fsync-tester.c 2024-08-31T06:48:15.809 INFO:tasks.workunit.client.0.smithi037.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-08-31T06:48:15.831 INFO:tasks.workunit.client.0.smithi037.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-08-31T06:48:15.852 INFO:tasks.workunit.client.0.smithi037.stderr:HTTP request sent, awaiting response... 200 OK 2024-08-31T06:48:15.852 INFO:tasks.workunit.client.0.smithi037.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-08-31T06:48:15.854 INFO:tasks.workunit.client.0.smithi037.stderr:Saving to: ‘fsync-tester.c’ 2024-08-31T06:48:15.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:15 smithi037 ceph-mon[18612]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:48:15.857 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:48:15.857 INFO:tasks.workunit.client.0.smithi037.stderr: 0K .. 100% 564M=0s 2024-08-31T06:48:15.857 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:48:15.857 INFO:tasks.workunit.client.0.smithi037.stderr:2024-08-31 06:48:15 (564 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-08-31T06:48:15.857 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-08-31T06:48:15.858 INFO:tasks.workunit.client.0.smithi037.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-08-31T06:48:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:15 smithi106 ceph-mon[22134]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:48:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:15 smithi066 ceph-mon[22244]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:48:16.150 INFO:tasks.workunit.client.0.smithi037.stderr:+ ./fsync-tester 2024-08-31T06:48:16.631 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9ac877b7', total seconds elapsed: 29.7 2024-08-31T06:48:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:17 smithi106 ceph-mon[22134]: pgmap v363: 97 pgs: 97 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-08-31T06:48:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:17 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:48:18.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:17 smithi037 ceph-mon[18612]: pgmap v363: 97 pgs: 97 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-08-31T06:48:18.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:17 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:48:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:17 smithi066 ceph-mon[22244]: pgmap v363: 97 pgs: 97 active+clean; 1.5 MiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-08-31T06:48:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:17 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:48:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:19 smithi106 ceph-mon[22134]: pgmap v364: 97 pgs: 97 active+clean; 9.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 689 KiB/s wr, 10 op/s 2024-08-31T06:48:20.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:19 smithi037 ceph-mon[18612]: pgmap v364: 97 pgs: 97 active+clean; 9.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 689 KiB/s wr, 10 op/s 2024-08-31T06:48:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:19 smithi066 ceph-mon[22244]: pgmap v364: 97 pgs: 97 active+clean; 9.5 MiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 689 KiB/s wr, 10 op/s 2024-08-31T06:48:22.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:21 smithi106 ceph-mon[22134]: pgmap v365: 97 pgs: 97 active+clean; 45 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-08-31T06:48:22.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:21 smithi037 ceph-mon[18612]: pgmap v365: 97 pgs: 97 active+clean; 45 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-08-31T06:48:22.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:21 smithi066 ceph-mon[22244]: pgmap v365: 97 pgs: 97 active+clean; 45 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-08-31T06:48:24.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:23 smithi106 ceph-mon[22134]: pgmap v366: 97 pgs: 97 active+clean; 106 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 15 op/s 2024-08-31T06:48:24.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:23 smithi037 ceph-mon[18612]: pgmap v366: 97 pgs: 97 active+clean; 106 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 15 op/s 2024-08-31T06:48:24.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:23 smithi066 ceph-mon[22244]: pgmap v366: 97 pgs: 97 active+clean; 106 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 MiB/s wr, 15 op/s 2024-08-31T06:48:26.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:25 smithi106 ceph-mon[22134]: pgmap v367: 97 pgs: 97 active+clean; 126 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 10 MiB/s wr, 12 op/s 2024-08-31T06:48:26.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:25 smithi037 ceph-mon[18612]: pgmap v367: 97 pgs: 97 active+clean; 126 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 10 MiB/s wr, 12 op/s 2024-08-31T06:48:26.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:25 smithi066 ceph-mon[22244]: pgmap v367: 97 pgs: 97 active+clean; 126 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 10 MiB/s wr, 12 op/s 2024-08-31T06:48:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:27 smithi106 ceph-mon[22134]: pgmap v368: 97 pgs: 97 active+clean; 207 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 39 op/s 2024-08-31T06:48:28.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:27 smithi037 ceph-mon[18612]: pgmap v368: 97 pgs: 97 active+clean; 207 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 39 op/s 2024-08-31T06:48:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:27 smithi066 ceph-mon[22244]: pgmap v368: 97 pgs: 97 active+clean; 207 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 39 op/s 2024-08-31T06:48:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 -- 172.21.15.37:0/75133161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef4102e10 msgr2=0x7f8ef4107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 --2- 172.21.15.37:0/75133161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef4102e10 0x7f8ef4107330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009c10 tx=0x7f8eec02a6e0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 -- 172.21.15.37:0/75133161 shutdown_connections 2024-08-31T06:48:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 --2- 172.21.15.37:0/75133161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ef41078f0 0x7f8ef4107dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 --2- 172.21.15.37:0/75133161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef4102e10 0x7f8ef4107330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 --2- 172.21.15.37:0/75133161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ef41024c0 0x7f8ef41028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 -- 172.21.15.37:0/75133161 >> 172.21.15.37:0/75133161 conn(0x7f8ef407a480 msgr2=0x7f8ef407a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 -- 172.21.15.37:0/75133161 shutdown_connections 2024-08-31T06:48:28.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.877+0000 7f8efa84d640 1 -- 172.21.15.37:0/75133161 wait complete. 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.878+0000 7f8efa84d640 1 Processor -- start 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.878+0000 7f8efa84d640 1 -- start start 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8efa84d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ef41024c0 0x7f8ef41a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8efa84d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ef4102e10 0x7f8ef41a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8efa84d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef41078f0 0x7f8ef41a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8efa84d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef4119c40 con 0x7f8ef4102e10 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8efa84d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef4119ac0 con 0x7f8ef41078f0 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8efa84d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef4119dc0 con 0x7f8ef41024c0 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ef41024c0 0x7f8ef41a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ef4102e10 0x7f8ef41a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef8dea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef41078f0 0x7f8ef41a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ef41024c0 0x7f8ef41a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:57478/0 (socket says 172.21.15.37:57478) 2024-08-31T06:48:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef3fff640 1 -- 172.21.15.37:0/1603014507 learned_addr learned my addr 172.21.15.37:0/1603014507 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:28.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef8dea640 1 -- 172.21.15.37:0/1603014507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ef41024c0 msgr2=0x7f8ef41a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef8dea640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ef41024c0 0x7f8ef41a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef8dea640 1 -- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ef4102e10 msgr2=0x7f8ef41a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef8dea640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ef4102e10 0x7f8ef41a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef8dea640 1 -- 172.21.15.37:0/1603014507 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef41a6630 con 0x7f8ef41078f0 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.879+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ef41024c0 0x7f8ef41a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.880+0000 7f8ef8dea640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef41078f0 0x7f8ef41a5f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400e970 tx=0x7f8ee400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.880+0000 7f8ef17fa640 1 -- 172.21.15.37:0/1603014507 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400ccc0 con 0x7f8ef41078f0 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.880+0000 7f8efa84d640 1 -- 172.21.15.37:0/1603014507 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef41a6920 con 0x7f8ef41078f0 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.880+0000 7f8efa84d640 1 -- 172.21.15.37:0/1603014507 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef41ad0b0 con 0x7f8ef41078f0 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.880+0000 7f8ef17fa640 1 -- 172.21.15.37:0/1603014507 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ee4005020 con 0x7f8ef41078f0 2024-08-31T06:48:28.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.880+0000 7f8ef17fa640 1 -- 172.21.15.37:0/1603014507 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400ce60 con 0x7f8ef41078f0 2024-08-31T06:48:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.885+0000 7f8f017bb740 1 Processor -- start 2024-08-31T06:48:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.885+0000 7f8ef17fa640 1 -- 172.21.15.37:0/1603014507 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f8ee4004a00 con 0x7f8ef41078f0 2024-08-31T06:48:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.885+0000 7f8f017bb740 1 -- start start 2024-08-31T06:48:28.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e39ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a6d2f0 0x564769e3a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a754d0 0x564769e3a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e39ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e39ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:57480/0 (socket says 172.21.15.37:57480) 2024-08-31T06:48:28.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a6d2f0 0x564769e3a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a6d2f0 0x564769e3a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:50256/0 (socket says 172.21.15.37:50256) 2024-08-31T06:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8ef17fa640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8ee00b4ca0 0x7f8ee00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8ef37fe640 1 -- 172.21.15.37:0/3871762826 learned_addr learned my addr 172.21.15.37:0/3871762826 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8f017bb740 1 -- 172.21.15.37:0/3871762826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564769daf000 con 0x564769a754d0 2024-08-31T06:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8f017bb740 1 -- 172.21.15.37:0/3871762826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564769d9e590 con 0x564769a6d2f0 2024-08-31T06:48:28.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.886+0000 7f8f017bb740 1 -- 172.21.15.37:0/3871762826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564769da2540 con 0x564769a961b0 2024-08-31T06:48:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a754d0 0x564769e3a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef3fff640 1 -- 172.21.15.37:0/3871762826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 msgr2=0x564769e39ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e39ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef3fff640 1 -- 172.21.15.37:0/3871762826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a754d0 msgr2=0x564769e3a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a754d0 0x564769e3a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef3fff640 1 -- 172.21.15.37:0/3871762826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564769b01790 con 0x564769a6d2f0 2024-08-31T06:48:28.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a754d0 0x564769e3a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef17fa640 1 -- 172.21.15.37:0/1603014507 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f8ee40e5270 con 0x7f8ef41078f0 2024-08-31T06:48:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.887+0000 7f8ef8dea640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8ee00b4ca0 0x7f8ee00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.888+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a6d2f0 0x564769e3a000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8edc010580 tx=0x7f8edc010a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e34be4f08a1afa4e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.888+0000 7f8eea7fc640 1 -- 172.21.15.37:0/3871762826 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc005220 con 0x564769a6d2f0 2024-08-31T06:48:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.888+0000 7f8ef8dea640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8ee00b4ca0 0x7f8ee00b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40ab930 tx=0x7f8ee40e5570 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.888+0000 7f8eea7fc640 1 -- 172.21.15.37:0/3871762826 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8edc004c30 con 0x564769a6d2f0 2024-08-31T06:48:28.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.888+0000 7f8eea7fc640 1 -- 172.21.15.37:0/3871762826 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00eb60 con 0x564769a6d2f0 2024-08-31T06:48:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.889+0000 7f8f017bb740 1 -- 172.21.15.37:0/3871762826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a6d2f0 msgr2=0x564769e3a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.889+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a6d2f0 0x564769e3a000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8edc010580 tx=0x7f8edc010a40 comp rx=0 tx=0).stop 2024-08-31T06:48:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.889+0000 7f8f017bb740 1 -- 172.21.15.37:0/3871762826 shutdown_connections 2024-08-31T06:48:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.889+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a754d0 0x564769e3a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.889+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a6d2f0 0x564769e3a000 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.890+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3871762826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e39ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.890+0000 7f8f017bb740 1 -- 172.21.15.37:0/3871762826 >> 172.21.15.37:0/3871762826 conn(0x564769a8a300 msgr2=0x564769e379b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.890+0000 7f8f017bb740 1 -- 172.21.15.37:0/3871762826 shutdown_connections 2024-08-31T06:48:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.890+0000 7f8f017bb740 1 -- 172.21.15.37:0/3871762826 wait complete. 2024-08-31T06:48:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.890+0000 7f8f017bb740 1 -- start start 2024-08-31T06:48:28.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.890+0000 7f8f017bb740 1 Processor -- start 2024-08-31T06:48:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e45730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a754d0 0x564769e45d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a961b0 0x564769e515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8f017bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564769cd7ab0 con 0x564769a6d2f0 2024-08-31T06:48:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e45730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a754d0 0x564769e45d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e45730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44774/0 (socket says 172.21.15.37:44774) 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8ef37fe640 1 -- 172.21.15.37:0/3345006000 learned_addr learned my addr 172.21.15.37:0/3345006000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564769d25680 con 0x564769a961b0 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.891+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564769e48240 con 0x564769a754d0 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8f017bb740 10 client.0 _ll_register_callbacks cb 0x564769aada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8ef3fff640 1 -- 172.21.15.37:0/3345006000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a961b0 msgr2=0x564769e515c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a961b0 0x564769e515c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8ef3fff640 1 -- 172.21.15.37:0/3345006000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 msgr2=0x564769e45730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e45730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8ef3fff640 1 -- 172.21.15.37:0/3345006000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564769b7a620 con 0x564769a754d0 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e45730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:28.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a754d0 0x564769e45d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8edc006010 tx=0x7f8edc004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bcd225221dd9886 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.892+0000 7f8ed37fe640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8ed37fe640 1 -- 172.21.15.37:0/3345006000 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc027020 con 0x564769a754d0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8ed37fe640 1 -- 172.21.15.37:0/3345006000 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f8edc00ec30 con 0x564769a754d0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8edc004c30 con 0x564769a754d0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8ed37fe640 1 -- 172.21.15.37:0/3345006000 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8edc00ee50 con 0x564769a754d0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8f017bb740 10 client.25588 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564769e54310 con 0x564769a754d0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8ed37fe640 1 -- 172.21.15.37:0/3345006000 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8edc004de0 con 0x564769a754d0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8ed37fe640 1 -- 172.21.15.37:0/3345006000 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8edc022070 con 0x564769a754d0 2024-08-31T06:48:28.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8f017bb740 10 client.25588 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.893+0000 7f8f017bb740 10 client.25588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.894+0000 7f8f017bb740 20 client.25588 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.894+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564769a54d80 0x564769e57730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.894+0000 7f8f017bb740 4 client.25588 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.894+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8edc004c30 con 0x564769a54d80 2024-08-31T06:48:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.894+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564769a54d80 0x564769e57730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.895+0000 7f8ed37fe640 10 client.25588 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:28.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.895+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564769a54d80 0x564769e57730 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c33a265b3296c2 server_cookie=7bc26cd1c3e4b1e5 in_seq=0 out_seq=0 2024-08-31T06:48:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.895+0000 7f8ed37fe640 1 -- 172.21.15.37:0/3345006000 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8edc004c30 con 0x564769a54d80 2024-08-31T06:48:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.895+0000 7f8ed37fe640 10 client.25588 handle_command_reply: tid=0 2024-08-31T06:48:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 client.25588 shutdown 2024-08-31T06:48:28.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a754d0 msgr2=0x564769e45d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a754d0 0x564769e45d30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8edc006010 tx=0x7f8edc004ab0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 shutdown_connections 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564769a54d80 0x564769e57730 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a961b0 0x564769e515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8ed37fe640 0 client.25588 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a754d0 0x564769e45d30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 --2- 172.21.15.37:0/3345006000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e45730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 >> 172.21.15.37:0/3345006000 conn(0x564769a8a300 msgr2=0x564769e3aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 shutdown_connections 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.896+0000 7f8f017bb740 1 -- 172.21.15.37:0/3345006000 wait complete. 2024-08-31T06:48:28.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.897+0000 7f8f017bb740 20 client.25588 trim_cache size 0 max 16384 2024-08-31T06:48:28.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8f017bb740 1 Processor -- start 2024-08-31T06:48:28.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8f017bb740 1 -- start start 2024-08-31T06:48:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a6d2f0 0x564769e3ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e3f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a961b0 0x564769e449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8f017bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4011060 con 0x564769a961b0 2024-08-31T06:48:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8f017bb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed400e930 con 0x564769a754d0 2024-08-31T06:48:28.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8f017bb740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed400c780 con 0x564769a6d2f0 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a6d2f0 0x564769e3ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a6d2f0 0x564769e3ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:57506/0 (socket says 172.21.15.37:57506) 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8ef37fe640 1 -- 172.21.15.37:0/2758730866 learned_addr learned my addr 172.21.15.37:0/2758730866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e3f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.926+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a961b0 0x564769e449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ef37fe640 1 -- 172.21.15.37:0/2758730866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 msgr2=0x564769e3f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e3f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ef37fe640 1 -- 172.21.15.37:0/2758730866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a961b0 msgr2=0x564769e449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a961b0 0x564769e449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ef37fe640 1 -- 172.21.15.37:0/2758730866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564769e3c8d0 con 0x564769a6d2f0 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a6d2f0 0x564769e3ebf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8eec030980 tx=0x7f8eec009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb58acec6847b2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ee9ffb640 1 -- 172.21.15.37:0/2758730866 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec04e040 con 0x564769a6d2f0 2024-08-31T06:48:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ee9ffb640 1 -- 172.21.15.37:0/2758730866 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8eec037040 con 0x564769a6d2f0 2024-08-31T06:48:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.927+0000 7f8ee9ffb640 1 -- 172.21.15.37:0/2758730866 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec036040 con 0x564769a6d2f0 2024-08-31T06:48:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 -- 172.21.15.37:0/2758730866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a6d2f0 msgr2=0x564769e3ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a6d2f0 0x564769e3ebf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8eec030980 tx=0x7f8eec009500 comp rx=0 tx=0).stop 2024-08-31T06:48:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 -- 172.21.15.37:0/2758730866 shutdown_connections 2024-08-31T06:48:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a961b0 0x564769e449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e3f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 --2- 172.21.15.37:0/2758730866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a6d2f0 0x564769e3ebf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 -- 172.21.15.37:0/2758730866 >> 172.21.15.37:0/2758730866 conn(0x564769a8a300 msgr2=0x564769e43d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 -- 172.21.15.37:0/2758730866 shutdown_connections 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.929+0000 7f8f017bb740 1 -- 172.21.15.37:0/2758730866 wait complete. 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.930+0000 7f8f017bb740 1 -- start start 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.930+0000 7f8f017bb740 1 Processor -- start 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.930+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e4de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.930+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e4b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.930+0000 7f8f017bb740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e4b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.930+0000 7f8f017bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed400cdf0 con 0x564769a6d2f0 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.930+0000 7f8f017bb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed400e260 con 0x564769a754d0 2024-08-31T06:48:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.930+0000 7f8f017bb740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed400d4c0 con 0x564769a961b0 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8f017bb740 10 client.0 _ll_register_callbacks cb 0x7f8edc0103d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e4b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e4b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:50264/0 (socket says 172.21.15.37:50264) 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef3fff640 1 -- 172.21.15.37:0/1115044826 learned_addr learned my addr 172.21.15.37:0/1115044826 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e4de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e4b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef3fff640 1 -- 172.21.15.37:0/1115044826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 msgr2=0x564769e4b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e4b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef3fff640 1 -- 172.21.15.37:0/1115044826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 msgr2=0x564769e4de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e4de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef3fff640 1 -- 172.21.15.37:0/1115044826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564769e4c120 con 0x564769a754d0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.931+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e4b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.932+0000 7f8ef3fff640 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e4b310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00e6d0 tx=0x7f8edc00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17491d152504c241 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.932+0000 7f8ed37fe640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.932+0000 7f8ed37fe640 1 -- 172.21.15.37:0/1115044826 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc03a060 con 0x564769a754d0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.932+0000 7f8f017bb740 1 -- 172.21.15.37:0/1115044826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eec037040 con 0x564769a754d0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.932+0000 7f8ed37fe640 1 -- 172.21.15.37:0/1115044826 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f8edc003ad0 con 0x564769a754d0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.932+0000 7f8ed37fe640 1 -- 172.21.15.37:0/1115044826 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8edc027040 con 0x564769a754d0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8f017bb740 10 client.25583 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8f017bb740 1 -- 172.21.15.37:0/1115044826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564769ec1fa0 con 0x564769a754d0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8ed37fe640 1 -- 172.21.15.37:0/1115044826 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8eec037040 con 0x564769a754d0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8ed37fe640 1 -- 172.21.15.37:0/1115044826 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8edc022070 con 0x564769a754d0 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8f017bb740 10 client.25583 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8f017bb740 10 client.25583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8f017bb740 20 client.25583 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8f017bb740 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564769a2a1c0 0x564769ec4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8f017bb740 4 client.25583 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:48:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8f017bb740 1 -- 172.21.15.37:0/1115044826 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564769db0f50 con 0x564769a2a1c0 2024-08-31T06:48:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.933+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564769a2a1c0 0x564769ec4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.934+0000 7f8ed37fe640 10 client.25583 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:28.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.934+0000 7f8ef37fe640 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564769a2a1c0 0x564769ec4730 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=658d8067c39dc4d4 server_cookie=a257eed26ca3326a in_seq=0 out_seq=0 2024-08-31T06:48:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.945+0000 7f8ed37fe640 1 -- 172.21.15.37:0/1115044826 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564769db0f50 con 0x564769a2a1c0 2024-08-31T06:48:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.945+0000 7f8ed37fe640 10 client.25583 handle_command_reply: tid=0 2024-08-31T06:48:28.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.945+0000 7f8f017bb740 1 client.25583 shutdown 2024-08-31T06:48:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 -- 172.21.15.37:0/1115044826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 msgr2=0x564769e4b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e4b310 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00e6d0 tx=0x7f8edc00bed0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 -- 172.21.15.37:0/1115044826 shutdown_connections 2024-08-31T06:48:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x564769a2a1c0 0x564769ec4730 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564769a961b0 0x564769e4b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564769a754d0 0x564769e4b310 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 --2- 172.21.15.37:0/1115044826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564769a6d2f0 0x564769e4de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 -- 172.21.15.37:0/1115044826 >> 172.21.15.37:0/1115044826 conn(0x564769a8a300 msgr2=0x564769e449f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8ed37fe640 0 client.25583 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 -- 172.21.15.37:0/1115044826 shutdown_connections 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 1 -- 172.21.15.37:0/1115044826 wait complete. 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.946+0000 7f8f017bb740 20 client.25583 trim_cache size 0 max 16384 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:48:28.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:48:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 -- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8ee00b4ca0 msgr2=0x7f8ee00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8ee00b4ca0 0x7f8ee00b71b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40ab930 tx=0x7f8ee40e5570 comp rx=0 tx=0).stop 2024-08-31T06:48:28.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 -- 172.21.15.37:0/1603014507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef41078f0 msgr2=0x7f8ef41a5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef41078f0 0x7f8ef41a5f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400e970 tx=0x7f8ee400ee30 comp rx=0 tx=0).stop 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 -- 172.21.15.37:0/1603014507 shutdown_connections 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8ee00b4ca0 0x7f8ee00b71b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ef4102e10 0x7f8ef41a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef41078f0 0x7f8ef41a5f30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 --2- 172.21.15.37:0/1603014507 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ef41024c0 0x7f8ef41a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 -- 172.21.15.37:0/1603014507 >> 172.21.15.37:0/1603014507 conn(0x7f8ef407a480 msgr2=0x7f8ef41052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 -- 172.21.15.37:0/1603014507 shutdown_connections 2024-08-31T06:48:28.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:28.947+0000 7f8efa84d640 1 -- 172.21.15.37:0/1603014507 wait complete. 2024-08-31T06:48:30.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:29 smithi106 ceph-mon[22134]: pgmap v369: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 20 MiB/s wr, 192 op/s 2024-08-31T06:48:30.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:29 smithi037 ceph-mon[18612]: pgmap v369: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 20 MiB/s wr, 192 op/s 2024-08-31T06:48:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:29 smithi066 ceph-mon[22244]: pgmap v369: 97 pgs: 97 active+clean; 239 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 20 MiB/s wr, 192 op/s 2024-08-31T06:48:32.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:31 smithi106 ceph-mon[22134]: pgmap v370: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 24 MiB/s wr, 873 op/s 2024-08-31T06:48:32.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:31 smithi037 ceph-mon[18612]: pgmap v370: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 24 MiB/s wr, 873 op/s 2024-08-31T06:48:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:31 smithi066 ceph-mon[22244]: pgmap v370: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 24 MiB/s wr, 873 op/s 2024-08-31T06:48:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:33 smithi106 ceph-mon[22134]: pgmap v371: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 1.54k op/s 2024-08-31T06:48:34.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:33 smithi037 ceph-mon[18612]: pgmap v371: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 1.54k op/s 2024-08-31T06:48:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:33 smithi066 ceph-mon[22244]: pgmap v371: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 1.54k op/s 2024-08-31T06:48:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:35 smithi106 ceph-mon[22134]: pgmap v372: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 21 MiB/s wr, 1.99k op/s 2024-08-31T06:48:36.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:35 smithi037 ceph-mon[18612]: pgmap v372: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 21 MiB/s wr, 1.99k op/s 2024-08-31T06:48:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:35 smithi066 ceph-mon[22244]: pgmap v372: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 21 MiB/s wr, 1.99k op/s 2024-08-31T06:48:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:37 smithi106 ceph-mon[22134]: pgmap v373: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 2.91k op/s 2024-08-31T06:48:38.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:37 smithi037 ceph-mon[18612]: pgmap v373: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 2.91k op/s 2024-08-31T06:48:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:37 smithi066 ceph-mon[22244]: pgmap v373: 97 pgs: 97 active+clean; 259 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 2.91k op/s 2024-08-31T06:48:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:39 smithi106 ceph-mon[22134]: pgmap v374: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 3.37k op/s 2024-08-31T06:48:40.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:39 smithi037 ceph-mon[18612]: pgmap v374: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 3.37k op/s 2024-08-31T06:48:40.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:39 smithi066 ceph-mon[22244]: pgmap v374: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 MiB/s wr, 3.37k op/s 2024-08-31T06:48:42.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:41 smithi106 ceph-mon[22134]: pgmap v375: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 4.12k op/s 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 -- 172.21.15.37:0/2986008816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95fc108080 msgr2=0x7f95fc108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 --2- 172.21.15.37:0/2986008816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95fc108080 0x7f95fc108490 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009900 tx=0x7f95f002a410 comp rx=0 tx=0).stop 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 -- 172.21.15.37:0/2986008816 shutdown_connections 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 --2- 172.21.15.37:0/2986008816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95fc108080 0x7f95fc108490 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 --2- 172.21.15.37:0/2986008816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95fc1089d0 0x7f95fc10f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 --2- 172.21.15.37:0/2986008816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95fc102750 0x7f95fc102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 -- 172.21.15.37:0/2986008816 >> 172.21.15.37:0/2986008816 conn(0x7f95fc07a4e0 msgr2=0x7f95fc07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 -- 172.21.15.37:0/2986008816 shutdown_connections 2024-08-31T06:48:42.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.097+0000 7f9600df8640 1 -- 172.21.15.37:0/2986008816 wait complete. 2024-08-31T06:48:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f9600df8640 1 Processor -- start 2024-08-31T06:48:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f9600df8640 1 -- start start 2024-08-31T06:48:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f9600df8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95fc102750 0x7f95fc10cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f9600df8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95fc108080 0x7f95fc1091d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f9600df8640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95fc1089d0 0x7f95fc109900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f9600df8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc112510 con 0x7f95fc102750 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f9600df8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc112390 con 0x7f95fc108080 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f9600df8640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc112690 con 0x7f95fc1089d0 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f95fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95fc102750 0x7f95fc10cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f95fad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95fc1089d0 0x7f95fc109900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95fc108080 0x7f95fc1091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f95fad9d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95fc1089d0 0x7f95fc109900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:37128/0 (socket says 172.21.15.37:37128) 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95fc108080 0x7f95fc1091d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:56832/0 (socket says 172.21.15.37:56832) 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.099+0000 7f95fad9d640 1 -- 172.21.15.37:0/336746605 learned_addr learned my addr 172.21.15.37:0/336746605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95fad9d640 1 -- 172.21.15.37:0/336746605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95fc108080 msgr2=0x7f95fc1091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95fad9d640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95fc108080 0x7f95fc1091d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95fad9d640 1 -- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95fc102750 msgr2=0x7f95fc10cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95fad9d640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95fc102750 0x7f95fc10cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95fad9d640 1 -- 172.21.15.37:0/336746605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc1ac8d0 con 0x7f95fc1089d0 2024-08-31T06:48:42.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95fad9d640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95fc1089d0 0x7f95fc109900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95f400eb10 tx=0x7f95f400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:42.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95eb7fe640 1 -- 172.21.15.37:0/336746605 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4004b20 con 0x7f95fc1089d0 2024-08-31T06:48:42.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95eb7fe640 1 -- 172.21.15.37:0/336746605 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f4004cc0 con 0x7f95fc1089d0 2024-08-31T06:48:42.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f9600df8640 1 -- 172.21.15.37:0/336746605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc1acb00 con 0x7f95fc1089d0 2024-08-31T06:48:42.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f95eb7fe640 1 -- 172.21.15.37:0/336746605 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f4010690 con 0x7f95fc1089d0 2024-08-31T06:48:42.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.100+0000 7f9600df8640 1 -- 172.21.15.37:0/336746605 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc1ad070 con 0x7f95fc1089d0 2024-08-31T06:48:42.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:41 smithi037 ceph-mon[18612]: pgmap v375: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 4.12k op/s 2024-08-31T06:48:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.104+0000 7f9607e3e740 1 Processor -- start 2024-08-31T06:48:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.104+0000 7f95eb7fe640 1 -- 172.21.15.37:0/336746605 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f95f4010830 con 0x7f95fc1089d0 2024-08-31T06:48:42.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f9607e3e740 1 -- start start 2024-08-31T06:48:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a5aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a5b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a5b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f9607e3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624a79d0000 con 0x5624a76964d0 2024-08-31T06:48:42.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f9607e3e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5624a79bf590 con 0x5624a76b71b0 2024-08-31T06:48:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f9607e3e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5624a79c3540 con 0x5624a768e2f0 2024-08-31T06:48:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a5b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a5aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a5aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:56836/0 (socket says 172.21.15.37:56836) 2024-08-31T06:48:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f95f9d9b640 1 -- 172.21.15.37:0/3594590828 learned_addr learned my addr 172.21.15.37:0/3594590828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:42.107 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.105+0000 7f95fa59c640 1 --2- 172.21.15.37:0/3594590828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a5b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95fa59c640 1 -- 172.21.15.37:0/3594590828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 msgr2=0x5624a7a5aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95fa59c640 1 --2- 172.21.15.37:0/3594590828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a5aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95fa59c640 1 -- 172.21.15.37:0/3594590828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 msgr2=0x5624a7a5b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95fa59c640 1 --2- 172.21.15.37:0/3594590828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a5b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95fa59c640 1 -- 172.21.15.37:0/3594590828 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a7722790 con 0x5624a768e2f0 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95fa59c640 1 --2- 172.21.15.37:0/3594590828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a5b000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bbf0 tx=0x7f95ec0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5f4ff421773ea9f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95eb7fe640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95e40b4d20 0x7f95e40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95e40b4d20 0x7f95e40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95e8ff9640 1 -- 172.21.15.37:0/3594590828 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec004030 con 0x5624a768e2f0 2024-08-31T06:48:42.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95e8ff9640 1 -- 172.21.15.37:0/3594590828 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95ec0035f0 con 0x5624a768e2f0 2024-08-31T06:48:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95e8ff9640 1 -- 172.21.15.37:0/3594590828 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0116a0 con 0x5624a768e2f0 2024-08-31T06:48:42.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.106+0000 7f95eb7fe640 1 -- 172.21.15.37:0/336746605 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f95f40e5740 con 0x7f95fc1089d0 2024-08-31T06:48:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.107+0000 7f9607e3e740 1 -- 172.21.15.37:0/3594590828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 msgr2=0x5624a7a5b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.107+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95e40b4d20 0x7f95e40b7230 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f95f0032fd0 tx=0x7f95f0000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.107+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3594590828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a5b000 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bbf0 tx=0x7f95ec0107a0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.108+0000 7f9607e3e740 1 -- 172.21.15.37:0/3594590828 shutdown_connections 2024-08-31T06:48:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.108+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3594590828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a5b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.108+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3594590828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a5b000 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.108+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3594590828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a5aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.108+0000 7f9607e3e740 1 -- 172.21.15.37:0/3594590828 >> 172.21.15.37:0/3594590828 conn(0x5624a76ab300 msgr2=0x5624a7a589b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.108+0000 7f9607e3e740 1 -- 172.21.15.37:0/3594590828 shutdown_connections 2024-08-31T06:48:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.108+0000 7f9607e3e740 1 -- 172.21.15.37:0/3594590828 wait complete. 2024-08-31T06:48:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.109+0000 7f9607e3e740 1 -- start start 2024-08-31T06:48:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.109+0000 7f9607e3e740 1 Processor -- start 2024-08-31T06:48:42.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.109+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a768e2f0 0x5624a7a66620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.109+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a76964d0 0x5624a7a66b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.109+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a725c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.109+0000 7f9607e3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624a78f8ab0 con 0x5624a768e2f0 2024-08-31T06:48:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.109+0000 7f9607e3e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5624a7946680 con 0x5624a76b71b0 2024-08-31T06:48:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.109+0000 7f9607e3e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5624a7a69240 con 0x5624a76964d0 2024-08-31T06:48:42.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f9607e3e740 10 client.0 _ll_register_callbacks cb 0x5624a76cea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a76964d0 0x5624a7a66b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a76964d0 0x5624a7a66b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:37158/0 (socket says 172.21.15.37:37158) 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95f9d9b640 1 -- 172.21.15.37:0/4143812345 learned_addr learned my addr 172.21.15.37:0/4143812345 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95fa59c640 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a768e2f0 0x5624a7a66620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95fad9d640 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a725c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95fad9d640 1 -- 172.21.15.37:0/4143812345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a76964d0 msgr2=0x5624a7a66b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95fad9d640 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a76964d0 0x5624a7a66b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95fad9d640 1 -- 172.21.15.37:0/4143812345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a768e2f0 msgr2=0x5624a7a66620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95fad9d640 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a768e2f0 0x5624a7a66620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95fad9d640 1 -- 172.21.15.37:0/4143812345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a779b620 con 0x5624a76b71b0 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a76964d0 0x5624a7a66b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:42.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95fad9d640 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a725c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95f40e2ed0 tx=0x7f95f40abd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9369144f65b5b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:42.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.110+0000 7f95e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:48:42.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.111+0000 7f95e1ffb640 1 -- 172.21.15.37:0/4143812345 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f40932e0 con 0x5624a76b71b0 2024-08-31T06:48:42.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.111+0000 7f95e1ffb640 1 -- 172.21.15.37:0/4143812345 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f95f40b4d00 con 0x5624a76b71b0 2024-08-31T06:48:42.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.111+0000 7f9607e3e740 1 -- 172.21.15.37:0/4143812345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95ec0035f0 con 0x5624a76b71b0 2024-08-31T06:48:42.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.111+0000 7f95e1ffb640 1 -- 172.21.15.37:0/4143812345 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95f40ac570 con 0x5624a76b71b0 2024-08-31T06:48:42.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.111+0000 7f9607e3e740 10 client.25595 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:42.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.111+0000 7f9607e3e740 1 -- 172.21.15.37:0/4143812345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5624a7a75290 con 0x5624a76b71b0 2024-08-31T06:48:42.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.112+0000 7f95e1ffb640 1 -- 172.21.15.37:0/4143812345 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95ec0035f0 con 0x5624a76b71b0 2024-08-31T06:48:42.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.112+0000 7f95e1ffb640 1 -- 172.21.15.37:0/4143812345 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95f40b0230 con 0x5624a76b71b0 2024-08-31T06:48:42.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.112+0000 7f9607e3e740 10 client.25595 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:42.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.112+0000 7f9607e3e740 10 client.25595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:42.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.112+0000 7f9607e3e740 20 client.25595 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:42.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.112+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5624a7675d80 0x5624a7a78820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.112+0000 7f9607e3e740 4 client.25595 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.112+0000 7f9607e3e740 1 -- 172.21.15.37:0/4143812345 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624a79d1f50 con 0x5624a7675d80 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.113+0000 7f95fa59c640 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5624a7675d80 0x5624a7a78820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.113+0000 7f95e1ffb640 10 client.25595 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.113+0000 7f95fa59c640 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5624a7675d80 0x5624a7a78820 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33cc1724e8d75820 server_cookie=a6a62373302cd05f in_seq=0 out_seq=0 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f95e1ffb640 1 -- 172.21.15.37:0/4143812345 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624a79d1f50 con 0x5624a7675d80 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f95e1ffb640 10 client.25595 handle_command_reply: tid=0 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 client.25595 shutdown 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 -- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 msgr2=0x5624a7a725c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a725c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95f40e2ed0 tx=0x7f95f40abd00 comp rx=0 tx=0).stop 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 -- 172.21.15.37:0/4143812345 shutdown_connections 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5624a7675d80 0x5624a7a78820 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f95e1ffb640 0 client.25595 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:42.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a76b71b0 0x5624a7a725c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a76964d0 0x5624a7a66b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4143812345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a768e2f0 0x5624a7a66620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 -- 172.21.15.37:0/4143812345 >> 172.21.15.37:0/4143812345 conn(0x5624a76ab300 msgr2=0x5624a7a5baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:42.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.114+0000 7f9607e3e740 1 -- 172.21.15.37:0/4143812345 shutdown_connections 2024-08-31T06:48:42.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.115+0000 7f9607e3e740 1 -- 172.21.15.37:0/4143812345 wait complete. 2024-08-31T06:48:42.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.115+0000 7f9607e3e740 20 client.25595 trim_cache size 0 max 16384 2024-08-31T06:48:42.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:41 smithi066 ceph-mon[22244]: pgmap v375: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 4.12k op/s 2024-08-31T06:48:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f9607e3e740 1 Processor -- start 2024-08-31T06:48:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f9607e3e740 1 -- start start 2024-08-31T06:48:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a64c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a651b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f95fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a64c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f95fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a64c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:56860/0 (socket says 172.21.15.37:56860) 2024-08-31T06:48:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f95fa59c640 1 -- 172.21.15.37:0/4278254124 learned_addr learned my addr 172.21.15.37:0/4278254124 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f9607e3e740 1 -- 172.21.15.37:0/4278254124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc011060 con 0x5624a76964d0 2024-08-31T06:48:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f9607e3e740 1 -- 172.21.15.37:0/4278254124 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc00e930 con 0x5624a7675d80 2024-08-31T06:48:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.140+0000 7f9607e3e740 1 -- 172.21.15.37:0/4278254124 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc00c780 con 0x5624a768e2f0 2024-08-31T06:48:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.141+0000 7f95fad9d640 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.141+0000 7f95f9d9b640 1 -- 172.21.15.37:0/4278254124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 msgr2=0x5624a7a64c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.141+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a64c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.141+0000 7f95f9d9b640 1 -- 172.21.15.37:0/4278254124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 msgr2=0x5624a7a658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.141+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.141+0000 7f95f9d9b640 1 -- 172.21.15.37:0/4278254124 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624a7a648f0 con 0x5624a768e2f0 2024-08-31T06:48:42.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.141+0000 7f95fad9d640 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.141+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a651b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95f0005940 tx=0x7f95f0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1befcdc2c99ca1ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.142+0000 7f95e3fff640 1 -- 172.21.15.37:0/4278254124 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0035040 con 0x5624a768e2f0 2024-08-31T06:48:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.142+0000 7f95e3fff640 1 -- 172.21.15.37:0/4278254124 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f0004440 con 0x5624a768e2f0 2024-08-31T06:48:42.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.142+0000 7f95e3fff640 1 -- 172.21.15.37:0/4278254124 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f003d850 con 0x5624a768e2f0 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 -- 172.21.15.37:0/4278254124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 msgr2=0x5624a7a651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a651b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95f0005940 tx=0x7f95f0009260 comp rx=0 tx=0).stop 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 -- 172.21.15.37:0/4278254124 shutdown_connections 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a651b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 --2- 172.21.15.37:0/4278254124 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a64c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 -- 172.21.15.37:0/4278254124 >> 172.21.15.37:0/4278254124 conn(0x5624a76ab300 msgr2=0x5624a7a61510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 -- 172.21.15.37:0/4278254124 shutdown_connections 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.143+0000 7f9607e3e740 1 -- 172.21.15.37:0/4278254124 wait complete. 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.144+0000 7f9607e3e740 1 -- start start 2024-08-31T06:48:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.144+0000 7f9607e3e740 1 Processor -- start 2024-08-31T06:48:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.144+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a6eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.144+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a6a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f9607e3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a6aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f9607e3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc00cdf0 con 0x5624a76964d0 2024-08-31T06:48:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f9607e3e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc00e260 con 0x5624a7675d80 2024-08-31T06:48:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f9607e3e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc00d4c0 con 0x5624a768e2f0 2024-08-31T06:48:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f9607e3e740 10 client.0 _ll_register_callbacks cb 0x7f95f40a7d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a6eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a6a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a6eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:56872/0 (socket says 172.21.15.37:56872) 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95f9d9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a6a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:37184/0 (socket says 172.21.15.37:37184) 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95fa59c640 1 -- 172.21.15.37:0/3715116161 learned_addr learned my addr 172.21.15.37:0/3715116161 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95fad9d640 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a6aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95f9d9b640 1 -- 172.21.15.37:0/3715116161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 msgr2=0x5624a7a6eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a6eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95f9d9b640 1 -- 172.21.15.37:0/3715116161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 msgr2=0x5624a7a6aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a6aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95f9d9b640 1 -- 172.21.15.37:0/3715116161 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624a7ae21e0 con 0x5624a768e2f0 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95f9d9b640 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a6a360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f95f002a450 tx=0x7f95f0003ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f602a2e576225552 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.145+0000 7f95e1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.146+0000 7f95e1ffb640 1 -- 172.21.15.37:0/3715116161 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0035040 con 0x5624a768e2f0 2024-08-31T06:48:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.146+0000 7f95e1ffb640 1 -- 172.21.15.37:0/3715116161 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f95f0003d80 con 0x5624a768e2f0 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.146+0000 7f9607e3e740 1 -- 172.21.15.37:0/3715116161 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95f0004440 con 0x5624a768e2f0 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.146+0000 7f95e1ffb640 1 -- 172.21.15.37:0/3715116161 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95f0055480 con 0x5624a768e2f0 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.146+0000 7f9607e3e740 10 client.25609 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.146+0000 7f9607e3e740 1 -- 172.21.15.37:0/3715116161 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5624a7ae3250 con 0x5624a768e2f0 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.146+0000 7f95e1ffb640 1 -- 172.21.15.37:0/3715116161 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95f005d070 con 0x5624a768e2f0 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f95e1ffb640 1 -- 172.21.15.37:0/3715116161 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95f0062610 con 0x5624a768e2f0 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f9607e3e740 10 client.25609 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f9607e3e740 10 client.25609 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f9607e3e740 20 client.25609 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5624a76b71b0 0x5624a7ae5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f9607e3e740 4 client.25609 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f9607e3e740 1 -- 172.21.15.37:0/3715116161 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f95f0004440 con 0x5624a76b71b0 2024-08-31T06:48:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f95fa59c640 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5624a76b71b0 0x5624a7ae5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.147+0000 7f95e1ffb640 10 client.25609 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.148+0000 7f95fa59c640 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5624a76b71b0 0x5624a7ae5930 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4163dcd780e16677 server_cookie=daa4c1030267c4a1 in_seq=0 out_seq=0 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f95e1ffb640 1 -- 172.21.15.37:0/3715116161 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f95f0004440 con 0x5624a76b71b0 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f95e1ffb640 10 client.25609 handle_command_reply: tid=0 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f9607e3e740 1 client.25609 shutdown 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f9607e3e740 1 -- 172.21.15.37:0/3715116161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 msgr2=0x5624a7a6a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a6a360 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f95f002a450 tx=0x7f95f0003ae0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f9607e3e740 1 -- 172.21.15.37:0/3715116161 shutdown_connections 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5624a76b71b0 0x5624a7ae5930 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624a76964d0 0x5624a7a6aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f95e1ffb640 0 client.25609 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:42.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.164+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624a768e2f0 0x5624a7a6a360 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.165+0000 7f9607e3e740 1 --2- 172.21.15.37:0/3715116161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624a7675d80 0x5624a7a6eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.165+0000 7f9607e3e740 1 -- 172.21.15.37:0/3715116161 >> 172.21.15.37:0/3715116161 conn(0x5624a76ab300 msgr2=0x5624a7a61510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.165+0000 7f9607e3e740 1 -- 172.21.15.37:0/3715116161 shutdown_connections 2024-08-31T06:48:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.165+0000 7f9607e3e740 1 -- 172.21.15.37:0/3715116161 wait complete. 2024-08-31T06:48:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.165+0000 7f9607e3e740 20 client.25609 trim_cache size 0 max 16384 2024-08-31T06:48:42.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:48:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:48:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:48:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:48:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 -- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95e40b4d20 msgr2=0x7f95e40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95e40b4d20 0x7f95e40b7230 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f95f0032fd0 tx=0x7f95f0000bc0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 -- 172.21.15.37:0/336746605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95fc1089d0 msgr2=0x7f95fc109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95fc1089d0 0x7f95fc109900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95f400eb10 tx=0x7f95f400c2d0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 -- 172.21.15.37:0/336746605 shutdown_connections 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95e40b4d20 0x7f95e40b7230 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95fc1089d0 0x7f95fc109900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95fc108080 0x7f95fc1091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 --2- 172.21.15.37:0/336746605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95fc102750 0x7f95fc10cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 -- 172.21.15.37:0/336746605 >> 172.21.15.37:0/336746605 conn(0x7f95fc07a4e0 msgr2=0x7f95fc06aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 -- 172.21.15.37:0/336746605 shutdown_connections 2024-08-31T06:48:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:42.166+0000 7f9600df8640 1 -- 172.21.15.37:0/336746605 wait complete. 2024-08-31T06:48:42.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:48:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.784+0000 7f16032cc640 1 -- 172.21.15.37:0/2319524776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15fc109bc0 msgr2=0x7f15fc1103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.785+0000 7f16032cc640 1 --2- 172.21.15.37:0/2319524776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15fc109bc0 0x7f15fc1103f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009ca0 tx=0x7f15f402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.785+0000 7f16032cc640 1 -- 172.21.15.37:0/2319524776 shutdown_connections 2024-08-31T06:48:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.785+0000 7f16032cc640 1 --2- 172.21.15.37:0/2319524776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15fc109bc0 0x7f15fc1103f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.785+0000 7f16032cc640 1 --2- 172.21.15.37:0/2319524776 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15fc109270 0x7f15fc109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.785+0000 7f16032cc640 1 --2- 172.21.15.37:0/2319524776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15fc103930 0x7f15fc103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.785+0000 7f16032cc640 1 -- 172.21.15.37:0/2319524776 >> 172.21.15.37:0/2319524776 conn(0x7f15fc0ff380 msgr2=0x7f15fc1017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.785+0000 7f16032cc640 1 -- 172.21.15.37:0/2319524776 shutdown_connections 2024-08-31T06:48:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.785+0000 7f16032cc640 1 -- 172.21.15.37:0/2319524776 wait complete. 2024-08-31T06:48:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.786+0000 7f16032cc640 1 Processor -- start 2024-08-31T06:48:43.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.786+0000 7f16032cc640 1 -- start start 2024-08-31T06:48:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f16032cc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15fc103930 0x7f15fc076ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f16032cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15fc109270 0x7f15fc0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f16032cc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15fc109bc0 0x7f15fc0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f16032cc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc113780 con 0x7f15fc103930 2024-08-31T06:48:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f16032cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc113600 con 0x7f15fc109270 2024-08-31T06:48:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f16032cc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc113900 con 0x7f15fc109bc0 2024-08-31T06:48:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f1601869640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15fc109bc0 0x7f15fc0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f1601869640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15fc109bc0 0x7f15fc0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:37200/0 (socket says 172.21.15.37:37200) 2024-08-31T06:48:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.787+0000 7f1601869640 1 -- 172.21.15.37:0/1765225565 learned_addr learned my addr 172.21.15.37:0/1765225565 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.788+0000 7f1601068640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15fc103930 0x7f15fc076ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.788+0000 7f1600867640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15fc109270 0x7f15fc0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.788+0000 7f1601869640 1 -- 172.21.15.37:0/1765225565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15fc109270 msgr2=0x7f15fc0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.788+0000 7f1601869640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15fc109270 0x7f15fc0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.788+0000 7f1601869640 1 -- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15fc103930 msgr2=0x7f15fc076ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.788+0000 7f1601869640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15fc103930 0x7f15fc076ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.788+0000 7f1601869640 1 -- 172.21.15.37:0/1765225565 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15fc076210 con 0x7f15fc109bc0 2024-08-31T06:48:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.789+0000 7f1601869640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15fc109bc0 0x7f15fc0759f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15f4005cc0 tx=0x7f15f4003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.790+0000 7f15f27fc640 1 -- 172.21.15.37:0/1765225565 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4032c10 con 0x7f15fc109bc0 2024-08-31T06:48:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.790+0000 7f15f27fc640 1 -- 172.21.15.37:0/1765225565 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15f4032db0 con 0x7f15fc109bc0 2024-08-31T06:48:43.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.791+0000 7f15f27fc640 1 -- 172.21.15.37:0/1765225565 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4030a60 con 0x7f15fc109bc0 2024-08-31T06:48:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.791+0000 7f16032cc640 1 -- 172.21.15.37:0/1765225565 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15fc19e230 con 0x7f15fc109bc0 2024-08-31T06:48:43.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.791+0000 7f16032cc640 1 -- 172.21.15.37:0/1765225565 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15fc19e720 con 0x7f15fc109bc0 2024-08-31T06:48:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.795+0000 7f15f27fc640 1 -- 172.21.15.37:0/1765225565 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f15f4030c20 con 0x7f15fc109bc0 2024-08-31T06:48:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.795+0000 7f1609841740 1 Processor -- start 2024-08-31T06:48:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.795+0000 7f1609841740 1 -- start start 2024-08-31T06:48:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1609841740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e473e070 0x5575e4ae32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1609841740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e47151b0 0x5575e4ae3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1609841740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 0x5575e4ae3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1609841740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5575e4a5a630 con 0x5575e473e070 2024-08-31T06:48:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1609841740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575e4a49bc0 con 0x5575e471d390 2024-08-31T06:48:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1609841740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5575e4a4db70 con 0x5575e47151b0 2024-08-31T06:48:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1601068640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e47151b0 0x5575e4ae3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1601068640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e47151b0 0x5575e4ae3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:37210/0 (socket says 172.21.15.37:37210) 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.796+0000 7f1601068640 1 -- 172.21.15.37:0/2601980584 learned_addr learned my addr 172.21.15.37:0/2601980584 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.797+0000 7f15f27fc640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15e80b4df0 0x7f15e80b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.797+0000 7f1600867640 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e473e070 0x5575e4ae32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.797+0000 7f1600867640 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 0x5575e4ae3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.798+0000 7f15f27fc640 1 -- 172.21.15.37:0/1765225565 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f15f41064a0 con 0x7f15fc109bc0 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.798+0000 7f1601869640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15e80b4df0 0x7f15e80b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.798+0000 7f1601068640 1 -- 172.21.15.37:0/2601980584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 msgr2=0x5575e4ae3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.798+0000 7f1601068640 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 0x5575e4ae3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.798+0000 7f1601068640 1 -- 172.21.15.37:0/2601980584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e473e070 msgr2=0x5575e4ae32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.798+0000 7f1601068640 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e473e070 0x5575e4ae32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.798+0000 7f1601068640 1 -- 172.21.15.37:0/2601980584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e47a9650 con 0x5575e47151b0 2024-08-31T06:48:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.799+0000 7f1601068640 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e47151b0 0x5575e4ae3800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009c90 tx=0x7f15f8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dee6e2e614dcff43 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.799+0000 7f1601869640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15e80b4df0 0x7f15e80b7300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f15f40c8c50 tx=0x7f15f40095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.799+0000 7f15e77fe640 1 -- 172.21.15.37:0/2601980584 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8005220 con 0x5575e47151b0 2024-08-31T06:48:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.799+0000 7f15e77fe640 1 -- 172.21.15.37:0/2601980584 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15f8004c30 con 0x5575e47151b0 2024-08-31T06:48:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.799+0000 7f15e77fe640 1 -- 172.21.15.37:0/2601980584 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8019670 con 0x5575e47151b0 2024-08-31T06:48:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.800+0000 7f1609841740 1 -- 172.21.15.37:0/2601980584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e47151b0 msgr2=0x5575e4ae3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.800+0000 7f1609841740 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e47151b0 0x5575e4ae3800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009c90 tx=0x7f15f8011810 comp rx=0 tx=0).stop 2024-08-31T06:48:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.801+0000 7f1609841740 1 -- 172.21.15.37:0/2601980584 shutdown_connections 2024-08-31T06:48:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.801+0000 7f1609841740 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 0x5575e4ae3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.801+0000 7f1609841740 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e47151b0 0x5575e4ae3800 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009c90 tx=0x7f15f8011810 comp rx=0 tx=0).stop 2024-08-31T06:48:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.801+0000 7f1609841740 1 --2- 172.21.15.37:0/2601980584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e473e070 0x5575e4ae32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.801+0000 7f1609841740 1 -- 172.21.15.37:0/2601980584 >> 172.21.15.37:0/2601980584 conn(0x5575e4732460 msgr2=0x5575e4ae11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.801+0000 7f1609841740 1 -- 172.21.15.37:0/2601980584 shutdown_connections 2024-08-31T06:48:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.801+0000 7f1609841740 1 -- 172.21.15.37:0/2601980584 wait complete. 2024-08-31T06:48:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.802+0000 7f1609841740 1 -- start start 2024-08-31T06:48:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.802+0000 7f1609841740 1 Processor -- start 2024-08-31T06:48:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1609841740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e471d390 0x5575e4affdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1609841740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b00300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1609841740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e46fc9f0 0x5575e4b0bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1609841740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5575e48ac700 con 0x5575e471d390 2024-08-31T06:48:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1609841740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5575e49d0700 con 0x5575e46fc9f0 2024-08-31T06:48:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1609841740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5575e4b02a00 con 0x5575e473e070 2024-08-31T06:48:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1609841740 10 client.0 _ll_register_callbacks cb 0x5575e49ffdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:43.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1600867640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e471d390 0x5575e4affdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1601068640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b00300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1601068640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b00300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:37226/0 (socket says 172.21.15.37:37226) 2024-08-31T06:48:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1601068640 1 -- 172.21.15.37:0/540574802 learned_addr learned my addr 172.21.15.37:0/540574802 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1600867640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e471d390 0x5575e4affdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51504/0 (socket says 172.21.15.37:51504) 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.803+0000 7f1600867640 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e46fc9f0 0x5575e4b0bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.804+0000 7f1601068640 1 -- 172.21.15.37:0/540574802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e46fc9f0 msgr2=0x5575e4b0bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.804+0000 7f1601068640 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e46fc9f0 0x5575e4b0bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.804+0000 7f1601068640 1 -- 172.21.15.37:0/540574802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e471d390 msgr2=0x5575e4affdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.804+0000 7f1601068640 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e471d390 0x5575e4affdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.804+0000 7f1601068640 1 -- 172.21.15.37:0/540574802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e4a098b0 con 0x5575e473e070 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.804+0000 7f1601068640 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b00300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15f8000c00 tx=0x7f15f8004ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5f14469adc31e86 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.804+0000 7f15e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:48:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.804+0000 7f15e4ff9640 1 -- 172.21.15.37:0/540574802 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8004de0 con 0x5575e473e070 2024-08-31T06:48:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.805+0000 7f1609841740 1 -- 172.21.15.37:0/540574802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15f8004c30 con 0x5575e473e070 2024-08-31T06:48:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.805+0000 7f15e4ff9640 1 -- 172.21.15.37:0/540574802 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f15f8004030 con 0x5575e473e070 2024-08-31T06:48:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.805+0000 7f15e4ff9640 1 -- 172.21.15.37:0/540574802 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15f8004230 con 0x5575e473e070 2024-08-31T06:48:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.806+0000 7f1609841740 10 client.25621 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.806+0000 7f1609841740 1 -- 172.21.15.37:0/540574802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5575e4b0e960 con 0x5575e473e070 2024-08-31T06:48:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.806+0000 7f15e4ff9640 1 -- 172.21.15.37:0/540574802 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15f8004c30 con 0x5575e473e070 2024-08-31T06:48:43.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.806+0000 7f15e4ff9640 1 -- 172.21.15.37:0/540574802 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15f8003c20 con 0x5575e473e070 2024-08-31T06:48:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.807+0000 7f1609841740 10 client.25621 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.807+0000 7f1609841740 10 client.25621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.807+0000 7f1609841740 20 client.25621 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.807+0000 7f1609841740 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5575e46d1da0 0x5575e4b11cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.807+0000 7f1609841740 4 client.25621 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.807+0000 7f1609841740 1 -- 172.21.15.37:0/540574802 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e4a5c580 con 0x5575e46d1da0 2024-08-31T06:48:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.808+0000 7f1600867640 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5575e46d1da0 0x5575e4b11cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.809+0000 7f1600867640 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5575e46d1da0 0x5575e4b11cc0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de0c6c550b0a8579 server_cookie=a9464f55e8eeabaf in_seq=0 out_seq=0 2024-08-31T06:48:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.809+0000 7f15e4ff9640 10 client.25621 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f15e4ff9640 1 -- 172.21.15.37:0/540574802 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575e4a5c580 con 0x5575e46d1da0 2024-08-31T06:48:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f15e4ff9640 10 client.25621 handle_command_reply: tid=0 2024-08-31T06:48:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 client.25621 shutdown 2024-08-31T06:48:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 -- 172.21.15.37:0/540574802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 msgr2=0x5575e4b00300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b00300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15f8000c00 tx=0x7f15f8004ba0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 -- 172.21.15.37:0/540574802 shutdown_connections 2024-08-31T06:48:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5575e46d1da0 0x5575e4b11cc0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e46fc9f0 0x5575e4b0bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b00300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f15e4ff9640 0 client.25621 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 --2- 172.21.15.37:0/540574802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e471d390 0x5575e4affdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.810+0000 7f1609841740 1 -- 172.21.15.37:0/540574802 >> 172.21.15.37:0/540574802 conn(0x5575e4732460 msgr2=0x5575e4ae4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.811+0000 7f1609841740 1 -- 172.21.15.37:0/540574802 shutdown_connections 2024-08-31T06:48:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.811+0000 7f1609841740 1 -- 172.21.15.37:0/540574802 wait complete. 2024-08-31T06:48:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.811+0000 7f1609841740 20 client.25621 trim_cache size 0 max 16384 2024-08-31T06:48:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.841+0000 7f1609841740 1 Processor -- start 2024-08-31T06:48:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.841+0000 7f1609841740 1 -- start start 2024-08-31T06:48:43.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1609841740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b017f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1609841740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 0x5575e4b0bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1609841740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b0c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1609841740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc06faf0 con 0x5575e46fc9f0 2024-08-31T06:48:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1609841740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc06d3c0 con 0x5575e471d390 2024-08-31T06:48:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1609841740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1a50d0 con 0x5575e473e070 2024-08-31T06:48:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1600867640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b017f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1600867640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b017f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51518/0 (socket says 172.21.15.37:51518) 2024-08-31T06:48:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1600867640 1 -- 172.21.15.37:0/1840934184 learned_addr learned my addr 172.21.15.37:0/1840934184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1600867640 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b0c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.842+0000 7f1601068640 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 0x5575e4b0bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.843+0000 7f1600867640 1 -- 172.21.15.37:0/1840934184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 msgr2=0x5575e4b0bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:43.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.843+0000 7f1600867640 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 0x5575e4b0bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.843+0000 7f1600867640 1 -- 172.21.15.37:0/1840934184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 msgr2=0x5575e4b017f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:43.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.843+0000 7f1600867640 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b017f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.843+0000 7f1600867640 1 -- 172.21.15.37:0/1840934184 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e4ae5be0 con 0x5575e473e070 2024-08-31T06:48:43.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.843+0000 7f1600867640 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b0c170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15fc106b80 tx=0x7f15ec0096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeb7537fd0bb6368 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:43.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.843+0000 7f15e6ffd640 1 -- 172.21.15.37:0/1840934184 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec01c040 con 0x5575e473e070 2024-08-31T06:48:43.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.843+0000 7f15e6ffd640 1 -- 172.21.15.37:0/1840934184 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15ec025d50 con 0x5575e473e070 2024-08-31T06:48:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.844+0000 7f15e6ffd640 1 -- 172.21.15.37:0/1840934184 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ec010c40 con 0x5575e473e070 2024-08-31T06:48:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 -- 172.21.15.37:0/1840934184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 msgr2=0x5575e4b0c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b0c170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15fc106b80 tx=0x7f15ec0096c0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 -- 172.21.15.37:0/1840934184 shutdown_connections 2024-08-31T06:48:43.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e473e070 0x5575e4b0c170 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15fc106b80 tx=0x7f15ec0096c0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e471d390 0x5575e4b0bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 --2- 172.21.15.37:0/1840934184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 -- 172.21.15.37:0/1840934184 >> 172.21.15.37:0/1840934184 conn(0x5575e4732460 msgr2=0x5575e4b010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 -- 172.21.15.37:0/1840934184 shutdown_connections 2024-08-31T06:48:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.845+0000 7f1609841740 1 -- 172.21.15.37:0/1840934184 wait complete. 2024-08-31T06:48:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.846+0000 7f1609841740 1 -- start start 2024-08-31T06:48:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.846+0000 7f1609841740 1 Processor -- start 2024-08-31T06:48:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.847+0000 7f1609841740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b04050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.847+0000 7f1609841740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e471d390 0x5575e4b045b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.847+0000 7f1609841740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e4b04c00 0x5575e4b7b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.847+0000 7f1609841740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1a5740 con 0x5575e46fc9f0 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.847+0000 7f1601068640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e471d390 0x5575e4b045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.847+0000 7f1601068640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e471d390 0x5575e4b045b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:37242/0 (socket says 172.21.15.37:37242) 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.847+0000 7f1601068640 1 -- 172.21.15.37:0/1567577046 learned_addr learned my addr 172.21.15.37:0/1567577046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1600867640 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b04050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc06ccf0 con 0x5575e4b04c00 2024-08-31T06:48:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f15fc1a5e10 con 0x5575e471d390 2024-08-31T06:48:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1609841740 10 client.0 _ll_register_callbacks cb 0x7f15ec009a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1600867640 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e4b04c00 0x5575e4b7b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1601068640 1 -- 172.21.15.37:0/1567577046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e4b04c00 msgr2=0x5575e4b7b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1601068640 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e4b04c00 0x5575e4b7b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1601068640 1 -- 172.21.15.37:0/1567577046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 msgr2=0x5575e4b04050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1601068640 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b04050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.848+0000 7f1601068640 1 -- 172.21.15.37:0/1567577046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e4ae5200 con 0x5575e471d390 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.849+0000 7f1601068640 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e471d390 0x5575e4b045b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009380 tx=0x7f15f8004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d029332f4136e37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.849+0000 7f15e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.849+0000 7f15e4ff9640 1 -- 172.21.15.37:0/1567577046 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8005b90 con 0x5575e471d390 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.849+0000 7f15e4ff9640 1 -- 172.21.15.37:0/1567577046 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f15f8005410 con 0x5575e471d390 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.849+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15ec025d50 con 0x5575e471d390 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.849+0000 7f15e4ff9640 1 -- 172.21.15.37:0/1567577046 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15f8009b10 con 0x5575e471d390 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f1609841740 10 client.25627 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:43.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5575e4b7cd00 con 0x5575e471d390 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f15e4ff9640 1 -- 172.21.15.37:0/1567577046 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15f803d070 con 0x5575e471d390 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f15e4ff9640 1 -- 172.21.15.37:0/1567577046 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15f8038650 con 0x5575e471d390 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f1609841740 10 client.25627 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f1609841740 10 client.25627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f1609841740 20 client.25627 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f1609841740 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5575e4b7d470 0x5575e4b7f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f1609841740 4 client.25627 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.850+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f15ec025d50 con 0x5575e4b7d470 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.851+0000 7f1600867640 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5575e4b7d470 0x5575e4b7f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.851+0000 7f1600867640 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5575e4b7d470 0x5575e4b7f890 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7b11c971ad74871 server_cookie=73275de5ee6f94d9 in_seq=0 out_seq=0 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.851+0000 7f15e4ff9640 10 client.25627 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f15e4ff9640 1 -- 172.21.15.37:0/1567577046 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x7f15ec025d50 con 0x5575e4b7d470 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f15e4ff9640 10 client.25627 handle_command_reply: tid=0 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 client.25627 shutdown 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e471d390 msgr2=0x5575e4b045b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e471d390 0x5575e4b045b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009380 tx=0x7f15f8004600 comp rx=0 tx=0).stop 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 shutdown_connections 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5575e4b7d470 0x5575e4b7f890 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5575e4b04c00 0x5575e4b7b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5575e471d390 0x5575e4b045b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 --2- 172.21.15.37:0/1567577046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5575e46fc9f0 0x5575e4b04050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 >> 172.21.15.37:0/1567577046 conn(0x5575e4732460 msgr2=0x5575e4afe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f15e4ff9640 0 client.25627 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 shutdown_connections 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.852+0000 7f1609841740 1 -- 172.21.15.37:0/1567577046 wait complete. 2024-08-31T06:48:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.853+0000 7f1609841740 20 client.25627 trim_cache size 0 max 16384 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:48:43.856 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:48:43.857 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:48:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:48:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:48:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:48:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:48:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:43.858 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:48:43.858 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:48:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.853+0000 7f16032cc640 1 -- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15e80b4df0 msgr2=0x7f15e80b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.853+0000 7f16032cc640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15e80b4df0 0x7f15e80b7300 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f15f40c8c50 tx=0x7f15f40095c0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 -- 172.21.15.37:0/1765225565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15fc109bc0 msgr2=0x7f15fc0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15fc109bc0 0x7f15fc0759f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f15f4005cc0 tx=0x7f15f4003f90 comp rx=0 tx=0).stop 2024-08-31T06:48:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 -- 172.21.15.37:0/1765225565 shutdown_connections 2024-08-31T06:48:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f15e80b4df0 0x7f15e80b7300 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15fc109bc0 0x7f15fc0759f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15fc109270 0x7f15fc0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 --2- 172.21.15.37:0/1765225565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15fc103930 0x7f15fc076ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 -- 172.21.15.37:0/1765225565 >> 172.21.15.37:0/1765225565 conn(0x7f15fc0ff380 msgr2=0x7f15fc1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 -- 172.21.15.37:0/1765225565 shutdown_connections 2024-08-31T06:48:43.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:43.854+0000 7f16032cc640 1 -- 172.21.15.37:0/1765225565 wait complete. 2024-08-31T06:48:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:43 smithi106 ceph-mon[22134]: pgmap v376: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.12k op/s 2024-08-31T06:48:44.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:43 smithi037 ceph-mon[18612]: pgmap v376: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.12k op/s 2024-08-31T06:48:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:43 smithi066 ceph-mon[22244]: pgmap v376: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.12k op/s 2024-08-31T06:48:44.687 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:48:44.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:48:45.072 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.650+0000 7fad973c4640 1 -- 172.21.15.37:0/3825866907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90102820 msgr2=0x7fad90102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.650+0000 7fad973c4640 1 --2- 172.21.15.37:0/3825866907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90102820 0x7fad90102c30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009ca0 tx=0x7fad8c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:48:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.651+0000 7fad973c4640 1 -- 172.21.15.37:0/3825866907 shutdown_connections 2024-08-31T06:48:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.651+0000 7fad973c4640 1 --2- 172.21.15.37:0/3825866907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad90108ab0 0x7fad9010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.651+0000 7fad973c4640 1 --2- 172.21.15.37:0/3825866907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad90108160 0x7fad90108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:45.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.651+0000 7fad973c4640 1 --2- 172.21.15.37:0/3825866907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90102820 0x7fad90102c30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.651+0000 7fad973c4640 1 -- 172.21.15.37:0/3825866907 >> 172.21.15.37:0/3825866907 conn(0x7fad900794e0 msgr2=0x7fad900798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.651+0000 7fad973c4640 1 -- 172.21.15.37:0/3825866907 shutdown_connections 2024-08-31T06:48:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.651+0000 7fad973c4640 1 -- 172.21.15.37:0/3825866907 wait complete. 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.652+0000 7fad973c4640 1 Processor -- start 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.652+0000 7fad973c4640 1 -- start start 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.652+0000 7fad973c4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad90102820 0x7fad9019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.652+0000 7fad973c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90108160 0x7fad9019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.652+0000 7fad973c4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad90108ab0 0x7fad901a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.652+0000 7fad973c4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad90112610 con 0x7fad90108160 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.652+0000 7fad973c4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fad90112490 con 0x7fad90102820 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.652+0000 7fad973c4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fad90112790 con 0x7fad90108ab0 2024-08-31T06:48:45.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad95160640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad90102820 0x7fad9019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad95160640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad90102820 0x7fad9019c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33654/0 (socket says 172.21.15.37:33654) 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad95160640 1 -- 172.21.15.37:0/1443612089 learned_addr learned my addr 172.21.15.37:0/1443612089 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad9495f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90108160 0x7fad9019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad95961640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad90108ab0 0x7fad901a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad9495f640 1 -- 172.21.15.37:0/1443612089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad90108ab0 msgr2=0x7fad901a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad9495f640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad90108ab0 0x7fad901a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad9495f640 1 -- 172.21.15.37:0/1443612089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad90102820 msgr2=0x7fad9019c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad9495f640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad90102820 0x7fad9019c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad9495f640 1 -- 172.21.15.37:0/1443612089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad901a22f0 con 0x7fad90108160 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.653+0000 7fad95160640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad90102820 0x7fad9019c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.654+0000 7fad9495f640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90108160 0x7fad9019c950 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fad8000e9c0 tx=0x7fad8000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.654+0000 7fad867fc640 1 -- 172.21.15.37:0/1443612089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8000ccc0 con 0x7fad90108160 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.654+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad901a25e0 con 0x7fad90108160 2024-08-31T06:48:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.654+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad90109170 con 0x7fad90108160 2024-08-31T06:48:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.655+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad90102c30 con 0x7fad90108160 2024-08-31T06:48:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.655+0000 7fad867fc640 1 -- 172.21.15.37:0/1443612089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad800108c0 con 0x7fad90108160 2024-08-31T06:48:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.655+0000 7fad867fc640 1 -- 172.21.15.37:0/1443612089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad80026060 con 0x7fad90108160 2024-08-31T06:48:45.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.659+0000 7fad867fc640 1 -- 172.21.15.37:0/1443612089 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fad80010430 con 0x7fad90108160 2024-08-31T06:48:45.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.660+0000 7fad867fc640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad7c0b4d20 0x7fad7c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.661+0000 7fad867fc640 1 -- 172.21.15.37:0/1443612089 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fad800e5d30 con 0x7fad90108160 2024-08-31T06:48:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.662+0000 7fad95160640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad7c0b4d20 0x7fad7c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.663+0000 7fad95160640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad7c0b4d20 0x7fad7c0b7230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0098b0 tx=0x7fad8c009800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:45.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:45.666+0000 7fad867fc640 1 -- 172.21.15.37:0/1443612089 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fad800ac4b0 con 0x7fad90108160 2024-08-31T06:48:45.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:45 smithi037 ceph-mon[18612]: pgmap v377: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 3.89k op/s 2024-08-31T06:48:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.056+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad9019d4e0 con 0x7fad90108160 2024-08-31T06:48:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.057+0000 7fad867fc640 1 -- 172.21.15.37:0/1443612089 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fad9019d4e0 con 0x7fad90108160 2024-08-31T06:48:46.059 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:48:46.060 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:48:46.060 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:48:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.060+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad7c0b4d20 msgr2=0x7fad7c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad7c0b4d20 0x7fad7c0b7230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0098b0 tx=0x7fad8c009800 comp rx=0 tx=0).stop 2024-08-31T06:48:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90108160 msgr2=0x7fad9019c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90108160 0x7fad9019c950 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fad8000e9c0 tx=0x7fad8000ee80 comp rx=0 tx=0).stop 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 shutdown_connections 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fad7c0b4d20 0x7fad7c0b7230 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad90108160 0x7fad9019c950 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad90108ab0 0x7fad901a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 --2- 172.21.15.37:0/1443612089 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad90102820 0x7fad9019c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 >> 172.21.15.37:0/1443612089 conn(0x7fad900794e0 msgr2=0x7fad9006b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 shutdown_connections 2024-08-31T06:48:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:46.061+0000 7fad973c4640 1 -- 172.21.15.37:0/1443612089 wait complete. 2024-08-31T06:48:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:45 smithi106 ceph-mon[22134]: pgmap v377: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 3.89k op/s 2024-08-31T06:48:46.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:45 smithi066 ceph-mon[22244]: pgmap v377: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 3.89k op/s 2024-08-31T06:48:46.970 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:46 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1443612089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:47.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:48:47.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:46 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1443612089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:47.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:46 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1443612089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:48:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:47.834 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:47 smithi037 ceph-mon[18612]: pgmap v378: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 4.30k op/s 2024-08-31T06:48:47.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 -- 172.21.15.37:0/679320050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80109260 msgr2=0x7f6b80109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:47.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 --2- 172.21.15.37:0/679320050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80109260 0x7f6b80109670 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009860 tx=0x7f6b7402a340 comp rx=0 tx=0).stop 2024-08-31T06:48:47.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 -- 172.21.15.37:0/679320050 shutdown_connections 2024-08-31T06:48:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 --2- 172.21.15.37:0/679320050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b80109bb0 0x7f6b80110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 --2- 172.21.15.37:0/679320050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80109260 0x7f6b80109670 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 --2- 172.21.15.37:0/679320050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b80101db0 0x7f6b801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 -- 172.21.15.37:0/679320050 >> 172.21.15.37:0/679320050 conn(0x7f6b80077a00 msgr2=0x7f6b80077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 -- 172.21.15.37:0/679320050 shutdown_connections 2024-08-31T06:48:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.977+0000 7f6b86501640 1 -- 172.21.15.37:0/679320050 wait complete. 2024-08-31T06:48:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.978+0000 7f6b86501640 1 Processor -- start 2024-08-31T06:48:47.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.978+0000 7f6b86501640 1 -- start start 2024-08-31T06:48:47.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b86501640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80101db0 0x7f6b801100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b86501640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b80109260 0x7f6b8010d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b86501640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b80109bb0 0x7f6b8010d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80101db0 0x7f6b801100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b86501640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b801040d0 con 0x7f6b80109260 2024-08-31T06:48:47.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b86501640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80103f50 con 0x7f6b80101db0 2024-08-31T06:48:47.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80101db0 0x7f6b801100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33668/0 (socket says 172.21.15.37:33668) 2024-08-31T06:48:47.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b7ffff640 1 -- 172.21.15.37:0/3917932370 learned_addr learned my addr 172.21.15.37:0/3917932370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:47.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b80104250 con 0x7f6b80109bb0 2024-08-31T06:48:47.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.979+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b80109260 0x7f6b8010d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.980+0000 7f6b7f7fe640 1 -- 172.21.15.37:0/3917932370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b80109bb0 msgr2=0x7f6b8010d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:47.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.980+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b80109bb0 0x7f6b8010d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.980+0000 7f6b7f7fe640 1 -- 172.21.15.37:0/3917932370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80101db0 msgr2=0x7f6b801100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:47.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.980+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80101db0 0x7f6b801100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.980+0000 7f6b7f7fe640 1 -- 172.21.15.37:0/3917932370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8010e000 con 0x7f6b80109260 2024-08-31T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.980+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80101db0 0x7f6b801100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.981+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b80109260 0x7f6b8010d390 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6b7402a860 tx=0x7f6b74033d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.981+0000 7f6b7d7fa640 1 -- 172.21.15.37:0/3917932370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74037040 con 0x7f6b80109260 2024-08-31T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.981+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b80073bd0 con 0x7f6b80109260 2024-08-31T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.981+0000 7f6b7d7fa640 1 -- 172.21.15.37:0/3917932370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b740044d0 con 0x7f6b80109260 2024-08-31T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.981+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b800740d0 con 0x7f6b80109260 2024-08-31T06:48:47.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.981+0000 7f6b7d7fa640 1 -- 172.21.15.37:0/3917932370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740035f0 con 0x7f6b80109260 2024-08-31T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.984+0000 7f6b8ca76740 1 Processor -- start 2024-08-31T06:48:47.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.984+0000 7f6b8ca76740 1 -- start start 2024-08-31T06:48:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92bab070 0x559b92f50350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f50890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 0x559b92f50dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559b92ec7680 con 0x559b92b8a390 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559b92eb6c10 con 0x559b92b821b0 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559b92ebabc0 con 0x559b92bab070 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f50890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b84a9e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92bab070 0x559b92f50350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f50890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33676/0 (socket says 172.21.15.37:33676) 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b84a9e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92bab070 0x559b92f50350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51628/0 (socket says 172.21.15.37:51628) 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.985+0000 7f6b7ffff640 1 -- 172.21.15.37:0/701566694 learned_addr learned my addr 172.21.15.37:0/701566694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:47.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b7ffff640 1 -- 172.21.15.37:0/701566694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92bab070 msgr2=0x559b92f50350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/701566694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92bab070 0x559b92f50350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b7ffff640 1 -- 172.21.15.37:0/701566694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 msgr2=0x559b92f50dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:48:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/701566694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 0x559b92f50dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b7ffff640 1 -- 172.21.15.37:0/701566694 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b92c16650 con 0x559b92b821b0 2024-08-31T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b7d7fa640 1 -- 172.21.15.37:0/3917932370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f6b74004040 con 0x7f6b80109260 2024-08-31T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/701566694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f50890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b700115f0 tx=0x7f6b70009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c3ed4f5d125dcec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b667fc640 1 -- 172.21.15.37:0/701566694 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70005020 con 0x559b92b821b0 2024-08-31T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.986+0000 7f6b667fc640 1 -- 172.21.15.37:0/701566694 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b700047a0 con 0x559b92b821b0 2024-08-31T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.987+0000 7f6b7d7fa640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b680b4ca0 0x7f6b680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.987+0000 7f6b667fc640 1 -- 172.21.15.37:0/701566694 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000f960 con 0x559b92b821b0 2024-08-31T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.987+0000 7f6b84a9e640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b680b4ca0 0x7f6b680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.987+0000 7f6b7d7fa640 1 -- 172.21.15.37:0/3917932370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6b740c7ae0 con 0x7f6b80109260 2024-08-31T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.988+0000 7f6b8ca76740 1 -- 172.21.15.37:0/701566694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 msgr2=0x559b92f50890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.988+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/701566694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f50890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b700115f0 tx=0x7f6b70009f90 comp rx=0 tx=0).stop 2024-08-31T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.988+0000 7f6b84a9e640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b680b4ca0 0x7f6b680b71b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009910 tx=0x7f6b780098a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:47.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.988+0000 7f6b8ca76740 1 -- 172.21.15.37:0/701566694 shutdown_connections 2024-08-31T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.988+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/701566694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 0x559b92f50dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.988+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/701566694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f50890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.988+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/701566694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92bab070 0x559b92f50350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.989+0000 7f6b8ca76740 1 -- 172.21.15.37:0/701566694 >> 172.21.15.37:0/701566694 conn(0x559b92b9f460 msgr2=0x559b92f4e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.989+0000 7f6b8ca76740 1 -- 172.21.15.37:0/701566694 shutdown_connections 2024-08-31T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.989+0000 7f6b8ca76740 1 -- 172.21.15.37:0/701566694 wait complete. 2024-08-31T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.989+0000 7f6b8ca76740 1 -- start start 2024-08-31T06:48:47.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.990+0000 7f6b8ca76740 1 Processor -- start 2024-08-31T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f5ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b8a390 0x559b92f5bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f67ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f5ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f5ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33678/0 (socket says 172.21.15.37:33678) 2024-08-31T06:48:47.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b7ffff640 1 -- 172.21.15.37:0/3327559717 learned_addr learned my addr 172.21.15.37:0/3327559717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:47.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559b92d19700 con 0x559b92bab070 2024-08-31T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559b92e3d750 con 0x559b92b821b0 2024-08-31T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559b92f5eb80 con 0x559b92b8a390 2024-08-31T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b84a9e640 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f67ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b8a390 0x559b92f5bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b8ca76740 10 client.0 _ll_register_callbacks cb 0x559b92e6ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b7ffff640 1 -- 172.21.15.37:0/3327559717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b8a390 msgr2=0x559b92f5bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:47.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.991+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b8a390 0x559b92f5bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.992+0000 7f6b7ffff640 1 -- 172.21.15.37:0/3327559717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 msgr2=0x559b92f67ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.992+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f67ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.992+0000 7f6b7ffff640 1 -- 172.21.15.37:0/3327559717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b92e76900 con 0x559b92b821b0 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.992+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b8a390 0x559b92f5bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.992+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b700047a0 con 0x559b92b821b0 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.992+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f5ba60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b700115c0 tx=0x7f6b70004f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc81f67e7eb6ca9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.992+0000 7f6b5f7fe640 10 client.25634 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.993+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/3327559717 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70038020 con 0x559b92b821b0 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.993+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/3327559717 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6b700052a0 con 0x559b92b821b0 2024-08-31T06:48:47.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.993+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/3327559717 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b7000f700 con 0x559b92b821b0 2024-08-31T06:48:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.993+0000 7f6b8ca76740 10 client.25634 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:47.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.993+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=25}) -- 0x559b92f6a910 con 0x559b92b821b0 2024-08-31T06:48:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.994+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/3327559717 <== mon.2 v2:172.21.15.66:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b7000f8a0 con 0x559b92b821b0 2024-08-31T06:48:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.994+0000 7f6b8ca76740 10 client.25634 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.994+0000 7f6b8ca76740 10 client.25634 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:48:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.994+0000 7f6b8ca76740 20 client.25634 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.994+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x559b92b699f0 0x559b92f6dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:47.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.994+0000 7f6b8ca76740 4 client.25634 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.994+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b92ec95d0 con 0x559b92b699f0 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.994+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x559b92b699f0 0x559b92f6dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.995+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x559b92b699f0 0x559b92f6dcd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be4a9c40af893e2c server_cookie=f71c19a74f43f087 in_seq=0 out_seq=0 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.995+0000 7f6b5f7fe640 10 client.25634 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.995+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/3327559717 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b92ec95d0 con 0x559b92b699f0 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.995+0000 7f6b5f7fe640 10 client.25634 handle_command_reply: tid=0 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.996+0000 7f6b8ca76740 1 client.25634 shutdown 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.996+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 msgr2=0x559b92f5ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:47.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.996+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f5ba60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6b700115c0 tx=0x7f6b70004f20 comp rx=0 tx=0).stop 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 shutdown_connections 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f67ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x559b92b699f0 0x559b92f6dcd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b8a390 0x559b92f5bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/3327559717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b821b0 0x559b92f5ba60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b5f7fe640 0 client.25634 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 >> 172.21.15.37:0/3327559717 conn(0x559b92b9f460 msgr2=0x559b92f51380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 shutdown_connections 2024-08-31T06:48:48.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 1 -- 172.21.15.37:0/3327559717 wait complete. 2024-08-31T06:48:48.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:47.997+0000 7f6b8ca76740 20 client.25634 trim_cache size 0 max 16384 2024-08-31T06:48:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.021+0000 7f6b8ca76740 1 Processor -- start 2024-08-31T06:48:48.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.021+0000 7f6b8ca76740 1 -- start start 2024-08-31T06:48:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f5d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 0x559b92f5dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92bab070 0x559b92f58e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:48.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f5d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b801b8230 con 0x559b92b8a390 2024-08-31T06:48:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8011ddd0 con 0x559b92bab070 2024-08-31T06:48:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b7ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f5d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51646/0 (socket says 172.21.15.37:51646) 2024-08-31T06:48:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8011bc20 con 0x559b92b821b0 2024-08-31T06:48:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b7ffff640 1 -- 172.21.15.37:0/2286162339 learned_addr learned my addr 172.21.15.37:0/2286162339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.022+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 0x559b92f5dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.023+0000 7f6b84a9e640 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92bab070 0x559b92f58e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.023+0000 7f6b7ffff640 1 -- 172.21.15.37:0/2286162339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92bab070 msgr2=0x559b92f58e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.023+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92bab070 0x559b92f58e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.023+0000 7f6b7ffff640 1 -- 172.21.15.37:0/2286162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 msgr2=0x559b92f5dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.023+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 0x559b92f5dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.023+0000 7f6b7ffff640 1 -- 172.21.15.37:0/2286162339 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b92f5cd20 con 0x559b92b821b0 2024-08-31T06:48:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.023+0000 7f6b7f7fe640 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 0x559b92f5dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.024+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f5d690 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6b70005e30 tx=0x7f6b7001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d8f48121d84b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.024+0000 7f6b65ffb640 1 -- 172.21.15.37:0/2286162339 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70038040 con 0x559b92b821b0 2024-08-31T06:48:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.024+0000 7f6b65ffb640 1 -- 172.21.15.37:0/2286162339 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b700047a0 con 0x559b92b821b0 2024-08-31T06:48:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.024+0000 7f6b65ffb640 1 -- 172.21.15.37:0/2286162339 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70004280 con 0x559b92b821b0 2024-08-31T06:48:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 -- 172.21.15.37:0/2286162339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 msgr2=0x559b92f5d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f5d690 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6b70005e30 tx=0x7f6b7001f000 comp rx=0 tx=0).stop 2024-08-31T06:48:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 -- 172.21.15.37:0/2286162339 shutdown_connections 2024-08-31T06:48:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92b8a390 0x559b92f5dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92bab070 0x559b92f58e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/2286162339 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f5d690 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 -- 172.21.15.37:0/2286162339 >> 172.21.15.37:0/2286162339 conn(0x559b92b9f460 msgr2=0x559b92f5cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 -- 172.21.15.37:0/2286162339 shutdown_connections 2024-08-31T06:48:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.025+0000 7f6b8ca76740 1 -- 172.21.15.37:0/2286162339 wait complete. 2024-08-31T06:48:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.026+0000 7f6b8ca76740 1 -- start start 2024-08-31T06:48:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.026+0000 7f6b8ca76740 1 Processor -- start 2024-08-31T06:48:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f72570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b8a390 0x559b92f6fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b8ca76740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f6ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8011c290 con 0x559b92bab070 2024-08-31T06:48:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8011d700 con 0x559b92b8a390 2024-08-31T06:48:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b8ca76740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8011c960 con 0x559b92b821b0 2024-08-31T06:48:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b84a9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f6ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b84a9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f6ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59638/0 (socket says 172.21.15.37:59638) 2024-08-31T06:48:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b84a9e640 1 -- 172.21.15.37:0/465174697 learned_addr learned my addr 172.21.15.37:0/465174697 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.027+0000 7f6b8ca76740 10 client.0 _ll_register_callbacks cb 0x7f6b78009540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f72570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b84a9e640 1 -- 172.21.15.37:0/465174697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 msgr2=0x559b92f72570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b84a9e640 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f72570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b84a9e640 1 -- 172.21.15.37:0/465174697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b8a390 msgr2=0x559b92f6fa90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b84a9e640 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b8a390 0x559b92f6fa90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b84a9e640 1 -- 172.21.15.37:0/465174697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b92f70760 con 0x559b92bab070 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f72570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b84a9e640 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f6ffd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6b78011ab0 tx=0x7f6b78009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b693888ac58761a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.028+0000 7f6b5f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.029+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/465174697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78029440 con 0x559b92bab070 2024-08-31T06:48:48.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.029+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/465174697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6b7801e450 con 0x559b92bab070 2024-08-31T06:48:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.029+0000 7f6b8ca76740 1 -- 172.21.15.37:0/465174697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b700047a0 con 0x559b92bab070 2024-08-31T06:48:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.029+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/465174697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b7801e690 con 0x559b92bab070 2024-08-31T06:48:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.029+0000 7f6b8ca76740 10 client.16137 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.029+0000 7f6b8ca76740 1 -- 172.21.15.37:0/465174697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b92fd83e0 con 0x559b92bab070 2024-08-31T06:48:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.030+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/465174697 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b700047a0 con 0x559b92bab070 2024-08-31T06:48:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.030+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/465174697 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b78027070 con 0x559b92bab070 2024-08-31T06:48:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.031+0000 7f6b8ca76740 10 client.16137 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.031+0000 7f6b8ca76740 10 client.16137 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:48:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.031+0000 7f6b8ca76740 20 client.16137 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.031+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x559b92b3eda0 0x559b92fdabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.032+0000 7f6b8ca76740 4 client.16137 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:48:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.032+0000 7f6b8ca76740 1 -- 172.21.15.37:0/465174697 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b92ec5070 con 0x559b92b3eda0 2024-08-31T06:48:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.032+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x559b92b3eda0 0x559b92fdabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.032+0000 7f6b7ffff640 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x559b92b3eda0 0x559b92fdabc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cfb0e2520cf4c73b server_cookie=8d74aac1171c7b6e in_seq=0 out_seq=0 2024-08-31T06:48:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.032+0000 7f6b5f7fe640 10 client.16137 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:48:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b5f7fe640 1 -- 172.21.15.37:0/465174697 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b92ec5070 con 0x559b92b3eda0 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b5f7fe640 10 client.16137 handle_command_reply: tid=0 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 client.16137 shutdown 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 -- 172.21.15.37:0/465174697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 msgr2=0x559b92f6ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f6ffd0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6b78011ab0 tx=0x7f6b78009620 comp rx=0 tx=0).stop 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 -- 172.21.15.37:0/465174697 shutdown_connections 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b92bab070 0x559b92f6ffd0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x559b92b3eda0 0x559b92fdabc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b92b8a390 0x559b92f6fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b5f7fe640 0 client.16137 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 --2- 172.21.15.37:0/465174697 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b92b821b0 0x559b92f72570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 -- 172.21.15.37:0/465174697 >> 172.21.15.37:0/465174697 conn(0x559b92b9f460 msgr2=0x559b92f5d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.033+0000 7f6b8ca76740 1 -- 172.21.15.37:0/465174697 shutdown_connections 2024-08-31T06:48:48.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.034+0000 7f6b8ca76740 1 -- 172.21.15.37:0/465174697 wait complete. 2024-08-31T06:48:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.034+0000 7f6b8ca76740 20 client.16137 trim_cache size 0 max 16384 2024-08-31T06:48:48.037 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b680b4ca0 msgr2=0x7f6b680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b680b4ca0 0x7f6b680b71b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009910 tx=0x7f6b780098a0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b80109260 msgr2=0x7f6b8010d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b80109260 0x7f6b8010d390 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6b7402a860 tx=0x7f6b74033d40 comp rx=0 tx=0).stop 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 shutdown_connections 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b680b4ca0 0x7f6b680b71b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b80109260 0x7f6b8010d390 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b80109bb0 0x7f6b8010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 --2- 172.21.15.37:0/3917932370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b80101db0 0x7f6b801100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 >> 172.21.15.37:0/3917932370 conn(0x7f6b80077a00 msgr2=0x7f6b80100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 shutdown_connections 2024-08-31T06:48:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:48.035+0000 7f6b86501640 1 -- 172.21.15.37:0/3917932370 wait complete. 2024-08-31T06:48:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:47 smithi106 ceph-mon[22134]: pgmap v378: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 4.30k op/s 2024-08-31T06:48:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:47 smithi066 ceph-mon[22244]: pgmap v378: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 MiB/s wr, 4.30k op/s 2024-08-31T06:48:48.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:48:49.267 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 -- 172.21.15.37:0/2111326742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3ec0754f0 msgr2=0x7fe3ec075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/2111326742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3ec0754f0 0x7fe3ec075900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009900 tx=0x7fe3e802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 -- 172.21.15.37:0/2111326742 shutdown_connections 2024-08-31T06:48:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/2111326742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10ff90 0x7fe3ec1123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/2111326742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3ec075e40 0x7fe3ec10fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/2111326742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3ec0754f0 0x7fe3ec075900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 -- 172.21.15.37:0/2111326742 >> 172.21.15.37:0/2111326742 conn(0x7fe3ec07b670 msgr2=0x7fe3ec07ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 -- 172.21.15.37:0/2111326742 shutdown_connections 2024-08-31T06:48:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.853+0000 7fe3f42d2640 1 -- 172.21.15.37:0/2111326742 wait complete. 2024-08-31T06:48:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f42d2640 1 Processor -- start 2024-08-31T06:48:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f42d2640 1 -- start start 2024-08-31T06:48:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f42d2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3ec0754f0 0x7fe3ec1059f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f42d2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3ec075e40 0x7fe3ec105f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f42d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10ff90 0x7fe3ec106470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f42d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec115910 con 0x7fe3ec10ff90 2024-08-31T06:48:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f42d2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec115790 con 0x7fe3ec075e40 2024-08-31T06:48:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f42d2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec115a90 con 0x7fe3ec0754f0 2024-08-31T06:48:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3ec0754f0 0x7fe3ec1059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3ec0754f0 0x7fe3ec1059f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51674/0 (socket says 172.21.15.37:51674) 2024-08-31T06:48:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f206e640 1 -- 172.21.15.37:0/3895148708 learned_addr learned my addr 172.21.15.37:0/3895148708 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f186d640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3ec075e40 0x7fe3ec105f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.854+0000 7fe3f286f640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10ff90 0x7fe3ec106470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.855+0000 7fe3f206e640 1 -- 172.21.15.37:0/3895148708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3ec075e40 msgr2=0x7fe3ec105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.855+0000 7fe3f206e640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3ec075e40 0x7fe3ec105f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.855+0000 7fe3f206e640 1 -- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10ff90 msgr2=0x7fe3ec106470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.855+0000 7fe3f206e640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10ff90 0x7fe3ec106470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.855+0000 7fe3f206e640 1 -- 172.21.15.37:0/3895148708 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec1ac820 con 0x7fe3ec0754f0 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.855+0000 7fe3f206e640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3ec0754f0 0x7fe3ec1059f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009230 tx=0x7fe3e80319a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.855+0000 7fe3e37fe640 1 -- 172.21.15.37:0/3895148708 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e803f030 con 0x7fe3ec0754f0 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.855+0000 7fe3e37fe640 1 -- 172.21.15.37:0/3895148708 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e80043d0 con 0x7fe3ec0754f0 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.856+0000 7fe3f42d2640 1 -- 172.21.15.37:0/3895148708 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ec1acab0 con 0x7fe3ec0754f0 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.856+0000 7fe3e37fe640 1 -- 172.21.15.37:0/3895148708 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8035070 con 0x7fe3ec0754f0 2024-08-31T06:48:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.856+0000 7fe3f42d2640 1 -- 172.21.15.37:0/3895148708 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3ec1acfe0 con 0x7fe3ec0754f0 2024-08-31T06:48:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.859+0000 7fe3e37fe640 1 -- 172.21.15.37:0/3895148708 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fe3e8042030 con 0x7fe3ec0754f0 2024-08-31T06:48:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.860+0000 7fe3fa847740 1 Processor -- start 2024-08-31T06:48:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.860+0000 7fe3fa847740 1 -- start start 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.860+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5918c070 0x55df59531310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.860+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df591631b0 0x55df59531850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.860+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5916b390 0x55df59531d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.860+0000 7fe3fa847740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df594a8680 con 0x55df591631b0 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.860+0000 7fe3fa847740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55df59497c10 con 0x55df5918c070 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.860+0000 7fe3fa847740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55df5949bbc0 con 0x55df5916b390 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df591631b0 0x55df59531850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df591631b0 0x55df59531850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59666/0 (socket says 172.21.15.37:59666) 2024-08-31T06:48:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f206e640 1 -- 172.21.15.37:0/2735584677 learned_addr learned my addr 172.21.15.37:0/2735584677 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f286f640 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5918c070 0x55df59531310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f186d640 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5916b390 0x55df59531d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3e37fe640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3d80b4d20 0x7fe3d80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f286f640 1 -- 172.21.15.37:0/2735584677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5916b390 msgr2=0x55df59531d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f286f640 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5916b390 0x55df59531d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f286f640 1 -- 172.21.15.37:0/2735584677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df591631b0 msgr2=0x55df59531850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f286f640 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df591631b0 0x55df59531850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f286f640 1 -- 172.21.15.37:0/2735584677 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df591f7650 con 0x55df5918c070 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.861+0000 7fe3f286f640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3d80b4d20 0x7fe3d80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.862+0000 7fe3e37fe640 1 -- 172.21.15.37:0/3895148708 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe3e81058a0 con 0x7fe3ec0754f0 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.862+0000 7fe3f286f640 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5918c070 0x55df59531310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4010420 tx=0x7fe3e40108e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af6a44a515db07d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.862+0000 7fe3e0d9a640 1 -- 172.21.15.37:0/2735584677 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4013b40 con 0x55df5918c070 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.862+0000 7fe3e0d9a640 1 -- 172.21.15.37:0/2735584677 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e401ee50 con 0x55df5918c070 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.862+0000 7fe3e0d9a640 1 -- 172.21.15.37:0/2735584677 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40055f0 con 0x55df5918c070 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3fa847740 1 -- 172.21.15.37:0/2735584677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5918c070 msgr2=0x55df59531310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3f286f640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3d80b4d20 0x7fe3d80b7230 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4020040 tx=0x7fe3e401a000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5918c070 0x55df59531310 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4010420 tx=0x7fe3e40108e0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3fa847740 1 -- 172.21.15.37:0/2735584677 shutdown_connections 2024-08-31T06:48:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df591631b0 0x55df59531850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5916b390 0x55df59531d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2735584677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5918c070 0x55df59531310 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3fa847740 1 -- 172.21.15.37:0/2735584677 >> 172.21.15.37:0/2735584677 conn(0x55df59180460 msgr2=0x55df5952f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.863+0000 7fe3fa847740 1 -- 172.21.15.37:0/2735584677 shutdown_connections 2024-08-31T06:48:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.864+0000 7fe3fa847740 1 -- 172.21.15.37:0/2735584677 wait complete. 2024-08-31T06:48:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.864+0000 7fe3fa847740 1 -- start start 2024-08-31T06:48:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.864+0000 7fe3fa847740 1 Processor -- start 2024-08-31T06:48:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df591631b0 0x55df5953ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5916b390 0x55df5953cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5918c070 0x55df59548de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3fa847740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df592fa700 con 0x55df5916b390 2024-08-31T06:48:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df591631b0 0x55df5953ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df591631b0 0x55df5953ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33726/0 (socket says 172.21.15.37:33726) 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3f206e640 1 -- 172.21.15.37:0/2125074526 learned_addr learned my addr 172.21.15.37:0/2125074526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3f286f640 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5918c070 0x55df59548de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.865+0000 7fe3f186d640 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5916b390 0x55df5953cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55df5941e750 con 0x55df591631b0 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55df5953faf0 con 0x55df5918c070 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3fa847740 10 client.0 _ll_register_callbacks cb 0x55df5944de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3f206e640 1 -- 172.21.15.37:0/2125074526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5918c070 msgr2=0x55df59548de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3f206e640 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5918c070 0x55df59548de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3f206e640 1 -- 172.21.15.37:0/2125074526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5916b390 msgr2=0x55df5953cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3f206e640 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5916b390 0x55df5953cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3f206e640 1 -- 172.21.15.37:0/2125074526 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df59457900 con 0x55df591631b0 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3f206e640 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df591631b0 0x55df5953ca10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80d2fa0 tx=0x7fe3e8103530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b0b8908b87594ff server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:49.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.866+0000 7fe3d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:48:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.867+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/2125074526 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8049040 con 0x55df591631b0 2024-08-31T06:48:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.867+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e401ee50 con 0x55df591631b0 2024-08-31T06:48:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.867+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/2125074526 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe3e80d5060 con 0x55df591631b0 2024-08-31T06:48:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.867+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/2125074526 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3e80cb920 con 0x55df591631b0 2024-08-31T06:48:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.867+0000 7fe3fa847740 10 client.25649 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:49.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.867+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55df5954b840 con 0x55df591631b0 2024-08-31T06:48:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.867+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/2125074526 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e80f2020 con 0x55df591631b0 2024-08-31T06:48:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.868+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/2125074526 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe3e80d3bc0 con 0x55df591631b0 2024-08-31T06:48:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.868+0000 7fe3fa847740 10 client.25649 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.868+0000 7fe3fa847740 10 client.25649 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:48:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.868+0000 7fe3fa847740 20 client.25649 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:49.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.868+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55df5914a9f0 0x55df5954eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.868+0000 7fe3fa847740 4 client.25649 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.868+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df594aa5d0 con 0x55df5914a9f0 2024-08-31T06:48:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.868+0000 7fe3f186d640 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55df5914a9f0 0x55df5954eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.869+0000 7fe3f186d640 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55df5914a9f0 0x55df5954eca0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45f526952b9cb46d server_cookie=eb09a82b61dca24d in_seq=0 out_seq=0 2024-08-31T06:48:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.869+0000 7fe3d5ffb640 10 client.25649 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:48:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.870+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/2125074526 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df594aa5d0 con 0x55df5914a9f0 2024-08-31T06:48:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.870+0000 7fe3d5ffb640 10 client.25649 handle_command_reply: tid=0 2024-08-31T06:48:49.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.870+0000 7fe3fa847740 1 client.25649 shutdown 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.870+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df591631b0 msgr2=0x55df5953ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.870+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df591631b0 0x55df5953ca10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80d2fa0 tx=0x7fe3e8103530 comp rx=0 tx=0).stop 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.870+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 shutdown_connections 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.870+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55df5914a9f0 0x55df5954eca0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.871+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5916b390 0x55df5953cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.871+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df5918c070 0x55df59548de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.871+0000 7fe3fa847740 1 --2- 172.21.15.37:0/2125074526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df591631b0 0x55df5953ca10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.871+0000 7fe3d5ffb640 0 client.25649 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:48:49.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.871+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 >> 172.21.15.37:0/2125074526 conn(0x55df59180460 msgr2=0x55df595344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:49.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.871+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 shutdown_connections 2024-08-31T06:48:49.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.871+0000 7fe3fa847740 1 -- 172.21.15.37:0/2125074526 wait complete. 2024-08-31T06:48:49.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.871+0000 7fe3fa847740 20 client.25649 trim_cache size 0 max 16384 2024-08-31T06:48:49.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.894+0000 7fe3fa847740 1 Processor -- start 2024-08-31T06:48:49.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.894+0000 7fe3fa847740 1 -- start start 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.894+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df5952f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.894+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df59548ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.894+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 0x55df59534410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.894+0000 7fe3fa847740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1b8230 con 0x55df5914a9f0 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3fa847740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1b5b00 con 0x55df5916b390 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df5952f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df5952f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59674/0 (socket says 172.21.15.37:59674) 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f206e640 1 -- 172.21.15.37:0/752981424 learned_addr learned my addr 172.21.15.37:0/752981424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3fa847740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1b3950 con 0x55df591631b0 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f286f640 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 0x55df59534410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f186d640 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df59548ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f206e640 1 -- 172.21.15.37:0/752981424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 msgr2=0x55df59548ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f206e640 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df59548ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f206e640 1 -- 172.21.15.37:0/752981424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 msgr2=0x55df59534410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f206e640 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 0x55df59534410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f206e640 1 -- 172.21.15.37:0/752981424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df5953dcd0 con 0x55df5914a9f0 2024-08-31T06:48:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.895+0000 7fe3f186d640 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df59548ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.896+0000 7fe3f206e640 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df5952f270 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80cc050 tx=0x7fe3e81030e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961ef1ba3aa6b4f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.896+0000 7fe3d7fff640 1 -- 172.21.15.37:0/752981424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8049070 con 0x55df5914a9f0 2024-08-31T06:48:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.896+0000 7fe3d7fff640 1 -- 172.21.15.37:0/752981424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e80f2030 con 0x55df5914a9f0 2024-08-31T06:48:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.896+0000 7fe3d7fff640 1 -- 172.21.15.37:0/752981424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8079020 con 0x55df5914a9f0 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.898+0000 7fe3fa847740 1 -- 172.21.15.37:0/752981424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 msgr2=0x55df5952f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.898+0000 7fe3fa847740 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df5952f270 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80cc050 tx=0x7fe3e81030e0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.898+0000 7fe3fa847740 1 -- 172.21.15.37:0/752981424 shutdown_connections 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.898+0000 7fe3fa847740 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 0x55df59534410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.898+0000 7fe3fa847740 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df59548ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.898+0000 7fe3fa847740 1 --2- 172.21.15.37:0/752981424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df5952f270 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.898+0000 7fe3fa847740 1 -- 172.21.15.37:0/752981424 >> 172.21.15.37:0/752981424 conn(0x55df59180460 msgr2=0x55df5952eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.899+0000 7fe3fa847740 1 -- 172.21.15.37:0/752981424 shutdown_connections 2024-08-31T06:48:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.899+0000 7fe3fa847740 1 -- 172.21.15.37:0/752981424 wait complete. 2024-08-31T06:48:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.900+0000 7fe3fa847740 1 -- start start 2024-08-31T06:48:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.900+0000 7fe3fa847740 1 Processor -- start 2024-08-31T06:48:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.900+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df59540fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.900+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df595414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.900+0000 7fe3fa847740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 0x55df595b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3fa847740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1b3fc0 con 0x55df5914a9f0 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3fa847740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1b5430 con 0x55df5916b390 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3fa847740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe3ec1b4690 con 0x55df591631b0 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3fa847740 10 client.0 _ll_register_callbacks cb 0x7fe3e8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df59540fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f206e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df59540fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59680/0 (socket says 172.21.15.37:59680) 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f206e640 1 -- 172.21.15.37:0/1349521526 learned_addr learned my addr 172.21.15.37:0/1349521526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f286f640 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 0x55df595b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f186d640 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df595414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f206e640 1 -- 172.21.15.37:0/1349521526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 msgr2=0x55df595414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f206e640 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df595414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f206e640 1 -- 172.21.15.37:0/1349521526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 msgr2=0x55df595b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f206e640 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 0x55df595b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.901+0000 7fe3f206e640 1 -- 172.21.15.37:0/1349521526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df59541d10 con 0x55df5914a9f0 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.902+0000 7fe3f206e640 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df59540fb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80cb250 tx=0x7fe3e80b72c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55b7754ba84cb62 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.902+0000 7fe3d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.902+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/1349521526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80e6060 con 0x55df5914a9f0 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.902+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/1349521526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe3e80caca0 con 0x55df5914a9f0 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.902+0000 7fe3fa847740 1 -- 172.21.15.37:0/1349521526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e80f2030 con 0x55df5914a9f0 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.902+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/1349521526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3e8079070 con 0x55df5914a9f0 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.902+0000 7fe3fa847740 10 client.16155 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.902+0000 7fe3fa847740 1 -- 172.21.15.37:0/1349521526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55df59541d10 con 0x55df5914a9f0 2024-08-31T06:48:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/1349521526 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3e80f2030 con 0x55df5914a9f0 2024-08-31T06:48:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/1349521526 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe3e80d19d0 con 0x55df5914a9f0 2024-08-31T06:48:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3fa847740 10 client.16155 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3fa847740 10 client.16155 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:48:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3fa847740 20 client.16155 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3fa847740 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55df5918c070 0x55df595bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3fa847740 4 client.16155 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3fa847740 1 -- 172.21.15.37:0/1349521526 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df594a6070 con 0x55df5918c070 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.903+0000 7fe3f186d640 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55df5918c070 0x55df595bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.904+0000 7fe3d5ffb640 10 client.16155 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.904+0000 7fe3f186d640 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55df5918c070 0x55df595bbe80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e53e1b728c0343e1 server_cookie=6574bfe311f250ee in_seq=0 out_seq=0 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.904+0000 7fe3d5ffb640 1 -- 172.21.15.37:0/1349521526 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df594a6070 con 0x55df5918c070 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.904+0000 7fe3d5ffb640 10 client.16155 handle_command_reply: tid=0 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.904+0000 7fe3fa847740 1 client.16155 shutdown 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 -- 172.21.15.37:0/1349521526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 msgr2=0x55df59540fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df59540fb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe3e80cb250 tx=0x7fe3e80b72c0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 -- 172.21.15.37:0/1349521526 shutdown_connections 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55df5918c070 0x55df595bbe80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55df5916b390 0x55df595b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3d5ffb640 0 client.16155 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:48:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55df591631b0 0x55df595414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 --2- 172.21.15.37:0/1349521526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df5914a9f0 0x55df59540fb0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 -- 172.21.15.37:0/1349521526 >> 172.21.15.37:0/1349521526 conn(0x55df59180460 msgr2=0x55df59534410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 -- 172.21.15.37:0/1349521526 shutdown_connections 2024-08-31T06:48:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 1 -- 172.21.15.37:0/1349521526 wait complete. 2024-08-31T06:48:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.905+0000 7fe3fa847740 20 client.16155 trim_cache size 0 max 16384 2024-08-31T06:48:49.909 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.906+0000 7fe3f42d2640 1 -- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3d80b4d20 msgr2=0x7fe3d80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.906+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3d80b4d20 0x7fe3d80b7230 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4020040 tx=0x7fe3e401a000 comp rx=0 tx=0).stop 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.906+0000 7fe3f42d2640 1 -- 172.21.15.37:0/3895148708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3ec0754f0 msgr2=0x7fe3ec1059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.906+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3ec0754f0 0x7fe3ec1059f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009230 tx=0x7fe3e80319a0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.907+0000 7fe3f42d2640 1 -- 172.21.15.37:0/3895148708 shutdown_connections 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.907+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe3d80b4d20 0x7fe3d80b7230 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.907+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3ec10ff90 0x7fe3ec106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.907+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3ec075e40 0x7fe3ec105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.907+0000 7fe3f42d2640 1 --2- 172.21.15.37:0/3895148708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3ec0754f0 0x7fe3ec1059f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.907+0000 7fe3f42d2640 1 -- 172.21.15.37:0/3895148708 >> 172.21.15.37:0/3895148708 conn(0x7fe3ec07b670 msgr2=0x7fe3ec109b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:49.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.907+0000 7fe3f42d2640 1 -- 172.21.15.37:0/3895148708 shutdown_connections 2024-08-31T06:48:49.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:49.907+0000 7fe3f42d2640 1 -- 172.21.15.37:0/3895148708 wait complete. 2024-08-31T06:48:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:49 smithi106 ceph-mon[22134]: pgmap v379: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 3.83k op/s 2024-08-31T06:48:50.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:49 smithi037 ceph-mon[18612]: pgmap v379: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 3.83k op/s 2024-08-31T06:48:50.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:49 smithi066 ceph-mon[22244]: pgmap v379: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 17 MiB/s wr, 3.83k op/s 2024-08-31T06:48:50.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:48:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.628+0000 7f4316253640 1 -- 172.21.15.37:0/1708404913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4310103930 msgr2=0x7f4310103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.628+0000 7f4316253640 1 --2- 172.21.15.37:0/1708404913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4310103930 0x7f4310103d40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4300009900 tx=0x7f430002a410 comp rx=0 tx=0).stop 2024-08-31T06:48:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.628+0000 7f4316253640 1 -- 172.21.15.37:0/1708404913 shutdown_connections 2024-08-31T06:48:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.628+0000 7f4316253640 1 --2- 172.21.15.37:0/1708404913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4310109bc0 0x7f43101103f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.628+0000 7f4316253640 1 --2- 172.21.15.37:0/1708404913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4310109270 0x7f4310109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.628+0000 7f4316253640 1 --2- 172.21.15.37:0/1708404913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4310103930 0x7f4310103d40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.628+0000 7f4316253640 1 -- 172.21.15.37:0/1708404913 >> 172.21.15.37:0/1708404913 conn(0x7f43100ff380 msgr2=0x7f43101017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:51.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.629+0000 7f4316253640 1 -- 172.21.15.37:0/1708404913 shutdown_connections 2024-08-31T06:48:51.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.629+0000 7f4316253640 1 -- 172.21.15.37:0/1708404913 wait complete. 2024-08-31T06:48:51.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.630+0000 7f4316253640 1 Processor -- start 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.630+0000 7f4316253640 1 -- start start 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.630+0000 7f4316253640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4310103930 0x7f43101a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.630+0000 7f4316253640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4310109270 0x7f43101a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.630+0000 7f4316253640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4310109bc0 0x7f43101ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f4316253640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4310113730 con 0x7f4310103930 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f4316253640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43101135b0 con 0x7f4310109bc0 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f4316253640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f43101138b0 con 0x7f4310109270 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4310109bc0 0x7f43101ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4310109bc0 0x7f43101ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33762/0 (socket says 172.21.15.37:33762) 2024-08-31T06:48:51.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 -- 172.21.15.37:0/2085931162 learned_addr learned my addr 172.21.15.37:0/2085931162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:51.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430effd640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4310109270 0x7f43101a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 -- 172.21.15.37:0/2085931162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4310109270 msgr2=0x7f43101a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4310109270 0x7f43101a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 -- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4310103930 msgr2=0x7f43101a1410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4310103930 0x7f43101a1410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 -- 172.21.15.37:0/2085931162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43101a2230 con 0x7f4310109bc0 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.631+0000 7f430ffff640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4310109bc0 0x7f43101ac490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f430800eb10 tx=0x7f430800c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.632+0000 7f430cff9640 1 -- 172.21.15.37:0/2085931162 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308004b20 con 0x7f4310109bc0 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.632+0000 7f430cff9640 1 -- 172.21.15.37:0/2085931162 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4308004cc0 con 0x7f4310109bc0 2024-08-31T06:48:51.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.632+0000 7f430cff9640 1 -- 172.21.15.37:0/2085931162 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308010690 con 0x7f4310109bc0 2024-08-31T06:48:51.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.632+0000 7f4316253640 1 -- 172.21.15.37:0/2085931162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43101acaf0 con 0x7f4310109bc0 2024-08-31T06:48:51.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.632+0000 7f4316253640 1 -- 172.21.15.37:0/2085931162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43101acf80 con 0x7f4310109bc0 2024-08-31T06:48:51.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.636+0000 7f430cff9640 1 -- 172.21.15.37:0/2085931162 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f4308005000 con 0x7f4310109bc0 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.636+0000 7f431c7c8740 1 Processor -- start 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f431c7c8740 1 -- start start 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f430cff9640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42f80b4da0 0x7f42f80b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dbdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f431c7c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561510d34680 con 0x561510a18070 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f431c7c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561510d23c10 con 0x5615109f7390 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f431c7c8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561510d27bc0 con 0x5615109ef1b0 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f430ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dbdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f430ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dbdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33768/0 (socket says 172.21.15.37:33768) 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f430ffff640 1 -- 172.21.15.37:0/3241427036 learned_addr learned my addr 172.21.15.37:0/3241427036 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:51.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.637+0000 7f430f7fe640 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430effd640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42f80b4da0 0x7f42f80b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430effd640 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430ffff640 1 -- 172.21.15.37:0/3241427036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 msgr2=0x561510dbd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:51.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430ffff640 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430ffff640 1 -- 172.21.15.37:0/3241427036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 msgr2=0x561510dbd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:51.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430ffff640 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430ffff640 1 -- 172.21.15.37:0/3241427036 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561510a83650 con 0x5615109f7390 2024-08-31T06:48:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430f7fe640 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.638+0000 7f430ffff640 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dbdd90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43080e3260 tx=0x7f43080a7fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d37c5f97c70536e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.639+0000 7f42f5ffb640 1 -- 172.21.15.37:0/3241427036 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43080a7a50 con 0x5615109f7390 2024-08-31T06:48:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.639+0000 7f42f5ffb640 1 -- 172.21.15.37:0/3241427036 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43080d0af0 con 0x5615109f7390 2024-08-31T06:48:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.639+0000 7f42f5ffb640 1 -- 172.21.15.37:0/3241427036 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43080aa880 con 0x5615109f7390 2024-08-31T06:48:51.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.639+0000 7f430cff9640 1 -- 172.21.15.37:0/2085931162 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f43080e5bf0 con 0x7f4310109bc0 2024-08-31T06:48:51.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.640+0000 7f430effd640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42f80b4da0 0x7f42f80b72b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x561510dbbf90 tx=0x7f4304009850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:51.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.640+0000 7f431c7c8740 1 -- 172.21.15.37:0/3241427036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 msgr2=0x561510dbdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.640+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dbdd90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43080e3260 tx=0x7f43080a7fb0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.641+0000 7f431c7c8740 1 -- 172.21.15.37:0/3241427036 shutdown_connections 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.641+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dbdd90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.641+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.641+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3241427036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.641+0000 7f431c7c8740 1 -- 172.21.15.37:0/3241427036 >> 172.21.15.37:0/3241427036 conn(0x561510a0c460 msgr2=0x561510dbb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.641+0000 7f431c7c8740 1 -- 172.21.15.37:0/3241427036 shutdown_connections 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.641+0000 7f431c7c8740 1 -- 172.21.15.37:0/3241427036 wait complete. 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.641+0000 7f431c7c8740 1 -- start start 2024-08-31T06:48:51.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.642+0000 7f431c7c8740 1 Processor -- start 2024-08-31T06:48:51.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.642+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109ef1b0 0x561510dc8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.642+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109f7390 0x561510dc9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.642+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dd4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f430effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109f7390 0x561510dc9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f430effd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109f7390 0x561510dc9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51746/0 (socket says 172.21.15.37:51746) 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f430effd640 1 -- 172.21.15.37:0/2687205195 learned_addr learned my addr 172.21.15.37:0/2687205195 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f430f7fe640 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109ef1b0 0x561510dc8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f430ffff640 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dd4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561510b86700 con 0x561510a18070 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561510caa750 con 0x5615109ef1b0 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561510dcbaf0 con 0x5615109f7390 2024-08-31T06:48:51.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.643+0000 7f431c7c8740 10 client.0 _ll_register_callbacks cb 0x561510cd9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.644+0000 7f430f7fe640 1 -- 172.21.15.37:0/2687205195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109f7390 msgr2=0x561510dc9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:51.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.644+0000 7f430f7fe640 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109f7390 0x561510dc9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.644+0000 7f430f7fe640 1 -- 172.21.15.37:0/2687205195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 msgr2=0x561510dd4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.644+0000 7f430f7fe640 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dd4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.644+0000 7f430f7fe640 1 -- 172.21.15.37:0/2687205195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561510ce3900 con 0x5615109ef1b0 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.644+0000 7f430f7fe640 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109ef1b0 0x561510dc8ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4300005ab0 tx=0x7f4300004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef9786b6cbc05dcc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.644+0000 7f42eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.645+0000 7f42eeffd640 1 -- 172.21.15.37:0/2687205195 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300035020 con 0x5615109ef1b0 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.645+0000 7f42eeffd640 1 -- 172.21.15.37:0/2687205195 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f43000046c0 con 0x5615109ef1b0 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.645+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43080d0af0 con 0x5615109ef1b0 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.645+0000 7f42eeffd640 1 -- 172.21.15.37:0/2687205195 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4300005df0 con 0x5615109ef1b0 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.645+0000 7f431c7c8740 10 client.25667 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.645+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561510dd7890 con 0x5615109ef1b0 2024-08-31T06:48:51.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.646+0000 7f42eeffd640 1 -- 172.21.15.37:0/2687205195 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43080d0af0 con 0x5615109ef1b0 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.646+0000 7f42eeffd640 1 -- 172.21.15.37:0/2687205195 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f430003a040 con 0x5615109ef1b0 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.646+0000 7f431c7c8740 10 client.25667 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.646+0000 7f431c7c8740 10 client.25667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.646+0000 7f431c7c8740 20 client.25667 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.646+0000 7f431c7c8740 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5615109d69f0 0x561510ddb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.647+0000 7f431c7c8740 4 client.25667 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.647+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561510d365d0 con 0x5615109d69f0 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.647+0000 7f430effd640 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5615109d69f0 0x561510ddb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.647+0000 7f430effd640 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5615109d69f0 0x561510ddb190 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=badc4508bb025c77 server_cookie=f7ad1444296ab97e in_seq=0 out_seq=0 2024-08-31T06:48:51.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.647+0000 7f42eeffd640 10 client.25667 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.648+0000 7f42eeffd640 1 -- 172.21.15.37:0/2687205195 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561510d365d0 con 0x5615109d69f0 2024-08-31T06:48:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.648+0000 7f42eeffd640 10 client.25667 handle_command_reply: tid=0 2024-08-31T06:48:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 client.25667 shutdown 2024-08-31T06:48:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109ef1b0 msgr2=0x561510dc8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109ef1b0 0x561510dc8ad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4300005ab0 tx=0x7f4300004270 comp rx=0 tx=0).stop 2024-08-31T06:48:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 shutdown_connections 2024-08-31T06:48:51.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5615109d69f0 0x561510ddb190 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dd4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109f7390 0x561510dc9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 --2- 172.21.15.37:0/2687205195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109ef1b0 0x561510dc8ad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.649+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 >> 172.21.15.37:0/2687205195 conn(0x561510a0c460 msgr2=0x561510dbe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.650+0000 7f42eeffd640 0 client.25667 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.650+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 shutdown_connections 2024-08-31T06:48:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.650+0000 7f431c7c8740 1 -- 172.21.15.37:0/2687205195 wait complete. 2024-08-31T06:48:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.650+0000 7f431c7c8740 20 client.25667 trim_cache size 0 max 16384 2024-08-31T06:48:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.673+0000 7f431c7c8740 1 Processor -- start 2024-08-31T06:48:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.673+0000 7f431c7c8740 1 -- start start 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.673+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.673+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dd4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430f7fe640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51754/0 (socket says 172.21.15.37:51754) 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f431c7c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43101b8350 con 0x561510a18070 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f431c7c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43101b5c20 con 0x5615109f7390 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f431c7c8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f43101b3a70 con 0x5615109ef1b0 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dd4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dd4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33800/0 (socket says 172.21.15.37:33800) 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430effd640 1 -- 172.21.15.37:0/1847874348 learned_addr learned my addr 172.21.15.37:0/1847874348 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430ffff640 1 --2- 172.21.15.37:0/1847874348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430effd640 1 -- 172.21.15.37:0/1847874348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 msgr2=0x561510dbea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430effd640 1 --2- 172.21.15.37:0/1847874348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430effd640 1 -- 172.21.15.37:0/1847874348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 msgr2=0x561510dbab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430effd640 1 --2- 172.21.15.37:0/1847874348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.674+0000 7f430effd640 1 -- 172.21.15.37:0/1847874348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561510dc9d90 con 0x5615109f7390 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.675+0000 7f430effd640 1 --2- 172.21.15.37:0/1847874348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dd4d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4304009f70 tx=0x7f4304013070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21b34f307f8fed6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.675+0000 7f42f57fa640 1 -- 172.21.15.37:0/1847874348 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430400fc00 con 0x5615109f7390 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.675+0000 7f42f57fa640 1 -- 172.21.15.37:0/1847874348 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f430400fda0 con 0x5615109f7390 2024-08-31T06:48:51.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.675+0000 7f42f57fa640 1 -- 172.21.15.37:0/1847874348 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304003970 con 0x5615109f7390 2024-08-31T06:48:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.676+0000 7f431c7c8740 1 -- 172.21.15.37:0/1847874348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 msgr2=0x561510dd4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.676+0000 7f431c7c8740 1 --2- 172.21.15.37:0/1847874348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dd4d10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4304009f70 tx=0x7f4304013070 comp rx=0 tx=0).stop 2024-08-31T06:48:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.676+0000 7f431c7c8740 1 -- 172.21.15.37:0/1847874348 shutdown_connections 2024-08-31T06:48:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.676+0000 7f431c7c8740 1 --2- 172.21.15.37:0/1847874348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dbab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.676+0000 7f431c7c8740 1 --2- 172.21.15.37:0/1847874348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dd4d10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.676+0000 7f431c7c8740 1 --2- 172.21.15.37:0/1847874348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dbea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.676+0000 7f431c7c8740 1 -- 172.21.15.37:0/1847874348 >> 172.21.15.37:0/1847874348 conn(0x561510a0c460 msgr2=0x561510dbe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.677+0000 7f431c7c8740 1 -- 172.21.15.37:0/1847874348 shutdown_connections 2024-08-31T06:48:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.677+0000 7f431c7c8740 1 -- 172.21.15.37:0/1847874348 wait complete. 2024-08-31T06:48:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.677+0000 7f431c7c8740 1 -- start start 2024-08-31T06:48:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.678+0000 7f431c7c8740 1 Processor -- start 2024-08-31T06:48:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.678+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.678+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dcd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.678+0000 7f431c7c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dcd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.678+0000 7f431c7c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f43101b40e0 con 0x561510a18070 2024-08-31T06:48:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.678+0000 7f431c7c8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f43101b5550 con 0x5615109f7390 2024-08-31T06:48:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.678+0000 7f431c7c8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f43101b47b0 con 0x5615109ef1b0 2024-08-31T06:48:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.678+0000 7f431c7c8740 10 client.0 _ll_register_callbacks cb 0x7f43080093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dcd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dcd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59710/0 (socket says 172.21.15.37:59710) 2024-08-31T06:48:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430ffff640 1 -- 172.21.15.37:0/3404333486 learned_addr learned my addr 172.21.15.37:0/3404333486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430f7fe640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430ffff640 1 -- 172.21.15.37:0/3404333486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 msgr2=0x561510dccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430effd640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dcd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430ffff640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430ffff640 1 -- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 msgr2=0x561510dcd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430ffff640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dcd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.679+0000 7f430ffff640 1 -- 172.21.15.37:0/3404333486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561510e44cf0 con 0x561510a18070 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.680+0000 7f430ffff640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dcd960 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f43080abfc0 tx=0x7f430800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b4e0ff616f426a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.680+0000 7f42eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.680+0000 7f42eeffd640 1 -- 172.21.15.37:0/3404333486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43080aac00 con 0x561510a18070 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.680+0000 7f42eeffd640 1 -- 172.21.15.37:0/3404333486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f43080ceeb0 con 0x561510a18070 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f431c7c8740 1 -- 172.21.15.37:0/3404333486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f430400fda0 con 0x561510a18070 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f430f7fe640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f42eeffd640 1 -- 172.21.15.37:0/3404333486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f43080aadd0 con 0x561510a18070 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f431c7c8740 10 client.16170 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:51.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f431c7c8740 1 -- 172.21.15.37:0/3404333486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561510e45f50 con 0x561510a18070 2024-08-31T06:48:51.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f430effd640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dcd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f42eeffd640 1 -- 172.21.15.37:0/3404333486 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43080cda30 con 0x561510a18070 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f42eeffd640 1 -- 172.21.15.37:0/3404333486 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f43080052f0 con 0x561510a18070 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f431c7c8740 10 client.16170 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.681+0000 7f431c7c8740 10 client.16170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.682+0000 7f431c7c8740 20 client.16170 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.682+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5615109abda0 0x561510e48240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.682+0000 7f431c7c8740 4 client.16170 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.682+0000 7f431c7c8740 1 -- 172.21.15.37:0/3404333486 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f430400fda0 con 0x5615109abda0 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.682+0000 7f430f7fe640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5615109abda0 0x561510e48240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.683+0000 7f42eeffd640 10 client.16170 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:51.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.683+0000 7f430f7fe640 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5615109abda0 0x561510e48240 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71fec258d11975e7 server_cookie=776321d6bcfa8fdb in_seq=0 out_seq=0 2024-08-31T06:48:51.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.683+0000 7f42eeffd640 1 -- 172.21.15.37:0/3404333486 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f430400fda0 con 0x5615109abda0 2024-08-31T06:48:51.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.683+0000 7f42eeffd640 10 client.16170 handle_command_reply: tid=0 2024-08-31T06:48:51.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.683+0000 7f431c7c8740 1 client.16170 shutdown 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.683+0000 7f431c7c8740 1 -- 172.21.15.37:0/3404333486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 msgr2=0x561510dcd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.683+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dcd960 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f43080abfc0 tx=0x7f430800cee0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.683+0000 7f431c7c8740 1 -- 172.21.15.37:0/3404333486 shutdown_connections 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5615109abda0 0x561510e48240 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f42eeffd640 0 client.16170 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561510a18070 0x561510dcd960 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5615109f7390 0x561510dcd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f431c7c8740 1 --2- 172.21.15.37:0/3404333486 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5615109ef1b0 0x561510dccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f431c7c8740 1 -- 172.21.15.37:0/3404333486 >> 172.21.15.37:0/3404333486 conn(0x561510a0c460 msgr2=0x561510dbe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:51.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f431c7c8740 1 -- 172.21.15.37:0/3404333486 shutdown_connections 2024-08-31T06:48:51.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f431c7c8740 1 -- 172.21.15.37:0/3404333486 wait complete. 2024-08-31T06:48:51.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.684+0000 7f431c7c8740 20 client.16170 trim_cache size 0 max 16384 2024-08-31T06:48:51.688 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 -- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42f80b4da0 msgr2=0x7f42f80b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42f80b4da0 0x7f42f80b72b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x561510dbbf90 tx=0x7f4304009850 comp rx=0 tx=0).stop 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 -- 172.21.15.37:0/2085931162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4310109bc0 msgr2=0x7f43101ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4310109bc0 0x7f43101ac490 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f430800eb10 tx=0x7f430800c2d0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 -- 172.21.15.37:0/2085931162 shutdown_connections 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f42f80b4da0 0x7f42f80b72b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4310109bc0 0x7f43101ac490 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4310109270 0x7f43101a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 --2- 172.21.15.37:0/2085931162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4310103930 0x7f43101a1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 -- 172.21.15.37:0/2085931162 >> 172.21.15.37:0/2085931162 conn(0x7f43100ff380 msgr2=0x7f43100ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 -- 172.21.15.37:0/2085931162 shutdown_connections 2024-08-31T06:48:51.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:51.685+0000 7f4316253640 1 -- 172.21.15.37:0/2085931162 wait complete. 2024-08-31T06:48:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:51 smithi106 ceph-mon[22134]: pgmap v380: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.19k op/s 2024-08-31T06:48:52.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:51 smithi037 ceph-mon[18612]: pgmap v380: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.19k op/s 2024-08-31T06:48:52.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:51 smithi066 ceph-mon[22244]: pgmap v380: 97 pgs: 97 active+clean; 259 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 4.19k op/s 2024-08-31T06:48:53.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:53 smithi037 ceph-mon[18612]: pgmap v381: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 3.92k op/s 2024-08-31T06:48:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:53 smithi106 ceph-mon[22134]: pgmap v381: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 3.92k op/s 2024-08-31T06:48:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:53 smithi066 ceph-mon[22244]: pgmap v381: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 MiB/s wr, 3.92k op/s 2024-08-31T06:48:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.308+0000 7fe8c4d12640 1 -- 172.21.15.37:0/2682688662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8c0109af0 msgr2=0x7fe8c0110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.308+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/2682688662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8c0109af0 0x7fe8c0110320 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009ca0 tx=0x7fe8b802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.309+0000 7fe8c4d12640 1 -- 172.21.15.37:0/2682688662 shutdown_connections 2024-08-31T06:48:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.309+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/2682688662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8c0109af0 0x7fe8c0110320 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.309+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/2682688662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8c01091a0 0x7fe8c01095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.309+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/2682688662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8c0103870 0x7fe8c0103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.309+0000 7fe8c4d12640 1 -- 172.21.15.37:0/2682688662 >> 172.21.15.37:0/2682688662 conn(0x7fe8c00ff2b0 msgr2=0x7fe8c0101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.309+0000 7fe8c4d12640 1 -- 172.21.15.37:0/2682688662 shutdown_connections 2024-08-31T06:48:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.309+0000 7fe8c4d12640 1 -- 172.21.15.37:0/2682688662 wait complete. 2024-08-31T06:48:55.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.310+0000 7fe8c4d12640 1 Processor -- start 2024-08-31T06:48:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.310+0000 7fe8c4d12640 1 -- start start 2024-08-31T06:48:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.310+0000 7fe8c4d12640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8c0103870 0x7fe8c019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.310+0000 7fe8c4d12640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8c01091a0 0x7fe8c019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8c4d12640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8c0109af0 0x7fe8c019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8c0103870 0x7fe8c019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8c0103870 0x7fe8c019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:35288/0 (socket says 172.21.15.37:35288) 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8be59c640 1 -- 172.21.15.37:0/3291355041 learned_addr learned my addr 172.21.15.37:0/3291355041 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0113670 con 0x7fe8c01091a0 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01134f0 con 0x7fe8c0103870 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01137f0 con 0x7fe8c0109af0 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8c0109af0 0x7fe8c019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8c01091a0 0x7fe8c019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8bed9d640 1 -- 172.21.15.37:0/3291355041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8c0103870 msgr2=0x7fe8c019a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8c0103870 0x7fe8c019a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8bed9d640 1 -- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8c01091a0 msgr2=0x7fe8c019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8c01091a0 0x7fe8c019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8bed9d640 1 -- 172.21.15.37:0/3291355041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c019ffe0 con 0x7fe8c0109af0 2024-08-31T06:48:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.311+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8c0109af0 0x7fe8c019f8e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8031040 tx=0x7fe8b8003f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.312+0000 7fe8af7fe640 1 -- 172.21.15.37:0/3291355041 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8032c10 con 0x7fe8c0109af0 2024-08-31T06:48:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.312+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c01a0270 con 0x7fe8c0109af0 2024-08-31T06:48:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.312+0000 7fe8af7fe640 1 -- 172.21.15.37:0/3291355041 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8b8032db0 con 0x7fe8c0109af0 2024-08-31T06:48:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.312+0000 7fe8af7fe640 1 -- 172.21.15.37:0/3291355041 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8030a20 con 0x7fe8c0109af0 2024-08-31T06:48:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.312+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c01a6a60 con 0x7fe8c0109af0 2024-08-31T06:48:55.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.315+0000 7fe8cbc7a740 1 Processor -- start 2024-08-31T06:48:55.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.317+0000 7fe8af7fe640 1 -- 172.21.15.37:0/3291355041 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fe8b8030bc0 con 0x7fe8c0109af0 2024-08-31T06:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8cbc7a740 1 -- start start 2024-08-31T06:48:55.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8af7fe640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe8a80b4dd0 0x7fe8a80b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d87f1b0 0x55985dc22ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d8562f0 0x55985dc23220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d85e4d0 0x55985dc23760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8cbc7a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55985db98000 con 0x55985d87f1b0 2024-08-31T06:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8cbc7a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55985db87590 con 0x55985d8562f0 2024-08-31T06:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8cbc7a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55985db8b540 con 0x55985d85e4d0 2024-08-31T06:48:55.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.318+0000 7fe8af7fe640 1 -- 172.21.15.37:0/3291355041 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe8b8106580 con 0x7fe8c0109af0 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d87f1b0 0x55985dc22ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d87f1b0 0x55985dc22ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57782/0 (socket says 172.21.15.37:57782) 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8be59c640 1 -- 172.21.15.37:0/1497959519 learned_addr learned my addr 172.21.15.37:0/1497959519 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d8562f0 0x55985dc23220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d85e4d0 0x55985dc23760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe8a80b4dd0 0x7fe8a80b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8bdd9b640 1 -- 172.21.15.37:0/1497959519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d85e4d0 msgr2=0x55985dc23760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d85e4d0 0x55985dc23760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8bdd9b640 1 -- 172.21.15.37:0/1497959519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d87f1b0 msgr2=0x55985dc22ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d87f1b0 0x55985dc22ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8bdd9b640 1 -- 172.21.15.37:0/1497959519 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985d8ea790 con 0x55985d8562f0 2024-08-31T06:48:55.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.319+0000 7fe8be59c640 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d87f1b0 0x55985dc22ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.320+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d8562f0 0x55985dc23220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8c006c390 tx=0x7fe8b400e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc959d67b2ced8c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.320+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe8a80b4dd0 0x7fe8a80b72e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe8c006c620 tx=0x7fe8b4015000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.320+0000 7fe8acff9640 1 -- 172.21.15.37:0/1497959519 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4026070 con 0x55985d8562f0 2024-08-31T06:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.320+0000 7fe8acff9640 1 -- 172.21.15.37:0/1497959519 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8b40098c0 con 0x55985d8562f0 2024-08-31T06:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.320+0000 7fe8acff9640 1 -- 172.21.15.37:0/1497959519 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40035f0 con 0x55985d8562f0 2024-08-31T06:48:55.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.321+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/1497959519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d8562f0 msgr2=0x55985dc23220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.321+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d8562f0 0x55985dc23220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8c006c390 tx=0x7fe8b400e720 comp rx=0 tx=0).stop 2024-08-31T06:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.321+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/1497959519 shutdown_connections 2024-08-31T06:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.321+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d85e4d0 0x55985dc23760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.321+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d8562f0 0x55985dc23220 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.321+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/1497959519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d87f1b0 0x55985dc22ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.321+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/1497959519 >> 172.21.15.37:0/1497959519 conn(0x55985d873300 msgr2=0x55985dc20bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.321+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/1497959519 shutdown_connections 2024-08-31T06:48:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.322+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/1497959519 wait complete. 2024-08-31T06:48:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.322+0000 7fe8cbc7a740 1 -- start start 2024-08-31T06:48:55.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.322+0000 7fe8cbc7a740 1 Processor -- start 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc2e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc2ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc3a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8cbc7a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55985dac0ab0 con 0x55985d85e4d0 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8cbc7a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55985db0e680 con 0x55985d87f1b0 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8cbc7a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55985dc31400 con 0x55985d8562f0 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8cbc7a740 10 client.0 _ll_register_callbacks cb 0x55985d896a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc2e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8bed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc3a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8bdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc2ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8bed9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc3a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:35292/0 (socket says 172.21.15.37:35292) 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8bed9d640 1 -- 172.21.15.37:0/453302416 learned_addr learned my addr 172.21.15.37:0/453302416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.323+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc2e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:52140/0 (socket says 172.21.15.37:52140) 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8bed9d640 1 -- 172.21.15.37:0/453302416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 msgr2=0x55985dc2e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc2e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8bed9d640 1 -- 172.21.15.37:0/453302416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 msgr2=0x55985dc2ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc2ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8bed9d640 1 -- 172.21.15.37:0/453302416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985d963620 con 0x55985d87f1b0 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc3a6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8006010 tx=0x7fe8b8047d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d832acc06de269 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/453302416 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80cd350 con 0x55985d87f1b0 2024-08-31T06:48:55.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/453302416 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe8b8047dd0 con 0x55985d87f1b0 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/453302416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8b40098c0 con 0x55985d87f1b0 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.324+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/453302416 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe8b80098b0 con 0x55985d87f1b0 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8cbc7a740 10 client.25682 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/453302416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55985dc3d4d0 con 0x55985d87f1b0 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/453302416 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8b80f1e50 con 0x55985d87f1b0 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/453302416 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe8b80c8ee0 con 0x55985d87f1b0 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8cbc7a740 10 client.25682 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8cbc7a740 10 client.25682 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8cbc7a740 20 client.25682 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:55.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55985d83dd80 0x55985dc40a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8cbc7a740 4 client.25682 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.325+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/453302416 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe8b40098c0 con 0x55985d83dd80 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.326+0000 7fe8be59c640 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55985d83dd80 0x55985dc40a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.326+0000 7fe8a5ffb640 10 client.25682 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.326+0000 7fe8be59c640 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55985d83dd80 0x55985dc40a30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=913282e851993130 server_cookie=6a75fdb026ee1a52 in_seq=0 out_seq=0 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.327+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/453302416 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fe8b40098c0 con 0x55985d83dd80 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.327+0000 7fe8a5ffb640 10 client.25682 handle_command_reply: tid=0 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.327+0000 7fe8cbc7a740 1 client.25682 shutdown 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.327+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/453302416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 msgr2=0x55985dc3a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.327+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc3a6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8006010 tx=0x7fe8b8047d60 comp rx=0 tx=0).stop 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/453302416 shutdown_connections 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55985d83dd80 0x55985dc40a30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc2ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc3a6f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8a5ffb640 0 client.25682 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/453302416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc2e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/453302416 >> 172.21.15.37:0/453302416 conn(0x55985d873300 msgr2=0x55985dc23d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/453302416 shutdown_connections 2024-08-31T06:48:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/453302416 wait complete. 2024-08-31T06:48:55.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.328+0000 7fe8cbc7a740 20 client.25682 trim_cache size 0 max 16384 2024-08-31T06:48:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.352+0000 7fe8cbc7a740 1 Processor -- start 2024-08-31T06:48:55.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.352+0000 7fe8cbc7a740 1 -- start start 2024-08-31T06:48:55.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.353+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc284b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.353+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc3a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.353+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc20180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.353+0000 7fe8cbc7a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01af830 con 0x55985d85e4d0 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.353+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.353+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc284b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:52156/0 (socket says 172.21.15.37:52156) 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.353+0000 7fe8be59c640 1 -- 172.21.15.37:0/2873036058 learned_addr learned my addr 172.21.15.37:0/2873036058 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.353+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc3a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc20180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/2873036058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01ad100 con 0x55985d87f1b0 2024-08-31T06:48:55.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/2873036058 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01aaf50 con 0x55985d8562f0 2024-08-31T06:48:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8bed9d640 1 -- 172.21.15.37:0/2873036058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 msgr2=0x55985dc284b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc284b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8bed9d640 1 -- 172.21.15.37:0/2873036058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 msgr2=0x55985dc3a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc3a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8bed9d640 1 -- 172.21.15.37:0/2873036058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55985dc40da0 con 0x55985d87f1b0 2024-08-31T06:48:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8be59c640 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc284b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.354+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc20180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80c9ec0 tx=0x7fe8b802a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f18c12508363de server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.355+0000 7fe8a7fff640 1 -- 172.21.15.37:0/2873036058 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80cc3c0 con 0x55985d87f1b0 2024-08-31T06:48:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.355+0000 7fe8a7fff640 1 -- 172.21.15.37:0/2873036058 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8b8079e50 con 0x55985d87f1b0 2024-08-31T06:48:55.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.355+0000 7fe8a7fff640 1 -- 172.21.15.37:0/2873036058 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80c8b10 con 0x55985d87f1b0 2024-08-31T06:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.356+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/2873036058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 msgr2=0x55985dc20180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.356+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc20180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80c9ec0 tx=0x7fe8b802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.356+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/2873036058 shutdown_connections 2024-08-31T06:48:55.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.356+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc3a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.356+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc20180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.356+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/2873036058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc284b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.356+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/2873036058 >> 172.21.15.37:0/2873036058 conn(0x55985d873300 msgr2=0x55985dc27da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.356+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/2873036058 shutdown_connections 2024-08-31T06:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.357+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/2873036058 wait complete. 2024-08-31T06:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.357+0000 7fe8cbc7a740 1 -- start start 2024-08-31T06:48:55.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.357+0000 7fe8cbc7a740 1 Processor -- start 2024-08-31T06:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc36d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8cbc7a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc321f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc36d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8be59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc36d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:52172/0 (socket says 172.21.15.37:52172) 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8be59c640 1 -- 172.21.15.37:0/4185356174 learned_addr learned my addr 172.21.15.37:0/4185356174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc32730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01ab5c0 con 0x55985d85e4d0 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01aca30 con 0x55985d87f1b0 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.358+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c01abc90 con 0x55985d8562f0 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8cbc7a740 10 client.0 _ll_register_callbacks cb 0x7fe8b80ccaf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc321f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc32730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8be59c640 1 -- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 msgr2=0x55985dc32730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8be59c640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc32730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8be59c640 1 -- 172.21.15.37:0/4185356174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 msgr2=0x55985dc321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8be59c640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc321f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8be59c640 1 -- 172.21.15.37:0/4185356174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55985dc32dd0 con 0x55985d8562f0 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8bed9d640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc32730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8be59c640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc36d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00127d0 tx=0x7fe8b0012c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44613897843c85a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.359+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/4185356174 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b002a020 con 0x55985d8562f0 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.360+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/4185356174 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe8b001faf0 con 0x55985d8562f0 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.360+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8b8079e50 con 0x55985d8562f0 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.360+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/4185356174 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe8b0035050 con 0x55985d8562f0 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.360+0000 7fe8cbc7a740 10 client.25696 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.360+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55985dcab2b0 con 0x55985d8562f0 2024-08-31T06:48:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.360+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/4185356174 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8b001fcf0 con 0x55985d8562f0 2024-08-31T06:48:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.361+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/4185356174 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe8b00314a0 con 0x55985d8562f0 2024-08-31T06:48:55.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.361+0000 7fe8cbc7a740 10 client.25696 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.361+0000 7fe8cbc7a740 10 client.25696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.361+0000 7fe8cbc7a740 20 client.25696 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.361+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55985d8131c0 0x55985dcadaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.361+0000 7fe8cbc7a740 4 client.25696 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.361+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fe8b8079e50 con 0x55985d8131c0 2024-08-31T06:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.362+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55985d8131c0 0x55985dcadaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.363+0000 7fe8bdd9b640 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55985d8131c0 0x55985dcadaf0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eec1b90a25b3a3a server_cookie=1a27f6b782cd9406 in_seq=0 out_seq=0 2024-08-31T06:48:55.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.363+0000 7fe8a5ffb640 10 client.25696 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8a5ffb640 1 -- 172.21.15.37:0/4185356174 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fe8b8079e50 con 0x55985d8131c0 2024-08-31T06:48:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8a5ffb640 10 client.25696 handle_command_reply: tid=0 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 client.25696 shutdown 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 msgr2=0x55985dc36d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc36d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00127d0 tx=0x7fe8b0012c90 comp rx=0 tx=0).stop 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 shutdown_connections 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55985d8131c0 0x55985dcadaf0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55985d85e4d0 0x55985dc321f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55985d87f1b0 0x55985dc32730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 --2- 172.21.15.37:0/4185356174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55985d8562f0 0x55985dc36d50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 >> 172.21.15.37:0/4185356174 conn(0x55985d873300 msgr2=0x55985dc23d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:55.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8a5ffb640 0 client.25696 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 shutdown_connections 2024-08-31T06:48:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.376+0000 7fe8cbc7a740 1 -- 172.21.15.37:0/4185356174 wait complete. 2024-08-31T06:48:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.377+0000 7fe8cbc7a740 20 client.25696 trim_cache size 0 max 16384 2024-08-31T06:48:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:48:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:48:55.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:48:55.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe8a80b4dd0 msgr2=0x7fe8a80b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe8a80b4dd0 0x7fe8a80b72e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe8c006c620 tx=0x7fe8b4015000 comp rx=0 tx=0).stop 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8c0109af0 msgr2=0x7fe8c019f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8c0109af0 0x7fe8c019f8e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8031040 tx=0x7fe8b8003f80 comp rx=0 tx=0).stop 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 shutdown_connections 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe8a80b4dd0 0x7fe8a80b72e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8c01091a0 0x7fe8c019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8c0109af0 0x7fe8c019f8e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 --2- 172.21.15.37:0/3291355041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8c0103870 0x7fe8c019a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 >> 172.21.15.37:0/3291355041 conn(0x7fe8c00ff2b0 msgr2=0x7fe8c01016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.378+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 shutdown_connections 2024-08-31T06:48:55.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:48:55.379+0000 7fe8c4d12640 1 -- 172.21.15.37:0/3291355041 wait complete. 2024-08-31T06:48:56.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:55 smithi106 ceph-mon[22134]: pgmap v382: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 3.66k op/s 2024-08-31T06:48:56.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:55 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:48:56.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:55 smithi037 ceph-mon[18612]: pgmap v382: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 3.66k op/s 2024-08-31T06:48:56.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:55 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:48:56.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:55 smithi066 ceph-mon[22244]: pgmap v382: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 3.66k op/s 2024-08-31T06:48:56.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:55 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:48:57.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:48:57.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:48:57.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:48:57.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:48:57.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:48:57.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:48:57.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:48:57.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:48:57.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:48:58.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:57 smithi106 ceph-mon[22134]: pgmap v383: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.04k op/s 2024-08-31T06:48:58.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:57 smithi037 ceph-mon[18612]: pgmap v383: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.04k op/s 2024-08-31T06:48:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:57 smithi066 ceph-mon[22244]: pgmap v383: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 MiB/s wr, 4.04k op/s 2024-08-31T06:48:58.381 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:48:58.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:48:58.775 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:48:59.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 -- 172.21.15.37:0/1528380070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 msgr2=0x7f5920116a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1528380070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 0x7f5920116a40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5918009900 tx=0x7f591802a410 comp rx=0 tx=0).stop 2024-08-31T06:48:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 -- 172.21.15.37:0/1528380070 shutdown_connections 2024-08-31T06:48:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1528380070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 0x7f5920116a40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1528380070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592010c660 0x7f592010ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1528380070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592010a230 0x7f592010a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 -- 172.21.15.37:0/1528380070 >> 172.21.15.37:0/1528380070 conn(0x7f5920079470 msgr2=0x7f592007b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 -- 172.21.15.37:0/1528380070 shutdown_connections 2024-08-31T06:48:59.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.365+0000 7f5927bf1640 1 -- 172.21.15.37:0/1528380070 wait complete. 2024-08-31T06:48:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.367+0000 7f5927bf1640 1 Processor -- start 2024-08-31T06:48:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.367+0000 7f5927bf1640 1 -- start start 2024-08-31T06:48:59.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.367+0000 7f5927bf1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592010a230 0x7f59201a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f5927bf1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592010c660 0x7f59201a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f592598d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592010a230 0x7f59201a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f592598d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592010a230 0x7f59201a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:35326/0 (socket says 172.21.15.37:35326) 2024-08-31T06:48:59.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f592518c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592010c660 0x7f59201a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f592518c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592010c660 0x7f59201a0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:52196/0 (socket says 172.21.15.37:52196) 2024-08-31T06:48:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f5927bf1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 0x7f59201a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f5927bf1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5920119d30 con 0x7f592010cfb0 2024-08-31T06:48:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f5927bf1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5920119bb0 con 0x7f592010a230 2024-08-31T06:48:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.368+0000 7f5927bf1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5920119eb0 con 0x7f592010c660 2024-08-31T06:48:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.369+0000 7f592618e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 0x7f59201a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.369+0000 7f592598d640 1 -- 172.21.15.37:0/1444750166 learned_addr learned my addr 172.21.15.37:0/1444750166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.369+0000 7f592618e640 1 -- 172.21.15.37:0/1444750166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592010c660 msgr2=0x7f59201a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.369+0000 7f592618e640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592010c660 0x7f59201a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.369+0000 7f592618e640 1 -- 172.21.15.37:0/1444750166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592010a230 msgr2=0x7f59201a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.369+0000 7f592618e640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592010a230 0x7f59201a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.369+0000 7f592618e640 1 -- 172.21.15.37:0/1444750166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59201a66d0 con 0x7f592010cfb0 2024-08-31T06:48:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.370+0000 7f592618e640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 0x7f59201a5fa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5918009230 tx=0x7f5918004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.370+0000 7f5916ffd640 1 -- 172.21.15.37:0/1444750166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591803f030 con 0x7f592010cfb0 2024-08-31T06:48:59.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.370+0000 7f5916ffd640 1 -- 172.21.15.37:0/1444750166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5918004440 con 0x7f592010cfb0 2024-08-31T06:48:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.370+0000 7f5916ffd640 1 -- 172.21.15.37:0/1444750166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5918035070 con 0x7f592010cfb0 2024-08-31T06:48:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.370+0000 7f5927bf1640 1 -- 172.21.15.37:0/1444750166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59201a6960 con 0x7f592010cfb0 2024-08-31T06:48:59.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.370+0000 7f5927bf1640 1 -- 172.21.15.37:0/1444750166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59201a6d30 con 0x7f592010cfb0 2024-08-31T06:48:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.375+0000 7f5916ffd640 1 -- 172.21.15.37:0/1444750166 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f5918042030 con 0x7f592010cfb0 2024-08-31T06:48:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.375+0000 7f592e166740 1 Processor -- start 2024-08-31T06:48:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.376+0000 7f592e166740 1 -- start start 2024-08-31T06:48:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.376+0000 7f592e166740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c2f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.376+0000 7f592e166740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23860490 0x561f23c2fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.376+0000 7f592e166740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c30200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.376+0000 7f592e166740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f23ba55f0 con 0x561f23860490 2024-08-31T06:48:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.376+0000 7f592e166740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561f23b94b80 con 0x561f23868670 2024-08-31T06:48:59.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.376+0000 7f592e166740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561f23b98b30 con 0x561f23889350 2024-08-31T06:48:59.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.376+0000 7f592598d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23860490 0x561f23c2fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592598d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23860490 0x561f23c2fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57826/0 (socket says 172.21.15.37:57826) 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592598d640 1 -- 172.21.15.37:0/3985248965 learned_addr learned my addr 172.21.15.37:0/3985248965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592518c640 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c2f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592518c640 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c30200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f5916ffd640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f590c0b4e70 0x7f590c0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592598d640 1 -- 172.21.15.37:0/3985248965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 msgr2=0x561f23c2f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592598d640 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c2f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592598d640 1 -- 172.21.15.37:0/3985248965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 msgr2=0x561f23c30200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592598d640 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c30200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592598d640 1 -- 172.21.15.37:0/3985248965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f238f4930 con 0x561f23860490 2024-08-31T06:48:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592618e640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f590c0b4e70 0x7f590c0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f592598d640 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23860490 0x561f23c2fcc0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f591c0115f0 tx=0x7f591c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f34ec7a3a5355c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.377+0000 7f5916ffd640 1 -- 172.21.15.37:0/1444750166 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f5918105ba0 con 0x7f592010cfb0 2024-08-31T06:48:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.378+0000 7f590bfff640 1 -- 172.21.15.37:0/3985248965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c004b20 con 0x561f23860490 2024-08-31T06:48:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.378+0000 7f590bfff640 1 -- 172.21.15.37:0/3985248965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f591c004cc0 con 0x561f23860490 2024-08-31T06:48:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.378+0000 7f590bfff640 1 -- 172.21.15.37:0/3985248965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c005390 con 0x561f23860490 2024-08-31T06:48:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 -- 172.21.15.37:0/3985248965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23860490 msgr2=0x561f23c2fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23860490 0x561f23c2fcc0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f591c0115f0 tx=0x7f591c011ab0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592618e640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f590c0b4e70 0x7f590c0b7380 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f59180c9590 tx=0x7f59180cc170 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:59.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 -- 172.21.15.37:0/3985248965 shutdown_connections 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23860490 0x561f23c2fcc0 secure :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f591c0115f0 tx=0x7f591c011ab0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c30200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 --2- 172.21.15.37:0/3985248965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c2f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 -- 172.21.15.37:0/3985248965 >> 172.21.15.37:0/3985248965 conn(0x561f2387d740 msgr2=0x561f23c2d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 -- 172.21.15.37:0/3985248965 shutdown_connections 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.379+0000 7f592e166740 1 -- 172.21.15.37:0/3985248965 wait complete. 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.380+0000 7f592e166740 1 -- start start 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.380+0000 7f592e166740 1 Processor -- start 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.381+0000 7f592e166740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 0x561f23c3b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.381+0000 7f592e166740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c3b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.381+0000 7f592e166740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23847cd0 0x561f23c47250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.381+0000 7f592598d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c3b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.381+0000 7f592598d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c3b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:52212/0 (socket says 172.21.15.37:52212) 2024-08-31T06:48:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.381+0000 7f592598d640 1 -- 172.21.15.37:0/1303859506 learned_addr learned my addr 172.21.15.37:0/1303859506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592518c640 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 0x561f23c3b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f239f7890 con 0x561f23868670 2024-08-31T06:48:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561f23b1b790 con 0x561f23847cd0 2024-08-31T06:48:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561f23c3df60 con 0x561f23889350 2024-08-31T06:48:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592e166740 10 client.0 _ll_register_callbacks cb 0x561f238a0ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592518c640 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23847cd0 0x561f23c47250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592598d640 1 -- 172.21.15.37:0/1303859506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23847cd0 msgr2=0x561f23c47250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592598d640 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23847cd0 0x561f23c47250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592598d640 1 -- 172.21.15.37:0/1303859506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 msgr2=0x561f23c3b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592598d640 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 0x561f23c3b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.382+0000 7f592598d640 1 -- 172.21.15.37:0/1303859506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f23b52f30 con 0x561f23889350 2024-08-31T06:48:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.383+0000 7f592598d640 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c3b770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f591c005c40 tx=0x7f591c00fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ce2501aa86a5eae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.383+0000 7f59097fa640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:48:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.383+0000 7f59097fa640 1 -- 172.21.15.37:0/1303859506 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c028070 con 0x561f23889350 2024-08-31T06:48:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.383+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f591c004cc0 con 0x561f23889350 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.383+0000 7f59097fa640 1 -- 172.21.15.37:0/1303859506 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f591c005090 con 0x561f23889350 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f59097fa640 1 -- 172.21.15.37:0/1303859506 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f591c034050 con 0x561f23889350 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f592e166740 10 client.25708 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561f23c49e60 con 0x561f23889350 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f59097fa640 1 -- 172.21.15.37:0/1303859506 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f591c005720 con 0x561f23889350 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f59097fa640 1 -- 172.21.15.37:0/1303859506 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f591c024460 con 0x561f23889350 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f592e166740 10 client.25708 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f592e166740 10 client.25708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f592e166740 20 client.25708 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f592e166740 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561f2381d080 0x561f23c4d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f592e166740 4 client.25708 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.384+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f591c004cc0 con 0x561f2381d080 2024-08-31T06:48:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.385+0000 7f592518c640 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561f2381d080 0x561f23c4d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.386+0000 7f592518c640 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561f2381d080 0x561f23c4d680 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e497656b8f7eaf server_cookie=f6ef436f50af5c29 in_seq=0 out_seq=0 2024-08-31T06:48:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.386+0000 7f59097fa640 10 client.25708 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.387+0000 7f59097fa640 1 -- 172.21.15.37:0/1303859506 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f591c004cc0 con 0x561f2381d080 2024-08-31T06:48:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.387+0000 7f59097fa640 10 client.25708 handle_command_reply: tid=0 2024-08-31T06:48:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.387+0000 7f592e166740 1 client.25708 shutdown 2024-08-31T06:48:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.387+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 msgr2=0x561f23c3b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.387+0000 7f592e166740 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c3b770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f591c005c40 tx=0x7f591c00fda0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 shutdown_connections 2024-08-31T06:48:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f592e166740 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561f2381d080 0x561f23c4d680 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f592e166740 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23847cd0 0x561f23c47250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f592e166740 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23c3b770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f592e166740 1 --2- 172.21.15.37:0/1303859506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 0x561f23c3b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 >> 172.21.15.37:0/1303859506 conn(0x561f2387d740 msgr2=0x561f23c32910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f59097fa640 0 client.25708 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 shutdown_connections 2024-08-31T06:48:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.388+0000 7f592e166740 1 -- 172.21.15.37:0/1303859506 wait complete. 2024-08-31T06:48:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.389+0000 7f592e166740 20 client.25708 trim_cache size 0 max 16384 2024-08-31T06:48:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.419+0000 7f592e166740 1 Processor -- start 2024-08-31T06:48:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.419+0000 7f592e166740 1 -- start start 2024-08-31T06:48:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592e166740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23847cd0 0x561f23c47150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592e166740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 0x561f23c47690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592518c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23847cd0 0x561f23c47150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592518c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23847cd0 0x561f23c47150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:52216/0 (socket says 172.21.15.37:52216) 2024-08-31T06:48:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592518c640 1 -- 172.21.15.37:0/3852815511 learned_addr learned my addr 172.21.15.37:0/3852815511 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592e166740 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23889350 0x561f23c38220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592e166740 1 -- 172.21.15.37:0/3852815511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59201b8150 con 0x561f23868670 2024-08-31T06:48:59.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592e166740 1 -- 172.21.15.37:0/3852815511 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59201b5a20 con 0x561f23889350 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592e166740 1 -- 172.21.15.37:0/3852815511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f59201b3870 con 0x561f23847cd0 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.420+0000 7f592598d640 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 0x561f23c47690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f592518c640 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23889350 0x561f23c38220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f592518c640 1 -- 172.21.15.37:0/3852815511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23889350 msgr2=0x561f23c38220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f592518c640 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23889350 0x561f23c38220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f592518c640 1 -- 172.21.15.37:0/3852815511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 msgr2=0x561f23c47690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f592518c640 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 0x561f23c47690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f592518c640 1 -- 172.21.15.37:0/3852815511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f23c39f90 con 0x561f23847cd0 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f592518c640 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23847cd0 0x561f23c47150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5910010570 tx=0x7f5910004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da7b09419d50e3ad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f590b7fe640 1 -- 172.21.15.37:0/3852815511 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910014110 con 0x561f23847cd0 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f590b7fe640 1 -- 172.21.15.37:0/3852815511 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5910025040 con 0x561f23847cd0 2024-08-31T06:48:59.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.421+0000 7f590b7fe640 1 -- 172.21.15.37:0/3852815511 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910005280 con 0x561f23847cd0 2024-08-31T06:48:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.422+0000 7f592e166740 1 -- 172.21.15.37:0/3852815511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23847cd0 msgr2=0x561f23c47150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.422+0000 7f592e166740 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23847cd0 0x561f23c47150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5910010570 tx=0x7f5910004730 comp rx=0 tx=0).stop 2024-08-31T06:48:59.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.423+0000 7f592e166740 1 -- 172.21.15.37:0/3852815511 shutdown_connections 2024-08-31T06:48:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.423+0000 7f592e166740 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23868670 0x561f23c47690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.423+0000 7f592e166740 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23889350 0x561f23c38220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.423+0000 7f592e166740 1 --2- 172.21.15.37:0/3852815511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23847cd0 0x561f23c47150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.423+0000 7f592e166740 1 -- 172.21.15.37:0/3852815511 >> 172.21.15.37:0/3852815511 conn(0x561f2387d740 msgr2=0x561f23c361e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.423+0000 7f592e166740 1 -- 172.21.15.37:0/3852815511 shutdown_connections 2024-08-31T06:48:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.423+0000 7f592e166740 1 -- 172.21.15.37:0/3852815511 wait complete. 2024-08-31T06:48:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.423+0000 7f592e166740 1 -- start start 2024-08-31T06:48:59.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.424+0000 7f592e166740 1 Processor -- start 2024-08-31T06:48:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.424+0000 7f592e166740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23847cd0 0x561f23c3f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.424+0000 7f592e166740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c3fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.424+0000 7f592e166740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23cb7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.424+0000 7f592e166740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59201b3ee0 con 0x561f23847cd0 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.424+0000 7f592e166740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59201b5350 con 0x561f23868670 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.424+0000 7f592e166740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f59201b45b0 con 0x561f23889350 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.424+0000 7f592598d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c3fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23847cd0 0x561f23c3f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23847cd0 0x561f23c3f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57844/0 (socket says 172.21.15.37:57844) 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592598d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c3fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:35350/0 (socket says 172.21.15.37:35350) 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 -- 172.21.15.37:0/2653254795 learned_addr learned my addr 172.21.15.37:0/2653254795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592e166740 10 client.0 _ll_register_callbacks cb 0x7f591c00fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23cb7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 -- 172.21.15.37:0/2653254795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 msgr2=0x561f23cb7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23cb7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 -- 172.21.15.37:0/2653254795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 msgr2=0x561f23c3fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:48:59.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c3fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 -- 172.21.15.37:0/2653254795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f23cb75c0 con 0x561f23847cd0 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592598d640 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c3fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f592518c640 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23847cd0 0x561f23c3f860 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f591000a520 tx=0x7f591000a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d93df6f381b2c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.425+0000 7f59097fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.426+0000 7f59097fa640 1 -- 172.21.15.37:0/2653254795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910031020 con 0x561f23847cd0 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.426+0000 7f59097fa640 1 -- 172.21.15.37:0/2653254795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f5910005430 con 0x561f23847cd0 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.426+0000 7f592e166740 1 -- 172.21.15.37:0/2653254795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5910025040 con 0x561f23847cd0 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.426+0000 7f59097fa640 1 -- 172.21.15.37:0/2653254795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f591003c050 con 0x561f23847cd0 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.426+0000 7f592e166740 10 client.16206 fetch_fsmap learned FSMap version 25 2024-08-31T06:48:59.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.426+0000 7f592e166740 1 -- 172.21.15.37:0/2653254795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561f23cb87d0 con 0x561f23847cd0 2024-08-31T06:48:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.427+0000 7f59097fa640 1 -- 172.21.15.37:0/2653254795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5910025040 con 0x561f23847cd0 2024-08-31T06:48:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.428+0000 7f59097fa640 1 -- 172.21.15.37:0/2653254795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5910028070 con 0x561f23847cd0 2024-08-31T06:48:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.428+0000 7f592e166740 10 client.16206 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:48:59.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.428+0000 7f592e166740 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:48:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.428+0000 7f592e166740 20 client.16206 populate_metadata read hostname 'smithi037' 2024-08-31T06:48:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.428+0000 7f592e166740 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561f23cb8f00 0x561f23cbb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:48:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.428+0000 7f592e166740 4 client.16206 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:48:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.428+0000 7f592e166740 1 -- 172.21.15.37:0/2653254795 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561f23ba7540 con 0x561f23cb8f00 2024-08-31T06:48:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.428+0000 7f592598d640 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561f23cb8f00 0x561f23cbb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:48:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.429+0000 7f592598d640 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561f23cb8f00 0x561f23cbb320 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea0bc385ac77974c server_cookie=255b944ba95c29f1 in_seq=0 out_seq=0 2024-08-31T06:48:59.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.429+0000 7f59097fa640 10 client.16206 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:59.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.431+0000 7f59097fa640 1 -- 172.21.15.37:0/2653254795 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561f23ba7540 con 0x561f23cb8f00 2024-08-31T06:48:59.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.431+0000 7f59097fa640 10 client.16206 handle_command_reply: tid=0 2024-08-31T06:48:59.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.431+0000 7f592e166740 1 client.16206 shutdown 2024-08-31T06:48:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.431+0000 7f592e166740 1 -- 172.21.15.37:0/2653254795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23847cd0 msgr2=0x561f23c3f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.431+0000 7f592e166740 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23847cd0 0x561f23c3f860 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f591000a520 tx=0x7f591000a470 comp rx=0 tx=0).stop 2024-08-31T06:48:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f592e166740 1 -- 172.21.15.37:0/2653254795 shutdown_connections 2024-08-31T06:48:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f592e166740 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561f23cb8f00 0x561f23cbb320 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f592e166740 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f23889350 0x561f23cb7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f592e166740 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f23868670 0x561f23c3fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f592e166740 1 --2- 172.21.15.37:0/2653254795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f23847cd0 0x561f23c3f860 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f592e166740 1 -- 172.21.15.37:0/2653254795 >> 172.21.15.37:0/2653254795 conn(0x561f2387d740 msgr2=0x561f23c361e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f59097fa640 0 client.16206 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:48:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f592e166740 1 -- 172.21.15.37:0/2653254795 shutdown_connections 2024-08-31T06:48:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.432+0000 7f592e166740 1 -- 172.21.15.37:0/2653254795 wait complete. 2024-08-31T06:48:59.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.433+0000 7f592e166740 20 client.16206 trim_cache size 0 max 16384 2024-08-31T06:48:59.434 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:48:59.435 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:48:59.435 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "c9a1c375-76b0-44f1-9019-3cb3b5c85711", 2024-08-31T06:48:59.435 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:48:59.435 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:48:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 -- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f590c0b4e70 msgr2=0x7f590c0b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f590c0b4e70 0x7f590c0b7380 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f59180c9590 tx=0x7f59180cc170 comp rx=0 tx=0).stop 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 -- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 msgr2=0x7f59201a5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 0x7f59201a5fa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5918009230 tx=0x7f5918004040 comp rx=0 tx=0).stop 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 -- 172.21.15.37:0/1444750166 shutdown_connections 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f590c0b4e70 0x7f590c0b7380 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592010cfb0 0x7f59201a5fa0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f592010c660 0x7f59201a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 --2- 172.21.15.37:0/1444750166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592010a230 0x7f59201a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 -- 172.21.15.37:0/1444750166 >> 172.21.15.37:0/1444750166 conn(0x7f5920079470 msgr2=0x7f592010de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 -- 172.21.15.37:0/1444750166 shutdown_connections 2024-08-31T06:48:59.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:48:59.434+0000 7f5927bf1640 1 -- 172.21.15.37:0/1444750166 wait complete. 2024-08-31T06:49:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:59 smithi106 ceph-mon[22134]: pgmap v384: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 3.58k op/s 2024-08-31T06:49:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:59 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:49:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:59 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:59 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:49:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:48:59 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:00.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:59 smithi037 ceph-mon[18612]: pgmap v384: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 3.58k op/s 2024-08-31T06:49:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:59 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:49:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:59 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:59 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:49:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:48:59 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:59 smithi066 ceph-mon[22244]: pgmap v384: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 3.58k op/s 2024-08-31T06:49:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:59 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:49:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:59 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:59 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:49:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:48:59 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:00.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:49:01.077 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:01.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 -- 172.21.15.37:0/416929744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 msgr2=0x7f451c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 --2- 172.21.15.37:0/416929744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 0x7f451c108570 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4510009900 tx=0x7f451002a410 comp rx=0 tx=0).stop 2024-08-31T06:49:01.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 -- 172.21.15.37:0/416929744 shutdown_connections 2024-08-31T06:49:01.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 --2- 172.21.15.37:0/416929744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 0x7f451c108570 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 --2- 172.21.15.37:0/416929744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f451c108ab0 0x7f451c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 --2- 172.21.15.37:0/416929744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c102820 0x7f451c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 -- 172.21.15.37:0/416929744 >> 172.21.15.37:0/416929744 conn(0x7f451c0794e0 msgr2=0x7f451c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 -- 172.21.15.37:0/416929744 shutdown_connections 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.646+0000 7f45228fb640 1 -- 172.21.15.37:0/416929744 wait complete. 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f45228fb640 1 Processor -- start 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f45228fb640 1 -- start start 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f45228fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f451c102820 0x7f451c10fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f45228fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 0x7f451c1102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f45228fb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c108ab0 0x7f451c1107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f45228fb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f451c1136f0 con 0x7f451c108160 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f45228fb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f451c113570 con 0x7f451c102820 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f45228fb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f451c113870 con 0x7f451c108ab0 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 0x7f451c1102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 0x7f451c1102b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57870/0 (socket says 172.21.15.37:57870) 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.647+0000 7f451b7fe640 1 -- 172.21.15.37:0/2129787321 learned_addr learned my addr 172.21.15.37:0/2129787321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f451bfff640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f451c102820 0x7f451c10fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f4520e98640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c108ab0 0x7f451c1107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f451b7fe640 1 -- 172.21.15.37:0/2129787321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c108ab0 msgr2=0x7f451c1107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f451b7fe640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c108ab0 0x7f451c1107f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f451b7fe640 1 -- 172.21.15.37:0/2129787321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f451c102820 msgr2=0x7f451c10fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f451b7fe640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f451c102820 0x7f451c10fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f451b7fe640 1 -- 172.21.15.37:0/2129787321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c1a8430 con 0x7f451c108160 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f451b7fe640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 0x7f451c1102b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4510005940 tx=0x7f45100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f45197fa640 1 -- 172.21.15.37:0/2129787321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451003f030 con 0x7f451c108160 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f45197fa640 1 -- 172.21.15.37:0/2129787321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4510003c90 con 0x7f451c108160 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f45228fb640 1 -- 172.21.15.37:0/2129787321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c1a86c0 con 0x7f451c108160 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f45197fa640 1 -- 172.21.15.37:0/2129787321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510035070 con 0x7f451c108160 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.648+0000 7f45228fb640 1 -- 172.21.15.37:0/2129787321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c1a8bf0 con 0x7f451c108160 2024-08-31T06:49:01.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4528e70740 1 Processor -- start 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4528e70740 1 -- start start 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4528e70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9bb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4528e70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4528e70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4528e70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55960e932630 con 0x55960e5f5390 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4528e70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55960e921bc0 con 0x55960e616070 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4528e70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55960e925b70 con 0x55960e5ed1b0 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f45197fa640 1 -- 172.21.15.37:0/2129787321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f4510042030 con 0x7f451c108160 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f4520e98640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9bb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f451bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9bbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57880/0 (socket says 172.21.15.37:57880) 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.651+0000 7f451b7fe640 1 -- 172.21.15.37:0/1183099043 learned_addr learned my addr 172.21.15.37:0/1183099043 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f451b7fe640 1 -- 172.21.15.37:0/1183099043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 msgr2=0x55960e9bb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f451b7fe640 1 --2- 172.21.15.37:0/1183099043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f451b7fe640 1 -- 172.21.15.37:0/1183099043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 msgr2=0x55960e9bb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f451b7fe640 1 --2- 172.21.15.37:0/1183099043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9bb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f451b7fe640 1 -- 172.21.15.37:0/1183099043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55960e681650 con 0x55960e5f5390 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f4520e98640 1 --2- 172.21.15.37:0/1183099043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9bb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f451b7fe640 1 --2- 172.21.15.37:0/1183099043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9bbd40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f45101030f0 tx=0x7f4510109ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb30dd86bdb3cf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f45027fc640 1 -- 172.21.15.37:0/1183099043 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510119070 con 0x55960e5f5390 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f45027fc640 1 -- 172.21.15.37:0/1183099043 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45101077b0 con 0x55960e5f5390 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f45027fc640 1 -- 172.21.15.37:0/1183099043 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510112740 con 0x55960e5f5390 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f45197fa640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45040b4d20 0x7f45040b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.652+0000 7f4520e98640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45040b4d20 0x7f45040b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f45197fa640 1 -- 172.21.15.37:0/2129787321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f45101059f0 con 0x7f451c108160 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 -- 172.21.15.37:0/1183099043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 msgr2=0x55960e9bbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4520e98640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45040b4d20 0x7f45040b7230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4514007fd0 tx=0x7f4514007600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 --2- 172.21.15.37:0/1183099043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9bbd40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f45101030f0 tx=0x7f4510109ab0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 -- 172.21.15.37:0/1183099043 shutdown_connections 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 --2- 172.21.15.37:0/1183099043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9bbd40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 --2- 172.21.15.37:0/1183099043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 --2- 172.21.15.37:0/1183099043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9bb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 -- 172.21.15.37:0/1183099043 >> 172.21.15.37:0/1183099043 conn(0x55960e60a460 msgr2=0x55960e9b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 -- 172.21.15.37:0/1183099043 shutdown_connections 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.653+0000 7f4528e70740 1 -- 172.21.15.37:0/1183099043 wait complete. 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 1 -- start start 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 1 Processor -- start 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5ed1b0 0x55960e9c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e616070 0x55960e9d2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55960e784700 con 0x55960e5ed1b0 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55960e8a8700 con 0x55960e5f5390 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55960e9c9860 con 0x55960e616070 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4528e70740 10 client.0 _ll_register_callbacks cb 0x55960e8d7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f451bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5ed1b0 0x55960e9c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f451bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5ed1b0 0x55960e9c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57884/0 (socket says 172.21.15.37:57884) 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f451bfff640 1 -- 172.21.15.37:0/2187420948 learned_addr learned my addr 172.21.15.37:0/2187420948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.654+0000 7f4520e98640 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e616070 0x55960e9d2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f451bfff640 1 -- 172.21.15.37:0/2187420948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e616070 msgr2=0x55960e9d2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f451bfff640 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e616070 0x55960e9d2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f451bfff640 1 -- 172.21.15.37:0/2187420948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 msgr2=0x55960e9c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f451bfff640 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f451bfff640 1 -- 172.21.15.37:0/2187420948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55960e8e18b0 con 0x55960e5ed1b0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f451b7fe640 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f451bfff640 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5ed1b0 0x55960e9c69a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f450c00ba60 tx=0x7f450c00bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652e0fdfd171a522 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f44fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f44fb7fe640 1 -- 172.21.15.37:0/2187420948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c005020 con 0x55960e5ed1b0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f44fb7fe640 1 -- 172.21.15.37:0/2187420948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f450c0051c0 con 0x55960e5ed1b0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f4528e70740 1 -- 172.21.15.37:0/2187420948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45101077b0 con 0x55960e5ed1b0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f44fb7fe640 1 -- 172.21.15.37:0/2187420948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f450c005400 con 0x55960e5ed1b0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f4528e70740 10 client.16218 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f4528e70740 1 -- 172.21.15.37:0/2187420948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55960e9d55c0 con 0x55960e5ed1b0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.655+0000 7f44fb7fe640 1 -- 172.21.15.37:0/2187420948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45101077b0 con 0x55960e5ed1b0 2024-08-31T06:49:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f44fb7fe640 1 -- 172.21.15.37:0/2187420948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f450c01b590 con 0x55960e5ed1b0 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f4528e70740 10 client.16218 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f4528e70740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f4528e70740 20 client.16218 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f4528e70740 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55960e5d49f0 0x55960e9d8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f4528e70740 4 client.16218 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f4528e70740 1 -- 172.21.15.37:0/2187420948 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55960e934580 con 0x55960e5d49f0 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f451b7fe640 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55960e5d49f0 0x55960e9d8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f44fb7fe640 10 client.16218 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.656+0000 7f451b7fe640 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55960e5d49f0 0x55960e9d8e80 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=233570b2061e50de server_cookie=c12de56c53adebdc in_seq=0 out_seq=0 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f44fb7fe640 1 -- 172.21.15.37:0/2187420948 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55960e934580 con 0x55960e5d49f0 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f44fb7fe640 10 client.16218 handle_command_reply: tid=0 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 client.16218 shutdown 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 -- 172.21.15.37:0/2187420948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5ed1b0 msgr2=0x55960e9c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5ed1b0 0x55960e9c69a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f450c00ba60 tx=0x7f450c00bf20 comp rx=0 tx=0).stop 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 -- 172.21.15.37:0/2187420948 shutdown_connections 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55960e5d49f0 0x55960e9d8e80 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e616070 0x55960e9d2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 --2- 172.21.15.37:0/2187420948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5ed1b0 0x55960e9c69a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 -- 172.21.15.37:0/2187420948 >> 172.21.15.37:0/2187420948 conn(0x55960e60a460 msgr2=0x55960e9be450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f44fb7fe640 0 client.16218 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.657+0000 7f4528e70740 1 -- 172.21.15.37:0/2187420948 shutdown_connections 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.658+0000 7f4528e70740 1 -- 172.21.15.37:0/2187420948 wait complete. 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.658+0000 7f4528e70740 20 client.16218 trim_cache size 0 max 16384 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.686+0000 7f4528e70740 1 Processor -- start 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.686+0000 7f4528e70740 1 -- start start 2024-08-31T06:49:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.686+0000 7f4528e70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.686+0000 7f4528e70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.686+0000 7f4528e70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.686+0000 7f4528e70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f451c1b3e30 con 0x55960e5f5390 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.686+0000 7f4528e70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f451c1b1700 con 0x55960e616070 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.686+0000 7f4528e70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f451c1af550 con 0x55960e5ed1b0 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:52282/0 (socket says 172.21.15.37:52282) 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451bfff640 1 -- 172.21.15.37:0/1312607539 learned_addr learned my addr 172.21.15.37:0/1312607539 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f4520e98640 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451b7fe640 1 -- 172.21.15.37:0/1312607539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 msgr2=0x55960e9bead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451b7fe640 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451b7fe640 1 -- 172.21.15.37:0/1312607539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 msgr2=0x55960e9c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451b7fe640 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451b7fe640 1 -- 172.21.15.37:0/1312607539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55960e9c5900 con 0x55960e5f5390 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451bfff640 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f451b7fe640 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9c6910 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f45100c9390 tx=0x7f45101094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a00d2df3029eab server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.687+0000 7f4501ffb640 1 -- 172.21.15.37:0/1312607539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510049040 con 0x55960e5f5390 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.688+0000 7f4501ffb640 1 -- 172.21.15.37:0/1312607539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4510003e40 con 0x55960e5f5390 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.688+0000 7f4501ffb640 1 -- 172.21.15.37:0/1312607539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45100c7fe0 con 0x55960e5f5390 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.688+0000 7f4528e70740 1 -- 172.21.15.37:0/1312607539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 msgr2=0x55960e9c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.688+0000 7f4528e70740 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9c6910 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f45100c9390 tx=0x7f45101094c0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 -- 172.21.15.37:0/1312607539 shutdown_connections 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e5f5390 0x55960e9c6910 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e616070 0x55960e9c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 --2- 172.21.15.37:0/1312607539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9bead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 -- 172.21.15.37:0/1312607539 >> 172.21.15.37:0/1312607539 conn(0x55960e60a460 msgr2=0x55960e9be3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 -- 172.21.15.37:0/1312607539 shutdown_connections 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 -- 172.21.15.37:0/1312607539 wait complete. 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 -- start start 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.689+0000 7f4528e70740 1 Processor -- start 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f4528e70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f4528e70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f4528e70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e616070 0x55960e9cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f4528e70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f451c1afbc0 con 0x55960e616070 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f4528e70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f451c1b1030 con 0x55960e5f5390 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f4528e70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f451c1b0290 con 0x55960e5ed1b0 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f4528e70740 10 client.0 _ll_register_callbacks cb 0x7f450c0042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451bfff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9cf430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:52294/0 (socket says 172.21.15.37:52294) 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451bfff640 1 -- 172.21.15.37:0/4006498877 learned_addr learned my addr 172.21.15.37:0/4006498877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451b7fe640 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f4520e98640 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e616070 0x55960e9cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451bfff640 1 -- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 msgr2=0x55960e9ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451bfff640 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451bfff640 1 -- 172.21.15.37:0/4006498877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e616070 msgr2=0x55960e9cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:01.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451bfff640 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e616070 0x55960e9cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451bfff640 1 -- 172.21.15.37:0/4006498877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55960ea42880 con 0x55960e5ed1b0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.690+0000 7f451b7fe640 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.691+0000 7f451bfff640 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9cf430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f450c00ba60 tx=0x7f450c003ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f439d398b00241e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.691+0000 7f44fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.691+0000 7f44fb7fe640 1 -- 172.21.15.37:0/4006498877 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c033020 con 0x55960e5ed1b0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.691+0000 7f4528e70740 1 -- 172.21.15.37:0/4006498877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55960e930020 con 0x55960e5ed1b0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.691+0000 7f44fb7fe640 1 -- 172.21.15.37:0/4006498877 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f450c020030 con 0x55960e5ed1b0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.691+0000 7f44fb7fe640 1 -- 172.21.15.37:0/4006498877 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f450c01b680 con 0x55960e5ed1b0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.691+0000 7f4528e70740 10 client.25732 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.691+0000 7f4528e70740 1 -- 172.21.15.37:0/4006498877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55960ea43990 con 0x55960e5ed1b0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f44fb7fe640 1 -- 172.21.15.37:0/4006498877 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55960e930020 con 0x55960e5ed1b0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f44fb7fe640 1 -- 172.21.15.37:0/4006498877 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f450c02e070 con 0x55960e5ed1b0 2024-08-31T06:49:01.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f4528e70740 10 client.25732 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f4528e70740 10 client.25732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f4528e70740 20 client.25732 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f4528e70740 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55960e5a9da0 0x55960ea461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f4528e70740 4 client.25732 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f4528e70740 1 -- 172.21.15.37:0/4006498877 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55960e92d760 con 0x55960e5a9da0 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.692+0000 7f451b7fe640 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55960e5a9da0 0x55960ea461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.693+0000 7f44fb7fe640 10 client.25732 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.693+0000 7f451b7fe640 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55960e5a9da0 0x55960ea461d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=862619e4c645beb2 server_cookie=3ddeb4cad8e4e671 in_seq=0 out_seq=0 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.693+0000 7f44fb7fe640 1 -- 172.21.15.37:0/4006498877 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55960e92d760 con 0x55960e5a9da0 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.693+0000 7f44fb7fe640 10 client.25732 handle_command_reply: tid=0 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.693+0000 7f4528e70740 1 client.25732 shutdown 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.693+0000 7f4528e70740 1 -- 172.21.15.37:0/4006498877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 msgr2=0x55960e9cf430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.693+0000 7f4528e70740 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9cf430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f450c00ba60 tx=0x7f450c003ee0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 1 -- 172.21.15.37:0/4006498877 shutdown_connections 2024-08-31T06:49:01.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55960e5a9da0 0x55960ea461d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55960e616070 0x55960e9cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f44fb7fe640 0 client.25732 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:01.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55960e5f5390 0x55960e9ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.862 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:49:01.862 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:49:01.862 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "c9a1c375-76b0-44f1-9019-3cb3b5c85711", 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:01.863 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:01.864 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:01.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 1 --2- 172.21.15.37:0/4006498877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55960e5ed1b0 0x55960e9cf430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 1 -- 172.21.15.37:0/4006498877 >> 172.21.15.37:0/4006498877 conn(0x55960e60a460 msgr2=0x55960e9be390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 1 -- 172.21.15.37:0/4006498877 shutdown_connections 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 1 -- 172.21.15.37:0/4006498877 wait complete. 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.694+0000 7f4528e70740 20 client.25732 trim_cache size 0 max 16384 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.695+0000 7f45228fb640 1 -- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45040b4d20 msgr2=0x7f45040b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.695+0000 7f45228fb640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45040b4d20 0x7f45040b7230 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4514007fd0 tx=0x7f4514007600 comp rx=0 tx=0).stop 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 -- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 msgr2=0x7f451c1102b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 0x7f451c1102b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4510005940 tx=0x7f45100042f0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 -- 172.21.15.37:0/2129787321 shutdown_connections 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45040b4d20 0x7f45040b7230 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f451c108160 0x7f451c1102b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f451c108ab0 0x7f451c1107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 --2- 172.21.15.37:0/2129787321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f451c102820 0x7f451c10fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 -- 172.21.15.37:0/2129787321 >> 172.21.15.37:0/2129787321 conn(0x7f451c0794e0 msgr2=0x7f451c1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 -- 172.21.15.37:0/2129787321 shutdown_connections 2024-08-31T06:49:01.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:01.696+0000 7f45228fb640 1 -- 172.21.15.37:0/2129787321 wait complete. 2024-08-31T06:49:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:01 smithi106 ceph-mon[22134]: pgmap v385: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 3.94k op/s 2024-08-31T06:49:02.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:01 smithi037 ceph-mon[18612]: pgmap v385: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 3.94k op/s 2024-08-31T06:49:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:01 smithi066 ceph-mon[22244]: pgmap v385: 97 pgs: 97 active+clean; 259 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 17 MiB/s wr, 3.94k op/s 2024-08-31T06:49:02.810 INFO:tasks.cephfs.filesystem:scrub status for tag:c9a1c375-76b0-44f1-9019-3cb3b5c85711 - {'path': '/', 'tag': 'c9a1c375-76b0-44f1-9019-3cb3b5c85711', 'options': 'recursive,force'} 2024-08-31T06:49:03.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:02 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:49:03.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:02 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:49:03.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:02 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:49:04.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:03 smithi106 ceph-mon[22134]: pgmap v386: 97 pgs: 97 active+clean; 261 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 3.72k op/s 2024-08-31T06:49:04.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:03 smithi037 ceph-mon[18612]: pgmap v386: 97 pgs: 97 active+clean; 261 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 3.72k op/s 2024-08-31T06:49:04.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:03 smithi066 ceph-mon[22244]: pgmap v386: 97 pgs: 97 active+clean; 261 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 3.72k op/s 2024-08-31T06:49:06.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:05 smithi106 ceph-mon[22134]: pgmap v387: 97 pgs: 97 active+clean; 269 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 3.49k op/s 2024-08-31T06:49:06.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:05 smithi037 ceph-mon[18612]: pgmap v387: 97 pgs: 97 active+clean; 269 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 3.49k op/s 2024-08-31T06:49:06.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:05 smithi066 ceph-mon[22244]: pgmap v387: 97 pgs: 97 active+clean; 269 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 15 MiB/s wr, 3.49k op/s 2024-08-31T06:49:08.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:07 smithi106 ceph-mon[22134]: pgmap v388: 97 pgs: 97 active+clean; 300 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 3.90k op/s 2024-08-31T06:49:08.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:07 smithi037 ceph-mon[18612]: pgmap v388: 97 pgs: 97 active+clean; 300 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 3.90k op/s 2024-08-31T06:49:08.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:07 smithi066 ceph-mon[22244]: pgmap v388: 97 pgs: 97 active+clean; 300 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 17 MiB/s wr, 3.90k op/s 2024-08-31T06:49:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.532+0000 7f01d4c84640 1 -- 172.21.15.37:0/2021100392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01d010a400 msgr2=0x7f01d010a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.532+0000 7f01d4c84640 1 --2- 172.21.15.37:0/2021100392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01d010a400 0x7f01d010a810 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f01c801acb0 tx=0x7f01c803b8e0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.532+0000 7f01d4c84640 1 -- 172.21.15.37:0/2021100392 shutdown_connections 2024-08-31T06:49:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.532+0000 7f01d4c84640 1 --2- 172.21.15.37:0/2021100392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d01100f0 0x7f01d0110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.532+0000 7f01d4c84640 1 --2- 172.21.15.37:0/2021100392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01d010f7a0 0x7f01d010fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.532+0000 7f01d4c84640 1 --2- 172.21.15.37:0/2021100392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01d010a400 0x7f01d010a810 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.532+0000 7f01d4c84640 1 -- 172.21.15.37:0/2021100392 >> 172.21.15.37:0/2021100392 conn(0x7f01d0070b70 msgr2=0x7f01d0070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.533+0000 7f01d4c84640 1 -- 172.21.15.37:0/2021100392 shutdown_connections 2024-08-31T06:49:08.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.533+0000 7f01d4c84640 1 -- 172.21.15.37:0/2021100392 wait complete. 2024-08-31T06:49:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.534+0000 7f01d4c84640 1 Processor -- start 2024-08-31T06:49:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.534+0000 7f01d4c84640 1 -- start start 2024-08-31T06:49:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.534+0000 7f01d4c84640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01d010a400 0x7f01d01a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.534+0000 7f01d4c84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d010f7a0 0x7f01d01a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.534+0000 7f01d4c84640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01d01100f0 0x7f01d01a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.534+0000 7f01d4c84640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01d0113c00 con 0x7f01d010f7a0 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.534+0000 7f01d4c84640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01d0113a80 con 0x7f01d01100f0 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.534+0000 7f01d4c84640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f01d0113d80 con 0x7f01d010a400 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01cdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d010f7a0 0x7f01d01a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01cdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d010f7a0 0x7f01d01a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40528/0 (socket says 172.21.15.37:40528) 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01cdd9b640 1 -- 172.21.15.37:0/1975150146 learned_addr learned my addr 172.21.15.37:0/1975150146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01ced9d640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01d01100f0 0x7f01d01a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01ce59c640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01d010a400 0x7f01d01a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01cdd9b640 1 -- 172.21.15.37:0/1975150146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01d010a400 msgr2=0x7f01d01a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01d010a400 0x7f01d01a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01cdd9b640 1 -- 172.21.15.37:0/1975150146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01d01100f0 msgr2=0x7f01d01a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01d01100f0 0x7f01d01a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01cdd9b640 1 -- 172.21.15.37:0/1975150146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d01a66e0 con 0x7f01d010f7a0 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.535+0000 7f01ced9d640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01d01100f0 0x7f01d01a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.536+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d010f7a0 0x7f01d01a0d50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f01b800e9f0 tx=0x7f01b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.536+0000 7f01c77fe640 1 -- 172.21.15.37:0/1975150146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b800ccc0 con 0x7f01d010f7a0 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.536+0000 7f01d4c84640 1 -- 172.21.15.37:0/1975150146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d01a69d0 con 0x7f01d010f7a0 2024-08-31T06:49:08.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.536+0000 7f01d4c84640 1 -- 172.21.15.37:0/1975150146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d01ad160 con 0x7f01d010f7a0 2024-08-31T06:49:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.536+0000 7f01c77fe640 1 -- 172.21.15.37:0/1975150146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01b80108c0 con 0x7f01d010f7a0 2024-08-31T06:49:08.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.536+0000 7f01c77fe640 1 -- 172.21.15.37:0/1975150146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8018750 con 0x7f01d010f7a0 2024-08-31T06:49:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.540+0000 7f01dbbee740 1 Processor -- start 2024-08-31T06:49:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.541+0000 7f01dbbee740 1 -- start start 2024-08-31T06:49:08.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.541+0000 7f01c77fe640 1 -- 172.21.15.37:0/1975150146 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f01b80188f0 con 0x7f01d010f7a0 2024-08-31T06:49:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.541+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486be1b0 0x55f048a61ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.541+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0486952f0 0x55f048a62000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.541+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04869d4d0 0x55f048a62540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01dbbee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f0489d7000 con 0x55f0486be1b0 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01dbbee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f0489c6590 con 0x55f04869d4d0 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0486952f0 0x55f048a62000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0486952f0 0x55f048a62000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:42520/0 (socket says 172.21.15.37:42520) 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01ce59c640 1 -- 172.21.15.37:0/1443277300 learned_addr learned my addr 172.21.15.37:0/1443277300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01ced9d640 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486be1b0 0x55f048a61ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04869d4d0 0x55f048a62540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01dbbee740 1 -- 172.21.15.37:0/1443277300 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55f0489ca540 con 0x55f0486952f0 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01c77fe640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01bc0b4d20 0x7f01bc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01ce59c640 1 -- 172.21.15.37:0/1443277300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04869d4d0 msgr2=0x55f048a62540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01ce59c640 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04869d4d0 0x55f048a62540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.542+0000 7f01ce59c640 1 -- 172.21.15.37:0/1443277300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486be1b0 msgr2=0x55f048a61ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01c77fe640 1 -- 172.21.15.37:0/1975150146 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f01b80e57e0 con 0x7f01d010f7a0 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01ce59c640 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486be1b0 0x55f048a61ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01ce59c640 1 -- 172.21.15.37:0/1443277300 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f048729790 con 0x55f0486952f0 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04869d4d0 0x55f048a62540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01ced9d640 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486be1b0 0x55f048a61ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01ce59c640 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0486952f0 0x55f048a62000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01c8042570 tx=0x7f01c80425a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72cc405d33fbefe1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01c4ff9640 1 -- 172.21.15.37:0/1443277300 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8050070 con 0x55f0486952f0 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01ced9d640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01bc0b4d20 0x7f01bc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01c4ff9640 1 -- 172.21.15.37:0/1443277300 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01c8047040 con 0x55f0486952f0 2024-08-31T06:49:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.543+0000 7f01c4ff9640 1 -- 172.21.15.37:0/1443277300 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c80042a0 con 0x55f0486952f0 2024-08-31T06:49:08.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.544+0000 7f01dbbee740 1 -- 172.21.15.37:0/1443277300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0486952f0 msgr2=0x55f048a62000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.544+0000 7f01ced9d640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01bc0b4d20 0x7f01bc0b7230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f01c00144d0 tx=0x7f01c0004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.544+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0486952f0 0x55f048a62000 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01c8042570 tx=0x7f01c80425a0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.544+0000 7f01dbbee740 1 -- 172.21.15.37:0/1443277300 shutdown_connections 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.544+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04869d4d0 0x55f048a62540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.544+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f0486952f0 0x55f048a62000 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.545+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1443277300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486be1b0 0x55f048a61ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.545+0000 7f01dbbee740 1 -- 172.21.15.37:0/1443277300 >> 172.21.15.37:0/1443277300 conn(0x55f0486b2300 msgr2=0x55f048a5f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.545+0000 7f01dbbee740 1 -- 172.21.15.37:0/1443277300 shutdown_connections 2024-08-31T06:49:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.545+0000 7f01dbbee740 1 -- 172.21.15.37:0/1443277300 wait complete. 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.545+0000 7f01dbbee740 1 -- start start 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.545+0000 7f01dbbee740 1 Processor -- start 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a6dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486be1b0 0x55f048a79560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01dbbee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f0488ffab0 con 0x55f0486952f0 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01dbbee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f04894d680 con 0x55f0486be1b0 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01dbbee740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55f048a701e0 con 0x55f04869d4d0 2024-08-31T06:49:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a6d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40550/0 (socket says 172.21.15.37:40550) 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01ce59c640 1 -- 172.21.15.37:0/4282169110 learned_addr learned my addr 172.21.15.37:0/4282169110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01cdd9b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a6dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01dbbee740 10 client.0 _ll_register_callbacks cb 0x55f0486d5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.546+0000 7f01ced9d640 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486be1b0 0x55f048a79560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01cdd9b640 1 -- 172.21.15.37:0/4282169110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486be1b0 msgr2=0x55f048a79560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486be1b0 0x55f048a79560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01cdd9b640 1 -- 172.21.15.37:0/4282169110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 msgr2=0x55f048a6d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a6d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01cdd9b640 1 -- 172.21.15.37:0/4282169110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0487a2620 con 0x55f04869d4d0 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a6dbb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f01b80e2f70 tx=0x7f01b8009770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e00cbb7dc7a322bb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01b5ffb640 1 -- 172.21.15.37:0/4282169110 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80abce0 con 0x55f04869d4d0 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01dbbee740 1 -- 172.21.15.37:0/4282169110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01c8047040 con 0x55f04869d4d0 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01b5ffb640 1 -- 172.21.15.37:0/4282169110 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f01b801ad00 con 0x55f04869d4d0 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.547+0000 7f01b5ffb640 1 -- 172.21.15.37:0/4282169110 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f01b80ab680 con 0x55f04869d4d0 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01dbbee740 10 client.25744 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01dbbee740 1 -- 172.21.15.37:0/4282169110 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f048a7c2b0 con 0x55f04869d4d0 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01b5ffb640 1 -- 172.21.15.37:0/4282169110 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01c8047040 con 0x55f04869d4d0 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01b5ffb640 1 -- 172.21.15.37:0/4282169110 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f01b80b0360 con 0x55f04869d4d0 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01dbbee740 10 client.25744 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01dbbee740 10 client.25744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01dbbee740 20 client.25744 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01dbbee740 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f04867cd80 0x55f048a7f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01dbbee740 4 client.25744 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01dbbee740 1 -- 172.21.15.37:0/4282169110 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0489d8f50 con 0x55f04867cd80 2024-08-31T06:49:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.548+0000 7f01ce59c640 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f04867cd80 0x55f048a7f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.549+0000 7f01b5ffb640 10 client.25744 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.549+0000 7f01ce59c640 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f04867cd80 0x55f048a7f7e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd475fdc5cb2ee4b server_cookie=bfd420727feeca8e in_seq=0 out_seq=0 2024-08-31T06:49:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01b5ffb640 1 -- 172.21.15.37:0/4282169110 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0489d8f50 con 0x55f04867cd80 2024-08-31T06:49:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01b5ffb640 10 client.25744 handle_command_reply: tid=0 2024-08-31T06:49:08.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 client.25744 shutdown 2024-08-31T06:49:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 -- 172.21.15.37:0/4282169110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 msgr2=0x55f048a6dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a6dbb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f01b80e2f70 tx=0x7f01b8009770 comp rx=0 tx=0).stop 2024-08-31T06:49:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 -- 172.21.15.37:0/4282169110 shutdown_connections 2024-08-31T06:49:08.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f04867cd80 0x55f048a7f7e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486be1b0 0x55f048a79560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01b5ffb640 0 client.25744 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a6dbb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 --2- 172.21.15.37:0/4282169110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a6d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.550+0000 7f01dbbee740 1 -- 172.21.15.37:0/4282169110 >> 172.21.15.37:0/4282169110 conn(0x55f0486b2300 msgr2=0x55f048a62af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.551+0000 7f01dbbee740 1 -- 172.21.15.37:0/4282169110 shutdown_connections 2024-08-31T06:49:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.551+0000 7f01dbbee740 1 -- 172.21.15.37:0/4282169110 wait complete. 2024-08-31T06:49:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.551+0000 7f01dbbee740 20 client.25744 trim_cache size 0 max 16384 2024-08-31T06:49:08.578 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.577+0000 7f01dbbee740 1 Processor -- start 2024-08-31T06:49:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.578+0000 7f01dbbee740 1 -- start start 2024-08-31T06:49:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.578+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f04867cd80 0x55f048a6bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.578+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486952f0 0x55f048a6c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.578+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a66b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f04867cd80 0x55f048a6bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f04867cd80 0x55f048a6bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40566/0 (socket says 172.21.15.37:40566) 2024-08-31T06:49:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01ce59c640 1 -- 172.21.15.37:0/3696010164 learned_addr learned my addr 172.21.15.37:0/3696010164 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01cdd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486952f0 0x55f048a6c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01dbbee740 1 -- 172.21.15.37:0/3696010164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01b0010ff0 con 0x55f04867cd80 2024-08-31T06:49:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01dbbee740 1 -- 172.21.15.37:0/3696010164 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000e8c0 con 0x55f0486952f0 2024-08-31T06:49:08.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01dbbee740 1 -- 172.21.15.37:0/3696010164 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000c710 con 0x55f04869d4d0 2024-08-31T06:49:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01ced9d640 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a66b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01cdd9b640 1 -- 172.21.15.37:0/3696010164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 msgr2=0x55f048a66b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:08.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a66b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.579+0000 7f01cdd9b640 1 -- 172.21.15.37:0/3696010164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f04867cd80 msgr2=0x55f048a6bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.580+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f04867cd80 0x55f048a6bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.580+0000 7f01cdd9b640 1 -- 172.21.15.37:0/3696010164 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f048a60740 con 0x55f0486952f0 2024-08-31T06:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.580+0000 7f01ce59c640 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f04867cd80 0x55f048a6bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.580+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486952f0 0x55f048a6c200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f01b80a7f90 tx=0x7f01b8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0d4e912b1140f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.580+0000 7f01b7fff640 1 -- 172.21.15.37:0/3696010164 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80ab860 con 0x55f0486952f0 2024-08-31T06:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.580+0000 7f01b7fff640 1 -- 172.21.15.37:0/3696010164 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01b80aba20 con 0x55f0486952f0 2024-08-31T06:49:08.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.580+0000 7f01b7fff640 1 -- 172.21.15.37:0/3696010164 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b0360 con 0x55f0486952f0 2024-08-31T06:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.581+0000 7f01dbbee740 1 -- 172.21.15.37:0/3696010164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486952f0 msgr2=0x55f048a6c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.581+0000 7f01dbbee740 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486952f0 0x55f048a6c200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f01b80a7f90 tx=0x7f01b8009310 comp rx=0 tx=0).stop 2024-08-31T06:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 -- 172.21.15.37:0/3696010164 shutdown_connections 2024-08-31T06:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a66b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f0486952f0 0x55f048a6c200 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 --2- 172.21.15.37:0/3696010164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f04867cd80 0x55f048a6bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 -- 172.21.15.37:0/3696010164 >> 172.21.15.37:0/3696010164 conn(0x55f0486b2300 msgr2=0x55f048a685d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 -- 172.21.15.37:0/3696010164 shutdown_connections 2024-08-31T06:49:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 -- 172.21.15.37:0/3696010164 wait complete. 2024-08-31T06:49:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 -- start start 2024-08-31T06:49:08.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.582+0000 7f01dbbee740 1 Processor -- start 2024-08-31T06:49:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.583+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04867cd80 0x55f048a75c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.583+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a710d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.583+0000 7f01dbbee740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a71610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.583+0000 7f01dbbee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000cd80 con 0x55f0486952f0 2024-08-31T06:49:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.583+0000 7f01dbbee740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000e1f0 con 0x55f04867cd80 2024-08-31T06:49:08.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04867cd80 0x55f048a75c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01dbbee740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f01b000d450 con 0x55f04869d4d0 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01ce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04867cd80 0x55f048a75c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:33454/0 (socket says 172.21.15.37:33454) 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01ce59c640 1 -- 172.21.15.37:0/1633150634 learned_addr learned my addr 172.21.15.37:0/1633150634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01dbbee740 10 client.0 _ll_register_callbacks cb 0x7f01b80eb240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01ced9d640 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a71610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01cdd9b640 1 -- 172.21.15.37:0/1633150634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 msgr2=0x55f048a71610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a71610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01cdd9b640 1 -- 172.21.15.37:0/1633150634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04867cd80 msgr2=0x55f048a75c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04867cd80 0x55f048a75c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.584+0000 7f01cdd9b640 1 -- 172.21.15.37:0/1633150634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f048a71d20 con 0x55f0486952f0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.585+0000 7f01cdd9b640 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a710d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f01b80eb3f0 tx=0x7f01b80b0610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae00fd1a4dd078d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.585+0000 7f01b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.585+0000 7f01b5ffb640 1 -- 172.21.15.37:0/1633150634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b80ab860 con 0x55f0486952f0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.585+0000 7f01b5ffb640 1 -- 172.21.15.37:0/1633150634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f01b80ab170 con 0x55f0486952f0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.585+0000 7f01dbbee740 1 -- 172.21.15.37:0/1633150634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01b80aba20 con 0x55f0486952f0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01b5ffb640 1 -- 172.21.15.37:0/1633150634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f01b80b5280 con 0x55f0486952f0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01dbbee740 10 client.16242 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01dbbee740 1 -- 172.21.15.37:0/1633150634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f048aea050 con 0x55f0486952f0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01b5ffb640 1 -- 172.21.15.37:0/1633150634 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01b80ac610 con 0x55f0486952f0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01b5ffb640 1 -- 172.21.15.37:0/1633150634 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f01b80aabe0 con 0x55f0486952f0 2024-08-31T06:49:08.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01dbbee740 10 client.16242 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01dbbee740 10 client.16242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01dbbee740 20 client.16242 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f0486be1b0 0x55f048aec530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.586+0000 7f01dbbee740 4 client.16242 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.587+0000 7f01dbbee740 1 -- 172.21.15.37:0/1633150634 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f01b80aba20 con 0x55f0486be1b0 2024-08-31T06:49:08.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.587+0000 7f01ce59c640 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f0486be1b0 0x55f048aec530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.587+0000 7f01b5ffb640 10 client.16242 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:08.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.588+0000 7f01ce59c640 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f0486be1b0 0x55f048aec530 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23c6f43ba67db3b2 server_cookie=1646ff1c4511ac3e in_seq=0 out_seq=0 2024-08-31T06:49:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.602+0000 7f01b5ffb640 1 -- 172.21.15.37:0/1633150634 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f01b80aba20 con 0x55f0486be1b0 2024-08-31T06:49:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.602+0000 7f01b5ffb640 10 client.16242 handle_command_reply: tid=0 2024-08-31T06:49:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.602+0000 7f01dbbee740 1 client.16242 shutdown 2024-08-31T06:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 -- 172.21.15.37:0/1633150634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 msgr2=0x55f048a710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a710d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f01b80eb3f0 tx=0x7f01b80b0610 comp rx=0 tx=0).stop 2024-08-31T06:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 -- 172.21.15.37:0/1633150634 shutdown_connections 2024-08-31T06:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f0486be1b0 0x55f048aec530 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0486952f0 0x55f048a710d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f04869d4d0 0x55f048a71610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 --2- 172.21.15.37:0/1633150634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f04867cd80 0x55f048a75c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 -- 172.21.15.37:0/1633150634 >> 172.21.15.37:0/1633150634 conn(0x55f0486b2300 msgr2=0x55f048a66b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01b5ffb640 0 client.16242 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 -- 172.21.15.37:0/1633150634 shutdown_connections 2024-08-31T06:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 1 -- 172.21.15.37:0/1633150634 wait complete. 2024-08-31T06:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.603+0000 7f01dbbee740 20 client.16242 trim_cache size 0 max 16384 2024-08-31T06:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:49:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:49:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:49:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.605+0000 7f01d4c84640 1 -- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01bc0b4d20 msgr2=0x7f01bc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.605+0000 7f01d4c84640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01bc0b4d20 0x7f01bc0b7230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f01c00144d0 tx=0x7f01c0004730 comp rx=0 tx=0).stop 2024-08-31T06:49:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.605+0000 7f01d4c84640 1 -- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d010f7a0 msgr2=0x7f01d01a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.605+0000 7f01d4c84640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d010f7a0 0x7f01d01a0d50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f01b800e9f0 tx=0x7f01b800eeb0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.605+0000 7f01d4c84640 1 -- 172.21.15.37:0/1975150146 shutdown_connections 2024-08-31T06:49:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.606+0000 7f01d4c84640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01bc0b4d20 0x7f01bc0b7230 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.606+0000 7f01d4c84640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01d010f7a0 0x7f01d01a0d50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.606+0000 7f01d4c84640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01d01100f0 0x7f01d01a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.606+0000 7f01d4c84640 1 --2- 172.21.15.37:0/1975150146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f01d010a400 0x7f01d01a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.606+0000 7f01d4c84640 1 -- 172.21.15.37:0/1975150146 >> 172.21.15.37:0/1975150146 conn(0x7f01d0070b70 msgr2=0x7f01d0073ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.606+0000 7f01d4c84640 1 -- 172.21.15.37:0/1975150146 shutdown_connections 2024-08-31T06:49:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:08.606+0000 7f01d4c84640 1 -- 172.21.15.37:0/1975150146 wait complete. 2024-08-31T06:49:10.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:09 smithi106 ceph-mon[22134]: pgmap v389: 97 pgs: 97 active+clean; 319 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 3.54k op/s 2024-08-31T06:49:10.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:09 smithi037 ceph-mon[18612]: pgmap v389: 97 pgs: 97 active+clean; 319 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 3.54k op/s 2024-08-31T06:49:10.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:09 smithi066 ceph-mon[22244]: pgmap v389: 97 pgs: 97 active+clean; 319 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 3.54k op/s 2024-08-31T06:49:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:11 smithi106 ceph-mon[22134]: pgmap v390: 97 pgs: 97 active+clean; 351 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 4.03k op/s 2024-08-31T06:49:12.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:11 smithi037 ceph-mon[18612]: pgmap v390: 97 pgs: 97 active+clean; 351 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 4.03k op/s 2024-08-31T06:49:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:11 smithi066 ceph-mon[22244]: pgmap v390: 97 pgs: 97 active+clean; 351 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 18 MiB/s wr, 4.03k op/s 2024-08-31T06:49:14.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:13 smithi037 ceph-mon[18612]: pgmap v391: 97 pgs: 97 active+clean; 372 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 17 MiB/s wr, 3.88k op/s 2024-08-31T06:49:14.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:13 smithi066 ceph-mon[22244]: pgmap v391: 97 pgs: 97 active+clean; 372 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 17 MiB/s wr, 3.88k op/s 2024-08-31T06:49:14.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:13 smithi106 ceph-mon[22134]: pgmap v391: 97 pgs: 97 active+clean; 372 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 17 MiB/s wr, 3.88k op/s 2024-08-31T06:49:16.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:15 smithi037 ceph-mon[18612]: pgmap v392: 97 pgs: 97 active+clean; 384 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 3.68k op/s 2024-08-31T06:49:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:15 smithi066 ceph-mon[22244]: pgmap v392: 97 pgs: 97 active+clean; 384 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 3.68k op/s 2024-08-31T06:49:16.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:15 smithi106 ceph-mon[22134]: pgmap v392: 97 pgs: 97 active+clean; 384 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 MiB/s wr, 3.68k op/s 2024-08-31T06:49:18.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:17 smithi037 ceph-mon[18612]: pgmap v393: 97 pgs: 97 active+clean; 405 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.13k op/s 2024-08-31T06:49:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:17 smithi066 ceph-mon[22244]: pgmap v393: 97 pgs: 97 active+clean; 405 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.13k op/s 2024-08-31T06:49:18.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:17 smithi106 ceph-mon[22134]: pgmap v393: 97 pgs: 97 active+clean; 405 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 MiB/s wr, 4.13k op/s 2024-08-31T06:49:20.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:19 smithi037 ceph-mon[18612]: pgmap v394: 97 pgs: 97 active+clean; 414 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 3.76k op/s 2024-08-31T06:49:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:19 smithi066 ceph-mon[22244]: pgmap v394: 97 pgs: 97 active+clean; 414 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 3.76k op/s 2024-08-31T06:49:20.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:19 smithi106 ceph-mon[22134]: pgmap v394: 97 pgs: 97 active+clean; 414 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 MiB/s wr, 3.76k op/s 2024-08-31T06:49:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 -- 172.21.15.37:0/3932743004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc102750 msgr2=0x7f00fc102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.762 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3932743004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc102750 0x7f00fc102b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009900 tx=0x7f00ec02a400 comp rx=0 tx=0).stop 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 -- 172.21.15.37:0/3932743004 shutdown_connections 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3932743004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00fc1089d0 0x7f00fc10f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3932743004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc108080 0x7f00fc108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3932743004 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc102750 0x7f00fc102b60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 -- 172.21.15.37:0/3932743004 >> 172.21.15.37:0/3932743004 conn(0x7f00fc07a4e0 msgr2=0x7f00fc07a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 -- 172.21.15.37:0/3932743004 shutdown_connections 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.759+0000 7f0100a7e640 1 -- 172.21.15.37:0/3932743004 wait complete. 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.760+0000 7f0100a7e640 1 Processor -- start 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.760+0000 7f0100a7e640 1 -- start start 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f0100a7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00fc102750 0x7f00fc199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f0100a7e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc108080 0x7f00fc1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f0100a7e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc1089d0 0x7f00fc19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00fc102750 0x7f00fc199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00fc102750 0x7f00fc199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44620/0 (socket says 172.21.15.37:44620) 2024-08-31T06:49:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc112580 con 0x7f00fc102750 2024-08-31T06:49:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f00fa59c640 1 -- 172.21.15.37:0/3345774569 learned_addr learned my addr 172.21.15.37:0/3345774569 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f00f3fff640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc108080 0x7f00fc1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc112400 con 0x7f00fc1089d0 2024-08-31T06:49:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc112700 con 0x7f00fc108080 2024-08-31T06:49:21.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.761+0000 7f00fad9d640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc1089d0 0x7f00fc19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.762+0000 7f00fad9d640 1 -- 172.21.15.37:0/3345774569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc108080 msgr2=0x7f00fc1995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.762+0000 7f00fad9d640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc108080 0x7f00fc1995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.762+0000 7f00fad9d640 1 -- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00fc102750 msgr2=0x7f00fc199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.762+0000 7f00fad9d640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00fc102750 0x7f00fc199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.762+0000 7f00fad9d640 1 -- 172.21.15.37:0/3345774569 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00fc19ef50 con 0x7f00fc1089d0 2024-08-31T06:49:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.762+0000 7f00fa59c640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00fc102750 0x7f00fc199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.762+0000 7f00fad9d640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc1089d0 0x7f00fc19e850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009fd0 tx=0x7f00f400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.763+0000 7f00f37fe640 1 -- 172.21.15.37:0/3345774569 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f400ce20 con 0x7f00fc1089d0 2024-08-31T06:49:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.763+0000 7f00f37fe640 1 -- 172.21.15.37:0/3345774569 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00f4005020 con 0x7f00fc1089d0 2024-08-31T06:49:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.763+0000 7f00f37fe640 1 -- 172.21.15.37:0/3345774569 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4010690 con 0x7f00fc1089d0 2024-08-31T06:49:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.763+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00fc19f240 con 0x7f00fc1089d0 2024-08-31T06:49:21.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.763+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00fc06a980 con 0x7f00fc1089d0 2024-08-31T06:49:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.766+0000 7f01079e5740 1 Processor -- start 2024-08-31T06:49:21.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.766+0000 7f00f37fe640 1 -- 172.21.15.37:0/3345774569 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f00f4004a40 con 0x7f00fc1089d0 2024-08-31T06:49:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.767+0000 7f01079e5740 1 -- start start 2024-08-31T06:49:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.767+0000 7f01079e5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0d41b0 0x563bed477ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.767+0000 7f01079e5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed478000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.767+0000 7f01079e5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed478540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.767+0000 7f01079e5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563bed3ed000 con 0x563bed0b34d0 2024-08-31T06:49:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.767+0000 7f01079e5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563bed3dc590 con 0x563bed0d41b0 2024-08-31T06:49:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.767+0000 7f01079e5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x563bed3e0540 con 0x563bed0ab2f0 2024-08-31T06:49:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.767+0000 7f00f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed478540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed478000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed478000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:38658/0 (socket says 172.21.15.37:38658) 2024-08-31T06:49:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00f3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0d41b0 0x563bed477ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 -- 172.21.15.37:0/2272084145 learned_addr learned my addr 172.21.15.37:0/2272084145 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 -- 172.21.15.37:0/2272084145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0d41b0 msgr2=0x563bed477ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 --2- 172.21.15.37:0/2272084145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0d41b0 0x563bed477ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 -- 172.21.15.37:0/2272084145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 msgr2=0x563bed478540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 --2- 172.21.15.37:0/2272084145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed478540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 -- 172.21.15.37:0/2272084145 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bed13f790 con 0x563bed0ab2f0 2024-08-31T06:49:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00f3fff640 1 --2- 172.21.15.37:0/2272084145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed478540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.768+0000 7f00fa59c640 1 --2- 172.21.15.37:0/2272084145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed478000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f00ec004650 tx=0x7f00ec0095e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86fc93a84493fc91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.770+0000 7f00f0ff9640 1 -- 172.21.15.37:0/2272084145 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec035040 con 0x563bed0ab2f0 2024-08-31T06:49:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.770+0000 7f00f0ff9640 1 -- 172.21.15.37:0/2272084145 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00ec005480 con 0x563bed0ab2f0 2024-08-31T06:49:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.770+0000 7f00f0ff9640 1 -- 172.21.15.37:0/2272084145 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec004af0 con 0x563bed0ab2f0 2024-08-31T06:49:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.770+0000 7f00f37fe640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f00e80b4d50 0x7f00e80b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.770+0000 7f00f37fe640 1 -- 172.21.15.37:0/3345774569 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f00f40e5be0 con 0x7f00fc1089d0 2024-08-31T06:49:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.771+0000 7f00f3fff640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f00e80b4d50 0x7f00e80b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.771+0000 7f01079e5740 1 -- 172.21.15.37:0/2272084145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 msgr2=0x563bed478000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.771+0000 7f01079e5740 1 --2- 172.21.15.37:0/2272084145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed478000 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f00ec004650 tx=0x7f00ec0095e0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.771+0000 7f01079e5740 1 -- 172.21.15.37:0/2272084145 shutdown_connections 2024-08-31T06:49:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.771+0000 7f01079e5740 1 --2- 172.21.15.37:0/2272084145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed478540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.771+0000 7f01079e5740 1 --2- 172.21.15.37:0/2272084145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed478000 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.771+0000 7f01079e5740 1 --2- 172.21.15.37:0/2272084145 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0d41b0 0x563bed477ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.771+0000 7f01079e5740 1 -- 172.21.15.37:0/2272084145 >> 172.21.15.37:0/2272084145 conn(0x563bed0c8300 msgr2=0x563bed4759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.772+0000 7f01079e5740 1 -- 172.21.15.37:0/2272084145 shutdown_connections 2024-08-31T06:49:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.772+0000 7f01079e5740 1 -- 172.21.15.37:0/2272084145 wait complete. 2024-08-31T06:49:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.772+0000 7f00f3fff640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f00e80b4d50 0x7f00e80b7260 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f00fc07aef0 tx=0x7f00e4004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.773+0000 7f01079e5740 1 -- start start 2024-08-31T06:49:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.773+0000 7f01079e5740 1 Processor -- start 2024-08-31T06:49:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.773+0000 7f01079e5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed483670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f01079e5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed483bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed483670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f01079e5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0d41b0 0x563bed48f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed483670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:38670/0 (socket says 172.21.15.37:38670) 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00fa59c640 1 -- 172.21.15.37:0/4039198501 learned_addr learned my addr 172.21.15.37:0/4039198501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563bed315ab0 con 0x563bed0d41b0 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563bed363680 con 0x563bed0b34d0 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x563bed4861e0 con 0x563bed0ab2f0 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00f3fff640 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed483bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f01079e5740 10 client.0 _ll_register_callbacks cb 0x563bed0eba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00fad9d640 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0d41b0 0x563bed48f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00fa59c640 1 -- 172.21.15.37:0/4039198501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 msgr2=0x563bed483bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00fa59c640 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed483bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00fa59c640 1 -- 172.21.15.37:0/4039198501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0d41b0 msgr2=0x563bed48f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:21.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.774+0000 7f00fa59c640 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0d41b0 0x563bed48f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f00fa59c640 1 -- 172.21.15.37:0/4039198501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bed1b8620 con 0x563bed0ab2f0 2024-08-31T06:49:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00ec005480 con 0x563bed0ab2f0 2024-08-31T06:49:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f00fa59c640 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed483670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0057c0 tx=0x7f00ec03dd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d84943ac0670c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:21.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f00e1ffb640 10 client.25762 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f00e1ffb640 1 -- 172.21.15.37:0/4039198501 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec054060 con 0x563bed0ab2f0 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f00e1ffb640 1 -- 172.21.15.37:0/4039198501 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f00ec005280 con 0x563bed0ab2f0 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f00e1ffb640 1 -- 172.21.15.37:0/4039198501 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f00ec035050 con 0x563bed0ab2f0 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f01079e5740 10 client.25762 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.775+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({fsmap=25}) -- 0x563bed4921f0 con 0x563bed0ab2f0 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.777+0000 7f00e1ffb640 1 -- 172.21.15.37:0/4039198501 <== mon.1 v2:172.21.15.106:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f00ec045020 con 0x563bed0ab2f0 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.777+0000 7f01079e5740 10 client.25762 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.777+0000 7f01079e5740 10 client.25762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:21.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.777+0000 7f01079e5740 20 client.25762 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.777+0000 7f01079e5740 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563bed092d80 0x563bed495550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.777+0000 7f01079e5740 4 client.25762 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.777+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bed3eef50 con 0x563bed092d80 2024-08-31T06:49:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.777+0000 7f00f3fff640 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563bed092d80 0x563bed495550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.778+0000 7f00e1ffb640 10 client.25762 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.778+0000 7f00f3fff640 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563bed092d80 0x563bed495550 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac8e722145969eba server_cookie=a425f27bde0fffc3 in_seq=0 out_seq=0 2024-08-31T06:49:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.779+0000 7f00e1ffb640 1 -- 172.21.15.37:0/4039198501 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563bed3eef50 con 0x563bed092d80 2024-08-31T06:49:21.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.779+0000 7f00e1ffb640 10 client.25762 handle_command_reply: tid=0 2024-08-31T06:49:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.779+0000 7f01079e5740 1 client.25762 shutdown 2024-08-31T06:49:21.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.779+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 msgr2=0x563bed483670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.779+0000 7f01079e5740 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed483670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0057c0 tx=0x7f00ec03dd00 comp rx=0 tx=0).stop 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 shutdown_connections 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563bed092d80 0x563bed495550 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0d41b0 0x563bed48f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed483bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 1 --2- 172.21.15.37:0/4039198501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0ab2f0 0x563bed483670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 >> 172.21.15.37:0/4039198501 conn(0x563bed0c8300 msgr2=0x563bed478af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f00e1ffb640 0 client.25762 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 shutdown_connections 2024-08-31T06:49:21.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 1 -- 172.21.15.37:0/4039198501 wait complete. 2024-08-31T06:49:21.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.780+0000 7f01079e5740 20 client.25762 trim_cache size 0 max 16384 2024-08-31T06:49:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.807+0000 7f01079e5740 1 Processor -- start 2024-08-31T06:49:21.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.807+0000 7f01079e5740 1 -- start start 2024-08-31T06:49:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.807+0000 7f01079e5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0ab2f0 0x563bed47cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f01079e5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed47d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f01079e5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 0x563bed480630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f01079e5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1af970 con 0x563bed0b34d0 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f01079e5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1ad240 con 0x563bed0ab2f0 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f01079e5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1ab090 con 0x563bed0d41b0 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed47d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0ab2f0 0x563bed47cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed47d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44648/0 (socket says 172.21.15.37:44648) 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00f3fff640 1 -- 172.21.15.37:0/1006231362 learned_addr learned my addr 172.21.15.37:0/1006231362 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00fad9d640 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 0x563bed480630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00f3fff640 1 -- 172.21.15.37:0/1006231362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 msgr2=0x563bed480630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:21.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00f3fff640 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 0x563bed480630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00f3fff640 1 -- 172.21.15.37:0/1006231362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0ab2f0 msgr2=0x563bed47cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:21.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00f3fff640 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0ab2f0 0x563bed47cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00f3fff640 1 -- 172.21.15.37:0/1006231362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bed47d670 con 0x563bed0b34d0 2024-08-31T06:49:21.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.808+0000 7f00fa59c640 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0ab2f0 0x563bed47cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:21.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.809+0000 7f00f3fff640 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed47d130 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f00fc06c760 tx=0x7f00e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149e738e8aefa97e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:21.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.809+0000 7f00e3fff640 1 -- 172.21.15.37:0/1006231362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4019040 con 0x563bed0b34d0 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.809+0000 7f00e3fff640 1 -- 172.21.15.37:0/1006231362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00e4035440 con 0x563bed0b34d0 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.809+0000 7f00e3fff640 1 -- 172.21.15.37:0/1006231362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e402d6e0 con 0x563bed0b34d0 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.810+0000 7f01079e5740 1 -- 172.21.15.37:0/1006231362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 msgr2=0x563bed47d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.810+0000 7f01079e5740 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed47d130 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f00fc06c760 tx=0x7f00e4013000 comp rx=0 tx=0).stop 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.810+0000 7f01079e5740 1 -- 172.21.15.37:0/1006231362 shutdown_connections 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.810+0000 7f01079e5740 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0b34d0 0x563bed47d130 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.810+0000 7f01079e5740 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 0x563bed480630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.810+0000 7f01079e5740 1 --2- 172.21.15.37:0/1006231362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0ab2f0 0x563bed47cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.811+0000 7f01079e5740 1 -- 172.21.15.37:0/1006231362 >> 172.21.15.37:0/1006231362 conn(0x563bed0c8300 msgr2=0x563bed481cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.811+0000 7f01079e5740 1 -- 172.21.15.37:0/1006231362 shutdown_connections 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.811+0000 7f01079e5740 1 -- 172.21.15.37:0/1006231362 wait complete. 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.811+0000 7f01079e5740 1 -- start start 2024-08-31T06:49:21.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.811+0000 7f01079e5740 1 Processor -- start 2024-08-31T06:49:21.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f01079e5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0ab2f0 0x563bed498610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f01079e5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed498bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0ab2f0 0x563bed498610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f00fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0ab2f0 0x563bed498610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44664/0 (socket says 172.21.15.37:44664) 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f00fa59c640 1 -- 172.21.15.37:0/3573172113 learned_addr learned my addr 172.21.15.37:0/3573172113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f01079e5740 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 0x563bed4f8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1ab700 con 0x563bed0ab2f0 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1acb70 con 0x563bed0b34d0 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f00fc1abdd0 con 0x563bed0d41b0 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f00f3fff640 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed498bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.812+0000 7f00fad9d640 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 0x563bed4f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f01079e5740 10 client.0 _ll_register_callbacks cb 0x7f00e4009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f00f3fff640 1 -- 172.21.15.37:0/3573172113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 msgr2=0x563bed4f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f00f3fff640 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 0x563bed4f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f00f3fff640 1 -- 172.21.15.37:0/3573172113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0ab2f0 msgr2=0x563bed498610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f00f3fff640 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0ab2f0 0x563bed498610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f00f3fff640 1 -- 172.21.15.37:0/3573172113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bed4f8a00 con 0x563bed0b34d0 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00e4035440 con 0x563bed0b34d0 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f00f3fff640 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed498bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x563bed484300 tx=0x7f00e4005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a80fd1a5acdd03eb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.813+0000 7f00e1ffb640 10 client.25754 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:49:21.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.814+0000 7f00e1ffb640 1 -- 172.21.15.37:0/3573172113 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e4052020 con 0x563bed0b34d0 2024-08-31T06:49:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.814+0000 7f00e1ffb640 1 -- 172.21.15.37:0/3573172113 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f00e40357f0 con 0x563bed0b34d0 2024-08-31T06:49:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.814+0000 7f00e1ffb640 1 -- 172.21.15.37:0/3573172113 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f00e4019070 con 0x563bed0b34d0 2024-08-31T06:49:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.814+0000 7f01079e5740 10 client.25754 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.814+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({fsmap=25}) -- 0x563bed4ffcb0 con 0x563bed0b34d0 2024-08-31T06:49:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.814+0000 7f00e1ffb640 1 -- 172.21.15.37:0/3573172113 <== mon.2 v2:172.21.15.66:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f00e404d070 con 0x563bed0b34d0 2024-08-31T06:49:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f01079e5740 10 client.25754 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:21.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f01079e5740 10 client.25754 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f01079e5740 20 client.25754 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f01079e5740 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563bed0681c0 0x563bed502130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f01079e5740 4 client.25754 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-31T06:49:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563bed3ea9f0 con 0x563bed0681c0 2024-08-31T06:49:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f00fa59c640 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563bed0681c0 0x563bed502130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f00e1ffb640 10 client.25754 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:21.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.815+0000 7f00fa59c640 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563bed0681c0 0x563bed502130 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1713f3f7e46fae server_cookie=8844b9d98efa5cb1 in_seq=0 out_seq=0 2024-08-31T06:49:21.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.827+0000 7f00e1ffb640 1 -- 172.21.15.37:0/3573172113 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563bed3ea9f0 con 0x563bed0681c0 2024-08-31T06:49:21.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.827+0000 7f00e1ffb640 10 client.25754 handle_command_reply: tid=0 2024-08-31T06:49:21.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.827+0000 7f01079e5740 1 client.25754 shutdown 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 msgr2=0x563bed498bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed498bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x563bed484300 tx=0x7f00e4005fb0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 shutdown_connections 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563bed0681c0 0x563bed502130 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f00e1ffb640 0 client.25754 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563bed0d41b0 0x563bed4f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563bed0b34d0 0x563bed498bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 --2- 172.21.15.37:0/3573172113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bed0ab2f0 0x563bed498610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 >> 172.21.15.37:0/3573172113 conn(0x563bed0c8300 msgr2=0x563bed47e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 shutdown_connections 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 1 -- 172.21.15.37:0/3573172113 wait complete. 2024-08-31T06:49:21.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.828+0000 7f01079e5740 20 client.25754 trim_cache size 0 max 16384 2024-08-31T06:49:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-31T06:49:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-31T06:49:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-31T06:49:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-31T06:49:21.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f00e80b4d50 msgr2=0x7f00e80b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f00e80b4d50 0x7f00e80b7260 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f00fc07aef0 tx=0x7f00e4004730 comp rx=0 tx=0).stop 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc1089d0 msgr2=0x7f00fc19e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc1089d0 0x7f00fc19e850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009fd0 tx=0x7f00f400ef10 comp rx=0 tx=0).stop 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 shutdown_connections 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f00e80b4d50 0x7f00e80b7260 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00fc1089d0 0x7f00fc19e850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00fc108080 0x7f00fc1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 --2- 172.21.15.37:0/3345774569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00fc102750 0x7f00fc199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 >> 172.21.15.37:0/3345774569 conn(0x7f00fc07a4e0 msgr2=0x7f00fc106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 shutdown_connections 2024-08-31T06:49:21.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-31T06:49:21.829+0000 7f0100a7e640 1 -- 172.21.15.37:0/3345774569 wait complete. 2024-08-31T06:49:22.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:21 smithi037 ceph-mon[18612]: pgmap v395: 97 pgs: 97 active+clean; 430 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.15k op/s 2024-08-31T06:49:22.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:21 smithi066 ceph-mon[22244]: pgmap v395: 97 pgs: 97 active+clean; 430 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.15k op/s 2024-08-31T06:49:22.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:21 smithi106 ceph-mon[22134]: pgmap v395: 97 pgs: 97 active+clean; 430 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 MiB/s wr, 4.15k op/s 2024-08-31T06:49:24.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:23 smithi037 ceph-mon[18612]: pgmap v396: 97 pgs: 97 active+clean; 441 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 3.90k op/s 2024-08-31T06:49:24.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:23 smithi066 ceph-mon[22244]: pgmap v396: 97 pgs: 97 active+clean; 441 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 3.90k op/s 2024-08-31T06:49:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:23 smithi106 ceph-mon[22134]: pgmap v396: 97 pgs: 97 active+clean; 441 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 17 MiB/s wr, 3.90k op/s 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:setting up random write file 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:done setting up random write file 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:starting fsync run 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0044s fsync time: 0.0074s 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0028s fsync time: 0.0457s 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0022s fsync time: 0.0330s 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0427s 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0028s fsync time: 0.0286s 2024-08-31T06:49:25.650 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0032s fsync time: 0.0351s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0022s fsync time: 0.0295s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0024s fsync time: 0.0409s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0042s fsync time: 0.0380s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0032s fsync time: 0.0527s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0023s fsync time: 0.0188s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0024s fsync time: 0.0348s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0347s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0024s fsync time: 0.0517s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0314s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0031s fsync time: 0.0611s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0445s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0035s fsync time: 0.0507s 2024-08-31T06:49:25.651 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0026s fsync time: 0.0197s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0030s fsync time: 0.0433s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0034s fsync time: 0.0372s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0051s fsync time: 0.0505s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0037s fsync time: 0.0404s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0045s fsync time: 0.0255s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0034s fsync time: 0.0391s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0026s fsync time: 0.0474s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0087s fsync time: 0.0424s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0023s fsync time: 0.0556s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0032s fsync time: 0.0756s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0030s fsync time: 0.0488s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0030s fsync time: 0.1001s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0031s fsync time: 0.0497s 2024-08-31T06:49:25.652 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0027s fsync time: 0.0336s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0038s fsync time: 0.0318s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0015s fsync time: 0.2141s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0027s fsync time: 0.0141s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0027s fsync time: 0.0149s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0022s fsync time: 0.0166s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0031s fsync time: 0.0162s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0026s fsync time: 0.0141s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0033s fsync time: 0.0205s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0020s fsync time: 0.0180s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0030s fsync time: 0.0175s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0024s fsync time: 0.0262s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0115s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0036s fsync time: 0.0145s 2024-08-31T06:49:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0032s fsync time: 0.0135s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0030s fsync time: 0.0203s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0026s fsync time: 0.0344s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0024s fsync time: 0.0198s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0031s fsync time: 0.0358s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0304s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0036s fsync time: 0.0308s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0031s fsync time: 0.0465s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0029s fsync time: 0.0244s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0203s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0351s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0024s fsync time: 0.0231s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:write time: 0.0025s fsync time: 0.0340s 2024-08-31T06:49:25.654 INFO:tasks.workunit.client.0.smithi037.stdout:run done 59 fsyncs total, killing random writer 2024-08-31T06:49:25.661 INFO:tasks.workunit.client.0.smithi037.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-08-31T06:49:25.661 INFO:tasks.workunit.client.0.smithi037.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-08-31T06:49:25.661 INFO:tasks.workunit.client.0.smithi037.stderr:+ whereis lsof 2024-08-31T06:49:25.789 INFO:tasks.workunit.client.0.smithi037.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-08-31T06:49:25.790 INFO:tasks.workunit.client.0.smithi037.stderr:+ lsof 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/6b7c0863b80cf8a325e7cc263bfea23e014120924e4b78d21c42a28e38c2c013/merged 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/f382b8e5b7040078cbc28f42a531874bc79e62296b84b647ba7a7fa61aa01dda/merged 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/d63f750a74668710906964fc4e652158003806f3fd6886b833c3c3642450e510/merged 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/8262479c0f4b91c5c31422829f6bd7ebcfc5e5fc6899a62dc289ab322c36df41/merged 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.857 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/562cd7ab317c5883f32ca0563ea9b7d697c6de1a6261a83e87a676f77ed2e51d/merged 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/32e41568a1d7622bf9ebedeabfe9c6414d828dfe5208e6cb45107c698cdfabcd/merged 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/460acfb570afb9205ad5e14bbe736aca6ff741b8c87636811fc9c3957cbdf767/merged 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/7af5b8222651147961ad3b1321a47a9c59306c981e4f193b891aae8b355affed/merged 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/ec06c6a909f1609a43ded7e06d3e5bfc21d0a36fe7f80b7d595b688482c7359b/merged 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/67d0e3cc4e0fb134dbbcc4424b9197fec6edc29c55e8eb899ba1ca5685644b88/merged 2024-08-31T06:49:25.858 INFO:tasks.workunit.client.0.smithi037.stderr: Output information may be incomplete. 2024-08-31T06:49:25.928 INFO:tasks.workunit.client.0.smithi037.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-08-31T06:49:25.928 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-08-31T06:49:25.929 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-08-31T06:49:25.930 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2024-08-31T06:49:25.931 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 12 root NOFD /proc/12/fd (opendir: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-08-31T06:49:25.932 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-08-31T06:49:25.933 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-08-31T06:49:25.933 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-08-31T06:49:25.933 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-08-31T06:49:25.933 INFO:tasks.workunit.client.0.smithi037.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-08-31T06:49:25.933 INFO:tasks.workunit.client.0.smithi037.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-08-31T06:49:25.933 INFO:tasks.workunit.client.0.smithi037.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-08-31T06:49:25.933 INFO:tasks.workunit.client.0.smithi037.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-08-31T06:49:25.934 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-08-31T06:49:25.934 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-08-31T06:49:25.934 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-08-31T06:49:25.934 INFO:tasks.workunit.client.0.smithi037.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-08-31T06:49:25.934 INFO:tasks.workunit.client.0.smithi037.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-08-31T06:49:25.934 INFO:tasks.workunit.client.0.smithi037.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-08-31T06:49:25.934 INFO:tasks.workunit.client.0.smithi037.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-08-31T06:49:25.934 INFO:tasks.workunit.client.0.smithi037.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-08-31T06:49:25.935 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-08-31T06:49:25.936 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-08-31T06:49:25.936 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-08-31T06:49:25.936 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-08-31T06:49:25.936 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-08-31T06:49:25.936 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-08-31T06:49:25.936 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-08-31T06:49:25.937 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 27 root cwd unknown /proc/27/cwd (readlink: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 27 root rtd unknown /proc/27/root (readlink: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 27 root txt unknown /proc/27/exe (readlink: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 27 root NOFD /proc/27/fd (opendir: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-08-31T06:49:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-08-31T06:49:25.939 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-08-31T06:49:25.939 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-08-31T06:49:25.939 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-08-31T06:49:25.939 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-08-31T06:49:25.939 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-08-31T06:49:25.939 INFO:tasks.workunit.client.0.smithi037.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-08-31T06:49:25.939 INFO:tasks.workunit.client.0.smithi037.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-08-31T06:49:25.940 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-08-31T06:49:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-08-31T06:49:25.942 INFO:tasks.workunit.client.0.smithi037.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-08-31T06:49:25.942 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-08-31T06:49:25.942 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-08-31T06:49:25.942 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-08-31T06:49:25.942 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-08-31T06:49:25.942 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2024-08-31T06:49:25.943 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2024-08-31T06:49:25.943 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2024-08-31T06:49:25.943 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 39 root NOFD /proc/39/fd (opendir: Permission denied) 2024-08-31T06:49:25.943 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-08-31T06:49:25.943 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-08-31T06:49:25.944 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-08-31T06:49:25.944 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-08-31T06:49:25.944 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-08-31T06:49:25.944 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-08-31T06:49:25.944 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-08-31T06:49:25.945 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-08-31T06:49:25.945 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-08-31T06:49:25.945 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-08-31T06:49:25.945 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-08-31T06:49:25.945 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-08-31T06:49:25.945 INFO:tasks.workunit.client.0.smithi037.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-08-31T06:49:25.945 INFO:tasks.workunit.client.0.smithi037.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-08-31T06:49:25.945 INFO:tasks.workunit.client.0.smithi037.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 45 root cwd unknown /proc/45/cwd (readlink: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 45 root rtd unknown /proc/45/root (readlink: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 45 root txt unknown /proc/45/exe (readlink: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 45 root NOFD /proc/45/fd (opendir: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-08-31T06:49:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-08-31T06:49:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-08-31T06:49:25.948 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-08-31T06:49:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-08-31T06:49:25.950 INFO:tasks.workunit.client.0.smithi037.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-08-31T06:49:25.951 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 71 root NOFD /proc/71/fd (opendir: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-08-31T06:49:25.952 INFO:tasks.workunit.client.0.smithi037.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-08-31T06:49:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:khugepage 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:khugepage 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2024-08-31T06:49:25.954 INFO:tasks.workunit.client.0.smithi037.stdout:khugepage 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:khugepage 81 root NOFD /proc/81/fd (opendir: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-08-31T06:49:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-08-31T06:49:25.956 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-08-31T06:49:25.957 INFO:tasks.workunit.client.0.smithi037.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 93 root cwd unknown /proc/93/cwd (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 93 root rtd unknown /proc/93/root (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 93 root txt unknown /proc/93/exe (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 93 root NOFD /proc/93/fd (opendir: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kswapd0 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kswapd0 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kswapd0 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kswapd0 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 101 root cwd unknown /proc/101/cwd (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 101 root rtd unknown /proc/101/root (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 101 root txt unknown /proc/101/exe (readlink: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 101 root NOFD /proc/101/fd (opendir: Permission denied) 2024-08-31T06:49:25.958 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-08-31T06:49:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-08-31T06:49:25.960 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 114 root cwd unknown /proc/114/cwd (readlink: Permission denied) 2024-08-31T06:49:25.960 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 114 root rtd unknown /proc/114/root (readlink: Permission denied) 2024-08-31T06:49:25.960 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 114 root txt unknown /proc/114/exe (readlink: Permission denied) 2024-08-31T06:49:25.960 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 114 root NOFD /proc/114/fd (opendir: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 115 root cwd unknown /proc/115/cwd (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 115 root rtd unknown /proc/115/root (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 115 root txt unknown /proc/115/exe (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 115 root NOFD /proc/115/fd (opendir: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 125 root cwd unknown /proc/125/cwd (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 125 root rtd unknown /proc/125/root (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 125 root txt unknown /proc/125/exe (readlink: Permission denied) 2024-08-31T06:49:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 125 root NOFD /proc/125/fd (opendir: Permission denied) 2024-08-31T06:49:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 128 root cwd unknown /proc/128/cwd (readlink: Permission denied) 2024-08-31T06:49:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 128 root rtd unknown /proc/128/root (readlink: Permission denied) 2024-08-31T06:49:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 128 root txt unknown /proc/128/exe (readlink: Permission denied) 2024-08-31T06:49:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 128 root NOFD /proc/128/fd (opendir: Permission denied) 2024-08-31T06:49:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 240 root cwd unknown /proc/240/cwd (readlink: Permission denied) 2024-08-31T06:49:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 240 root rtd unknown /proc/240/root (readlink: Permission denied) 2024-08-31T06:49:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 240 root txt unknown /proc/240/exe (readlink: Permission denied) 2024-08-31T06:49:25.962 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 240 root NOFD /proc/240/fd (opendir: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 241 root cwd unknown /proc/241/cwd (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 241 root rtd unknown /proc/241/root (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 241 root txt unknown /proc/241/exe (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 241 root NOFD /proc/241/fd (opendir: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 280 root cwd unknown /proc/280/cwd (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 280 root rtd unknown /proc/280/root (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 280 root txt unknown /proc/280/exe (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 280 root NOFD /proc/280/fd (opendir: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 283 root cwd unknown /proc/283/cwd (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 283 root rtd unknown /proc/283/root (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 283 root txt unknown /proc/283/exe (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 283 root NOFD /proc/283/fd (opendir: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 287 root cwd unknown /proc/287/cwd (readlink: Permission denied) 2024-08-31T06:49:25.963 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 287 root rtd unknown /proc/287/root (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 287 root txt unknown /proc/287/exe (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 287 root NOFD /proc/287/fd (opendir: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 290 root cwd unknown /proc/290/cwd (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 290 root rtd unknown /proc/290/root (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 290 root txt unknown /proc/290/exe (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 290 root NOFD /proc/290/fd (opendir: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 372 root cwd unknown /proc/372/cwd (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 372 root rtd unknown /proc/372/root (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 372 root txt unknown /proc/372/exe (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 372 root NOFD /proc/372/fd (opendir: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 425 root cwd unknown /proc/425/cwd (readlink: Permission denied) 2024-08-31T06:49:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 425 root rtd unknown /proc/425/root (readlink: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 425 root txt unknown /proc/425/exe (readlink: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 425 root NOFD /proc/425/fd (opendir: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 426 root cwd unknown /proc/426/cwd (readlink: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 426 root rtd unknown /proc/426/root (readlink: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 426 root txt unknown /proc/426/exe (readlink: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 426 root NOFD /proc/426/fd (opendir: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 429 root cwd unknown /proc/429/cwd (readlink: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 429 root rtd unknown /proc/429/root (readlink: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 429 root txt unknown /proc/429/exe (readlink: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 429 root NOFD /proc/429/fd (opendir: Permission denied) 2024-08-31T06:49:25.965 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 430 root cwd unknown /proc/430/cwd (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 430 root rtd unknown /proc/430/root (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 430 root txt unknown /proc/430/exe (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 430 root NOFD /proc/430/fd (opendir: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 431 root cwd unknown /proc/431/cwd (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 431 root rtd unknown /proc/431/root (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 431 root txt unknown /proc/431/exe (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 431 root NOFD /proc/431/fd (opendir: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 433 root cwd unknown /proc/433/cwd (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 433 root rtd unknown /proc/433/root (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 433 root txt unknown /proc/433/exe (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 433 root NOFD /proc/433/fd (opendir: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_0 447 root cwd unknown /proc/447/cwd (readlink: Permission denied) 2024-08-31T06:49:25.966 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_0 447 root rtd unknown /proc/447/root (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_0 447 root txt unknown /proc/447/exe (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_0 447 root NOFD /proc/447/fd (opendir: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 448 root cwd unknown /proc/448/cwd (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 448 root rtd unknown /proc/448/root (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 448 root txt unknown /proc/448/exe (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 448 root NOFD /proc/448/fd (opendir: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_1 449 root cwd unknown /proc/449/cwd (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_1 449 root rtd unknown /proc/449/root (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_1 449 root txt unknown /proc/449/exe (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_1 449 root NOFD /proc/449/fd (opendir: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-08-31T06:49:25.967 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_2 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_2 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_2 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_2 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_3 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_3 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_3 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_3 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-08-31T06:49:25.968 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_4 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_4 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_4 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_4 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-08-31T06:49:25.969 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_5 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_5 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_5 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_5 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_6 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_6 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_6 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_6 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-08-31T06:49:25.970 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_7 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_7 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_7 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_7 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_8 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_8 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_8 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-08-31T06:49:25.971 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_8 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_9 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_9 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_9 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:scsi_eh_9 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-08-31T06:49:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:jbd2/sda1 500 root cwd unknown /proc/500/cwd (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:jbd2/sda1 500 root rtd unknown /proc/500/root (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:jbd2/sda1 500 root txt unknown /proc/500/exe (readlink: Permission denied) 2024-08-31T06:49:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:jbd2/sda1 500 root NOFD /proc/500/fd (opendir: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 501 root cwd unknown /proc/501/cwd (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 501 root rtd unknown /proc/501/root (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 501 root txt unknown /proc/501/exe (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 501 root NOFD /proc/501/fd (opendir: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-j 577 root cwd unknown /proc/577/cwd (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-j 577 root rtd unknown /proc/577/root (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-j 577 root txt unknown /proc/577/exe (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-j 577 root NOFD /proc/577/fd (opendir: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:ext4lazyi 583 root cwd unknown /proc/583/cwd (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:ext4lazyi 583 root rtd unknown /proc/583/root (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:ext4lazyi 583 root txt unknown /proc/583/exe (readlink: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:ext4lazyi 583 root NOFD /proc/583/fd (opendir: Permission denied) 2024-08-31T06:49:25.974 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-u 596 root cwd unknown /proc/596/cwd (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-u 596 root rtd unknown /proc/596/root (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-u 596 root txt unknown /proc/596/exe (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-u 596 root NOFD /proc/596/fd (opendir: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 647 root cwd unknown /proc/647/cwd (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 647 root rtd unknown /proc/647/root (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 647 root txt unknown /proc/647/exe (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 647 root NOFD /proc/647/fd (opendir: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:kipmi0 661 root cwd unknown /proc/661/cwd (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:kipmi0 661 root rtd unknown /proc/661/root (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:kipmi0 661 root txt unknown /proc/661/exe (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:kipmi0 661 root NOFD /proc/661/fd (opendir: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:rpcbind 672 rpc cwd unknown /proc/672/cwd (readlink: Permission denied) 2024-08-31T06:49:25.975 INFO:tasks.workunit.client.0.smithi037.stdout:rpcbind 672 rpc rtd unknown /proc/672/root (readlink: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:rpcbind 672 rpc txt unknown /proc/672/exe (readlink: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:rpcbind 672 rpc NOFD /proc/672/fd (opendir: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 687 root cwd unknown /proc/687/cwd (readlink: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 687 root rtd unknown /proc/687/root (readlink: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 687 root txt unknown /proc/687/exe (readlink: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 687 root NOFD /proc/687/fd (opendir: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 688 root cwd unknown /proc/688/cwd (readlink: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 688 root rtd unknown /proc/688/root (readlink: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 688 root txt unknown /proc/688/exe (readlink: Permission denied) 2024-08-31T06:49:25.976 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 688 root NOFD /proc/688/fd (opendir: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 root cwd unknown /proc/694/cwd (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 root rtd unknown /proc/694/root (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 root txt unknown /proc/694/exe (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 root NOFD /proc/694/fd (opendir: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 695 auditd root cwd unknown /proc/694/task/695/cwd (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 695 auditd root rtd unknown /proc/694/task/695/root (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 695 auditd root txt unknown /proc/694/task/695/exe (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 695 auditd root NOFD /proc/694/task/695/fd (opendir: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 697 auditd root cwd unknown /proc/694/task/697/cwd (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 697 auditd root rtd unknown /proc/694/task/697/root (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 697 auditd root txt unknown /proc/694/task/697/exe (readlink: Permission denied) 2024-08-31T06:49:25.977 INFO:tasks.workunit.client.0.smithi037.stdout:auditd 694 697 auditd root NOFD /proc/694/task/697/fd (opendir: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:sedispatc 696 root cwd unknown /proc/696/cwd (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:sedispatc 696 root rtd unknown /proc/696/root (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:sedispatc 696 root txt unknown /proc/696/exe (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:sedispatc 696 root NOFD /proc/696/fd (opendir: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:dbus-brok 723 dbus cwd unknown /proc/723/cwd (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:dbus-brok 723 dbus rtd unknown /proc/723/root (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:dbus-brok 723 dbus txt unknown /proc/723/exe (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:dbus-brok 723 dbus NOFD /proc/723/fd (opendir: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:dbus-brok 724 dbus cwd unknown /proc/724/cwd (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:dbus-brok 724 dbus rtd unknown /proc/724/root (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:dbus-brok 724 dbus txt unknown /proc/724/exe (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:dbus-brok 724 dbus NOFD /proc/724/fd (opendir: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 root cwd unknown /proc/725/cwd (readlink: Permission denied) 2024-08-31T06:49:25.978 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 root rtd unknown /proc/725/root (readlink: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 root txt unknown /proc/725/exe (readlink: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 root NOFD /proc/725/fd (opendir: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 771 gmain root cwd unknown /proc/725/task/771/cwd (readlink: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 771 gmain root rtd unknown /proc/725/task/771/root (readlink: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 771 gmain root txt unknown /proc/725/task/771/exe (readlink: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 771 gmain root NOFD /proc/725/task/771/fd (opendir: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 772 gdbus root cwd unknown /proc/725/task/772/cwd (readlink: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 772 gdbus root rtd unknown /proc/725/task/772/root (readlink: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 772 gdbus root txt unknown /proc/725/task/772/exe (readlink: Permission denied) 2024-08-31T06:49:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:NetworkMa 725 772 gdbus root NOFD /proc/725/task/772/fd (opendir: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:irqbalanc 728 root cwd unknown /proc/728/cwd (readlink: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:irqbalanc 728 root rtd unknown /proc/728/root (readlink: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:irqbalanc 728 root txt unknown /proc/728/exe (readlink: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:irqbalanc 728 root NOFD /proc/728/fd (opendir: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:irqbalanc 728 732 gmain root cwd unknown /proc/728/task/732/cwd (readlink: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:irqbalanc 728 732 gmain root rtd unknown /proc/728/task/732/root (readlink: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:irqbalanc 728 732 gmain root txt unknown /proc/728/task/732/exe (readlink: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:irqbalanc 728 732 gmain root NOFD /proc/728/task/732/fd (opendir: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:lsmd 729 libstoragemgmt cwd unknown /proc/729/cwd (readlink: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:lsmd 729 libstoragemgmt rtd unknown /proc/729/root (readlink: Permission denied) 2024-08-31T06:49:25.980 INFO:tasks.workunit.client.0.smithi037.stdout:lsmd 729 libstoragemgmt txt unknown /proc/729/exe (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:lsmd 729 libstoragemgmt NOFD /proc/729/fd (opendir: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:mcelog 730 root cwd unknown /proc/730/cwd (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:mcelog 730 root rtd unknown /proc/730/root (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:mcelog 730 root txt unknown /proc/730/exe (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:mcelog 730 root NOFD /proc/730/fd (opendir: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:smartd 733 root cwd unknown /proc/733/cwd (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:smartd 733 root rtd unknown /proc/733/root (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:smartd 733 root txt unknown /proc/733/exe (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:smartd 733 root NOFD /proc/733/fd (opendir: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-l 738 root cwd unknown /proc/738/cwd (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-l 738 root rtd unknown /proc/738/root (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-l 738 root txt unknown /proc/738/exe (readlink: Permission denied) 2024-08-31T06:49:25.981 INFO:tasks.workunit.client.0.smithi037.stdout:systemd-l 738 root NOFD /proc/738/fd (opendir: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 782 root cwd unknown /proc/782/cwd (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 782 root rtd unknown /proc/782/root (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 782 root txt unknown /proc/782/exe (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 782 root NOFD /proc/782/fd (opendir: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 root cwd unknown /proc/790/cwd (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 root rtd unknown /proc/790/root (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 root txt unknown /proc/790/exe (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 root NOFD /proc/790/fd (opendir: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 795 gssproxy root cwd unknown /proc/790/task/795/cwd (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 795 gssproxy root rtd unknown /proc/790/task/795/root (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 795 gssproxy root txt unknown /proc/790/task/795/exe (readlink: Permission denied) 2024-08-31T06:49:25.982 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 795 gssproxy root NOFD /proc/790/task/795/fd (opendir: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 796 gssproxy root cwd unknown /proc/790/task/796/cwd (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 796 gssproxy root rtd unknown /proc/790/task/796/root (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 796 gssproxy root txt unknown /proc/790/task/796/exe (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 796 gssproxy root NOFD /proc/790/task/796/fd (opendir: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 797 gssproxy root cwd unknown /proc/790/task/797/cwd (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 797 gssproxy root rtd unknown /proc/790/task/797/root (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 797 gssproxy root txt unknown /proc/790/task/797/exe (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 797 gssproxy root NOFD /proc/790/task/797/fd (opendir: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 798 gssproxy root cwd unknown /proc/790/task/798/cwd (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 798 gssproxy root rtd unknown /proc/790/task/798/root (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 798 gssproxy root txt unknown /proc/790/task/798/exe (readlink: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 798 gssproxy root NOFD /proc/790/task/798/fd (opendir: Permission denied) 2024-08-31T06:49:25.983 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 799 gssproxy root cwd unknown /proc/790/task/799/cwd (readlink: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 799 gssproxy root rtd unknown /proc/790/task/799/root (readlink: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 799 gssproxy root txt unknown /proc/790/task/799/exe (readlink: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:gssproxy 790 799 gssproxy root NOFD /proc/790/task/799/fd (opendir: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:atd 817 root cwd unknown /proc/817/cwd (readlink: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:atd 817 root rtd unknown /proc/817/root (readlink: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:atd 817 root txt unknown /proc/817/exe (readlink: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:atd 817 root NOFD /proc/817/fd (opendir: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:crond 818 root cwd unknown /proc/818/cwd (readlink: Permission denied) 2024-08-31T06:49:25.984 INFO:tasks.workunit.client.0.smithi037.stdout:crond 818 root rtd unknown /proc/818/root (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:crond 818 root txt unknown /proc/818/exe (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:crond 818 root NOFD /proc/818/fd (opendir: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:nrpe 842 nrpe cwd unknown /proc/842/cwd (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:nrpe 842 nrpe rtd unknown /proc/842/root (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:nrpe 842 nrpe txt unknown /proc/842/exe (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:nrpe 842 nrpe NOFD /proc/842/fd (opendir: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:agetty 5193 root cwd unknown /proc/5193/cwd (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:agetty 5193 root rtd unknown /proc/5193/root (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:agetty 5193 root txt unknown /proc/5193/exe (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:agetty 5193 root NOFD /proc/5193/fd (opendir: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:agetty 5195 root cwd unknown /proc/5195/cwd (readlink: Permission denied) 2024-08-31T06:49:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:agetty 5195 root rtd unknown /proc/5195/root (readlink: Permission denied) 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:agetty 5195 root txt unknown /proc/5195/exe (readlink: Permission denied) 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:agetty 5195 root NOFD /proc/5195/fd (opendir: Permission denied) 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu cwd DIR 8,1 4096 2 / 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu rtd DIR 8,1 4096 2 / 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 600667 655 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 5436040 11595 /usr/lib64/libcrypto.so.3.2.2 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 21219 2229 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-08-31T06:49:25.986 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-08-31T06:49:25.987 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-08-31T06:49:25.987 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-08-31T06:49:25.987 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-08-31T06:49:25.987 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-08-31T06:49:25.987 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-08-31T06:49:25.987 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-08-31T06:49:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-08-31T06:49:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-08-31T06:49:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-08-31T06:49:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-08-31T06:49:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-08-31T06:49:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-08-31T06:49:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-08-31T06:49:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 1u unix 0x0000000000000000 0t0 22101 type=STREAM (CONNECTED) 2024-08-31T06:49:25.989 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 2u unix 0x0000000000000000 0t0 22101 type=STREAM (CONNECTED) 2024-08-31T06:49:25.990 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 3u unix 0x0000000000000000 0t0 22129 type=DGRAM (CONNECTED) 2024-08-31T06:49:25.990 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 4u a_inode 0,14 0 3102 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-08-31T06:49:25.990 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 5u a_inode 0,14 0 3102 [signalfd] 2024-08-31T06:49:25.990 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 6r a_inode 0,14 0 3102 inotify 2024-08-31T06:49:25.990 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 7r DIR 0,25 0 4083 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-08-31T06:49:25.990 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 8u a_inode 0,14 0 3102 [timerfd] 2024-08-31T06:49:25.990 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 9u a_inode 0,14 0 3102 [eventpoll:10,13] 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 10r REG 0,20 0 22118 /proc/5389/mountinfo 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 11r a_inode 0,14 0 3102 inotify 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 12u unix 0x0000000000000000 0t0 22151 /run/user/1000/bus type=STREAM (LISTEN) 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 13r a_inode 0,14 0 3102 inotify 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 15u netlink 0t0 22133 KOBJECT_UEVENT 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 16u unix 0x0000000000000000 0t0 22138 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 17u unix 0x0000000000000000 0t0 22139 type=DGRAM (CONNECTED) 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 18u unix 0x0000000000000000 0t0 22140 type=DGRAM (CONNECTED) 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 19u unix 0x0000000000000000 0t0 22141 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 20u unix 0x0000000000000000 0t0 22143 type=STREAM (CONNECTED) 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 5389 ubuntu 21u a_inode 0,14 0 3102 [timerfd] 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:(sd-pam) 5391 ubuntu cwd unknown /proc/5391/cwd (readlink: Permission denied) 2024-08-31T06:49:25.991 INFO:tasks.workunit.client.0.smithi037.stdout:(sd-pam) 5391 ubuntu rtd unknown /proc/5391/root (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:(sd-pam) 5391 ubuntu txt unknown /proc/5391/exe (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:(sd-pam) 5391 ubuntu NOFD /proc/5391/fd (opendir: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 5574 root cwd unknown /proc/5574/cwd (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 5574 root rtd unknown /proc/5574/root (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 5574 root txt unknown /proc/5574/exe (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 5574 root NOFD /proc/5574/fd (opendir: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 polkitd cwd unknown /proc/5656/cwd (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 polkitd rtd unknown /proc/5656/root (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 polkitd txt unknown /proc/5656/exe (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 polkitd NOFD /proc/5656/fd (opendir: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5658 gmain polkitd cwd unknown /proc/5656/task/5658/cwd (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5658 gmain polkitd rtd unknown /proc/5656/task/5658/root (readlink: Permission denied) 2024-08-31T06:49:25.992 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5658 gmain polkitd txt unknown /proc/5656/task/5658/exe (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5658 gmain polkitd NOFD /proc/5656/task/5658/fd (opendir: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5659 gdbus polkitd cwd unknown /proc/5656/task/5659/cwd (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5659 gdbus polkitd rtd unknown /proc/5656/task/5659/root (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5659 gdbus polkitd txt unknown /proc/5656/task/5659/exe (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5659 gdbus polkitd NOFD /proc/5656/task/5659/fd (opendir: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5660 JS\x20Hel polkitd cwd unknown /proc/5656/task/5660/cwd (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5660 JS\x20Hel polkitd rtd unknown /proc/5656/task/5660/root (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5660 JS\x20Hel polkitd txt unknown /proc/5656/task/5660/exe (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5660 JS\x20Hel polkitd NOFD /proc/5656/task/5660/fd (opendir: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5661 JS\x20Hel polkitd cwd unknown /proc/5656/task/5661/cwd (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5661 JS\x20Hel polkitd rtd unknown /proc/5656/task/5661/root (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5661 JS\x20Hel polkitd txt unknown /proc/5656/task/5661/exe (readlink: Permission denied) 2024-08-31T06:49:25.993 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5661 JS\x20Hel polkitd NOFD /proc/5656/task/5661/fd (opendir: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5662 JS\x20Hel polkitd cwd unknown /proc/5656/task/5662/cwd (readlink: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5662 JS\x20Hel polkitd rtd unknown /proc/5656/task/5662/root (readlink: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5662 JS\x20Hel polkitd txt unknown /proc/5656/task/5662/exe (readlink: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5662 JS\x20Hel polkitd NOFD /proc/5656/task/5662/fd (opendir: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5663 JS\x20Hel polkitd cwd unknown /proc/5656/task/5663/cwd (readlink: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5663 JS\x20Hel polkitd rtd unknown /proc/5656/task/5663/root (readlink: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5663 JS\x20Hel polkitd txt unknown /proc/5656/task/5663/exe (readlink: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5663 JS\x20Hel polkitd NOFD /proc/5656/task/5663/fd (opendir: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5664 JS\x20Hel polkitd cwd unknown /proc/5656/task/5664/cwd (readlink: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5664 JS\x20Hel polkitd rtd unknown /proc/5656/task/5664/root (readlink: Permission denied) 2024-08-31T06:49:25.994 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5664 JS\x20Hel polkitd txt unknown /proc/5656/task/5664/exe (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5664 JS\x20Hel polkitd NOFD /proc/5656/task/5664/fd (opendir: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5665 JS\x20Hel polkitd cwd unknown /proc/5656/task/5665/cwd (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5665 JS\x20Hel polkitd rtd unknown /proc/5656/task/5665/root (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5665 JS\x20Hel polkitd txt unknown /proc/5656/task/5665/exe (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5665 JS\x20Hel polkitd NOFD /proc/5656/task/5665/fd (opendir: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5666 JS\x20Hel polkitd cwd unknown /proc/5656/task/5666/cwd (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5666 JS\x20Hel polkitd rtd unknown /proc/5656/task/5666/root (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5666 JS\x20Hel polkitd txt unknown /proc/5656/task/5666/exe (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5666 JS\x20Hel polkitd NOFD /proc/5656/task/5666/fd (opendir: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5667 JS\x20Hel polkitd cwd unknown /proc/5656/task/5667/cwd (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5667 JS\x20Hel polkitd rtd unknown /proc/5656/task/5667/root (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5667 JS\x20Hel polkitd txt unknown /proc/5656/task/5667/exe (readlink: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5667 JS\x20Hel polkitd NOFD /proc/5656/task/5667/fd (opendir: Permission denied) 2024-08-31T06:49:25.995 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5668 polkitd polkitd cwd unknown /proc/5656/task/5668/cwd (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5668 polkitd polkitd rtd unknown /proc/5656/task/5668/root (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5668 polkitd polkitd txt unknown /proc/5656/task/5668/exe (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:polkitd 5656 5668 polkitd polkitd NOFD /proc/5656/task/5668/fd (opendir: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 root cwd unknown /proc/5907/cwd (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 root rtd unknown /proc/5907/root (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 root txt unknown /proc/5907/exe (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 root NOFD /proc/5907/fd (opendir: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 5909 in:imjour root cwd unknown /proc/5907/task/5909/cwd (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 5909 in:imjour root rtd unknown /proc/5907/task/5909/root (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 5909 in:imjour root txt unknown /proc/5907/task/5909/exe (readlink: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 5909 in:imjour root NOFD /proc/5907/task/5909/fd (opendir: Permission denied) 2024-08-31T06:49:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 5910 rs:main root cwd unknown /proc/5907/task/5910/cwd (readlink: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 5910 rs:main root rtd unknown /proc/5907/task/5910/root (readlink: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 5910 rs:main root txt unknown /proc/5907/task/5910/exe (readlink: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:rsyslogd 5907 5910 rs:main root NOFD /proc/5907/task/5910/fd (opendir: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9630 root cwd unknown /proc/9630/cwd (readlink: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9630 root rtd unknown /proc/9630/root (readlink: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9630 root txt unknown /proc/9630/exe (readlink: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9630 root NOFD /proc/9630/fd (opendir: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9659 root cwd unknown /proc/9659/cwd (readlink: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9659 root rtd unknown /proc/9659/root (readlink: Permission denied) 2024-08-31T06:49:25.997 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9659 root txt unknown /proc/9659/exe (readlink: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9659 root NOFD /proc/9659/fd (opendir: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9688 root cwd unknown /proc/9688/cwd (readlink: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9688 root rtd unknown /proc/9688/root (readlink: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9688 root txt unknown /proc/9688/exe (readlink: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9688 root NOFD /proc/9688/fd (opendir: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9717 root cwd unknown /proc/9717/cwd (readlink: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9717 root rtd unknown /proc/9717/root (readlink: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9717 root txt unknown /proc/9717/exe (readlink: Permission denied) 2024-08-31T06:49:25.998 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9717 root NOFD /proc/9717/fd (opendir: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9746 root cwd unknown /proc/9746/cwd (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9746 root rtd unknown /proc/9746/root (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9746 root txt unknown /proc/9746/exe (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9746 root NOFD /proc/9746/fd (opendir: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9910 root cwd unknown /proc/9910/cwd (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9910 root rtd unknown /proc/9910/root (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9910 root txt unknown /proc/9910/exe (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9910 root NOFD /proc/9910/fd (opendir: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9911 root cwd unknown /proc/9911/cwd (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9911 root rtd unknown /proc/9911/root (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9911 root txt unknown /proc/9911/exe (readlink: Permission denied) 2024-08-31T06:49:25.999 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9911 root NOFD /proc/9911/fd (opendir: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9912 root cwd unknown /proc/9912/cwd (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9912 root rtd unknown /proc/9912/root (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9912 root txt unknown /proc/9912/exe (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9912 root NOFD /proc/9912/fd (opendir: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9913 root cwd unknown /proc/9913/cwd (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9913 root rtd unknown /proc/9913/root (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9913 root txt unknown /proc/9913/exe (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9913 root NOFD /proc/9913/fd (opendir: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9914 root cwd unknown /proc/9914/cwd (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9914 root rtd unknown /proc/9914/root (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9914 root txt unknown /proc/9914/exe (readlink: Permission denied) 2024-08-31T06:49:26.000 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9914 root NOFD /proc/9914/fd (opendir: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9915 root cwd unknown /proc/9915/cwd (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9915 root rtd unknown /proc/9915/root (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9915 root txt unknown /proc/9915/exe (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9915 root NOFD /proc/9915/fd (opendir: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9916 root cwd unknown /proc/9916/cwd (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9916 root rtd unknown /proc/9916/root (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9916 root txt unknown /proc/9916/exe (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9916 root NOFD /proc/9916/fd (opendir: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9917 root cwd unknown /proc/9917/cwd (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9917 root rtd unknown /proc/9917/root (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9917 root txt unknown /proc/9917/exe (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9917 root NOFD /proc/9917/fd (opendir: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9918 root cwd unknown /proc/9918/cwd (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9918 root rtd unknown /proc/9918/root (readlink: Permission denied) 2024-08-31T06:49:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9918 root txt unknown /proc/9918/exe (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/R 9918 root NOFD /proc/9918/fd (opendir: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:xfsaild/d 9919 root cwd unknown /proc/9919/cwd (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:xfsaild/d 9919 root rtd unknown /proc/9919/root (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:xfsaild/d 9919 root txt unknown /proc/9919/exe (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:xfsaild/d 9919 root NOFD /proc/9919/fd (opendir: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 10839 root cwd unknown /proc/10839/cwd (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 10839 root rtd unknown /proc/10839/root (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 10839 root txt unknown /proc/10839/exe (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 10839 root NOFD /proc/10839/fd (opendir: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 10842 ubuntu cwd unknown /proc/10842/cwd (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 10842 ubuntu rtd unknown /proc/10842/root (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 10842 ubuntu txt unknown /proc/10842/exe (readlink: Permission denied) 2024-08-31T06:49:26.002 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 10842 ubuntu NOFD /proc/10842/fd (opendir: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:chronyd 10902 chrony cwd unknown /proc/10902/cwd (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:chronyd 10902 chrony rtd unknown /proc/10902/root (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:chronyd 10902 chrony txt unknown /proc/10902/exe (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:chronyd 10902 chrony NOFD /proc/10902/fd (opendir: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 11165 root cwd unknown /proc/11165/cwd (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 11165 root rtd unknown /proc/11165/root (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 11165 root txt unknown /proc/11165/exe (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 11165 root NOFD /proc/11165/fd (opendir: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-cras 11190 ceph cwd unknown /proc/11190/cwd (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-cras 11190 ceph rtd unknown /proc/11190/root (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-cras 11190 ceph txt unknown /proc/11190/exe (readlink: Permission denied) 2024-08-31T06:49:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-cras 11190 ceph NOFD /proc/11190/fd (opendir: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 11658 root cwd unknown /proc/11658/cwd (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 11658 root rtd unknown /proc/11658/root (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 11658 root txt unknown /proc/11658/exe (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 11658 root NOFD /proc/11658/fd (opendir: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 17487 root cwd unknown /proc/17487/cwd (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 17487 root rtd unknown /proc/17487/root (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 17487 root txt unknown /proc/17487/exe (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 17487 root NOFD /proc/17487/fd (opendir: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 17607 root cwd unknown /proc/17607/cwd (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 17607 root rtd unknown /proc/17607/root (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 17607 root txt unknown /proc/17607/exe (readlink: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 17607 root NOFD /proc/17607/fd (opendir: Permission denied) 2024-08-31T06:49:26.004 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 17624 root cwd unknown /proc/17624/cwd (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 17624 root rtd unknown /proc/17624/root (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 17624 root txt unknown /proc/17624/exe (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 17624 root NOFD /proc/17624/fd (opendir: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 17625 root cwd unknown /proc/17625/cwd (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 17625 root rtd unknown /proc/17625/root (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 17625 root txt unknown /proc/17625/exe (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 17625 root NOFD /proc/17625/fd (opendir: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 17642 root cwd unknown /proc/17642/cwd (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 17642 root rtd unknown /proc/17642/root (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 17642 root txt unknown /proc/17642/exe (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 17642 root NOFD /proc/17642/fd (opendir: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 17765 root cwd unknown /proc/17765/cwd (readlink: Permission denied) 2024-08-31T06:49:26.005 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 17765 root rtd unknown /proc/17765/root (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 17765 root txt unknown /proc/17765/exe (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 17765 root NOFD /proc/17765/fd (opendir: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 17806 root cwd unknown /proc/17806/cwd (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 17806 root rtd unknown /proc/17806/root (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 17806 root txt unknown /proc/17806/exe (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 17806 root NOFD /proc/17806/fd (opendir: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 18508 root cwd unknown /proc/18508/cwd (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 18508 root rtd unknown /proc/18508/root (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 18508 root txt unknown /proc/18508/exe (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 18508 root NOFD /proc/18508/fd (opendir: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 18510 root cwd unknown /proc/18510/cwd (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 18510 root rtd unknown /proc/18510/root (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 18510 root txt unknown /proc/18510/exe (readlink: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 18510 root NOFD /proc/18510/fd (opendir: Permission denied) 2024-08-31T06:49:26.006 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 18608 root cwd unknown /proc/18608/cwd (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 18608 root rtd unknown /proc/18608/root (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 18608 root txt unknown /proc/18608/exe (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 18608 root NOFD /proc/18608/fd (opendir: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 18610 root cwd unknown /proc/18610/cwd (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 18610 root rtd unknown /proc/18610/root (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 18610 root txt unknown /proc/18610/exe (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 18610 root NOFD /proc/18610/fd (opendir: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 ceph cwd unknown /proc/18612/cwd (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 ceph rtd unknown /proc/18612/root (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 ceph txt unknown /proc/18612/exe (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 ceph NOFD /proc/18612/fd (opendir: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18613 log ceph cwd unknown /proc/18612/task/18613/cwd (readlink: Permission denied) 2024-08-31T06:49:26.007 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18613 log ceph rtd unknown /proc/18612/task/18613/root (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18613 log ceph txt unknown /proc/18612/task/18613/exe (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18613 log ceph NOFD /proc/18612/task/18613/fd (opendir: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18614 service ceph cwd unknown /proc/18612/task/18614/cwd (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18614 service ceph rtd unknown /proc/18612/task/18614/root (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18614 service ceph txt unknown /proc/18612/task/18614/exe (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18614 service ceph NOFD /proc/18612/task/18614/fd (opendir: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18615 admin_soc ceph cwd unknown /proc/18612/task/18615/cwd (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18615 admin_soc ceph rtd unknown /proc/18612/task/18615/root (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18615 admin_soc ceph txt unknown /proc/18612/task/18615/exe (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18615 admin_soc ceph NOFD /proc/18612/task/18615/fd (opendir: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18616 signal_ha ceph cwd unknown /proc/18612/task/18616/cwd (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18616 signal_ha ceph rtd unknown /proc/18612/task/18616/root (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18616 signal_ha ceph txt unknown /proc/18612/task/18616/exe (readlink: Permission denied) 2024-08-31T06:49:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18616 signal_ha ceph NOFD /proc/18612/task/18616/fd (opendir: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18617 rocksdb:l ceph cwd unknown /proc/18612/task/18617/cwd (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18617 rocksdb:l ceph rtd unknown /proc/18612/task/18617/root (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18617 rocksdb:l ceph txt unknown /proc/18612/task/18617/exe (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18617 rocksdb:l ceph NOFD /proc/18612/task/18617/fd (opendir: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18618 rocksdb:h ceph cwd unknown /proc/18612/task/18618/cwd (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18618 rocksdb:h ceph rtd unknown /proc/18612/task/18618/root (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18618 rocksdb:h ceph txt unknown /proc/18612/task/18618/exe (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18618 rocksdb:h ceph NOFD /proc/18612/task/18618/fd (opendir: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18634 ceph-mon ceph cwd unknown /proc/18612/task/18634/cwd (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18634 ceph-mon ceph rtd unknown /proc/18612/task/18634/root (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18634 ceph-mon ceph txt unknown /proc/18612/task/18634/exe (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18634 ceph-mon ceph NOFD /proc/18612/task/18634/fd (opendir: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18635 fn_monsto ceph cwd unknown /proc/18612/task/18635/cwd (readlink: Permission denied) 2024-08-31T06:49:26.009 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18635 fn_monsto ceph rtd unknown /proc/18612/task/18635/root (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18635 fn_monsto ceph txt unknown /proc/18612/task/18635/exe (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18635 fn_monsto ceph NOFD /proc/18612/task/18635/fd (opendir: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18636 msgr-work ceph cwd unknown /proc/18612/task/18636/cwd (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18636 msgr-work ceph rtd unknown /proc/18612/task/18636/root (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18636 msgr-work ceph txt unknown /proc/18612/task/18636/exe (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18636 msgr-work ceph NOFD /proc/18612/task/18636/fd (opendir: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18637 msgr-work ceph cwd unknown /proc/18612/task/18637/cwd (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18637 msgr-work ceph rtd unknown /proc/18612/task/18637/root (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18637 msgr-work ceph txt unknown /proc/18612/task/18637/exe (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18637 msgr-work ceph NOFD /proc/18612/task/18637/fd (opendir: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18638 msgr-work ceph cwd unknown /proc/18612/task/18638/cwd (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18638 msgr-work ceph rtd unknown /proc/18612/task/18638/root (readlink: Permission denied) 2024-08-31T06:49:26.010 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18638 msgr-work ceph txt unknown /proc/18612/task/18638/exe (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18638 msgr-work ceph NOFD /proc/18612/task/18638/fd (opendir: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18639 OpHistory ceph cwd unknown /proc/18612/task/18639/cwd (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18639 OpHistory ceph rtd unknown /proc/18612/task/18639/root (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18639 OpHistory ceph txt unknown /proc/18612/task/18639/exe (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18639 OpHistory ceph NOFD /proc/18612/task/18639/fd (opendir: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18640 fin ceph cwd unknown /proc/18612/task/18640/cwd (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18640 fin ceph rtd unknown /proc/18612/task/18640/root (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18640 fin ceph txt unknown /proc/18612/task/18640/exe (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18640 fin ceph NOFD /proc/18612/task/18640/fd (opendir: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18641 safe_time ceph cwd unknown /proc/18612/task/18641/cwd (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18641 safe_time ceph rtd unknown /proc/18612/task/18641/root (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18641 safe_time ceph txt unknown /proc/18612/task/18641/exe (readlink: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18641 safe_time ceph NOFD /proc/18612/task/18641/fd (opendir: Permission denied) 2024-08-31T06:49:26.011 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18642 cpu_tp ceph cwd unknown /proc/18612/task/18642/cwd (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18642 cpu_tp ceph rtd unknown /proc/18612/task/18642/root (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18642 cpu_tp ceph txt unknown /proc/18612/task/18642/exe (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18642 cpu_tp ceph NOFD /proc/18612/task/18642/fd (opendir: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18643 cpu_tp ceph cwd unknown /proc/18612/task/18643/cwd (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18643 cpu_tp ceph rtd unknown /proc/18612/task/18643/root (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18643 cpu_tp ceph txt unknown /proc/18612/task/18643/exe (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18643 cpu_tp ceph NOFD /proc/18612/task/18643/fd (opendir: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18644 cpu_tp ceph cwd unknown /proc/18612/task/18644/cwd (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18644 cpu_tp ceph rtd unknown /proc/18612/task/18644/root (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18644 cpu_tp ceph txt unknown /proc/18612/task/18644/exe (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18644 cpu_tp ceph NOFD /proc/18612/task/18644/fd (opendir: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18645 cpu_tp ceph cwd unknown /proc/18612/task/18645/cwd (readlink: Permission denied) 2024-08-31T06:49:26.012 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18645 cpu_tp ceph rtd unknown /proc/18612/task/18645/root (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18645 cpu_tp ceph txt unknown /proc/18612/task/18645/exe (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18645 cpu_tp ceph NOFD /proc/18612/task/18645/fd (opendir: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18646 ms_dispat ceph cwd unknown /proc/18612/task/18646/cwd (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18646 ms_dispat ceph rtd unknown /proc/18612/task/18646/root (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18646 ms_dispat ceph txt unknown /proc/18612/task/18646/exe (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18646 ms_dispat ceph NOFD /proc/18612/task/18646/fd (opendir: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18647 ms_local ceph cwd unknown /proc/18612/task/18647/cwd (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18647 ms_local ceph rtd unknown /proc/18612/task/18647/root (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18647 ms_local ceph txt unknown /proc/18612/task/18647/exe (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18647 ms_local ceph NOFD /proc/18612/task/18647/fd (opendir: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18648 safe_time ceph cwd unknown /proc/18612/task/18648/cwd (readlink: Permission denied) 2024-08-31T06:49:26.013 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18648 safe_time ceph rtd unknown /proc/18612/task/18648/root (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18648 safe_time ceph txt unknown /proc/18612/task/18648/exe (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18648 safe_time ceph NOFD /proc/18612/task/18648/fd (opendir: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18649 ms_dispat ceph cwd unknown /proc/18612/task/18649/cwd (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18649 ms_dispat ceph rtd unknown /proc/18612/task/18649/root (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18649 ms_dispat ceph txt unknown /proc/18612/task/18649/exe (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18649 ms_dispat ceph NOFD /proc/18612/task/18649/fd (opendir: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18650 ms_local ceph cwd unknown /proc/18612/task/18650/cwd (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18650 ms_local ceph rtd unknown /proc/18612/task/18650/root (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18650 ms_local ceph txt unknown /proc/18612/task/18650/exe (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 18650 ms_local ceph NOFD /proc/18612/task/18650/fd (opendir: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 57002 rstore_co ceph cwd unknown /proc/18612/task/57002/cwd (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 57002 rstore_co ceph rtd unknown /proc/18612/task/57002/root (readlink: Permission denied) 2024-08-31T06:49:26.014 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 57002 rstore_co ceph txt unknown /proc/18612/task/57002/exe (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mon 18612 57002 rstore_co ceph NOFD /proc/18612/task/57002/fd (opendir: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 18839 root cwd unknown /proc/18839/cwd (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 18839 root rtd unknown /proc/18839/root (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 18839 root txt unknown /proc/18839/exe (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 18839 root NOFD /proc/18839/fd (opendir: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 18841 root cwd unknown /proc/18841/cwd (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 18841 root rtd unknown /proc/18841/root (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 18841 root txt unknown /proc/18841/exe (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 18841 root NOFD /proc/18841/fd (opendir: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 ceph cwd unknown /proc/18843/cwd (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 ceph rtd unknown /proc/18843/root (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 ceph txt unknown /proc/18843/exe (readlink: Permission denied) 2024-08-31T06:49:26.015 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 ceph NOFD /proc/18843/fd (opendir: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29784 log ceph cwd unknown /proc/18843/task/29784/cwd (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29784 log ceph rtd unknown /proc/18843/task/29784/root (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29784 log ceph txt unknown /proc/18843/task/29784/exe (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29784 log ceph NOFD /proc/18843/task/29784/fd (opendir: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29786 msgr-work ceph cwd unknown /proc/18843/task/29786/cwd (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29786 msgr-work ceph rtd unknown /proc/18843/task/29786/root (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29786 msgr-work ceph txt unknown /proc/18843/task/29786/exe (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29786 msgr-work ceph NOFD /proc/18843/task/29786/fd (opendir: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29787 msgr-work ceph cwd unknown /proc/18843/task/29787/cwd (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29787 msgr-work ceph rtd unknown /proc/18843/task/29787/root (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29787 msgr-work ceph txt unknown /proc/18843/task/29787/exe (readlink: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29787 msgr-work ceph NOFD /proc/18843/task/29787/fd (opendir: Permission denied) 2024-08-31T06:49:26.016 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29788 msgr-work ceph cwd unknown /proc/18843/task/29788/cwd (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29788 msgr-work ceph rtd unknown /proc/18843/task/29788/root (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29788 msgr-work ceph txt unknown /proc/18843/task/29788/exe (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29788 msgr-work ceph NOFD /proc/18843/task/29788/fd (opendir: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29792 service ceph cwd unknown /proc/18843/task/29792/cwd (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29792 service ceph rtd unknown /proc/18843/task/29792/root (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29792 service ceph txt unknown /proc/18843/task/29792/exe (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29792 service ceph NOFD /proc/18843/task/29792/fd (opendir: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29793 admin_soc ceph cwd unknown /proc/18843/task/29793/cwd (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29793 admin_soc ceph rtd unknown /proc/18843/task/29793/root (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29793 admin_soc ceph txt unknown /proc/18843/task/29793/exe (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29793 admin_soc ceph NOFD /proc/18843/task/29793/fd (opendir: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29794 ceph_time ceph cwd unknown /proc/18843/task/29794/cwd (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29794 ceph_time ceph rtd unknown /proc/18843/task/29794/root (readlink: Permission denied) 2024-08-31T06:49:26.017 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29794 ceph_time ceph txt unknown /proc/18843/task/29794/exe (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29794 ceph_time ceph NOFD /proc/18843/task/29794/fd (opendir: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29795 fn_anonym ceph cwd unknown /proc/18843/task/29795/cwd (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29795 fn_anonym ceph rtd unknown /proc/18843/task/29795/root (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29795 fn_anonym ceph txt unknown /proc/18843/task/29795/exe (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29795 fn_anonym ceph NOFD /proc/18843/task/29795/fd (opendir: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29796 signal_ha ceph cwd unknown /proc/18843/task/29796/cwd (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29796 signal_ha ceph rtd unknown /proc/18843/task/29796/root (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29796 signal_ha ceph txt unknown /proc/18843/task/29796/exe (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29796 signal_ha ceph NOFD /proc/18843/task/29796/fd (opendir: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29797 mgrsb-fin ceph cwd unknown /proc/18843/task/29797/cwd (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29797 mgrsb-fin ceph rtd unknown /proc/18843/task/29797/root (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29797 mgrsb-fin ceph txt unknown /proc/18843/task/29797/exe (readlink: Permission denied) 2024-08-31T06:49:26.018 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29797 mgrsb-fin ceph NOFD /proc/18843/task/29797/fd (opendir: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29798 ms_dispat ceph cwd unknown /proc/18843/task/29798/cwd (readlink: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29798 ms_dispat ceph rtd unknown /proc/18843/task/29798/root (readlink: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29798 ms_dispat ceph txt unknown /proc/18843/task/29798/exe (readlink: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29798 ms_dispat ceph NOFD /proc/18843/task/29798/fd (opendir: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29799 ms_local ceph cwd unknown /proc/18843/task/29799/cwd (readlink: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29799 ms_local ceph rtd unknown /proc/18843/task/29799/root (readlink: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29799 ms_local ceph txt unknown /proc/18843/task/29799/exe (readlink: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29799 ms_local ceph NOFD /proc/18843/task/29799/fd (opendir: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29800 io_contex ceph cwd unknown /proc/18843/task/29800/cwd (readlink: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29800 io_contex ceph rtd unknown /proc/18843/task/29800/root (readlink: Permission denied) 2024-08-31T06:49:26.019 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29800 io_contex ceph txt unknown /proc/18843/task/29800/exe (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29800 io_contex ceph NOFD /proc/18843/task/29800/fd (opendir: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29801 io_contex ceph cwd unknown /proc/18843/task/29801/cwd (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29801 io_contex ceph rtd unknown /proc/18843/task/29801/root (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29801 io_contex ceph txt unknown /proc/18843/task/29801/exe (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29801 io_contex ceph NOFD /proc/18843/task/29801/fd (opendir: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29802 safe_time ceph cwd unknown /proc/18843/task/29802/cwd (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29802 safe_time ceph rtd unknown /proc/18843/task/29802/root (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29802 safe_time ceph txt unknown /proc/18843/task/29802/exe (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29802 safe_time ceph NOFD /proc/18843/task/29802/fd (opendir: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29803 safe_time ceph cwd unknown /proc/18843/task/29803/cwd (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29803 safe_time ceph rtd unknown /proc/18843/task/29803/root (readlink: Permission denied) 2024-08-31T06:49:26.020 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29803 safe_time ceph txt unknown /proc/18843/task/29803/exe (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29803 safe_time ceph NOFD /proc/18843/task/29803/fd (opendir: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29804 safe_time ceph cwd unknown /proc/18843/task/29804/cwd (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29804 safe_time ceph rtd unknown /proc/18843/task/29804/root (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29804 safe_time ceph txt unknown /proc/18843/task/29804/exe (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29804 safe_time ceph NOFD /proc/18843/task/29804/fd (opendir: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29805 fn_anonym ceph cwd unknown /proc/18843/task/29805/cwd (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29805 fn_anonym ceph rtd unknown /proc/18843/task/29805/root (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29805 fn_anonym ceph txt unknown /proc/18843/task/29805/exe (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29805 fn_anonym ceph NOFD /proc/18843/task/29805/fd (opendir: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29806 flusher ceph cwd unknown /proc/18843/task/29806/cwd (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29806 flusher ceph rtd unknown /proc/18843/task/29806/root (readlink: Permission denied) 2024-08-31T06:49:26.021 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29806 flusher ceph txt unknown /proc/18843/task/29806/exe (readlink: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29806 flusher ceph NOFD /proc/18843/task/29806/fd (opendir: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29807 safe_time ceph cwd unknown /proc/18843/task/29807/cwd (readlink: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29807 safe_time ceph rtd unknown /proc/18843/task/29807/root (readlink: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29807 safe_time ceph txt unknown /proc/18843/task/29807/exe (readlink: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29807 safe_time ceph NOFD /proc/18843/task/29807/fd (opendir: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29823 OpHistory ceph cwd unknown /proc/18843/task/29823/cwd (readlink: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29823 OpHistory ceph rtd unknown /proc/18843/task/29823/root (readlink: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29823 OpHistory ceph txt unknown /proc/18843/task/29823/exe (readlink: Permission denied) 2024-08-31T06:49:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29823 OpHistory ceph NOFD /proc/18843/task/29823/fd (opendir: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29824 mgr-fin ceph cwd unknown /proc/18843/task/29824/cwd (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29824 mgr-fin ceph rtd unknown /proc/18843/task/29824/root (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29824 mgr-fin ceph txt unknown /proc/18843/task/29824/exe (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29824 mgr-fin ceph NOFD /proc/18843/task/29824/fd (opendir: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29825 ms_dispat ceph cwd unknown /proc/18843/task/29825/cwd (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29825 ms_dispat ceph rtd unknown /proc/18843/task/29825/root (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29825 ms_dispat ceph txt unknown /proc/18843/task/29825/exe (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29825 ms_dispat ceph NOFD /proc/18843/task/29825/fd (opendir: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29826 ms_local ceph cwd unknown /proc/18843/task/29826/cwd (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29826 ms_local ceph rtd unknown /proc/18843/task/29826/root (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29826 ms_local ceph txt unknown /proc/18843/task/29826/exe (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29826 ms_local ceph NOFD /proc/18843/task/29826/fd (opendir: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29827 safe_time ceph cwd unknown /proc/18843/task/29827/cwd (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29827 safe_time ceph rtd unknown /proc/18843/task/29827/root (readlink: Permission denied) 2024-08-31T06:49:26.023 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29827 safe_time ceph txt unknown /proc/18843/task/29827/exe (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29827 safe_time ceph NOFD /proc/18843/task/29827/fd (opendir: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29828 cmdfin ceph cwd unknown /proc/18843/task/29828/cwd (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29828 cmdfin ceph rtd unknown /proc/18843/task/29828/root (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29828 cmdfin ceph txt unknown /proc/18843/task/29828/exe (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29828 cmdfin ceph NOFD /proc/18843/task/29828/fd (opendir: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29832 io_contex ceph cwd unknown /proc/18843/task/29832/cwd (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29832 io_contex ceph rtd unknown /proc/18843/task/29832/root (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29832 io_contex ceph txt unknown /proc/18843/task/29832/exe (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29832 io_contex ceph NOFD /proc/18843/task/29832/fd (opendir: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29833 io_contex ceph cwd unknown /proc/18843/task/29833/cwd (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29833 io_contex ceph rtd unknown /proc/18843/task/29833/root (readlink: Permission denied) 2024-08-31T06:49:26.024 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29833 io_contex ceph txt unknown /proc/18843/task/29833/exe (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29833 io_contex ceph NOFD /proc/18843/task/29833/fd (opendir: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29834 ceph_time ceph cwd unknown /proc/18843/task/29834/cwd (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29834 ceph_time ceph rtd unknown /proc/18843/task/29834/root (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29834 ceph_time ceph txt unknown /proc/18843/task/29834/exe (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29834 ceph_time ceph NOFD /proc/18843/task/29834/fd (opendir: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29835 ms_dispat ceph cwd unknown /proc/18843/task/29835/cwd (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29835 ms_dispat ceph rtd unknown /proc/18843/task/29835/root (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29835 ms_dispat ceph txt unknown /proc/18843/task/29835/exe (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29835 ms_dispat ceph NOFD /proc/18843/task/29835/fd (opendir: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29836 ms_local ceph cwd unknown /proc/18843/task/29836/cwd (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29836 ms_local ceph rtd unknown /proc/18843/task/29836/root (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29836 ms_local ceph txt unknown /proc/18843/task/29836/exe (readlink: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29836 ms_local ceph NOFD /proc/18843/task/29836/fd (opendir: Permission denied) 2024-08-31T06:49:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29837 safe_time ceph cwd unknown /proc/18843/task/29837/cwd (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29837 safe_time ceph rtd unknown /proc/18843/task/29837/root (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29837 safe_time ceph txt unknown /proc/18843/task/29837/exe (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29837 safe_time ceph NOFD /proc/18843/task/29837/fd (opendir: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29838 safe_time ceph cwd unknown /proc/18843/task/29838/cwd (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29838 safe_time ceph rtd unknown /proc/18843/task/29838/root (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29838 safe_time ceph txt unknown /proc/18843/task/29838/exe (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29838 safe_time ceph NOFD /proc/18843/task/29838/fd (opendir: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29839 balancer ceph cwd unknown /proc/18843/task/29839/cwd (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29839 balancer ceph rtd unknown /proc/18843/task/29839/root (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29839 balancer ceph txt unknown /proc/18843/task/29839/exe (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29839 balancer ceph NOFD /proc/18843/task/29839/fd (opendir: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29840 m-fin-bal ceph cwd unknown /proc/18843/task/29840/cwd (readlink: Permission denied) 2024-08-31T06:49:26.026 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29840 m-fin-bal ceph rtd unknown /proc/18843/task/29840/root (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29840 m-fin-bal ceph txt unknown /proc/18843/task/29840/exe (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29840 m-fin-bal ceph NOFD /proc/18843/task/29840/fd (opendir: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29841 mgr-fin ceph cwd unknown /proc/18843/task/29841/cwd (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29841 mgr-fin ceph rtd unknown /proc/18843/task/29841/root (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29841 mgr-fin ceph txt unknown /proc/18843/task/29841/exe (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29841 mgr-fin ceph NOFD /proc/18843/task/29841/fd (opendir: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29842 mgr-fin ceph cwd unknown /proc/18843/task/29842/cwd (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29842 mgr-fin ceph rtd unknown /proc/18843/task/29842/root (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29842 mgr-fin ceph txt unknown /proc/18843/task/29842/exe (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29842 mgr-fin ceph NOFD /proc/18843/task/29842/fd (opendir: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29843 mgr-fin ceph cwd unknown /proc/18843/task/29843/cwd (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29843 mgr-fin ceph rtd unknown /proc/18843/task/29843/root (readlink: Permission denied) 2024-08-31T06:49:26.027 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29843 mgr-fin ceph txt unknown /proc/18843/task/29843/exe (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29843 mgr-fin ceph NOFD /proc/18843/task/29843/fd (opendir: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29844 mgr-fin ceph cwd unknown /proc/18843/task/29844/cwd (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29844 mgr-fin ceph rtd unknown /proc/18843/task/29844/root (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29844 mgr-fin ceph txt unknown /proc/18843/task/29844/exe (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29844 mgr-fin ceph NOFD /proc/18843/task/29844/fd (opendir: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29845 mgr-fin ceph cwd unknown /proc/18843/task/29845/cwd (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29845 mgr-fin ceph rtd unknown /proc/18843/task/29845/root (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29845 mgr-fin ceph txt unknown /proc/18843/task/29845/exe (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29845 mgr-fin ceph NOFD /proc/18843/task/29845/fd (opendir: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29846 mgr-fin ceph cwd unknown /proc/18843/task/29846/cwd (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29846 mgr-fin ceph rtd unknown /proc/18843/task/29846/root (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29846 mgr-fin ceph txt unknown /proc/18843/task/29846/exe (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29846 mgr-fin ceph NOFD /proc/18843/task/29846/fd (opendir: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29847 mgr-fin ceph cwd unknown /proc/18843/task/29847/cwd (readlink: Permission denied) 2024-08-31T06:49:26.028 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29847 mgr-fin ceph rtd unknown /proc/18843/task/29847/root (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29847 mgr-fin ceph txt unknown /proc/18843/task/29847/exe (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29847 mgr-fin ceph NOFD /proc/18843/task/29847/fd (opendir: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29848 mgr-fin ceph cwd unknown /proc/18843/task/29848/cwd (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29848 mgr-fin ceph rtd unknown /proc/18843/task/29848/root (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29848 mgr-fin ceph txt unknown /proc/18843/task/29848/exe (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29848 mgr-fin ceph NOFD /proc/18843/task/29848/fd (opendir: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29849 mgr-fin ceph cwd unknown /proc/18843/task/29849/cwd (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29849 mgr-fin ceph rtd unknown /proc/18843/task/29849/root (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29849 mgr-fin ceph txt unknown /proc/18843/task/29849/exe (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29849 mgr-fin ceph NOFD /proc/18843/task/29849/fd (opendir: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29850 mgr-fin ceph cwd unknown /proc/18843/task/29850/cwd (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29850 mgr-fin ceph rtd unknown /proc/18843/task/29850/root (readlink: Permission denied) 2024-08-31T06:49:26.029 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29850 mgr-fin ceph txt unknown /proc/18843/task/29850/exe (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29850 mgr-fin ceph NOFD /proc/18843/task/29850/fd (opendir: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29851 mgr-fin ceph cwd unknown /proc/18843/task/29851/cwd (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29851 mgr-fin ceph rtd unknown /proc/18843/task/29851/root (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29851 mgr-fin ceph txt unknown /proc/18843/task/29851/exe (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29851 mgr-fin ceph NOFD /proc/18843/task/29851/fd (opendir: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29852 mgr-fin ceph cwd unknown /proc/18843/task/29852/cwd (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29852 mgr-fin ceph rtd unknown /proc/18843/task/29852/root (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29852 mgr-fin ceph txt unknown /proc/18843/task/29852/exe (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29852 mgr-fin ceph NOFD /proc/18843/task/29852/fd (opendir: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29853 mgr-fin ceph cwd unknown /proc/18843/task/29853/cwd (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29853 mgr-fin ceph rtd unknown /proc/18843/task/29853/root (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29853 mgr-fin ceph txt unknown /proc/18843/task/29853/exe (readlink: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29853 mgr-fin ceph NOFD /proc/18843/task/29853/fd (opendir: Permission denied) 2024-08-31T06:49:26.030 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29854 mgr-fin ceph cwd unknown /proc/18843/task/29854/cwd (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29854 mgr-fin ceph rtd unknown /proc/18843/task/29854/root (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29854 mgr-fin ceph txt unknown /proc/18843/task/29854/exe (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29854 mgr-fin ceph NOFD /proc/18843/task/29854/fd (opendir: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29855 mgr-fin ceph cwd unknown /proc/18843/task/29855/cwd (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29855 mgr-fin ceph rtd unknown /proc/18843/task/29855/root (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29855 mgr-fin ceph txt unknown /proc/18843/task/29855/exe (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29855 mgr-fin ceph NOFD /proc/18843/task/29855/fd (opendir: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29856 mgr-fin ceph cwd unknown /proc/18843/task/29856/cwd (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29856 mgr-fin ceph rtd unknown /proc/18843/task/29856/root (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29856 mgr-fin ceph txt unknown /proc/18843/task/29856/exe (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29856 mgr-fin ceph NOFD /proc/18843/task/29856/fd (opendir: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29857 cephadm ceph cwd unknown /proc/18843/task/29857/cwd (readlink: Permission denied) 2024-08-31T06:49:26.031 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29857 cephadm ceph rtd unknown /proc/18843/task/29857/root (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29857 cephadm ceph txt unknown /proc/18843/task/29857/exe (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29857 cephadm ceph NOFD /proc/18843/task/29857/fd (opendir: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29858 m-fin-cep ceph cwd unknown /proc/18843/task/29858/cwd (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29858 m-fin-cep ceph rtd unknown /proc/18843/task/29858/root (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29858 m-fin-cep ceph txt unknown /proc/18843/task/29858/exe (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29858 m-fin-cep ceph NOFD /proc/18843/task/29858/fd (opendir: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29859 mgr-fin ceph cwd unknown /proc/18843/task/29859/cwd (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29859 mgr-fin ceph rtd unknown /proc/18843/task/29859/root (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29859 mgr-fin ceph txt unknown /proc/18843/task/29859/exe (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29859 mgr-fin ceph NOFD /proc/18843/task/29859/fd (opendir: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29860 mgr-fin ceph cwd unknown /proc/18843/task/29860/cwd (readlink: Permission denied) 2024-08-31T06:49:26.032 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29860 mgr-fin ceph rtd unknown /proc/18843/task/29860/root (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29860 mgr-fin ceph txt unknown /proc/18843/task/29860/exe (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29860 mgr-fin ceph NOFD /proc/18843/task/29860/fd (opendir: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29861 cephadm ceph cwd unknown /proc/18843/task/29861/cwd (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29861 cephadm ceph rtd unknown /proc/18843/task/29861/root (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29861 cephadm ceph txt unknown /proc/18843/task/29861/exe (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29861 cephadm ceph NOFD /proc/18843/task/29861/fd (opendir: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29862 mgr-fin ceph cwd unknown /proc/18843/task/29862/cwd (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29862 mgr-fin ceph rtd unknown /proc/18843/task/29862/root (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29862 mgr-fin ceph txt unknown /proc/18843/task/29862/exe (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29862 mgr-fin ceph NOFD /proc/18843/task/29862/fd (opendir: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29863 crash ceph cwd unknown /proc/18843/task/29863/cwd (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29863 crash ceph rtd unknown /proc/18843/task/29863/root (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29863 crash ceph txt unknown /proc/18843/task/29863/exe (readlink: Permission denied) 2024-08-31T06:49:26.033 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29863 crash ceph NOFD /proc/18843/task/29863/fd (opendir: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29864 m-fin-cra ceph cwd unknown /proc/18843/task/29864/cwd (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29864 m-fin-cra ceph rtd unknown /proc/18843/task/29864/root (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29864 m-fin-cra ceph txt unknown /proc/18843/task/29864/exe (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29864 m-fin-cra ceph NOFD /proc/18843/task/29864/fd (opendir: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29865 mgr-fin ceph cwd unknown /proc/18843/task/29865/cwd (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29865 mgr-fin ceph rtd unknown /proc/18843/task/29865/root (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29865 mgr-fin ceph txt unknown /proc/18843/task/29865/exe (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29865 mgr-fin ceph NOFD /proc/18843/task/29865/fd (opendir: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29866 mgr-fin ceph cwd unknown /proc/18843/task/29866/cwd (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29866 mgr-fin ceph rtd unknown /proc/18843/task/29866/root (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29866 mgr-fin ceph txt unknown /proc/18843/task/29866/exe (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29866 mgr-fin ceph NOFD /proc/18843/task/29866/fd (opendir: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29867 mgr-fin ceph cwd unknown /proc/18843/task/29867/cwd (readlink: Permission denied) 2024-08-31T06:49:26.034 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29867 mgr-fin ceph rtd unknown /proc/18843/task/29867/root (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29867 mgr-fin ceph txt unknown /proc/18843/task/29867/exe (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29867 mgr-fin ceph NOFD /proc/18843/task/29867/fd (opendir: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29868 mgr-fin ceph cwd unknown /proc/18843/task/29868/cwd (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29868 mgr-fin ceph rtd unknown /proc/18843/task/29868/root (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29868 mgr-fin ceph txt unknown /proc/18843/task/29868/exe (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29868 mgr-fin ceph NOFD /proc/18843/task/29868/fd (opendir: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29869 mgr-fin ceph cwd unknown /proc/18843/task/29869/cwd (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29869 mgr-fin ceph rtd unknown /proc/18843/task/29869/root (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29869 mgr-fin ceph txt unknown /proc/18843/task/29869/exe (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29869 mgr-fin ceph NOFD /proc/18843/task/29869/fd (opendir: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29870 dashboard ceph cwd unknown /proc/18843/task/29870/cwd (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29870 dashboard ceph rtd unknown /proc/18843/task/29870/root (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29870 dashboard ceph txt unknown /proc/18843/task/29870/exe (readlink: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29870 dashboard ceph NOFD /proc/18843/task/29870/fd (opendir: Permission denied) 2024-08-31T06:49:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29871 m-fin-das ceph cwd unknown /proc/18843/task/29871/cwd (readlink: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29871 m-fin-das ceph rtd unknown /proc/18843/task/29871/root (readlink: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29871 m-fin-das ceph txt unknown /proc/18843/task/29871/exe (readlink: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29871 m-fin-das ceph NOFD /proc/18843/task/29871/fd (opendir: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29872 mgr-fin ceph cwd unknown /proc/18843/task/29872/cwd (readlink: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29872 mgr-fin ceph rtd unknown /proc/18843/task/29872/root (readlink: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29872 mgr-fin ceph txt unknown /proc/18843/task/29872/exe (readlink: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29872 mgr-fin ceph NOFD /proc/18843/task/29872/fd (opendir: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29873 mgr-fin ceph cwd unknown /proc/18843/task/29873/cwd (readlink: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29873 mgr-fin ceph rtd unknown /proc/18843/task/29873/root (readlink: Permission denied) 2024-08-31T06:49:26.036 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29873 mgr-fin ceph txt unknown /proc/18843/task/29873/exe (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29873 mgr-fin ceph NOFD /proc/18843/task/29873/fd (opendir: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29874 devicehea ceph cwd unknown /proc/18843/task/29874/cwd (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29874 devicehea ceph rtd unknown /proc/18843/task/29874/root (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29874 devicehea ceph txt unknown /proc/18843/task/29874/exe (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29874 devicehea ceph NOFD /proc/18843/task/29874/fd (opendir: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29875 m-fin-dev ceph cwd unknown /proc/18843/task/29875/cwd (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29875 m-fin-dev ceph rtd unknown /proc/18843/task/29875/root (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29875 m-fin-dev ceph txt unknown /proc/18843/task/29875/exe (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29875 m-fin-dev ceph NOFD /proc/18843/task/29875/fd (opendir: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29877 m-fin-ios ceph cwd unknown /proc/18843/task/29877/cwd (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29877 m-fin-ios ceph rtd unknown /proc/18843/task/29877/root (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29877 m-fin-ios ceph txt unknown /proc/18843/task/29877/exe (readlink: Permission denied) 2024-08-31T06:49:26.037 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29877 m-fin-ios ceph NOFD /proc/18843/task/29877/fd (opendir: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29878 mgr-fin ceph cwd unknown /proc/18843/task/29878/cwd (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29878 mgr-fin ceph rtd unknown /proc/18843/task/29878/root (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29878 mgr-fin ceph txt unknown /proc/18843/task/29878/exe (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29878 mgr-fin ceph NOFD /proc/18843/task/29878/fd (opendir: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29879 mgr-fin ceph cwd unknown /proc/18843/task/29879/cwd (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29879 mgr-fin ceph rtd unknown /proc/18843/task/29879/root (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29879 mgr-fin ceph txt unknown /proc/18843/task/29879/exe (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29879 mgr-fin ceph NOFD /proc/18843/task/29879/fd (opendir: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29881 m-fin-nfs ceph cwd unknown /proc/18843/task/29881/cwd (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29881 m-fin-nfs ceph rtd unknown /proc/18843/task/29881/root (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29881 m-fin-nfs ceph txt unknown /proc/18843/task/29881/exe (readlink: Permission denied) 2024-08-31T06:49:26.038 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29881 m-fin-nfs ceph NOFD /proc/18843/task/29881/fd (opendir: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29883 m-fin-orc ceph cwd unknown /proc/18843/task/29883/cwd (readlink: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29883 m-fin-orc ceph rtd unknown /proc/18843/task/29883/root (readlink: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29883 m-fin-orc ceph txt unknown /proc/18843/task/29883/exe (readlink: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29883 m-fin-orc ceph NOFD /proc/18843/task/29883/fd (opendir: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29884 cephadm ceph cwd unknown /proc/18843/task/29884/cwd (readlink: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29884 cephadm ceph rtd unknown /proc/18843/task/29884/root (readlink: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29884 cephadm ceph txt unknown /proc/18843/task/29884/exe (readlink: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29884 cephadm ceph NOFD /proc/18843/task/29884/fd (opendir: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29885 pg_autosc ceph cwd unknown /proc/18843/task/29885/cwd (readlink: Permission denied) 2024-08-31T06:49:26.039 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29885 pg_autosc ceph rtd unknown /proc/18843/task/29885/root (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29885 pg_autosc ceph txt unknown /proc/18843/task/29885/exe (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29885 pg_autosc ceph NOFD /proc/18843/task/29885/fd (opendir: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29886 m-fin-pg_ ceph cwd unknown /proc/18843/task/29886/cwd (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29886 m-fin-pg_ ceph rtd unknown /proc/18843/task/29886/root (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29886 m-fin-pg_ ceph txt unknown /proc/18843/task/29886/exe (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29886 m-fin-pg_ ceph NOFD /proc/18843/task/29886/fd (opendir: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29887 progress ceph cwd unknown /proc/18843/task/29887/cwd (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29887 progress ceph rtd unknown /proc/18843/task/29887/root (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29887 progress ceph txt unknown /proc/18843/task/29887/exe (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29887 progress ceph NOFD /proc/18843/task/29887/fd (opendir: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29888 m-fin-pro ceph cwd unknown /proc/18843/task/29888/cwd (readlink: Permission denied) 2024-08-31T06:49:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29888 m-fin-pro ceph rtd unknown /proc/18843/task/29888/root (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29888 m-fin-pro ceph txt unknown /proc/18843/task/29888/exe (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29888 m-fin-pro ceph NOFD /proc/18843/task/29888/fd (opendir: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29889 cephadm ceph cwd unknown /proc/18843/task/29889/cwd (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29889 cephadm ceph rtd unknown /proc/18843/task/29889/root (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29889 cephadm ceph txt unknown /proc/18843/task/29889/exe (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29889 cephadm ceph NOFD /proc/18843/task/29889/fd (opendir: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29893 io_contex ceph cwd unknown /proc/18843/task/29893/cwd (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29893 io_contex ceph rtd unknown /proc/18843/task/29893/root (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29893 io_contex ceph txt unknown /proc/18843/task/29893/exe (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29893 io_contex ceph NOFD /proc/18843/task/29893/fd (opendir: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29894 io_contex ceph cwd unknown /proc/18843/task/29894/cwd (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29894 io_contex ceph rtd unknown /proc/18843/task/29894/root (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29894 io_contex ceph txt unknown /proc/18843/task/29894/exe (readlink: Permission denied) 2024-08-31T06:49:26.041 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29894 io_contex ceph NOFD /proc/18843/task/29894/fd (opendir: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29895 ceph_time ceph cwd unknown /proc/18843/task/29895/cwd (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29895 ceph_time ceph rtd unknown /proc/18843/task/29895/root (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29895 ceph_time ceph txt unknown /proc/18843/task/29895/exe (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29895 ceph_time ceph NOFD /proc/18843/task/29895/fd (opendir: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29896 ms_dispat ceph cwd unknown /proc/18843/task/29896/cwd (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29896 ms_dispat ceph rtd unknown /proc/18843/task/29896/root (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29896 ms_dispat ceph txt unknown /proc/18843/task/29896/exe (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29896 ms_dispat ceph NOFD /proc/18843/task/29896/fd (opendir: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29897 ms_local ceph cwd unknown /proc/18843/task/29897/cwd (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29897 ms_local ceph rtd unknown /proc/18843/task/29897/root (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29897 ms_local ceph txt unknown /proc/18843/task/29897/exe (readlink: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29897 ms_local ceph NOFD /proc/18843/task/29897/fd (opendir: Permission denied) 2024-08-31T06:49:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29898 safe_time ceph cwd unknown /proc/18843/task/29898/cwd (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29898 safe_time ceph rtd unknown /proc/18843/task/29898/root (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29898 safe_time ceph txt unknown /proc/18843/task/29898/exe (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29898 safe_time ceph NOFD /proc/18843/task/29898/fd (opendir: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29899 cephadm ceph cwd unknown /proc/18843/task/29899/cwd (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29899 cephadm ceph rtd unknown /proc/18843/task/29899/root (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29899 cephadm ceph txt unknown /proc/18843/task/29899/exe (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29899 cephadm ceph NOFD /proc/18843/task/29899/fd (opendir: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29900 safe_time ceph cwd unknown /proc/18843/task/29900/cwd (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29900 safe_time ceph rtd unknown /proc/18843/task/29900/root (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29900 safe_time ceph txt unknown /proc/18843/task/29900/exe (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29900 safe_time ceph NOFD /proc/18843/task/29900/fd (opendir: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29901 mgr-fin ceph cwd unknown /proc/18843/task/29901/cwd (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29901 mgr-fin ceph rtd unknown /proc/18843/task/29901/root (readlink: Permission denied) 2024-08-31T06:49:26.043 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29901 mgr-fin ceph txt unknown /proc/18843/task/29901/exe (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29901 mgr-fin ceph NOFD /proc/18843/task/29901/fd (opendir: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29903 m-fin-rbd ceph cwd unknown /proc/18843/task/29903/cwd (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29903 m-fin-rbd ceph rtd unknown /proc/18843/task/29903/root (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29903 m-fin-rbd ceph txt unknown /proc/18843/task/29903/exe (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29903 m-fin-rbd ceph NOFD /proc/18843/task/29903/fd (opendir: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29904 mgr-fin ceph cwd unknown /proc/18843/task/29904/cwd (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29904 mgr-fin ceph rtd unknown /proc/18843/task/29904/root (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29904 mgr-fin ceph txt unknown /proc/18843/task/29904/exe (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29904 mgr-fin ceph NOFD /proc/18843/task/29904/fd (opendir: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29905 restful ceph cwd unknown /proc/18843/task/29905/cwd (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29905 restful ceph rtd unknown /proc/18843/task/29905/root (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29905 restful ceph txt unknown /proc/18843/task/29905/exe (readlink: Permission denied) 2024-08-31T06:49:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29905 restful ceph NOFD /proc/18843/task/29905/fd (opendir: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29906 m-fin-res ceph cwd unknown /proc/18843/task/29906/cwd (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29906 m-fin-res ceph rtd unknown /proc/18843/task/29906/root (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29906 m-fin-res ceph txt unknown /proc/18843/task/29906/exe (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29906 m-fin-res ceph NOFD /proc/18843/task/29906/fd (opendir: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29907 mgr-fin ceph cwd unknown /proc/18843/task/29907/cwd (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29907 mgr-fin ceph rtd unknown /proc/18843/task/29907/root (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29907 mgr-fin ceph txt unknown /proc/18843/task/29907/exe (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29907 mgr-fin ceph NOFD /proc/18843/task/29907/fd (opendir: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29908 mgr-fin ceph cwd unknown /proc/18843/task/29908/cwd (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29908 mgr-fin ceph rtd unknown /proc/18843/task/29908/root (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29908 mgr-fin ceph txt unknown /proc/18843/task/29908/exe (readlink: Permission denied) 2024-08-31T06:49:26.045 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29908 mgr-fin ceph NOFD /proc/18843/task/29908/fd (opendir: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29909 mgr-fin ceph cwd unknown /proc/18843/task/29909/cwd (readlink: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29909 mgr-fin ceph rtd unknown /proc/18843/task/29909/root (readlink: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29909 mgr-fin ceph txt unknown /proc/18843/task/29909/exe (readlink: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29909 mgr-fin ceph NOFD /proc/18843/task/29909/fd (opendir: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29911 m-fin-sna ceph cwd unknown /proc/18843/task/29911/cwd (readlink: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29911 m-fin-sna ceph rtd unknown /proc/18843/task/29911/root (readlink: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29911 m-fin-sna ceph txt unknown /proc/18843/task/29911/exe (readlink: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29911 m-fin-sna ceph NOFD /proc/18843/task/29911/fd (opendir: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29912 mgr-fin ceph cwd unknown /proc/18843/task/29912/cwd (readlink: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29912 mgr-fin ceph rtd unknown /proc/18843/task/29912/root (readlink: Permission denied) 2024-08-31T06:49:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29912 mgr-fin ceph txt unknown /proc/18843/task/29912/exe (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29912 mgr-fin ceph NOFD /proc/18843/task/29912/fd (opendir: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29914 m-fin-sta ceph cwd unknown /proc/18843/task/29914/cwd (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29914 m-fin-sta ceph rtd unknown /proc/18843/task/29914/root (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29914 m-fin-sta ceph txt unknown /proc/18843/task/29914/exe (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29914 m-fin-sta ceph NOFD /proc/18843/task/29914/fd (opendir: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29915 telemetry ceph cwd unknown /proc/18843/task/29915/cwd (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29915 telemetry ceph rtd unknown /proc/18843/task/29915/root (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29915 telemetry ceph txt unknown /proc/18843/task/29915/exe (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29915 telemetry ceph NOFD /proc/18843/task/29915/fd (opendir: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29916 m-fin-tel ceph cwd unknown /proc/18843/task/29916/cwd (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29916 m-fin-tel ceph rtd unknown /proc/18843/task/29916/root (readlink: Permission denied) 2024-08-31T06:49:26.047 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29916 m-fin-tel ceph txt unknown /proc/18843/task/29916/exe (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29916 m-fin-tel ceph NOFD /proc/18843/task/29916/fd (opendir: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29917 mgr-fin ceph cwd unknown /proc/18843/task/29917/cwd (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29917 mgr-fin ceph rtd unknown /proc/18843/task/29917/root (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29917 mgr-fin ceph txt unknown /proc/18843/task/29917/exe (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29917 mgr-fin ceph NOFD /proc/18843/task/29917/fd (opendir: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29921 io_contex ceph cwd unknown /proc/18843/task/29921/cwd (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29921 io_contex ceph rtd unknown /proc/18843/task/29921/root (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29921 io_contex ceph txt unknown /proc/18843/task/29921/exe (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29921 io_contex ceph NOFD /proc/18843/task/29921/fd (opendir: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29922 io_contex ceph cwd unknown /proc/18843/task/29922/cwd (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29922 io_contex ceph rtd unknown /proc/18843/task/29922/root (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29922 io_contex ceph txt unknown /proc/18843/task/29922/exe (readlink: Permission denied) 2024-08-31T06:49:26.048 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29922 io_contex ceph NOFD /proc/18843/task/29922/fd (opendir: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29923 ceph_time ceph cwd unknown /proc/18843/task/29923/cwd (readlink: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29923 ceph_time ceph rtd unknown /proc/18843/task/29923/root (readlink: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29923 ceph_time ceph txt unknown /proc/18843/task/29923/exe (readlink: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29923 ceph_time ceph NOFD /proc/18843/task/29923/fd (opendir: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29924 ms_dispat ceph cwd unknown /proc/18843/task/29924/cwd (readlink: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29924 ms_dispat ceph rtd unknown /proc/18843/task/29924/root (readlink: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29924 ms_dispat ceph txt unknown /proc/18843/task/29924/exe (readlink: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29924 ms_dispat ceph NOFD /proc/18843/task/29924/fd (opendir: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29925 ms_local ceph cwd unknown /proc/18843/task/29925/cwd (readlink: Permission denied) 2024-08-31T06:49:26.049 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29925 ms_local ceph rtd unknown /proc/18843/task/29925/root (readlink: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29925 ms_local ceph txt unknown /proc/18843/task/29925/exe (readlink: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29925 ms_local ceph NOFD /proc/18843/task/29925/fd (opendir: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29926 safe_time ceph cwd unknown /proc/18843/task/29926/cwd (readlink: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29926 safe_time ceph rtd unknown /proc/18843/task/29926/root (readlink: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29926 safe_time ceph txt unknown /proc/18843/task/29926/exe (readlink: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29926 safe_time ceph NOFD /proc/18843/task/29926/fd (opendir: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29927 safe_time ceph cwd unknown /proc/18843/task/29927/cwd (readlink: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29927 safe_time ceph rtd unknown /proc/18843/task/29927/root (readlink: Permission denied) 2024-08-31T06:49:26.050 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29927 safe_time ceph txt unknown /proc/18843/task/29927/exe (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29927 safe_time ceph NOFD /proc/18843/task/29927/fd (opendir: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29928 mgr-fin ceph cwd unknown /proc/18843/task/29928/cwd (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29928 mgr-fin ceph rtd unknown /proc/18843/task/29928/root (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29928 mgr-fin ceph txt unknown /proc/18843/task/29928/exe (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29928 mgr-fin ceph NOFD /proc/18843/task/29928/fd (opendir: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29929 mgr-fin ceph cwd unknown /proc/18843/task/29929/cwd (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29929 mgr-fin ceph rtd unknown /proc/18843/task/29929/root (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29929 mgr-fin ceph txt unknown /proc/18843/task/29929/exe (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29929 mgr-fin ceph NOFD /proc/18843/task/29929/fd (opendir: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29930 mgr-fin ceph cwd unknown /proc/18843/task/29930/cwd (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29930 mgr-fin ceph rtd unknown /proc/18843/task/29930/root (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29930 mgr-fin ceph txt unknown /proc/18843/task/29930/exe (readlink: Permission denied) 2024-08-31T06:49:26.051 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29930 mgr-fin ceph NOFD /proc/18843/task/29930/fd (opendir: Permission denied) 2024-08-31T06:49:26.052 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29931 mgr-fin ceph cwd unknown /proc/18843/task/29931/cwd (readlink: Permission denied) 2024-08-31T06:49:26.052 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29931 mgr-fin ceph rtd unknown /proc/18843/task/29931/root (readlink: Permission denied) 2024-08-31T06:49:26.052 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29931 mgr-fin ceph txt unknown /proc/18843/task/29931/exe (readlink: Permission denied) 2024-08-31T06:49:26.052 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29931 mgr-fin ceph NOFD /proc/18843/task/29931/fd (opendir: Permission denied) 2024-08-31T06:49:26.052 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29932 mgr-fin ceph cwd unknown /proc/18843/task/29932/cwd (readlink: Permission denied) 2024-08-31T06:49:26.052 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29932 mgr-fin ceph rtd unknown /proc/18843/task/29932/root (readlink: Permission denied) 2024-08-31T06:49:26.052 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29932 mgr-fin ceph txt unknown /proc/18843/task/29932/exe (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29932 mgr-fin ceph NOFD /proc/18843/task/29932/fd (opendir: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29933 mgr-fin ceph cwd unknown /proc/18843/task/29933/cwd (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29933 mgr-fin ceph rtd unknown /proc/18843/task/29933/root (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29933 mgr-fin ceph txt unknown /proc/18843/task/29933/exe (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29933 mgr-fin ceph NOFD /proc/18843/task/29933/fd (opendir: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29934 mgr-fin ceph cwd unknown /proc/18843/task/29934/cwd (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29934 mgr-fin ceph rtd unknown /proc/18843/task/29934/root (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29934 mgr-fin ceph txt unknown /proc/18843/task/29934/exe (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29934 mgr-fin ceph NOFD /proc/18843/task/29934/fd (opendir: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29935 mgr-fin ceph cwd unknown /proc/18843/task/29935/cwd (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29935 mgr-fin ceph rtd unknown /proc/18843/task/29935/root (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29935 mgr-fin ceph txt unknown /proc/18843/task/29935/exe (readlink: Permission denied) 2024-08-31T06:49:26.053 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29935 mgr-fin ceph NOFD /proc/18843/task/29935/fd (opendir: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29936 mgr-fin ceph cwd unknown /proc/18843/task/29936/cwd (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29936 mgr-fin ceph rtd unknown /proc/18843/task/29936/root (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29936 mgr-fin ceph txt unknown /proc/18843/task/29936/exe (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29936 mgr-fin ceph NOFD /proc/18843/task/29936/fd (opendir: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29937 mgr-fin ceph cwd unknown /proc/18843/task/29937/cwd (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29937 mgr-fin ceph rtd unknown /proc/18843/task/29937/root (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29937 mgr-fin ceph txt unknown /proc/18843/task/29937/exe (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29937 mgr-fin ceph NOFD /proc/18843/task/29937/fd (opendir: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29938 mgr-fin ceph cwd unknown /proc/18843/task/29938/cwd (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29938 mgr-fin ceph rtd unknown /proc/18843/task/29938/root (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29938 mgr-fin ceph txt unknown /proc/18843/task/29938/exe (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29938 mgr-fin ceph NOFD /proc/18843/task/29938/fd (opendir: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29939 mgr-fin ceph cwd unknown /proc/18843/task/29939/cwd (readlink: Permission denied) 2024-08-31T06:49:26.054 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29939 mgr-fin ceph rtd unknown /proc/18843/task/29939/root (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29939 mgr-fin ceph txt unknown /proc/18843/task/29939/exe (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29939 mgr-fin ceph NOFD /proc/18843/task/29939/fd (opendir: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29941 m-fin-vol ceph cwd unknown /proc/18843/task/29941/cwd (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29941 m-fin-vol ceph rtd unknown /proc/18843/task/29941/root (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29941 m-fin-vol ceph txt unknown /proc/18843/task/29941/exe (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 29941 m-fin-vol ceph NOFD /proc/18843/task/29941/fd (opendir: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30068 dashboard ceph cwd unknown /proc/18843/task/30068/cwd (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30068 dashboard ceph rtd unknown /proc/18843/task/30068/root (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30068 dashboard ceph txt unknown /proc/18843/task/30068/exe (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30068 dashboard ceph NOFD /proc/18843/task/30068/fd (opendir: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30069 dashboard ceph cwd unknown /proc/18843/task/30069/cwd (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30069 dashboard ceph rtd unknown /proc/18843/task/30069/root (readlink: Permission denied) 2024-08-31T06:49:26.055 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30069 dashboard ceph txt unknown /proc/18843/task/30069/exe (readlink: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30069 dashboard ceph NOFD /proc/18843/task/30069/fd (opendir: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30070 dashboard ceph cwd unknown /proc/18843/task/30070/cwd (readlink: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30070 dashboard ceph rtd unknown /proc/18843/task/30070/root (readlink: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30070 dashboard ceph txt unknown /proc/18843/task/30070/exe (readlink: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30070 dashboard ceph NOFD /proc/18843/task/30070/fd (opendir: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30071 dashboard ceph cwd unknown /proc/18843/task/30071/cwd (readlink: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30071 dashboard ceph rtd unknown /proc/18843/task/30071/root (readlink: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30071 dashboard ceph txt unknown /proc/18843/task/30071/exe (readlink: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30071 dashboard ceph NOFD /proc/18843/task/30071/fd (opendir: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30072 dashboard ceph cwd unknown /proc/18843/task/30072/cwd (readlink: Permission denied) 2024-08-31T06:49:26.056 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30072 dashboard ceph rtd unknown /proc/18843/task/30072/root (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30072 dashboard ceph txt unknown /proc/18843/task/30072/exe (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30072 dashboard ceph NOFD /proc/18843/task/30072/fd (opendir: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30073 dashboard ceph cwd unknown /proc/18843/task/30073/cwd (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30073 dashboard ceph rtd unknown /proc/18843/task/30073/root (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30073 dashboard ceph txt unknown /proc/18843/task/30073/exe (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30073 dashboard ceph NOFD /proc/18843/task/30073/fd (opendir: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30074 dashboard ceph cwd unknown /proc/18843/task/30074/cwd (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30074 dashboard ceph rtd unknown /proc/18843/task/30074/root (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30074 dashboard ceph txt unknown /proc/18843/task/30074/exe (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30074 dashboard ceph NOFD /proc/18843/task/30074/fd (opendir: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30075 dashboard ceph cwd unknown /proc/18843/task/30075/cwd (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30075 dashboard ceph rtd unknown /proc/18843/task/30075/root (readlink: Permission denied) 2024-08-31T06:49:26.057 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30075 dashboard ceph txt unknown /proc/18843/task/30075/exe (readlink: Permission denied) 2024-08-31T06:49:26.058 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30075 dashboard ceph NOFD /proc/18843/task/30075/fd (opendir: Permission denied) 2024-08-31T06:49:26.058 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30076 dashboard ceph cwd unknown /proc/18843/task/30076/cwd (readlink: Permission denied) 2024-08-31T06:49:26.058 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30076 dashboard ceph rtd unknown /proc/18843/task/30076/root (readlink: Permission denied) 2024-08-31T06:49:26.058 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30076 dashboard ceph txt unknown /proc/18843/task/30076/exe (readlink: Permission denied) 2024-08-31T06:49:26.058 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30076 dashboard ceph NOFD /proc/18843/task/30076/fd (opendir: Permission denied) 2024-08-31T06:49:26.058 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30077 dashboard ceph cwd unknown /proc/18843/task/30077/cwd (readlink: Permission denied) 2024-08-31T06:49:26.059 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30077 dashboard ceph rtd unknown /proc/18843/task/30077/root (readlink: Permission denied) 2024-08-31T06:49:26.059 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30077 dashboard ceph txt unknown /proc/18843/task/30077/exe (readlink: Permission denied) 2024-08-31T06:49:26.059 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30077 dashboard ceph NOFD /proc/18843/task/30077/fd (opendir: Permission denied) 2024-08-31T06:49:26.059 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30078 dashboard ceph cwd unknown /proc/18843/task/30078/cwd (readlink: Permission denied) 2024-08-31T06:49:26.059 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30078 dashboard ceph rtd unknown /proc/18843/task/30078/root (readlink: Permission denied) 2024-08-31T06:49:26.059 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30078 dashboard ceph txt unknown /proc/18843/task/30078/exe (readlink: Permission denied) 2024-08-31T06:49:26.060 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30078 dashboard ceph NOFD /proc/18843/task/30078/fd (opendir: Permission denied) 2024-08-31T06:49:26.060 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30104 dashboard ceph cwd unknown /proc/18843/task/30104/cwd (readlink: Permission denied) 2024-08-31T06:49:26.060 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30104 dashboard ceph rtd unknown /proc/18843/task/30104/root (readlink: Permission denied) 2024-08-31T06:49:26.060 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30104 dashboard ceph txt unknown /proc/18843/task/30104/exe (readlink: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 30104 dashboard ceph NOFD /proc/18843/task/30104/fd (opendir: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31478 mgr-fin ceph cwd unknown /proc/18843/task/31478/cwd (readlink: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31478 mgr-fin ceph rtd unknown /proc/18843/task/31478/root (readlink: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31478 mgr-fin ceph txt unknown /proc/18843/task/31478/exe (readlink: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31478 mgr-fin ceph NOFD /proc/18843/task/31478/fd (opendir: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31479 mgr-fin ceph cwd unknown /proc/18843/task/31479/cwd (readlink: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31479 mgr-fin ceph rtd unknown /proc/18843/task/31479/root (readlink: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31479 mgr-fin ceph txt unknown /proc/18843/task/31479/exe (readlink: Permission denied) 2024-08-31T06:49:26.061 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31479 mgr-fin ceph NOFD /proc/18843/task/31479/fd (opendir: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31480 mgr-fin ceph cwd unknown /proc/18843/task/31480/cwd (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31480 mgr-fin ceph rtd unknown /proc/18843/task/31480/root (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31480 mgr-fin ceph txt unknown /proc/18843/task/31480/exe (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31480 mgr-fin ceph NOFD /proc/18843/task/31480/fd (opendir: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31481 mgr-fin ceph cwd unknown /proc/18843/task/31481/cwd (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31481 mgr-fin ceph rtd unknown /proc/18843/task/31481/root (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31481 mgr-fin ceph txt unknown /proc/18843/task/31481/exe (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31481 mgr-fin ceph NOFD /proc/18843/task/31481/fd (opendir: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31482 mgr-fin ceph cwd unknown /proc/18843/task/31482/cwd (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31482 mgr-fin ceph rtd unknown /proc/18843/task/31482/root (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31482 mgr-fin ceph txt unknown /proc/18843/task/31482/exe (readlink: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31482 mgr-fin ceph NOFD /proc/18843/task/31482/fd (opendir: Permission denied) 2024-08-31T06:49:26.062 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31483 mgr-fin ceph cwd unknown /proc/18843/task/31483/cwd (readlink: Permission denied) 2024-08-31T06:49:26.063 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31483 mgr-fin ceph rtd unknown /proc/18843/task/31483/root (readlink: Permission denied) 2024-08-31T06:49:26.063 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31483 mgr-fin ceph txt unknown /proc/18843/task/31483/exe (readlink: Permission denied) 2024-08-31T06:49:26.063 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31483 mgr-fin ceph NOFD /proc/18843/task/31483/fd (opendir: Permission denied) 2024-08-31T06:49:26.063 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31484 mgr-fin ceph cwd unknown /proc/18843/task/31484/cwd (readlink: Permission denied) 2024-08-31T06:49:26.063 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31484 mgr-fin ceph rtd unknown /proc/18843/task/31484/root (readlink: Permission denied) 2024-08-31T06:49:26.063 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31484 mgr-fin ceph txt unknown /proc/18843/task/31484/exe (readlink: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31484 mgr-fin ceph NOFD /proc/18843/task/31484/fd (opendir: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31485 mgr-fin ceph cwd unknown /proc/18843/task/31485/cwd (readlink: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31485 mgr-fin ceph rtd unknown /proc/18843/task/31485/root (readlink: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31485 mgr-fin ceph txt unknown /proc/18843/task/31485/exe (readlink: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31485 mgr-fin ceph NOFD /proc/18843/task/31485/fd (opendir: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31486 mgr-fin ceph cwd unknown /proc/18843/task/31486/cwd (readlink: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31486 mgr-fin ceph rtd unknown /proc/18843/task/31486/root (readlink: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31486 mgr-fin ceph txt unknown /proc/18843/task/31486/exe (readlink: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31486 mgr-fin ceph NOFD /proc/18843/task/31486/fd (opendir: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31487 mgr-fin ceph cwd unknown /proc/18843/task/31487/cwd (readlink: Permission denied) 2024-08-31T06:49:26.064 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31487 mgr-fin ceph rtd unknown /proc/18843/task/31487/root (readlink: Permission denied) 2024-08-31T06:49:26.065 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31487 mgr-fin ceph txt unknown /proc/18843/task/31487/exe (readlink: Permission denied) 2024-08-31T06:49:26.065 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31487 mgr-fin ceph NOFD /proc/18843/task/31487/fd (opendir: Permission denied) 2024-08-31T06:49:26.065 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31488 mgr-fin ceph cwd unknown /proc/18843/task/31488/cwd (readlink: Permission denied) 2024-08-31T06:49:26.065 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31488 mgr-fin ceph rtd unknown /proc/18843/task/31488/root (readlink: Permission denied) 2024-08-31T06:49:26.065 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31488 mgr-fin ceph txt unknown /proc/18843/task/31488/exe (readlink: Permission denied) 2024-08-31T06:49:26.065 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31488 mgr-fin ceph NOFD /proc/18843/task/31488/fd (opendir: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31499 mgr-fin ceph cwd unknown /proc/18843/task/31499/cwd (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31499 mgr-fin ceph rtd unknown /proc/18843/task/31499/root (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31499 mgr-fin ceph txt unknown /proc/18843/task/31499/exe (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31499 mgr-fin ceph NOFD /proc/18843/task/31499/fd (opendir: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31500 mgr-fin ceph cwd unknown /proc/18843/task/31500/cwd (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31500 mgr-fin ceph rtd unknown /proc/18843/task/31500/root (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31500 mgr-fin ceph txt unknown /proc/18843/task/31500/exe (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31500 mgr-fin ceph NOFD /proc/18843/task/31500/fd (opendir: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31501 mgr-fin ceph cwd unknown /proc/18843/task/31501/cwd (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31501 mgr-fin ceph rtd unknown /proc/18843/task/31501/root (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31501 mgr-fin ceph txt unknown /proc/18843/task/31501/exe (readlink: Permission denied) 2024-08-31T06:49:26.066 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31501 mgr-fin ceph NOFD /proc/18843/task/31501/fd (opendir: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31502 mgr-fin ceph cwd unknown /proc/18843/task/31502/cwd (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31502 mgr-fin ceph rtd unknown /proc/18843/task/31502/root (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31502 mgr-fin ceph txt unknown /proc/18843/task/31502/exe (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31502 mgr-fin ceph NOFD /proc/18843/task/31502/fd (opendir: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31503 mgr-fin ceph cwd unknown /proc/18843/task/31503/cwd (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31503 mgr-fin ceph rtd unknown /proc/18843/task/31503/root (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31503 mgr-fin ceph txt unknown /proc/18843/task/31503/exe (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31503 mgr-fin ceph NOFD /proc/18843/task/31503/fd (opendir: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31504 mgr-fin ceph cwd unknown /proc/18843/task/31504/cwd (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31504 mgr-fin ceph rtd unknown /proc/18843/task/31504/root (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31504 mgr-fin ceph txt unknown /proc/18843/task/31504/exe (readlink: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31504 mgr-fin ceph NOFD /proc/18843/task/31504/fd (opendir: Permission denied) 2024-08-31T06:49:26.067 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31505 mgr-fin ceph cwd unknown /proc/18843/task/31505/cwd (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31505 mgr-fin ceph rtd unknown /proc/18843/task/31505/root (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31505 mgr-fin ceph txt unknown /proc/18843/task/31505/exe (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31505 mgr-fin ceph NOFD /proc/18843/task/31505/fd (opendir: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31506 mgr-fin ceph cwd unknown /proc/18843/task/31506/cwd (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31506 mgr-fin ceph rtd unknown /proc/18843/task/31506/root (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31506 mgr-fin ceph txt unknown /proc/18843/task/31506/exe (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31506 mgr-fin ceph NOFD /proc/18843/task/31506/fd (opendir: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31507 mgr-fin ceph cwd unknown /proc/18843/task/31507/cwd (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31507 mgr-fin ceph rtd unknown /proc/18843/task/31507/root (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31507 mgr-fin ceph txt unknown /proc/18843/task/31507/exe (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31507 mgr-fin ceph NOFD /proc/18843/task/31507/fd (opendir: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31508 mgr-fin ceph cwd unknown /proc/18843/task/31508/cwd (readlink: Permission denied) 2024-08-31T06:49:26.068 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31508 mgr-fin ceph rtd unknown /proc/18843/task/31508/root (readlink: Permission denied) 2024-08-31T06:49:26.069 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31508 mgr-fin ceph txt unknown /proc/18843/task/31508/exe (readlink: Permission denied) 2024-08-31T06:49:26.073 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31508 mgr-fin ceph NOFD /proc/18843/task/31508/fd (opendir: Permission denied) 2024-08-31T06:49:26.073 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31509 mgr-fin ceph cwd unknown /proc/18843/task/31509/cwd (readlink: Permission denied) 2024-08-31T06:49:26.073 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31509 mgr-fin ceph rtd unknown /proc/18843/task/31509/root (readlink: Permission denied) 2024-08-31T06:49:26.073 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31509 mgr-fin ceph txt unknown /proc/18843/task/31509/exe (readlink: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 31509 mgr-fin ceph NOFD /proc/18843/task/31509/fd (opendir: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41531 devicehea ceph cwd unknown /proc/18843/task/41531/cwd (readlink: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41531 devicehea ceph rtd unknown /proc/18843/task/41531/root (readlink: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41531 devicehea ceph txt unknown /proc/18843/task/41531/exe (readlink: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41531 devicehea ceph NOFD /proc/18843/task/41531/fd (opendir: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41535 io_contex ceph cwd unknown /proc/18843/task/41535/cwd (readlink: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41535 io_contex ceph rtd unknown /proc/18843/task/41535/root (readlink: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41535 io_contex ceph txt unknown /proc/18843/task/41535/exe (readlink: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41535 io_contex ceph NOFD /proc/18843/task/41535/fd (opendir: Permission denied) 2024-08-31T06:49:26.074 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41536 io_contex ceph cwd unknown /proc/18843/task/41536/cwd (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41536 io_contex ceph rtd unknown /proc/18843/task/41536/root (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41536 io_contex ceph txt unknown /proc/18843/task/41536/exe (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41536 io_contex ceph NOFD /proc/18843/task/41536/fd (opendir: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41537 ceph_time ceph cwd unknown /proc/18843/task/41537/cwd (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41537 ceph_time ceph rtd unknown /proc/18843/task/41537/root (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41537 ceph_time ceph txt unknown /proc/18843/task/41537/exe (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41537 ceph_time ceph NOFD /proc/18843/task/41537/fd (opendir: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41538 ms_dispat ceph cwd unknown /proc/18843/task/41538/cwd (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41538 ms_dispat ceph rtd unknown /proc/18843/task/41538/root (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41538 ms_dispat ceph txt unknown /proc/18843/task/41538/exe (readlink: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41538 ms_dispat ceph NOFD /proc/18843/task/41538/fd (opendir: Permission denied) 2024-08-31T06:49:26.075 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41539 ms_local ceph cwd unknown /proc/18843/task/41539/cwd (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41539 ms_local ceph rtd unknown /proc/18843/task/41539/root (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41539 ms_local ceph txt unknown /proc/18843/task/41539/exe (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41539 ms_local ceph NOFD /proc/18843/task/41539/fd (opendir: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41540 safe_time ceph cwd unknown /proc/18843/task/41540/cwd (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41540 safe_time ceph rtd unknown /proc/18843/task/41540/root (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41540 safe_time ceph txt unknown /proc/18843/task/41540/exe (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41540 safe_time ceph NOFD /proc/18843/task/41540/fd (opendir: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41541 safe_time ceph cwd unknown /proc/18843/task/41541/cwd (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41541 safe_time ceph rtd unknown /proc/18843/task/41541/root (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41541 safe_time ceph txt unknown /proc/18843/task/41541/exe (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 41541 safe_time ceph NOFD /proc/18843/task/41541/fd (opendir: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 73909 io_contex ceph cwd unknown /proc/18843/task/73909/cwd (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 73909 io_contex ceph rtd unknown /proc/18843/task/73909/root (readlink: Permission denied) 2024-08-31T06:49:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 73909 io_contex ceph txt unknown /proc/18843/task/73909/exe (readlink: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 73909 io_contex ceph NOFD /proc/18843/task/73909/fd (opendir: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 73910 io_contex ceph cwd unknown /proc/18843/task/73910/cwd (readlink: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 73910 io_contex ceph rtd unknown /proc/18843/task/73910/root (readlink: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 73910 io_contex ceph txt unknown /proc/18843/task/73910/exe (readlink: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 73910 io_contex ceph NOFD /proc/18843/task/73910/fd (opendir: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74662 m-fin-sna ceph cwd unknown /proc/18843/task/74662/cwd (readlink: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74662 m-fin-sna ceph rtd unknown /proc/18843/task/74662/root (readlink: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74662 m-fin-sna ceph txt unknown /proc/18843/task/74662/exe (readlink: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74662 m-fin-sna ceph NOFD /proc/18843/task/74662/fd (opendir: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74666 io_contex ceph cwd unknown /proc/18843/task/74666/cwd (readlink: Permission denied) 2024-08-31T06:49:26.077 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74666 io_contex ceph rtd unknown /proc/18843/task/74666/root (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74666 io_contex ceph txt unknown /proc/18843/task/74666/exe (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74666 io_contex ceph NOFD /proc/18843/task/74666/fd (opendir: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74667 io_contex ceph cwd unknown /proc/18843/task/74667/cwd (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74667 io_contex ceph rtd unknown /proc/18843/task/74667/root (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74667 io_contex ceph txt unknown /proc/18843/task/74667/exe (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74667 io_contex ceph NOFD /proc/18843/task/74667/fd (opendir: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74668 ceph_time ceph cwd unknown /proc/18843/task/74668/cwd (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74668 ceph_time ceph rtd unknown /proc/18843/task/74668/root (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74668 ceph_time ceph txt unknown /proc/18843/task/74668/exe (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74668 ceph_time ceph NOFD /proc/18843/task/74668/fd (opendir: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74669 ms_dispat ceph cwd unknown /proc/18843/task/74669/cwd (readlink: Permission denied) 2024-08-31T06:49:26.078 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74669 ms_dispat ceph rtd unknown /proc/18843/task/74669/root (readlink: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74669 ms_dispat ceph txt unknown /proc/18843/task/74669/exe (readlink: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74669 ms_dispat ceph NOFD /proc/18843/task/74669/fd (opendir: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74670 ms_local ceph cwd unknown /proc/18843/task/74670/cwd (readlink: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74670 ms_local ceph rtd unknown /proc/18843/task/74670/root (readlink: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74670 ms_local ceph txt unknown /proc/18843/task/74670/exe (readlink: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74670 ms_local ceph NOFD /proc/18843/task/74670/fd (opendir: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74671 safe_time ceph cwd unknown /proc/18843/task/74671/cwd (readlink: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74671 safe_time ceph rtd unknown /proc/18843/task/74671/root (readlink: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74671 safe_time ceph txt unknown /proc/18843/task/74671/exe (readlink: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74671 safe_time ceph NOFD /proc/18843/task/74671/fd (opendir: Permission denied) 2024-08-31T06:49:26.079 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74672 safe_time ceph cwd unknown /proc/18843/task/74672/cwd (readlink: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74672 safe_time ceph rtd unknown /proc/18843/task/74672/root (readlink: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74672 safe_time ceph txt unknown /proc/18843/task/74672/exe (readlink: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 74672 safe_time ceph NOFD /proc/18843/task/74672/fd (opendir: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76827 ceph_time ceph cwd unknown /proc/18843/task/76827/cwd (readlink: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76827 ceph_time ceph rtd unknown /proc/18843/task/76827/root (readlink: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76827 ceph_time ceph txt unknown /proc/18843/task/76827/exe (readlink: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76827 ceph_time ceph NOFD /proc/18843/task/76827/fd (opendir: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76828 fn_anonym ceph cwd unknown /proc/18843/task/76828/cwd (readlink: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76828 fn_anonym ceph rtd unknown /proc/18843/task/76828/root (readlink: Permission denied) 2024-08-31T06:49:26.080 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76828 fn_anonym ceph txt unknown /proc/18843/task/76828/exe (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76828 fn_anonym ceph NOFD /proc/18843/task/76828/fd (opendir: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76829 safe_time ceph cwd unknown /proc/18843/task/76829/cwd (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76829 safe_time ceph rtd unknown /proc/18843/task/76829/root (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76829 safe_time ceph txt unknown /proc/18843/task/76829/exe (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76829 safe_time ceph NOFD /proc/18843/task/76829/fd (opendir: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76830 fn_anonym ceph cwd unknown /proc/18843/task/76830/cwd (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76830 fn_anonym ceph rtd unknown /proc/18843/task/76830/root (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76830 fn_anonym ceph txt unknown /proc/18843/task/76830/exe (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76830 fn_anonym ceph NOFD /proc/18843/task/76830/fd (opendir: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76831 flusher ceph cwd unknown /proc/18843/task/76831/cwd (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76831 flusher ceph rtd unknown /proc/18843/task/76831/root (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76831 flusher ceph txt unknown /proc/18843/task/76831/exe (readlink: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76831 flusher ceph NOFD /proc/18843/task/76831/fd (opendir: Permission denied) 2024-08-31T06:49:26.081 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76832 ms_dispat ceph cwd unknown /proc/18843/task/76832/cwd (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76832 ms_dispat ceph rtd unknown /proc/18843/task/76832/root (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76832 ms_dispat ceph txt unknown /proc/18843/task/76832/exe (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76832 ms_dispat ceph NOFD /proc/18843/task/76832/fd (opendir: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76833 ms_local ceph cwd unknown /proc/18843/task/76833/cwd (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76833 ms_local ceph rtd unknown /proc/18843/task/76833/root (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76833 ms_local ceph txt unknown /proc/18843/task/76833/exe (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76833 ms_local ceph NOFD /proc/18843/task/76833/fd (opendir: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76834 safe_time ceph cwd unknown /proc/18843/task/76834/cwd (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76834 safe_time ceph rtd unknown /proc/18843/task/76834/root (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76834 safe_time ceph txt unknown /proc/18843/task/76834/exe (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76834 safe_time ceph NOFD /proc/18843/task/76834/fd (opendir: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76835 m-fin-sna ceph cwd unknown /proc/18843/task/76835/cwd (readlink: Permission denied) 2024-08-31T06:49:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76835 m-fin-sna ceph rtd unknown /proc/18843/task/76835/root (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76835 m-fin-sna ceph txt unknown /proc/18843/task/76835/exe (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 76835 m-fin-sna ceph NOFD /proc/18843/task/76835/fd (opendir: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 81595 m-fin-sna ceph cwd unknown /proc/18843/task/81595/cwd (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 81595 m-fin-sna ceph rtd unknown /proc/18843/task/81595/root (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 81595 m-fin-sna ceph txt unknown /proc/18843/task/81595/exe (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mgr 18843 81595 m-fin-sna ceph NOFD /proc/18843/task/81595/fd (opendir: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 18943 root cwd unknown /proc/18943/cwd (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 18943 root rtd unknown /proc/18943/root (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 18943 root txt unknown /proc/18943/exe (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 18943 root NOFD /proc/18943/fd (opendir: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 19391 root cwd unknown /proc/19391/cwd (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 19391 root rtd unknown /proc/19391/root (readlink: Permission denied) 2024-08-31T06:49:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 19391 root txt unknown /proc/19391/exe (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 19391 root NOFD /proc/19391/fd (opendir: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 19812 root cwd unknown /proc/19812/cwd (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 19812 root rtd unknown /proc/19812/root (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 19812 root txt unknown /proc/19812/exe (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:systemd 19812 root NOFD /proc/19812/fd (opendir: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:(sd-pam) 19814 root cwd unknown /proc/19814/cwd (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:(sd-pam) 19814 root rtd unknown /proc/19814/root (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:(sd-pam) 19814 root txt unknown /proc/19814/exe (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:(sd-pam) 19814 root NOFD /proc/19814/fd (opendir: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 29942 root cwd unknown /proc/29942/cwd (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 29942 root rtd unknown /proc/29942/root (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 29942 root txt unknown /proc/29942/exe (readlink: Permission denied) 2024-08-31T06:49:26.084 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 29942 root NOFD /proc/29942/fd (opendir: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 29945 root cwd unknown /proc/29945/cwd (readlink: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 29945 root rtd unknown /proc/29945/root (readlink: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 29945 root txt unknown /proc/29945/exe (readlink: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:sshd 29945 root NOFD /proc/29945/fd (opendir: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 30578 root cwd unknown /proc/30578/cwd (readlink: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 30578 root rtd unknown /proc/30578/root (readlink: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 30578 root txt unknown /proc/30578/exe (readlink: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 30578 root NOFD /proc/30578/fd (opendir: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 31175 root cwd unknown /proc/31175/cwd (readlink: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 31175 root rtd unknown /proc/31175/root (readlink: Permission denied) 2024-08-31T06:49:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 31175 root txt unknown /proc/31175/exe (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 31175 root NOFD /proc/31175/fd (opendir: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 37063 root cwd unknown /proc/37063/cwd (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 37063 root rtd unknown /proc/37063/root (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 37063 root txt unknown /proc/37063/exe (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 37063 root NOFD /proc/37063/fd (opendir: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 37065 root cwd unknown /proc/37065/cwd (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 37065 root rtd unknown /proc/37065/root (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 37065 root txt unknown /proc/37065/exe (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 37065 root NOFD /proc/37065/fd (opendir: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 ceph cwd unknown /proc/37067/cwd (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 ceph rtd unknown /proc/37067/root (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 ceph txt unknown /proc/37067/exe (readlink: Permission denied) 2024-08-31T06:49:26.086 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 ceph NOFD /proc/37067/fd (opendir: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37068 log ceph cwd unknown /proc/37067/task/37068/cwd (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37068 log ceph rtd unknown /proc/37067/task/37068/root (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37068 log ceph txt unknown /proc/37067/task/37068/exe (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37068 log ceph NOFD /proc/37067/task/37068/fd (opendir: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37070 msgr-work ceph cwd unknown /proc/37067/task/37070/cwd (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37070 msgr-work ceph rtd unknown /proc/37067/task/37070/root (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37070 msgr-work ceph txt unknown /proc/37067/task/37070/exe (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37070 msgr-work ceph NOFD /proc/37067/task/37070/fd (opendir: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37071 msgr-work ceph cwd unknown /proc/37067/task/37071/cwd (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37071 msgr-work ceph rtd unknown /proc/37067/task/37071/root (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37071 msgr-work ceph txt unknown /proc/37067/task/37071/exe (readlink: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37071 msgr-work ceph NOFD /proc/37067/task/37071/fd (opendir: Permission denied) 2024-08-31T06:49:26.087 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37072 msgr-work ceph cwd unknown /proc/37067/task/37072/cwd (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37072 msgr-work ceph rtd unknown /proc/37067/task/37072/root (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37072 msgr-work ceph txt unknown /proc/37067/task/37072/exe (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37072 msgr-work ceph NOFD /proc/37067/task/37072/fd (opendir: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37076 service ceph cwd unknown /proc/37067/task/37076/cwd (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37076 service ceph rtd unknown /proc/37067/task/37076/root (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37076 service ceph txt unknown /proc/37067/task/37076/exe (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37076 service ceph NOFD /proc/37067/task/37076/fd (opendir: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37077 admin_soc ceph cwd unknown /proc/37067/task/37077/cwd (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37077 admin_soc ceph rtd unknown /proc/37067/task/37077/root (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37077 admin_soc ceph txt unknown /proc/37067/task/37077/exe (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37077 admin_soc ceph NOFD /proc/37067/task/37077/fd (opendir: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37416 signal_ha ceph cwd unknown /proc/37067/task/37416/cwd (readlink: Permission denied) 2024-08-31T06:49:26.088 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37416 signal_ha ceph rtd unknown /proc/37067/task/37416/root (readlink: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37416 signal_ha ceph txt unknown /proc/37067/task/37416/exe (readlink: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37416 signal_ha ceph NOFD /proc/37067/task/37416/fd (opendir: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37417 io_contex ceph cwd unknown /proc/37067/task/37417/cwd (readlink: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37417 io_contex ceph rtd unknown /proc/37067/task/37417/root (readlink: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37417 io_contex ceph txt unknown /proc/37067/task/37417/exe (readlink: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37417 io_contex ceph NOFD /proc/37067/task/37417/fd (opendir: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37418 io_contex ceph cwd unknown /proc/37067/task/37418/cwd (readlink: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37418 io_contex ceph rtd unknown /proc/37067/task/37418/root (readlink: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37418 io_contex ceph txt unknown /proc/37067/task/37418/exe (readlink: Permission denied) 2024-08-31T06:49:26.089 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37418 io_contex ceph NOFD /proc/37067/task/37418/fd (opendir: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37437 OpHistory ceph cwd unknown /proc/37067/task/37437/cwd (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37437 OpHistory ceph rtd unknown /proc/37067/task/37437/root (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37437 OpHistory ceph txt unknown /proc/37067/task/37437/exe (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37437 OpHistory ceph NOFD /proc/37067/task/37437/fd (opendir: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37438 ceph_time ceph cwd unknown /proc/37067/task/37438/cwd (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37438 ceph_time ceph rtd unknown /proc/37067/task/37438/root (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37438 ceph_time ceph txt unknown /proc/37067/task/37438/exe (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37438 ceph_time ceph NOFD /proc/37067/task/37438/fd (opendir: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37442 ceph-osd ceph cwd unknown /proc/37067/task/37442/cwd (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37442 ceph-osd ceph rtd unknown /proc/37067/task/37442/root (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37442 ceph-osd ceph txt unknown /proc/37067/task/37442/exe (readlink: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37442 ceph-osd ceph NOFD /proc/37067/task/37442/fd (opendir: Permission denied) 2024-08-31T06:49:26.090 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37482 ceph-osd ceph cwd unknown /proc/37067/task/37482/cwd (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37482 ceph-osd ceph rtd unknown /proc/37067/task/37482/root (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37482 ceph-osd ceph txt unknown /proc/37067/task/37482/exe (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37482 ceph-osd ceph NOFD /proc/37067/task/37482/fd (opendir: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37532 ceph-osd ceph cwd unknown /proc/37067/task/37532/cwd (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37532 ceph-osd ceph rtd unknown /proc/37067/task/37532/root (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37532 ceph-osd ceph txt unknown /proc/37067/task/37532/exe (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37532 ceph-osd ceph NOFD /proc/37067/task/37532/fd (opendir: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37540 ceph-osd ceph cwd unknown /proc/37067/task/37540/cwd (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37540 ceph-osd ceph rtd unknown /proc/37067/task/37540/root (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37540 ceph-osd ceph txt unknown /proc/37067/task/37540/exe (readlink: Permission denied) 2024-08-31T06:49:26.091 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37540 ceph-osd ceph NOFD /proc/37067/task/37540/fd (opendir: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37548 ceph-osd ceph cwd unknown /proc/37067/task/37548/cwd (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37548 ceph-osd ceph rtd unknown /proc/37067/task/37548/root (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37548 ceph-osd ceph txt unknown /proc/37067/task/37548/exe (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37548 ceph-osd ceph NOFD /proc/37067/task/37548/fd (opendir: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37556 ceph-osd ceph cwd unknown /proc/37067/task/37556/cwd (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37556 ceph-osd ceph rtd unknown /proc/37067/task/37556/root (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37556 ceph-osd ceph txt unknown /proc/37067/task/37556/exe (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37556 ceph-osd ceph NOFD /proc/37067/task/37556/fd (opendir: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37572 ceph-osd ceph cwd unknown /proc/37067/task/37572/cwd (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37572 ceph-osd ceph rtd unknown /proc/37067/task/37572/root (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37572 ceph-osd ceph txt unknown /proc/37067/task/37572/exe (readlink: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37572 ceph-osd ceph NOFD /proc/37067/task/37572/fd (opendir: Permission denied) 2024-08-31T06:49:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37576 ceph-osd ceph cwd unknown /proc/37067/task/37576/cwd (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37576 ceph-osd ceph rtd unknown /proc/37067/task/37576/root (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37576 ceph-osd ceph txt unknown /proc/37067/task/37576/exe (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37576 ceph-osd ceph NOFD /proc/37067/task/37576/fd (opendir: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37578 ceph-osd ceph cwd unknown /proc/37067/task/37578/cwd (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37578 ceph-osd ceph rtd unknown /proc/37067/task/37578/root (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37578 ceph-osd ceph txt unknown /proc/37067/task/37578/exe (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37578 ceph-osd ceph NOFD /proc/37067/task/37578/fd (opendir: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37579 safe_time ceph cwd unknown /proc/37067/task/37579/cwd (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37579 safe_time ceph rtd unknown /proc/37067/task/37579/root (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37579 safe_time ceph txt unknown /proc/37067/task/37579/exe (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37579 safe_time ceph NOFD /proc/37067/task/37579/fd (opendir: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37580 safe_time ceph cwd unknown /proc/37067/task/37580/cwd (readlink: Permission denied) 2024-08-31T06:49:26.093 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37580 safe_time ceph rtd unknown /proc/37067/task/37580/root (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37580 safe_time ceph txt unknown /proc/37067/task/37580/exe (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37580 safe_time ceph NOFD /proc/37067/task/37580/fd (opendir: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37581 safe_time ceph cwd unknown /proc/37067/task/37581/cwd (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37581 safe_time ceph rtd unknown /proc/37067/task/37581/root (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37581 safe_time ceph txt unknown /proc/37067/task/37581/exe (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37581 safe_time ceph NOFD /proc/37067/task/37581/fd (opendir: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37582 safe_time ceph cwd unknown /proc/37067/task/37582/cwd (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37582 safe_time ceph rtd unknown /proc/37067/task/37582/root (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37582 safe_time ceph txt unknown /proc/37067/task/37582/exe (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37582 safe_time ceph NOFD /proc/37067/task/37582/fd (opendir: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37583 fn_anonym ceph cwd unknown /proc/37067/task/37583/cwd (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37583 fn_anonym ceph rtd unknown /proc/37067/task/37583/root (readlink: Permission denied) 2024-08-31T06:49:26.094 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37583 fn_anonym ceph txt unknown /proc/37067/task/37583/exe (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37583 fn_anonym ceph NOFD /proc/37067/task/37583/fd (opendir: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37713 rocksdb:l ceph cwd unknown /proc/37067/task/37713/cwd (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37713 rocksdb:l ceph rtd unknown /proc/37067/task/37713/root (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37713 rocksdb:l ceph txt unknown /proc/37067/task/37713/exe (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37713 rocksdb:l ceph NOFD /proc/37067/task/37713/fd (opendir: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37714 rocksdb:l ceph cwd unknown /proc/37067/task/37714/cwd (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37714 rocksdb:l ceph rtd unknown /proc/37067/task/37714/root (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37714 rocksdb:l ceph txt unknown /proc/37067/task/37714/exe (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37714 rocksdb:l ceph NOFD /proc/37067/task/37714/fd (opendir: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37715 rocksdb:l ceph cwd unknown /proc/37067/task/37715/cwd (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37715 rocksdb:l ceph rtd unknown /proc/37067/task/37715/root (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37715 rocksdb:l ceph txt unknown /proc/37067/task/37715/exe (readlink: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37715 rocksdb:l ceph NOFD /proc/37067/task/37715/fd (opendir: Permission denied) 2024-08-31T06:49:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37716 rocksdb:h ceph cwd unknown /proc/37067/task/37716/cwd (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37716 rocksdb:h ceph rtd unknown /proc/37067/task/37716/root (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37716 rocksdb:h ceph txt unknown /proc/37067/task/37716/exe (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 37716 rocksdb:h ceph NOFD /proc/37067/task/37716/fd (opendir: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38134 bstore_ai ceph cwd unknown /proc/37067/task/38134/cwd (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38134 bstore_ai ceph rtd unknown /proc/37067/task/38134/root (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38134 bstore_ai ceph txt unknown /proc/37067/task/38134/exe (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38134 bstore_ai ceph NOFD /proc/37067/task/38134/fd (opendir: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38318 bstore_ai ceph cwd unknown /proc/37067/task/38318/cwd (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38318 bstore_ai ceph rtd unknown /proc/37067/task/38318/root (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38318 bstore_ai ceph txt unknown /proc/37067/task/38318/exe (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38318 bstore_ai ceph NOFD /proc/37067/task/38318/fd (opendir: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38501 ceph-osd ceph cwd unknown /proc/37067/task/38501/cwd (readlink: Permission denied) 2024-08-31T06:49:26.096 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38501 ceph-osd ceph rtd unknown /proc/37067/task/38501/root (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38501 ceph-osd ceph txt unknown /proc/37067/task/38501/exe (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38501 ceph-osd ceph NOFD /proc/37067/task/38501/fd (opendir: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38502 cfin ceph cwd unknown /proc/37067/task/38502/cwd (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38502 cfin ceph rtd unknown /proc/37067/task/38502/root (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38502 cfin ceph txt unknown /proc/37067/task/38502/exe (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38502 cfin ceph NOFD /proc/37067/task/38502/fd (opendir: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38503 bstore_kv ceph cwd unknown /proc/37067/task/38503/cwd (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38503 bstore_kv ceph rtd unknown /proc/37067/task/38503/root (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38503 bstore_kv ceph txt unknown /proc/37067/task/38503/exe (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38503 bstore_kv ceph NOFD /proc/37067/task/38503/fd (opendir: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38504 bstore_kv ceph cwd unknown /proc/37067/task/38504/cwd (readlink: Permission denied) 2024-08-31T06:49:26.097 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38504 bstore_kv ceph rtd unknown /proc/37067/task/38504/root (readlink: Permission denied) 2024-08-31T06:49:26.098 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38504 bstore_kv ceph txt unknown /proc/37067/task/38504/exe (readlink: Permission denied) 2024-08-31T06:49:26.098 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38504 bstore_kv ceph NOFD /proc/37067/task/38504/fd (opendir: Permission denied) 2024-08-31T06:49:26.098 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38505 bstore_me ceph cwd unknown /proc/37067/task/38505/cwd (readlink: Permission denied) 2024-08-31T06:49:26.098 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38505 bstore_me ceph rtd unknown /proc/37067/task/38505/root (readlink: Permission denied) 2024-08-31T06:49:26.098 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38505 bstore_me ceph txt unknown /proc/37067/task/38505/exe (readlink: Permission denied) 2024-08-31T06:49:26.098 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38505 bstore_me ceph NOFD /proc/37067/task/38505/fd (opendir: Permission denied) 2024-08-31T06:49:26.098 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38506 ms_dispat ceph cwd unknown /proc/37067/task/38506/cwd (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38506 ms_dispat ceph rtd unknown /proc/37067/task/38506/root (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38506 ms_dispat ceph txt unknown /proc/37067/task/38506/exe (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38506 ms_dispat ceph NOFD /proc/37067/task/38506/fd (opendir: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38507 ms_local ceph cwd unknown /proc/37067/task/38507/cwd (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38507 ms_local ceph rtd unknown /proc/37067/task/38507/root (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38507 ms_local ceph txt unknown /proc/37067/task/38507/exe (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38507 ms_local ceph NOFD /proc/37067/task/38507/fd (opendir: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38508 safe_time ceph cwd unknown /proc/37067/task/38508/cwd (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38508 safe_time ceph rtd unknown /proc/37067/task/38508/root (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38508 safe_time ceph txt unknown /proc/37067/task/38508/exe (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38508 safe_time ceph NOFD /proc/37067/task/38508/fd (opendir: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38509 safe_time ceph cwd unknown /proc/37067/task/38509/cwd (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38509 safe_time ceph rtd unknown /proc/37067/task/38509/root (readlink: Permission denied) 2024-08-31T06:49:26.099 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38509 safe_time ceph txt unknown /proc/37067/task/38509/exe (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38509 safe_time ceph NOFD /proc/37067/task/38509/fd (opendir: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38510 ms_dispat ceph cwd unknown /proc/37067/task/38510/cwd (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38510 ms_dispat ceph rtd unknown /proc/37067/task/38510/root (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38510 ms_dispat ceph txt unknown /proc/37067/task/38510/exe (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38510 ms_dispat ceph NOFD /proc/37067/task/38510/fd (opendir: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38511 ms_local ceph cwd unknown /proc/37067/task/38511/cwd (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38511 ms_local ceph rtd unknown /proc/37067/task/38511/root (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38511 ms_local ceph txt unknown /proc/37067/task/38511/exe (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38511 ms_local ceph NOFD /proc/37067/task/38511/fd (opendir: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38512 ms_dispat ceph cwd unknown /proc/37067/task/38512/cwd (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38512 ms_dispat ceph rtd unknown /proc/37067/task/38512/root (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38512 ms_dispat ceph txt unknown /proc/37067/task/38512/exe (readlink: Permission denied) 2024-08-31T06:49:26.100 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38512 ms_dispat ceph NOFD /proc/37067/task/38512/fd (opendir: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38513 ms_local ceph cwd unknown /proc/37067/task/38513/cwd (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38513 ms_local ceph rtd unknown /proc/37067/task/38513/root (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38513 ms_local ceph txt unknown /proc/37067/task/38513/exe (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38513 ms_local ceph NOFD /proc/37067/task/38513/fd (opendir: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38514 ms_dispat ceph cwd unknown /proc/37067/task/38514/cwd (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38514 ms_dispat ceph rtd unknown /proc/37067/task/38514/root (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38514 ms_dispat ceph txt unknown /proc/37067/task/38514/exe (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38514 ms_dispat ceph NOFD /proc/37067/task/38514/fd (opendir: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38515 ms_local ceph cwd unknown /proc/37067/task/38515/cwd (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38515 ms_local ceph rtd unknown /proc/37067/task/38515/root (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38515 ms_local ceph txt unknown /proc/37067/task/38515/exe (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38515 ms_local ceph NOFD /proc/37067/task/38515/fd (opendir: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38516 ms_dispat ceph cwd unknown /proc/37067/task/38516/cwd (readlink: Permission denied) 2024-08-31T06:49:26.101 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38516 ms_dispat ceph rtd unknown /proc/37067/task/38516/root (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38516 ms_dispat ceph txt unknown /proc/37067/task/38516/exe (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38516 ms_dispat ceph NOFD /proc/37067/task/38516/fd (opendir: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38517 ms_local ceph cwd unknown /proc/37067/task/38517/cwd (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38517 ms_local ceph rtd unknown /proc/37067/task/38517/root (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38517 ms_local ceph txt unknown /proc/37067/task/38517/exe (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38517 ms_local ceph NOFD /proc/37067/task/38517/fd (opendir: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38518 ms_dispat ceph cwd unknown /proc/37067/task/38518/cwd (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38518 ms_dispat ceph rtd unknown /proc/37067/task/38518/root (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38518 ms_dispat ceph txt unknown /proc/37067/task/38518/exe (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38518 ms_dispat ceph NOFD /proc/37067/task/38518/fd (opendir: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38519 ms_local ceph cwd unknown /proc/37067/task/38519/cwd (readlink: Permission denied) 2024-08-31T06:49:26.102 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38519 ms_local ceph rtd unknown /proc/37067/task/38519/root (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38519 ms_local ceph txt unknown /proc/37067/task/38519/exe (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38519 ms_local ceph NOFD /proc/37067/task/38519/fd (opendir: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38520 ms_dispat ceph cwd unknown /proc/37067/task/38520/cwd (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38520 ms_dispat ceph rtd unknown /proc/37067/task/38520/root (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38520 ms_dispat ceph txt unknown /proc/37067/task/38520/exe (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38520 ms_dispat ceph NOFD /proc/37067/task/38520/fd (opendir: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38521 ms_local ceph cwd unknown /proc/37067/task/38521/cwd (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38521 ms_local ceph rtd unknown /proc/37067/task/38521/root (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38521 ms_local ceph txt unknown /proc/37067/task/38521/exe (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38521 ms_local ceph NOFD /proc/37067/task/38521/fd (opendir: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38522 fn_anonym ceph cwd unknown /proc/37067/task/38522/cwd (readlink: Permission denied) 2024-08-31T06:49:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38522 fn_anonym ceph rtd unknown /proc/37067/task/38522/root (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38522 fn_anonym ceph txt unknown /proc/37067/task/38522/exe (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38522 fn_anonym ceph NOFD /proc/37067/task/38522/fd (opendir: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38523 finisher ceph cwd unknown /proc/37067/task/38523/cwd (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38523 finisher ceph rtd unknown /proc/37067/task/38523/root (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38523 finisher ceph txt unknown /proc/37067/task/38523/exe (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38523 finisher ceph NOFD /proc/37067/task/38523/fd (opendir: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38524 safe_time ceph cwd unknown /proc/37067/task/38524/cwd (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38524 safe_time ceph rtd unknown /proc/37067/task/38524/root (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38524 safe_time ceph txt unknown /proc/37067/task/38524/exe (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38524 safe_time ceph NOFD /proc/37067/task/38524/fd (opendir: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38525 safe_time ceph cwd unknown /proc/37067/task/38525/cwd (readlink: Permission denied) 2024-08-31T06:49:26.104 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38525 safe_time ceph rtd unknown /proc/37067/task/38525/root (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38525 safe_time ceph txt unknown /proc/37067/task/38525/exe (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38525 safe_time ceph NOFD /proc/37067/task/38525/fd (opendir: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38526 ceph-osd ceph cwd unknown /proc/37067/task/38526/cwd (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38526 ceph-osd ceph rtd unknown /proc/37067/task/38526/root (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38526 ceph-osd ceph txt unknown /proc/37067/task/38526/exe (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38526 ceph-osd ceph NOFD /proc/37067/task/38526/fd (opendir: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38527 osd_srv_a ceph cwd unknown /proc/37067/task/38527/cwd (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38527 osd_srv_a ceph rtd unknown /proc/37067/task/38527/root (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38527 osd_srv_a ceph txt unknown /proc/37067/task/38527/exe (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38527 osd_srv_a ceph NOFD /proc/37067/task/38527/fd (opendir: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38528 tp_osd_tp ceph cwd unknown /proc/37067/task/38528/cwd (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38528 tp_osd_tp ceph rtd unknown /proc/37067/task/38528/root (readlink: Permission denied) 2024-08-31T06:49:26.105 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38528 tp_osd_tp ceph txt unknown /proc/37067/task/38528/exe (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38528 tp_osd_tp ceph NOFD /proc/37067/task/38528/fd (opendir: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38529 tp_osd_tp ceph cwd unknown /proc/37067/task/38529/cwd (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38529 tp_osd_tp ceph rtd unknown /proc/37067/task/38529/root (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38529 tp_osd_tp ceph txt unknown /proc/37067/task/38529/exe (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38529 tp_osd_tp ceph NOFD /proc/37067/task/38529/fd (opendir: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38530 tp_osd_tp ceph cwd unknown /proc/37067/task/38530/cwd (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38530 tp_osd_tp ceph rtd unknown /proc/37067/task/38530/root (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38530 tp_osd_tp ceph txt unknown /proc/37067/task/38530/exe (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38530 tp_osd_tp ceph NOFD /proc/37067/task/38530/fd (opendir: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38531 tp_osd_tp ceph cwd unknown /proc/37067/task/38531/cwd (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38531 tp_osd_tp ceph rtd unknown /proc/37067/task/38531/root (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38531 tp_osd_tp ceph txt unknown /proc/37067/task/38531/exe (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38531 tp_osd_tp ceph NOFD /proc/37067/task/38531/fd (opendir: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38532 tp_osd_tp ceph cwd unknown /proc/37067/task/38532/cwd (readlink: Permission denied) 2024-08-31T06:49:26.106 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38532 tp_osd_tp ceph rtd unknown /proc/37067/task/38532/root (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38532 tp_osd_tp ceph txt unknown /proc/37067/task/38532/exe (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38532 tp_osd_tp ceph NOFD /proc/37067/task/38532/fd (opendir: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38533 tp_osd_tp ceph cwd unknown /proc/37067/task/38533/cwd (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38533 tp_osd_tp ceph rtd unknown /proc/37067/task/38533/root (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38533 tp_osd_tp ceph txt unknown /proc/37067/task/38533/exe (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38533 tp_osd_tp ceph NOFD /proc/37067/task/38533/fd (opendir: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38534 tp_osd_tp ceph cwd unknown /proc/37067/task/38534/cwd (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38534 tp_osd_tp ceph rtd unknown /proc/37067/task/38534/root (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38534 tp_osd_tp ceph txt unknown /proc/37067/task/38534/exe (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38534 tp_osd_tp ceph NOFD /proc/37067/task/38534/fd (opendir: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38535 tp_osd_tp ceph cwd unknown /proc/37067/task/38535/cwd (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38535 tp_osd_tp ceph rtd unknown /proc/37067/task/38535/root (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38535 tp_osd_tp ceph txt unknown /proc/37067/task/38535/exe (readlink: Permission denied) 2024-08-31T06:49:26.107 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38535 tp_osd_tp ceph NOFD /proc/37067/task/38535/fd (opendir: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38536 tp_osd_tp ceph cwd unknown /proc/37067/task/38536/cwd (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38536 tp_osd_tp ceph rtd unknown /proc/37067/task/38536/root (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38536 tp_osd_tp ceph txt unknown /proc/37067/task/38536/exe (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38536 tp_osd_tp ceph NOFD /proc/37067/task/38536/fd (opendir: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38537 tp_osd_tp ceph cwd unknown /proc/37067/task/38537/cwd (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38537 tp_osd_tp ceph rtd unknown /proc/37067/task/38537/root (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38537 tp_osd_tp ceph txt unknown /proc/37067/task/38537/exe (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38537 tp_osd_tp ceph NOFD /proc/37067/task/38537/fd (opendir: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38538 tp_osd_tp ceph cwd unknown /proc/37067/task/38538/cwd (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38538 tp_osd_tp ceph rtd unknown /proc/37067/task/38538/root (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38538 tp_osd_tp ceph txt unknown /proc/37067/task/38538/exe (readlink: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38538 tp_osd_tp ceph NOFD /proc/37067/task/38538/fd (opendir: Permission denied) 2024-08-31T06:49:26.108 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38539 tp_osd_tp ceph cwd unknown /proc/37067/task/38539/cwd (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38539 tp_osd_tp ceph rtd unknown /proc/37067/task/38539/root (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38539 tp_osd_tp ceph txt unknown /proc/37067/task/38539/exe (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38539 tp_osd_tp ceph NOFD /proc/37067/task/38539/fd (opendir: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38540 tp_osd_tp ceph cwd unknown /proc/37067/task/38540/cwd (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38540 tp_osd_tp ceph rtd unknown /proc/37067/task/38540/root (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38540 tp_osd_tp ceph txt unknown /proc/37067/task/38540/exe (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38540 tp_osd_tp ceph NOFD /proc/37067/task/38540/fd (opendir: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38541 tp_osd_tp ceph cwd unknown /proc/37067/task/38541/cwd (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38541 tp_osd_tp ceph rtd unknown /proc/37067/task/38541/root (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38541 tp_osd_tp ceph txt unknown /proc/37067/task/38541/exe (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38541 tp_osd_tp ceph NOFD /proc/37067/task/38541/fd (opendir: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38542 tp_osd_tp ceph cwd unknown /proc/37067/task/38542/cwd (readlink: Permission denied) 2024-08-31T06:49:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38542 tp_osd_tp ceph rtd unknown /proc/37067/task/38542/root (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38542 tp_osd_tp ceph txt unknown /proc/37067/task/38542/exe (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38542 tp_osd_tp ceph NOFD /proc/37067/task/38542/fd (opendir: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38543 tp_osd_tp ceph cwd unknown /proc/37067/task/38543/cwd (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38543 tp_osd_tp ceph rtd unknown /proc/37067/task/38543/root (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38543 tp_osd_tp ceph txt unknown /proc/37067/task/38543/exe (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38543 tp_osd_tp ceph NOFD /proc/37067/task/38543/fd (opendir: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38544 osd_srv_h ceph cwd unknown /proc/37067/task/38544/cwd (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38544 osd_srv_h ceph rtd unknown /proc/37067/task/38544/root (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38544 osd_srv_h ceph txt unknown /proc/37067/task/38544/exe (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 37067 38544 osd_srv_h ceph NOFD /proc/37067/task/38544/fd (opendir: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 38080 root cwd unknown /proc/38080/cwd (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 38080 root rtd unknown /proc/38080/root (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 38080 root txt unknown /proc/38080/exe (readlink: Permission denied) 2024-08-31T06:49:26.110 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 38080 root NOFD /proc/38080/fd (opendir: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 38105 root cwd unknown /proc/38105/cwd (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 38105 root rtd unknown /proc/38105/root (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 38105 root txt unknown /proc/38105/exe (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 38105 root NOFD /proc/38105/fd (opendir: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 40994 root cwd unknown /proc/40994/cwd (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 40994 root rtd unknown /proc/40994/root (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 40994 root txt unknown /proc/40994/exe (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 40994 root NOFD /proc/40994/fd (opendir: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 43633 root cwd unknown /proc/43633/cwd (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 43633 root rtd unknown /proc/43633/root (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 43633 root txt unknown /proc/43633/exe (readlink: Permission denied) 2024-08-31T06:49:26.111 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 43633 root NOFD /proc/43633/fd (opendir: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 43635 root cwd unknown /proc/43635/cwd (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 43635 root rtd unknown /proc/43635/root (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 43635 root txt unknown /proc/43635/exe (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 43635 root NOFD /proc/43635/fd (opendir: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 ceph cwd unknown /proc/43637/cwd (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 ceph rtd unknown /proc/43637/root (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 ceph txt unknown /proc/43637/exe (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 ceph NOFD /proc/43637/fd (opendir: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43638 log ceph cwd unknown /proc/43637/task/43638/cwd (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43638 log ceph rtd unknown /proc/43637/task/43638/root (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43638 log ceph txt unknown /proc/43637/task/43638/exe (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43638 log ceph NOFD /proc/43637/task/43638/fd (opendir: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43640 msgr-work ceph cwd unknown /proc/43637/task/43640/cwd (readlink: Permission denied) 2024-08-31T06:49:26.112 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43640 msgr-work ceph rtd unknown /proc/43637/task/43640/root (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43640 msgr-work ceph txt unknown /proc/43637/task/43640/exe (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43640 msgr-work ceph NOFD /proc/43637/task/43640/fd (opendir: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43641 msgr-work ceph cwd unknown /proc/43637/task/43641/cwd (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43641 msgr-work ceph rtd unknown /proc/43637/task/43641/root (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43641 msgr-work ceph txt unknown /proc/43637/task/43641/exe (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43641 msgr-work ceph NOFD /proc/43637/task/43641/fd (opendir: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43642 msgr-work ceph cwd unknown /proc/43637/task/43642/cwd (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43642 msgr-work ceph rtd unknown /proc/43637/task/43642/root (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43642 msgr-work ceph txt unknown /proc/43637/task/43642/exe (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43642 msgr-work ceph NOFD /proc/43637/task/43642/fd (opendir: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43646 service ceph cwd unknown /proc/43637/task/43646/cwd (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43646 service ceph rtd unknown /proc/43637/task/43646/root (readlink: Permission denied) 2024-08-31T06:49:26.113 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43646 service ceph txt unknown /proc/43637/task/43646/exe (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43646 service ceph NOFD /proc/43637/task/43646/fd (opendir: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43647 admin_soc ceph cwd unknown /proc/43637/task/43647/cwd (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43647 admin_soc ceph rtd unknown /proc/43637/task/43647/root (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43647 admin_soc ceph txt unknown /proc/43637/task/43647/exe (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43647 admin_soc ceph NOFD /proc/43637/task/43647/fd (opendir: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43978 signal_ha ceph cwd unknown /proc/43637/task/43978/cwd (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43978 signal_ha ceph rtd unknown /proc/43637/task/43978/root (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43978 signal_ha ceph txt unknown /proc/43637/task/43978/exe (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43978 signal_ha ceph NOFD /proc/43637/task/43978/fd (opendir: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43979 io_contex ceph cwd unknown /proc/43637/task/43979/cwd (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43979 io_contex ceph rtd unknown /proc/43637/task/43979/root (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43979 io_contex ceph txt unknown /proc/43637/task/43979/exe (readlink: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43979 io_contex ceph NOFD /proc/43637/task/43979/fd (opendir: Permission denied) 2024-08-31T06:49:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43980 io_contex ceph cwd unknown /proc/43637/task/43980/cwd (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43980 io_contex ceph rtd unknown /proc/43637/task/43980/root (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43980 io_contex ceph txt unknown /proc/43637/task/43980/exe (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 43980 io_contex ceph NOFD /proc/43637/task/43980/fd (opendir: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44000 OpHistory ceph cwd unknown /proc/43637/task/44000/cwd (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44000 OpHistory ceph rtd unknown /proc/43637/task/44000/root (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44000 OpHistory ceph txt unknown /proc/43637/task/44000/exe (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44000 OpHistory ceph NOFD /proc/43637/task/44000/fd (opendir: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44001 ceph_time ceph cwd unknown /proc/43637/task/44001/cwd (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44001 ceph_time ceph rtd unknown /proc/43637/task/44001/root (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44001 ceph_time ceph txt unknown /proc/43637/task/44001/exe (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44001 ceph_time ceph NOFD /proc/43637/task/44001/fd (opendir: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44231 ceph-osd ceph cwd unknown /proc/43637/task/44231/cwd (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44231 ceph-osd ceph rtd unknown /proc/43637/task/44231/root (readlink: Permission denied) 2024-08-31T06:49:26.115 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44231 ceph-osd ceph txt unknown /proc/43637/task/44231/exe (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44231 ceph-osd ceph NOFD /proc/43637/task/44231/fd (opendir: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44233 safe_time ceph cwd unknown /proc/43637/task/44233/cwd (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44233 safe_time ceph rtd unknown /proc/43637/task/44233/root (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44233 safe_time ceph txt unknown /proc/43637/task/44233/exe (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44233 safe_time ceph NOFD /proc/43637/task/44233/fd (opendir: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44234 safe_time ceph cwd unknown /proc/43637/task/44234/cwd (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44234 safe_time ceph rtd unknown /proc/43637/task/44234/root (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44234 safe_time ceph txt unknown /proc/43637/task/44234/exe (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44234 safe_time ceph NOFD /proc/43637/task/44234/fd (opendir: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44235 safe_time ceph cwd unknown /proc/43637/task/44235/cwd (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44235 safe_time ceph rtd unknown /proc/43637/task/44235/root (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44235 safe_time ceph txt unknown /proc/43637/task/44235/exe (readlink: Permission denied) 2024-08-31T06:49:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44235 safe_time ceph NOFD /proc/43637/task/44235/fd (opendir: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44236 safe_time ceph cwd unknown /proc/43637/task/44236/cwd (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44236 safe_time ceph rtd unknown /proc/43637/task/44236/root (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44236 safe_time ceph txt unknown /proc/43637/task/44236/exe (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44236 safe_time ceph NOFD /proc/43637/task/44236/fd (opendir: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44237 fn_anonym ceph cwd unknown /proc/43637/task/44237/cwd (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44237 fn_anonym ceph rtd unknown /proc/43637/task/44237/root (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44237 fn_anonym ceph txt unknown /proc/43637/task/44237/exe (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44237 fn_anonym ceph NOFD /proc/43637/task/44237/fd (opendir: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44320 rocksdb:l ceph cwd unknown /proc/43637/task/44320/cwd (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44320 rocksdb:l ceph rtd unknown /proc/43637/task/44320/root (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44320 rocksdb:l ceph txt unknown /proc/43637/task/44320/exe (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44320 rocksdb:l ceph NOFD /proc/43637/task/44320/fd (opendir: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44321 rocksdb:l ceph cwd unknown /proc/43637/task/44321/cwd (readlink: Permission denied) 2024-08-31T06:49:26.117 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44321 rocksdb:l ceph rtd unknown /proc/43637/task/44321/root (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44321 rocksdb:l ceph txt unknown /proc/43637/task/44321/exe (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44321 rocksdb:l ceph NOFD /proc/43637/task/44321/fd (opendir: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44322 rocksdb:l ceph cwd unknown /proc/43637/task/44322/cwd (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44322 rocksdb:l ceph rtd unknown /proc/43637/task/44322/root (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44322 rocksdb:l ceph txt unknown /proc/43637/task/44322/exe (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44322 rocksdb:l ceph NOFD /proc/43637/task/44322/fd (opendir: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44323 rocksdb:h ceph cwd unknown /proc/43637/task/44323/cwd (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44323 rocksdb:h ceph rtd unknown /proc/43637/task/44323/root (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44323 rocksdb:h ceph txt unknown /proc/43637/task/44323/exe (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44323 rocksdb:h ceph NOFD /proc/43637/task/44323/fd (opendir: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44714 bstore_ai ceph cwd unknown /proc/43637/task/44714/cwd (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44714 bstore_ai ceph rtd unknown /proc/43637/task/44714/root (readlink: Permission denied) 2024-08-31T06:49:26.118 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44714 bstore_ai ceph txt unknown /proc/43637/task/44714/exe (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44714 bstore_ai ceph NOFD /proc/43637/task/44714/fd (opendir: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44919 bstore_ai ceph cwd unknown /proc/43637/task/44919/cwd (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44919 bstore_ai ceph rtd unknown /proc/43637/task/44919/root (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44919 bstore_ai ceph txt unknown /proc/43637/task/44919/exe (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 44919 bstore_ai ceph NOFD /proc/43637/task/44919/fd (opendir: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45101 ceph-osd ceph cwd unknown /proc/43637/task/45101/cwd (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45101 ceph-osd ceph rtd unknown /proc/43637/task/45101/root (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45101 ceph-osd ceph txt unknown /proc/43637/task/45101/exe (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45101 ceph-osd ceph NOFD /proc/43637/task/45101/fd (opendir: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45102 cfin ceph cwd unknown /proc/43637/task/45102/cwd (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45102 cfin ceph rtd unknown /proc/43637/task/45102/root (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45102 cfin ceph txt unknown /proc/43637/task/45102/exe (readlink: Permission denied) 2024-08-31T06:49:26.119 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45102 cfin ceph NOFD /proc/43637/task/45102/fd (opendir: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45103 bstore_kv ceph cwd unknown /proc/43637/task/45103/cwd (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45103 bstore_kv ceph rtd unknown /proc/43637/task/45103/root (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45103 bstore_kv ceph txt unknown /proc/43637/task/45103/exe (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45103 bstore_kv ceph NOFD /proc/43637/task/45103/fd (opendir: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45104 bstore_kv ceph cwd unknown /proc/43637/task/45104/cwd (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45104 bstore_kv ceph rtd unknown /proc/43637/task/45104/root (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45104 bstore_kv ceph txt unknown /proc/43637/task/45104/exe (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45104 bstore_kv ceph NOFD /proc/43637/task/45104/fd (opendir: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45105 bstore_me ceph cwd unknown /proc/43637/task/45105/cwd (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45105 bstore_me ceph rtd unknown /proc/43637/task/45105/root (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45105 bstore_me ceph txt unknown /proc/43637/task/45105/exe (readlink: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45105 bstore_me ceph NOFD /proc/43637/task/45105/fd (opendir: Permission denied) 2024-08-31T06:49:26.120 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45106 ms_dispat ceph cwd unknown /proc/43637/task/45106/cwd (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45106 ms_dispat ceph rtd unknown /proc/43637/task/45106/root (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45106 ms_dispat ceph txt unknown /proc/43637/task/45106/exe (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45106 ms_dispat ceph NOFD /proc/43637/task/45106/fd (opendir: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45107 ms_local ceph cwd unknown /proc/43637/task/45107/cwd (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45107 ms_local ceph rtd unknown /proc/43637/task/45107/root (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45107 ms_local ceph txt unknown /proc/43637/task/45107/exe (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45107 ms_local ceph NOFD /proc/43637/task/45107/fd (opendir: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45108 safe_time ceph cwd unknown /proc/43637/task/45108/cwd (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45108 safe_time ceph rtd unknown /proc/43637/task/45108/root (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45108 safe_time ceph txt unknown /proc/43637/task/45108/exe (readlink: Permission denied) 2024-08-31T06:49:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45108 safe_time ceph NOFD /proc/43637/task/45108/fd (opendir: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45109 safe_time ceph cwd unknown /proc/43637/task/45109/cwd (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45109 safe_time ceph rtd unknown /proc/43637/task/45109/root (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45109 safe_time ceph txt unknown /proc/43637/task/45109/exe (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45109 safe_time ceph NOFD /proc/43637/task/45109/fd (opendir: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45110 ms_dispat ceph cwd unknown /proc/43637/task/45110/cwd (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45110 ms_dispat ceph rtd unknown /proc/43637/task/45110/root (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45110 ms_dispat ceph txt unknown /proc/43637/task/45110/exe (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45110 ms_dispat ceph NOFD /proc/43637/task/45110/fd (opendir: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45111 ms_local ceph cwd unknown /proc/43637/task/45111/cwd (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45111 ms_local ceph rtd unknown /proc/43637/task/45111/root (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45111 ms_local ceph txt unknown /proc/43637/task/45111/exe (readlink: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45111 ms_local ceph NOFD /proc/43637/task/45111/fd (opendir: Permission denied) 2024-08-31T06:49:26.122 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45112 ms_dispat ceph cwd unknown /proc/43637/task/45112/cwd (readlink: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45112 ms_dispat ceph rtd unknown /proc/43637/task/45112/root (readlink: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45112 ms_dispat ceph txt unknown /proc/43637/task/45112/exe (readlink: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45112 ms_dispat ceph NOFD /proc/43637/task/45112/fd (opendir: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45113 ms_local ceph cwd unknown /proc/43637/task/45113/cwd (readlink: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45113 ms_local ceph rtd unknown /proc/43637/task/45113/root (readlink: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45113 ms_local ceph txt unknown /proc/43637/task/45113/exe (readlink: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45113 ms_local ceph NOFD /proc/43637/task/45113/fd (opendir: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45114 ms_dispat ceph cwd unknown /proc/43637/task/45114/cwd (readlink: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45114 ms_dispat ceph rtd unknown /proc/43637/task/45114/root (readlink: Permission denied) 2024-08-31T06:49:26.123 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45114 ms_dispat ceph txt unknown /proc/43637/task/45114/exe (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45114 ms_dispat ceph NOFD /proc/43637/task/45114/fd (opendir: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45115 ms_local ceph cwd unknown /proc/43637/task/45115/cwd (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45115 ms_local ceph rtd unknown /proc/43637/task/45115/root (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45115 ms_local ceph txt unknown /proc/43637/task/45115/exe (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45115 ms_local ceph NOFD /proc/43637/task/45115/fd (opendir: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45116 ms_dispat ceph cwd unknown /proc/43637/task/45116/cwd (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45116 ms_dispat ceph rtd unknown /proc/43637/task/45116/root (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45116 ms_dispat ceph txt unknown /proc/43637/task/45116/exe (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45116 ms_dispat ceph NOFD /proc/43637/task/45116/fd (opendir: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45117 ms_local ceph cwd unknown /proc/43637/task/45117/cwd (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45117 ms_local ceph rtd unknown /proc/43637/task/45117/root (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45117 ms_local ceph txt unknown /proc/43637/task/45117/exe (readlink: Permission denied) 2024-08-31T06:49:26.124 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45117 ms_local ceph NOFD /proc/43637/task/45117/fd (opendir: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45118 ms_dispat ceph cwd unknown /proc/43637/task/45118/cwd (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45118 ms_dispat ceph rtd unknown /proc/43637/task/45118/root (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45118 ms_dispat ceph txt unknown /proc/43637/task/45118/exe (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45118 ms_dispat ceph NOFD /proc/43637/task/45118/fd (opendir: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45119 ms_local ceph cwd unknown /proc/43637/task/45119/cwd (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45119 ms_local ceph rtd unknown /proc/43637/task/45119/root (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45119 ms_local ceph txt unknown /proc/43637/task/45119/exe (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45119 ms_local ceph NOFD /proc/43637/task/45119/fd (opendir: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45120 ms_dispat ceph cwd unknown /proc/43637/task/45120/cwd (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45120 ms_dispat ceph rtd unknown /proc/43637/task/45120/root (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45120 ms_dispat ceph txt unknown /proc/43637/task/45120/exe (readlink: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45120 ms_dispat ceph NOFD /proc/43637/task/45120/fd (opendir: Permission denied) 2024-08-31T06:49:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45121 ms_local ceph cwd unknown /proc/43637/task/45121/cwd (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45121 ms_local ceph rtd unknown /proc/43637/task/45121/root (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45121 ms_local ceph txt unknown /proc/43637/task/45121/exe (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45121 ms_local ceph NOFD /proc/43637/task/45121/fd (opendir: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45122 fn_anonym ceph cwd unknown /proc/43637/task/45122/cwd (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45122 fn_anonym ceph rtd unknown /proc/43637/task/45122/root (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45122 fn_anonym ceph txt unknown /proc/43637/task/45122/exe (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45122 fn_anonym ceph NOFD /proc/43637/task/45122/fd (opendir: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45123 finisher ceph cwd unknown /proc/43637/task/45123/cwd (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45123 finisher ceph rtd unknown /proc/43637/task/45123/root (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45123 finisher ceph txt unknown /proc/43637/task/45123/exe (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45123 finisher ceph NOFD /proc/43637/task/45123/fd (opendir: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45124 safe_time ceph cwd unknown /proc/43637/task/45124/cwd (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45124 safe_time ceph rtd unknown /proc/43637/task/45124/root (readlink: Permission denied) 2024-08-31T06:49:26.126 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45124 safe_time ceph txt unknown /proc/43637/task/45124/exe (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45124 safe_time ceph NOFD /proc/43637/task/45124/fd (opendir: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45125 safe_time ceph cwd unknown /proc/43637/task/45125/cwd (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45125 safe_time ceph rtd unknown /proc/43637/task/45125/root (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45125 safe_time ceph txt unknown /proc/43637/task/45125/exe (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45125 safe_time ceph NOFD /proc/43637/task/45125/fd (opendir: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45126 ceph-osd ceph cwd unknown /proc/43637/task/45126/cwd (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45126 ceph-osd ceph rtd unknown /proc/43637/task/45126/root (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45126 ceph-osd ceph txt unknown /proc/43637/task/45126/exe (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45126 ceph-osd ceph NOFD /proc/43637/task/45126/fd (opendir: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45127 osd_srv_a ceph cwd unknown /proc/43637/task/45127/cwd (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45127 osd_srv_a ceph rtd unknown /proc/43637/task/45127/root (readlink: Permission denied) 2024-08-31T06:49:26.127 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45127 osd_srv_a ceph txt unknown /proc/43637/task/45127/exe (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45127 osd_srv_a ceph NOFD /proc/43637/task/45127/fd (opendir: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45128 tp_osd_tp ceph cwd unknown /proc/43637/task/45128/cwd (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45128 tp_osd_tp ceph rtd unknown /proc/43637/task/45128/root (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45128 tp_osd_tp ceph txt unknown /proc/43637/task/45128/exe (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45128 tp_osd_tp ceph NOFD /proc/43637/task/45128/fd (opendir: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45129 tp_osd_tp ceph cwd unknown /proc/43637/task/45129/cwd (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45129 tp_osd_tp ceph rtd unknown /proc/43637/task/45129/root (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45129 tp_osd_tp ceph txt unknown /proc/43637/task/45129/exe (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45129 tp_osd_tp ceph NOFD /proc/43637/task/45129/fd (opendir: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45130 tp_osd_tp ceph cwd unknown /proc/43637/task/45130/cwd (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45130 tp_osd_tp ceph rtd unknown /proc/43637/task/45130/root (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45130 tp_osd_tp ceph txt unknown /proc/43637/task/45130/exe (readlink: Permission denied) 2024-08-31T06:49:26.128 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45130 tp_osd_tp ceph NOFD /proc/43637/task/45130/fd (opendir: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45131 tp_osd_tp ceph cwd unknown /proc/43637/task/45131/cwd (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45131 tp_osd_tp ceph rtd unknown /proc/43637/task/45131/root (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45131 tp_osd_tp ceph txt unknown /proc/43637/task/45131/exe (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45131 tp_osd_tp ceph NOFD /proc/43637/task/45131/fd (opendir: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45132 tp_osd_tp ceph cwd unknown /proc/43637/task/45132/cwd (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45132 tp_osd_tp ceph rtd unknown /proc/43637/task/45132/root (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45132 tp_osd_tp ceph txt unknown /proc/43637/task/45132/exe (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45132 tp_osd_tp ceph NOFD /proc/43637/task/45132/fd (opendir: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45133 tp_osd_tp ceph cwd unknown /proc/43637/task/45133/cwd (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45133 tp_osd_tp ceph rtd unknown /proc/43637/task/45133/root (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45133 tp_osd_tp ceph txt unknown /proc/43637/task/45133/exe (readlink: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45133 tp_osd_tp ceph NOFD /proc/43637/task/45133/fd (opendir: Permission denied) 2024-08-31T06:49:26.129 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45134 tp_osd_tp ceph cwd unknown /proc/43637/task/45134/cwd (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45134 tp_osd_tp ceph rtd unknown /proc/43637/task/45134/root (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45134 tp_osd_tp ceph txt unknown /proc/43637/task/45134/exe (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45134 tp_osd_tp ceph NOFD /proc/43637/task/45134/fd (opendir: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45135 tp_osd_tp ceph cwd unknown /proc/43637/task/45135/cwd (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45135 tp_osd_tp ceph rtd unknown /proc/43637/task/45135/root (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45135 tp_osd_tp ceph txt unknown /proc/43637/task/45135/exe (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45135 tp_osd_tp ceph NOFD /proc/43637/task/45135/fd (opendir: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45136 tp_osd_tp ceph cwd unknown /proc/43637/task/45136/cwd (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45136 tp_osd_tp ceph rtd unknown /proc/43637/task/45136/root (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45136 tp_osd_tp ceph txt unknown /proc/43637/task/45136/exe (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45136 tp_osd_tp ceph NOFD /proc/43637/task/45136/fd (opendir: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45137 tp_osd_tp ceph cwd unknown /proc/43637/task/45137/cwd (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45137 tp_osd_tp ceph rtd unknown /proc/43637/task/45137/root (readlink: Permission denied) 2024-08-31T06:49:26.130 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45137 tp_osd_tp ceph txt unknown /proc/43637/task/45137/exe (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45137 tp_osd_tp ceph NOFD /proc/43637/task/45137/fd (opendir: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45138 tp_osd_tp ceph cwd unknown /proc/43637/task/45138/cwd (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45138 tp_osd_tp ceph rtd unknown /proc/43637/task/45138/root (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45138 tp_osd_tp ceph txt unknown /proc/43637/task/45138/exe (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45138 tp_osd_tp ceph NOFD /proc/43637/task/45138/fd (opendir: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45139 tp_osd_tp ceph cwd unknown /proc/43637/task/45139/cwd (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45139 tp_osd_tp ceph rtd unknown /proc/43637/task/45139/root (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45139 tp_osd_tp ceph txt unknown /proc/43637/task/45139/exe (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45139 tp_osd_tp ceph NOFD /proc/43637/task/45139/fd (opendir: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45140 tp_osd_tp ceph cwd unknown /proc/43637/task/45140/cwd (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45140 tp_osd_tp ceph rtd unknown /proc/43637/task/45140/root (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45140 tp_osd_tp ceph txt unknown /proc/43637/task/45140/exe (readlink: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45140 tp_osd_tp ceph NOFD /proc/43637/task/45140/fd (opendir: Permission denied) 2024-08-31T06:49:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45141 tp_osd_tp ceph cwd unknown /proc/43637/task/45141/cwd (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45141 tp_osd_tp ceph rtd unknown /proc/43637/task/45141/root (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45141 tp_osd_tp ceph txt unknown /proc/43637/task/45141/exe (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45141 tp_osd_tp ceph NOFD /proc/43637/task/45141/fd (opendir: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45142 tp_osd_tp ceph cwd unknown /proc/43637/task/45142/cwd (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45142 tp_osd_tp ceph rtd unknown /proc/43637/task/45142/root (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45142 tp_osd_tp ceph txt unknown /proc/43637/task/45142/exe (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45142 tp_osd_tp ceph NOFD /proc/43637/task/45142/fd (opendir: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45143 tp_osd_tp ceph cwd unknown /proc/43637/task/45143/cwd (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45143 tp_osd_tp ceph rtd unknown /proc/43637/task/45143/root (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45143 tp_osd_tp ceph txt unknown /proc/43637/task/45143/exe (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45143 tp_osd_tp ceph NOFD /proc/43637/task/45143/fd (opendir: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45144 osd_srv_h ceph cwd unknown /proc/43637/task/45144/cwd (readlink: Permission denied) 2024-08-31T06:49:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45144 osd_srv_h ceph rtd unknown /proc/43637/task/45144/root (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45144 osd_srv_h ceph txt unknown /proc/43637/task/45144/exe (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 43637 45144 osd_srv_h ceph NOFD /proc/43637/task/45144/fd (opendir: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 44257 root cwd unknown /proc/44257/cwd (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 44257 root rtd unknown /proc/44257/root (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 44257 root txt unknown /proc/44257/exe (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 44257 root NOFD /proc/44257/fd (opendir: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 44274 root cwd unknown /proc/44274/cwd (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 44274 root rtd unknown /proc/44274/root (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 44274 root txt unknown /proc/44274/exe (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 44274 root NOFD /proc/44274/fd (opendir: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 49702 root cwd unknown /proc/49702/cwd (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 49702 root rtd unknown /proc/49702/root (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 49702 root txt unknown /proc/49702/exe (readlink: Permission denied) 2024-08-31T06:49:26.133 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 49702 root NOFD /proc/49702/fd (opendir: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 50090 root cwd unknown /proc/50090/cwd (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 50090 root rtd unknown /proc/50090/root (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 50090 root txt unknown /proc/50090/exe (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 50090 root NOFD /proc/50090/fd (opendir: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 50092 root cwd unknown /proc/50092/cwd (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 50092 root rtd unknown /proc/50092/root (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 50092 root txt unknown /proc/50092/exe (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 50092 root NOFD /proc/50092/fd (opendir: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 ceph cwd unknown /proc/50094/cwd (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 ceph rtd unknown /proc/50094/root (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 ceph txt unknown /proc/50094/exe (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 ceph NOFD /proc/50094/fd (opendir: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50095 log ceph cwd unknown /proc/50094/task/50095/cwd (readlink: Permission denied) 2024-08-31T06:49:26.134 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50095 log ceph rtd unknown /proc/50094/task/50095/root (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50095 log ceph txt unknown /proc/50094/task/50095/exe (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50095 log ceph NOFD /proc/50094/task/50095/fd (opendir: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50097 msgr-work ceph cwd unknown /proc/50094/task/50097/cwd (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50097 msgr-work ceph rtd unknown /proc/50094/task/50097/root (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50097 msgr-work ceph txt unknown /proc/50094/task/50097/exe (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50097 msgr-work ceph NOFD /proc/50094/task/50097/fd (opendir: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50098 msgr-work ceph cwd unknown /proc/50094/task/50098/cwd (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50098 msgr-work ceph rtd unknown /proc/50094/task/50098/root (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50098 msgr-work ceph txt unknown /proc/50094/task/50098/exe (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50098 msgr-work ceph NOFD /proc/50094/task/50098/fd (opendir: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50099 msgr-work ceph cwd unknown /proc/50094/task/50099/cwd (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50099 msgr-work ceph rtd unknown /proc/50094/task/50099/root (readlink: Permission denied) 2024-08-31T06:49:26.135 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50099 msgr-work ceph txt unknown /proc/50094/task/50099/exe (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50099 msgr-work ceph NOFD /proc/50094/task/50099/fd (opendir: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50103 service ceph cwd unknown /proc/50094/task/50103/cwd (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50103 service ceph rtd unknown /proc/50094/task/50103/root (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50103 service ceph txt unknown /proc/50094/task/50103/exe (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50103 service ceph NOFD /proc/50094/task/50103/fd (opendir: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50104 admin_soc ceph cwd unknown /proc/50094/task/50104/cwd (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50104 admin_soc ceph rtd unknown /proc/50094/task/50104/root (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50104 admin_soc ceph txt unknown /proc/50094/task/50104/exe (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50104 admin_soc ceph NOFD /proc/50094/task/50104/fd (opendir: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50402 signal_ha ceph cwd unknown /proc/50094/task/50402/cwd (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50402 signal_ha ceph rtd unknown /proc/50094/task/50402/root (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50402 signal_ha ceph txt unknown /proc/50094/task/50402/exe (readlink: Permission denied) 2024-08-31T06:49:26.136 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50402 signal_ha ceph NOFD /proc/50094/task/50402/fd (opendir: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50403 io_contex ceph cwd unknown /proc/50094/task/50403/cwd (readlink: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50403 io_contex ceph rtd unknown /proc/50094/task/50403/root (readlink: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50403 io_contex ceph txt unknown /proc/50094/task/50403/exe (readlink: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50403 io_contex ceph NOFD /proc/50094/task/50403/fd (opendir: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50404 io_contex ceph cwd unknown /proc/50094/task/50404/cwd (readlink: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50404 io_contex ceph rtd unknown /proc/50094/task/50404/root (readlink: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50404 io_contex ceph txt unknown /proc/50094/task/50404/exe (readlink: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50404 io_contex ceph NOFD /proc/50094/task/50404/fd (opendir: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50445 OpHistory ceph cwd unknown /proc/50094/task/50445/cwd (readlink: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50445 OpHistory ceph rtd unknown /proc/50094/task/50445/root (readlink: Permission denied) 2024-08-31T06:49:26.137 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50445 OpHistory ceph txt unknown /proc/50094/task/50445/exe (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50445 OpHistory ceph NOFD /proc/50094/task/50445/fd (opendir: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50446 ceph_time ceph cwd unknown /proc/50094/task/50446/cwd (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50446 ceph_time ceph rtd unknown /proc/50094/task/50446/root (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50446 ceph_time ceph txt unknown /proc/50094/task/50446/exe (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50446 ceph_time ceph NOFD /proc/50094/task/50446/fd (opendir: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50734 ceph-osd ceph cwd unknown /proc/50094/task/50734/cwd (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50734 ceph-osd ceph rtd unknown /proc/50094/task/50734/root (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50734 ceph-osd ceph txt unknown /proc/50094/task/50734/exe (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50734 ceph-osd ceph NOFD /proc/50094/task/50734/fd (opendir: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50735 safe_time ceph cwd unknown /proc/50094/task/50735/cwd (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50735 safe_time ceph rtd unknown /proc/50094/task/50735/root (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50735 safe_time ceph txt unknown /proc/50094/task/50735/exe (readlink: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50735 safe_time ceph NOFD /proc/50094/task/50735/fd (opendir: Permission denied) 2024-08-31T06:49:26.138 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50736 safe_time ceph cwd unknown /proc/50094/task/50736/cwd (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50736 safe_time ceph rtd unknown /proc/50094/task/50736/root (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50736 safe_time ceph txt unknown /proc/50094/task/50736/exe (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50736 safe_time ceph NOFD /proc/50094/task/50736/fd (opendir: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50737 safe_time ceph cwd unknown /proc/50094/task/50737/cwd (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50737 safe_time ceph rtd unknown /proc/50094/task/50737/root (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50737 safe_time ceph txt unknown /proc/50094/task/50737/exe (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50737 safe_time ceph NOFD /proc/50094/task/50737/fd (opendir: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50738 safe_time ceph cwd unknown /proc/50094/task/50738/cwd (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50738 safe_time ceph rtd unknown /proc/50094/task/50738/root (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50738 safe_time ceph txt unknown /proc/50094/task/50738/exe (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50738 safe_time ceph NOFD /proc/50094/task/50738/fd (opendir: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50740 fn_anonym ceph cwd unknown /proc/50094/task/50740/cwd (readlink: Permission denied) 2024-08-31T06:49:26.139 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50740 fn_anonym ceph rtd unknown /proc/50094/task/50740/root (readlink: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50740 fn_anonym ceph txt unknown /proc/50094/task/50740/exe (readlink: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50740 fn_anonym ceph NOFD /proc/50094/task/50740/fd (opendir: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50750 rocksdb:l ceph cwd unknown /proc/50094/task/50750/cwd (readlink: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50750 rocksdb:l ceph rtd unknown /proc/50094/task/50750/root (readlink: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50750 rocksdb:l ceph txt unknown /proc/50094/task/50750/exe (readlink: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50750 rocksdb:l ceph NOFD /proc/50094/task/50750/fd (opendir: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50751 rocksdb:l ceph cwd unknown /proc/50094/task/50751/cwd (readlink: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50751 rocksdb:l ceph rtd unknown /proc/50094/task/50751/root (readlink: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50751 rocksdb:l ceph txt unknown /proc/50094/task/50751/exe (readlink: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50751 rocksdb:l ceph NOFD /proc/50094/task/50751/fd (opendir: Permission denied) 2024-08-31T06:49:26.140 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50752 rocksdb:l ceph cwd unknown /proc/50094/task/50752/cwd (readlink: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50752 rocksdb:l ceph rtd unknown /proc/50094/task/50752/root (readlink: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50752 rocksdb:l ceph txt unknown /proc/50094/task/50752/exe (readlink: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50752 rocksdb:l ceph NOFD /proc/50094/task/50752/fd (opendir: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50753 rocksdb:h ceph cwd unknown /proc/50094/task/50753/cwd (readlink: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50753 rocksdb:h ceph rtd unknown /proc/50094/task/50753/root (readlink: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50753 rocksdb:h ceph txt unknown /proc/50094/task/50753/exe (readlink: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 50753 rocksdb:h ceph NOFD /proc/50094/task/50753/fd (opendir: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51189 bstore_ai ceph cwd unknown /proc/50094/task/51189/cwd (readlink: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51189 bstore_ai ceph rtd unknown /proc/50094/task/51189/root (readlink: Permission denied) 2024-08-31T06:49:26.141 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51189 bstore_ai ceph txt unknown /proc/50094/task/51189/exe (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51189 bstore_ai ceph NOFD /proc/50094/task/51189/fd (opendir: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51373 bstore_ai ceph cwd unknown /proc/50094/task/51373/cwd (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51373 bstore_ai ceph rtd unknown /proc/50094/task/51373/root (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51373 bstore_ai ceph txt unknown /proc/50094/task/51373/exe (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51373 bstore_ai ceph NOFD /proc/50094/task/51373/fd (opendir: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51555 ceph-osd ceph cwd unknown /proc/50094/task/51555/cwd (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51555 ceph-osd ceph rtd unknown /proc/50094/task/51555/root (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51555 ceph-osd ceph txt unknown /proc/50094/task/51555/exe (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51555 ceph-osd ceph NOFD /proc/50094/task/51555/fd (opendir: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51556 cfin ceph cwd unknown /proc/50094/task/51556/cwd (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51556 cfin ceph rtd unknown /proc/50094/task/51556/root (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51556 cfin ceph txt unknown /proc/50094/task/51556/exe (readlink: Permission denied) 2024-08-31T06:49:26.142 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51556 cfin ceph NOFD /proc/50094/task/51556/fd (opendir: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51557 bstore_kv ceph cwd unknown /proc/50094/task/51557/cwd (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51557 bstore_kv ceph rtd unknown /proc/50094/task/51557/root (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51557 bstore_kv ceph txt unknown /proc/50094/task/51557/exe (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51557 bstore_kv ceph NOFD /proc/50094/task/51557/fd (opendir: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51558 bstore_kv ceph cwd unknown /proc/50094/task/51558/cwd (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51558 bstore_kv ceph rtd unknown /proc/50094/task/51558/root (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51558 bstore_kv ceph txt unknown /proc/50094/task/51558/exe (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51558 bstore_kv ceph NOFD /proc/50094/task/51558/fd (opendir: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51559 bstore_me ceph cwd unknown /proc/50094/task/51559/cwd (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51559 bstore_me ceph rtd unknown /proc/50094/task/51559/root (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51559 bstore_me ceph txt unknown /proc/50094/task/51559/exe (readlink: Permission denied) 2024-08-31T06:49:26.143 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51559 bstore_me ceph NOFD /proc/50094/task/51559/fd (opendir: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51560 ms_dispat ceph cwd unknown /proc/50094/task/51560/cwd (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51560 ms_dispat ceph rtd unknown /proc/50094/task/51560/root (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51560 ms_dispat ceph txt unknown /proc/50094/task/51560/exe (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51560 ms_dispat ceph NOFD /proc/50094/task/51560/fd (opendir: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51561 ms_local ceph cwd unknown /proc/50094/task/51561/cwd (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51561 ms_local ceph rtd unknown /proc/50094/task/51561/root (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51561 ms_local ceph txt unknown /proc/50094/task/51561/exe (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51561 ms_local ceph NOFD /proc/50094/task/51561/fd (opendir: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51562 safe_time ceph cwd unknown /proc/50094/task/51562/cwd (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51562 safe_time ceph rtd unknown /proc/50094/task/51562/root (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51562 safe_time ceph txt unknown /proc/50094/task/51562/exe (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51562 safe_time ceph NOFD /proc/50094/task/51562/fd (opendir: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51563 safe_time ceph cwd unknown /proc/50094/task/51563/cwd (readlink: Permission denied) 2024-08-31T06:49:26.144 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51563 safe_time ceph rtd unknown /proc/50094/task/51563/root (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51563 safe_time ceph txt unknown /proc/50094/task/51563/exe (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51563 safe_time ceph NOFD /proc/50094/task/51563/fd (opendir: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51564 ms_dispat ceph cwd unknown /proc/50094/task/51564/cwd (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51564 ms_dispat ceph rtd unknown /proc/50094/task/51564/root (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51564 ms_dispat ceph txt unknown /proc/50094/task/51564/exe (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51564 ms_dispat ceph NOFD /proc/50094/task/51564/fd (opendir: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51565 ms_local ceph cwd unknown /proc/50094/task/51565/cwd (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51565 ms_local ceph rtd unknown /proc/50094/task/51565/root (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51565 ms_local ceph txt unknown /proc/50094/task/51565/exe (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51565 ms_local ceph NOFD /proc/50094/task/51565/fd (opendir: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51566 ms_dispat ceph cwd unknown /proc/50094/task/51566/cwd (readlink: Permission denied) 2024-08-31T06:49:26.145 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51566 ms_dispat ceph rtd unknown /proc/50094/task/51566/root (readlink: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51566 ms_dispat ceph txt unknown /proc/50094/task/51566/exe (readlink: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51566 ms_dispat ceph NOFD /proc/50094/task/51566/fd (opendir: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51567 ms_local ceph cwd unknown /proc/50094/task/51567/cwd (readlink: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51567 ms_local ceph rtd unknown /proc/50094/task/51567/root (readlink: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51567 ms_local ceph txt unknown /proc/50094/task/51567/exe (readlink: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51567 ms_local ceph NOFD /proc/50094/task/51567/fd (opendir: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51568 ms_dispat ceph cwd unknown /proc/50094/task/51568/cwd (readlink: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51568 ms_dispat ceph rtd unknown /proc/50094/task/51568/root (readlink: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51568 ms_dispat ceph txt unknown /proc/50094/task/51568/exe (readlink: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51568 ms_dispat ceph NOFD /proc/50094/task/51568/fd (opendir: Permission denied) 2024-08-31T06:49:26.146 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51569 ms_local ceph cwd unknown /proc/50094/task/51569/cwd (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51569 ms_local ceph rtd unknown /proc/50094/task/51569/root (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51569 ms_local ceph txt unknown /proc/50094/task/51569/exe (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51569 ms_local ceph NOFD /proc/50094/task/51569/fd (opendir: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51570 ms_dispat ceph cwd unknown /proc/50094/task/51570/cwd (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51570 ms_dispat ceph rtd unknown /proc/50094/task/51570/root (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51570 ms_dispat ceph txt unknown /proc/50094/task/51570/exe (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51570 ms_dispat ceph NOFD /proc/50094/task/51570/fd (opendir: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51571 ms_local ceph cwd unknown /proc/50094/task/51571/cwd (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51571 ms_local ceph rtd unknown /proc/50094/task/51571/root (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51571 ms_local ceph txt unknown /proc/50094/task/51571/exe (readlink: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51571 ms_local ceph NOFD /proc/50094/task/51571/fd (opendir: Permission denied) 2024-08-31T06:49:26.147 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51572 ms_dispat ceph cwd unknown /proc/50094/task/51572/cwd (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51572 ms_dispat ceph rtd unknown /proc/50094/task/51572/root (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51572 ms_dispat ceph txt unknown /proc/50094/task/51572/exe (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51572 ms_dispat ceph NOFD /proc/50094/task/51572/fd (opendir: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51573 ms_local ceph cwd unknown /proc/50094/task/51573/cwd (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51573 ms_local ceph rtd unknown /proc/50094/task/51573/root (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51573 ms_local ceph txt unknown /proc/50094/task/51573/exe (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51573 ms_local ceph NOFD /proc/50094/task/51573/fd (opendir: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51574 ms_dispat ceph cwd unknown /proc/50094/task/51574/cwd (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51574 ms_dispat ceph rtd unknown /proc/50094/task/51574/root (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51574 ms_dispat ceph txt unknown /proc/50094/task/51574/exe (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51574 ms_dispat ceph NOFD /proc/50094/task/51574/fd (opendir: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51575 ms_local ceph cwd unknown /proc/50094/task/51575/cwd (readlink: Permission denied) 2024-08-31T06:49:26.148 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51575 ms_local ceph rtd unknown /proc/50094/task/51575/root (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51575 ms_local ceph txt unknown /proc/50094/task/51575/exe (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51575 ms_local ceph NOFD /proc/50094/task/51575/fd (opendir: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51576 fn_anonym ceph cwd unknown /proc/50094/task/51576/cwd (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51576 fn_anonym ceph rtd unknown /proc/50094/task/51576/root (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51576 fn_anonym ceph txt unknown /proc/50094/task/51576/exe (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51576 fn_anonym ceph NOFD /proc/50094/task/51576/fd (opendir: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51577 finisher ceph cwd unknown /proc/50094/task/51577/cwd (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51577 finisher ceph rtd unknown /proc/50094/task/51577/root (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51577 finisher ceph txt unknown /proc/50094/task/51577/exe (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51577 finisher ceph NOFD /proc/50094/task/51577/fd (opendir: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51578 safe_time ceph cwd unknown /proc/50094/task/51578/cwd (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51578 safe_time ceph rtd unknown /proc/50094/task/51578/root (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51578 safe_time ceph txt unknown /proc/50094/task/51578/exe (readlink: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51578 safe_time ceph NOFD /proc/50094/task/51578/fd (opendir: Permission denied) 2024-08-31T06:49:26.149 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51579 safe_time ceph cwd unknown /proc/50094/task/51579/cwd (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51579 safe_time ceph rtd unknown /proc/50094/task/51579/root (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51579 safe_time ceph txt unknown /proc/50094/task/51579/exe (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51579 safe_time ceph NOFD /proc/50094/task/51579/fd (opendir: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51580 ceph-osd ceph cwd unknown /proc/50094/task/51580/cwd (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51580 ceph-osd ceph rtd unknown /proc/50094/task/51580/root (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51580 ceph-osd ceph txt unknown /proc/50094/task/51580/exe (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51580 ceph-osd ceph NOFD /proc/50094/task/51580/fd (opendir: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51581 osd_srv_a ceph cwd unknown /proc/50094/task/51581/cwd (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51581 osd_srv_a ceph rtd unknown /proc/50094/task/51581/root (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51581 osd_srv_a ceph txt unknown /proc/50094/task/51581/exe (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51581 osd_srv_a ceph NOFD /proc/50094/task/51581/fd (opendir: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51582 tp_osd_tp ceph cwd unknown /proc/50094/task/51582/cwd (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51582 tp_osd_tp ceph rtd unknown /proc/50094/task/51582/root (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51582 tp_osd_tp ceph txt unknown /proc/50094/task/51582/exe (readlink: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51582 tp_osd_tp ceph NOFD /proc/50094/task/51582/fd (opendir: Permission denied) 2024-08-31T06:49:26.150 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51583 tp_osd_tp ceph cwd unknown /proc/50094/task/51583/cwd (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51583 tp_osd_tp ceph rtd unknown /proc/50094/task/51583/root (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51583 tp_osd_tp ceph txt unknown /proc/50094/task/51583/exe (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51583 tp_osd_tp ceph NOFD /proc/50094/task/51583/fd (opendir: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51584 tp_osd_tp ceph cwd unknown /proc/50094/task/51584/cwd (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51584 tp_osd_tp ceph rtd unknown /proc/50094/task/51584/root (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51584 tp_osd_tp ceph txt unknown /proc/50094/task/51584/exe (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51584 tp_osd_tp ceph NOFD /proc/50094/task/51584/fd (opendir: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51585 tp_osd_tp ceph cwd unknown /proc/50094/task/51585/cwd (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51585 tp_osd_tp ceph rtd unknown /proc/50094/task/51585/root (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51585 tp_osd_tp ceph txt unknown /proc/50094/task/51585/exe (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51585 tp_osd_tp ceph NOFD /proc/50094/task/51585/fd (opendir: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51586 tp_osd_tp ceph cwd unknown /proc/50094/task/51586/cwd (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51586 tp_osd_tp ceph rtd unknown /proc/50094/task/51586/root (readlink: Permission denied) 2024-08-31T06:49:26.151 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51586 tp_osd_tp ceph txt unknown /proc/50094/task/51586/exe (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51586 tp_osd_tp ceph NOFD /proc/50094/task/51586/fd (opendir: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51587 tp_osd_tp ceph cwd unknown /proc/50094/task/51587/cwd (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51587 tp_osd_tp ceph rtd unknown /proc/50094/task/51587/root (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51587 tp_osd_tp ceph txt unknown /proc/50094/task/51587/exe (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51587 tp_osd_tp ceph NOFD /proc/50094/task/51587/fd (opendir: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51588 tp_osd_tp ceph cwd unknown /proc/50094/task/51588/cwd (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51588 tp_osd_tp ceph rtd unknown /proc/50094/task/51588/root (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51588 tp_osd_tp ceph txt unknown /proc/50094/task/51588/exe (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51588 tp_osd_tp ceph NOFD /proc/50094/task/51588/fd (opendir: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51589 tp_osd_tp ceph cwd unknown /proc/50094/task/51589/cwd (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51589 tp_osd_tp ceph rtd unknown /proc/50094/task/51589/root (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51589 tp_osd_tp ceph txt unknown /proc/50094/task/51589/exe (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51589 tp_osd_tp ceph NOFD /proc/50094/task/51589/fd (opendir: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51590 tp_osd_tp ceph cwd unknown /proc/50094/task/51590/cwd (readlink: Permission denied) 2024-08-31T06:49:26.152 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51590 tp_osd_tp ceph rtd unknown /proc/50094/task/51590/root (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51590 tp_osd_tp ceph txt unknown /proc/50094/task/51590/exe (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51590 tp_osd_tp ceph NOFD /proc/50094/task/51590/fd (opendir: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51591 tp_osd_tp ceph cwd unknown /proc/50094/task/51591/cwd (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51591 tp_osd_tp ceph rtd unknown /proc/50094/task/51591/root (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51591 tp_osd_tp ceph txt unknown /proc/50094/task/51591/exe (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51591 tp_osd_tp ceph NOFD /proc/50094/task/51591/fd (opendir: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51592 tp_osd_tp ceph cwd unknown /proc/50094/task/51592/cwd (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51592 tp_osd_tp ceph rtd unknown /proc/50094/task/51592/root (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51592 tp_osd_tp ceph txt unknown /proc/50094/task/51592/exe (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51592 tp_osd_tp ceph NOFD /proc/50094/task/51592/fd (opendir: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51593 tp_osd_tp ceph cwd unknown /proc/50094/task/51593/cwd (readlink: Permission denied) 2024-08-31T06:49:26.153 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51593 tp_osd_tp ceph rtd unknown /proc/50094/task/51593/root (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51593 tp_osd_tp ceph txt unknown /proc/50094/task/51593/exe (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51593 tp_osd_tp ceph NOFD /proc/50094/task/51593/fd (opendir: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51594 tp_osd_tp ceph cwd unknown /proc/50094/task/51594/cwd (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51594 tp_osd_tp ceph rtd unknown /proc/50094/task/51594/root (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51594 tp_osd_tp ceph txt unknown /proc/50094/task/51594/exe (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51594 tp_osd_tp ceph NOFD /proc/50094/task/51594/fd (opendir: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51595 tp_osd_tp ceph cwd unknown /proc/50094/task/51595/cwd (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51595 tp_osd_tp ceph rtd unknown /proc/50094/task/51595/root (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51595 tp_osd_tp ceph txt unknown /proc/50094/task/51595/exe (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51595 tp_osd_tp ceph NOFD /proc/50094/task/51595/fd (opendir: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51596 tp_osd_tp ceph cwd unknown /proc/50094/task/51596/cwd (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51596 tp_osd_tp ceph rtd unknown /proc/50094/task/51596/root (readlink: Permission denied) 2024-08-31T06:49:26.154 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51596 tp_osd_tp ceph txt unknown /proc/50094/task/51596/exe (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51596 tp_osd_tp ceph NOFD /proc/50094/task/51596/fd (opendir: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51597 tp_osd_tp ceph cwd unknown /proc/50094/task/51597/cwd (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51597 tp_osd_tp ceph rtd unknown /proc/50094/task/51597/root (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51597 tp_osd_tp ceph txt unknown /proc/50094/task/51597/exe (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51597 tp_osd_tp ceph NOFD /proc/50094/task/51597/fd (opendir: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51598 osd_srv_h ceph cwd unknown /proc/50094/task/51598/cwd (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51598 osd_srv_h ceph rtd unknown /proc/50094/task/51598/root (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51598 osd_srv_h ceph txt unknown /proc/50094/task/51598/exe (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 50094 51598 osd_srv_h ceph NOFD /proc/50094/task/51598/fd (opendir: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 50936 root cwd unknown /proc/50936/cwd (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 50936 root rtd unknown /proc/50936/root (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 50936 root txt unknown /proc/50936/exe (readlink: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 50936 root NOFD /proc/50936/fd (opendir: Permission denied) 2024-08-31T06:49:26.155 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 50953 root cwd unknown /proc/50953/cwd (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 50953 root rtd unknown /proc/50953/root (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 50953 root txt unknown /proc/50953/exe (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 50953 root NOFD /proc/50953/fd (opendir: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 53791 root cwd unknown /proc/53791/cwd (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 53791 root rtd unknown /proc/53791/root (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 53791 root txt unknown /proc/53791/exe (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 53791 root NOFD /proc/53791/fd (opendir: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 53967 root cwd unknown /proc/53967/cwd (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 53967 root rtd unknown /proc/53967/root (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 53967 root txt unknown /proc/53967/exe (readlink: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 53967 root NOFD /proc/53967/fd (opendir: Permission denied) 2024-08-31T06:49:26.156 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 54641 root cwd unknown /proc/54641/cwd (readlink: Permission denied) 2024-08-31T06:49:26.157 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 54641 root rtd unknown /proc/54641/root (readlink: Permission denied) 2024-08-31T06:49:26.157 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 54641 root txt unknown /proc/54641/exe (readlink: Permission denied) 2024-08-31T06:49:26.157 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 54641 root NOFD /proc/54641/fd (opendir: Permission denied) 2024-08-31T06:49:26.157 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 56607 root cwd unknown /proc/56607/cwd (readlink: Permission denied) 2024-08-31T06:49:26.157 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 56607 root rtd unknown /proc/56607/root (readlink: Permission denied) 2024-08-31T06:49:26.157 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 56607 root txt unknown /proc/56607/exe (readlink: Permission denied) 2024-08-31T06:49:26.157 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 56607 root NOFD /proc/56607/fd (opendir: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 56609 root cwd unknown /proc/56609/cwd (readlink: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 56609 root rtd unknown /proc/56609/root (readlink: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 56609 root txt unknown /proc/56609/exe (readlink: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 56609 root NOFD /proc/56609/fd (opendir: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 ceph cwd unknown /proc/56611/cwd (readlink: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 ceph rtd unknown /proc/56611/root (readlink: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 ceph txt unknown /proc/56611/exe (readlink: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 ceph NOFD /proc/56611/fd (opendir: Permission denied) 2024-08-31T06:49:26.158 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56612 log ceph cwd unknown /proc/56611/task/56612/cwd (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56612 log ceph rtd unknown /proc/56611/task/56612/root (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56612 log ceph txt unknown /proc/56611/task/56612/exe (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56612 log ceph NOFD /proc/56611/task/56612/fd (opendir: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56614 msgr-work ceph cwd unknown /proc/56611/task/56614/cwd (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56614 msgr-work ceph rtd unknown /proc/56611/task/56614/root (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56614 msgr-work ceph txt unknown /proc/56611/task/56614/exe (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56614 msgr-work ceph NOFD /proc/56611/task/56614/fd (opendir: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56615 msgr-work ceph cwd unknown /proc/56611/task/56615/cwd (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56615 msgr-work ceph rtd unknown /proc/56611/task/56615/root (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56615 msgr-work ceph txt unknown /proc/56611/task/56615/exe (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56615 msgr-work ceph NOFD /proc/56611/task/56615/fd (opendir: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56616 msgr-work ceph cwd unknown /proc/56611/task/56616/cwd (readlink: Permission denied) 2024-08-31T06:49:26.159 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56616 msgr-work ceph rtd unknown /proc/56611/task/56616/root (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56616 msgr-work ceph txt unknown /proc/56611/task/56616/exe (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56616 msgr-work ceph NOFD /proc/56611/task/56616/fd (opendir: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56620 service ceph cwd unknown /proc/56611/task/56620/cwd (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56620 service ceph rtd unknown /proc/56611/task/56620/root (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56620 service ceph txt unknown /proc/56611/task/56620/exe (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56620 service ceph NOFD /proc/56611/task/56620/fd (opendir: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56621 admin_soc ceph cwd unknown /proc/56611/task/56621/cwd (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56621 admin_soc ceph rtd unknown /proc/56611/task/56621/root (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56621 admin_soc ceph txt unknown /proc/56611/task/56621/exe (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56621 admin_soc ceph NOFD /proc/56611/task/56621/fd (opendir: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56947 signal_ha ceph cwd unknown /proc/56611/task/56947/cwd (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56947 signal_ha ceph rtd unknown /proc/56611/task/56947/root (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56947 signal_ha ceph txt unknown /proc/56611/task/56947/exe (readlink: Permission denied) 2024-08-31T06:49:26.160 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56947 signal_ha ceph NOFD /proc/56611/task/56947/fd (opendir: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56948 io_contex ceph cwd unknown /proc/56611/task/56948/cwd (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56948 io_contex ceph rtd unknown /proc/56611/task/56948/root (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56948 io_contex ceph txt unknown /proc/56611/task/56948/exe (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56948 io_contex ceph NOFD /proc/56611/task/56948/fd (opendir: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56949 io_contex ceph cwd unknown /proc/56611/task/56949/cwd (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56949 io_contex ceph rtd unknown /proc/56611/task/56949/root (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56949 io_contex ceph txt unknown /proc/56611/task/56949/exe (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56949 io_contex ceph NOFD /proc/56611/task/56949/fd (opendir: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56965 OpHistory ceph cwd unknown /proc/56611/task/56965/cwd (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56965 OpHistory ceph rtd unknown /proc/56611/task/56965/root (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56965 OpHistory ceph txt unknown /proc/56611/task/56965/exe (readlink: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56965 OpHistory ceph NOFD /proc/56611/task/56965/fd (opendir: Permission denied) 2024-08-31T06:49:26.161 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56966 ceph_time ceph cwd unknown /proc/56611/task/56966/cwd (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56966 ceph_time ceph rtd unknown /proc/56611/task/56966/root (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56966 ceph_time ceph txt unknown /proc/56611/task/56966/exe (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 56966 ceph_time ceph NOFD /proc/56611/task/56966/fd (opendir: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57254 ceph-osd ceph cwd unknown /proc/56611/task/57254/cwd (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57254 ceph-osd ceph rtd unknown /proc/56611/task/57254/root (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57254 ceph-osd ceph txt unknown /proc/56611/task/57254/exe (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57254 ceph-osd ceph NOFD /proc/56611/task/57254/fd (opendir: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57256 safe_time ceph cwd unknown /proc/56611/task/57256/cwd (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57256 safe_time ceph rtd unknown /proc/56611/task/57256/root (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57256 safe_time ceph txt unknown /proc/56611/task/57256/exe (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57256 safe_time ceph NOFD /proc/56611/task/57256/fd (opendir: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57257 safe_time ceph cwd unknown /proc/56611/task/57257/cwd (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57257 safe_time ceph rtd unknown /proc/56611/task/57257/root (readlink: Permission denied) 2024-08-31T06:49:26.162 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57257 safe_time ceph txt unknown /proc/56611/task/57257/exe (readlink: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57257 safe_time ceph NOFD /proc/56611/task/57257/fd (opendir: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57258 safe_time ceph cwd unknown /proc/56611/task/57258/cwd (readlink: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57258 safe_time ceph rtd unknown /proc/56611/task/57258/root (readlink: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57258 safe_time ceph txt unknown /proc/56611/task/57258/exe (readlink: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57258 safe_time ceph NOFD /proc/56611/task/57258/fd (opendir: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57259 safe_time ceph cwd unknown /proc/56611/task/57259/cwd (readlink: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57259 safe_time ceph rtd unknown /proc/56611/task/57259/root (readlink: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57259 safe_time ceph txt unknown /proc/56611/task/57259/exe (readlink: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57259 safe_time ceph NOFD /proc/56611/task/57259/fd (opendir: Permission denied) 2024-08-31T06:49:26.163 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57260 fn_anonym ceph cwd unknown /proc/56611/task/57260/cwd (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57260 fn_anonym ceph rtd unknown /proc/56611/task/57260/root (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57260 fn_anonym ceph txt unknown /proc/56611/task/57260/exe (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57260 fn_anonym ceph NOFD /proc/56611/task/57260/fd (opendir: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57331 rocksdb:l ceph cwd unknown /proc/56611/task/57331/cwd (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57331 rocksdb:l ceph rtd unknown /proc/56611/task/57331/root (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57331 rocksdb:l ceph txt unknown /proc/56611/task/57331/exe (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57331 rocksdb:l ceph NOFD /proc/56611/task/57331/fd (opendir: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57332 rocksdb:l ceph cwd unknown /proc/56611/task/57332/cwd (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57332 rocksdb:l ceph rtd unknown /proc/56611/task/57332/root (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57332 rocksdb:l ceph txt unknown /proc/56611/task/57332/exe (readlink: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57332 rocksdb:l ceph NOFD /proc/56611/task/57332/fd (opendir: Permission denied) 2024-08-31T06:49:26.164 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57333 rocksdb:l ceph cwd unknown /proc/56611/task/57333/cwd (readlink: Permission denied) 2024-08-31T06:49:26.165 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57333 rocksdb:l ceph rtd unknown /proc/56611/task/57333/root (readlink: Permission denied) 2024-08-31T06:49:26.165 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57333 rocksdb:l ceph txt unknown /proc/56611/task/57333/exe (readlink: Permission denied) 2024-08-31T06:49:26.165 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57333 rocksdb:l ceph NOFD /proc/56611/task/57333/fd (opendir: Permission denied) 2024-08-31T06:49:26.165 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57334 rocksdb:h ceph cwd unknown /proc/56611/task/57334/cwd (readlink: Permission denied) 2024-08-31T06:49:26.165 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57334 rocksdb:h ceph rtd unknown /proc/56611/task/57334/root (readlink: Permission denied) 2024-08-31T06:49:26.165 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57334 rocksdb:h ceph txt unknown /proc/56611/task/57334/exe (readlink: Permission denied) 2024-08-31T06:49:26.165 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57334 rocksdb:h ceph NOFD /proc/56611/task/57334/fd (opendir: Permission denied) 2024-08-31T06:49:26.165 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57745 bstore_ai ceph cwd unknown /proc/56611/task/57745/cwd (readlink: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57745 bstore_ai ceph rtd unknown /proc/56611/task/57745/root (readlink: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57745 bstore_ai ceph txt unknown /proc/56611/task/57745/exe (readlink: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57745 bstore_ai ceph NOFD /proc/56611/task/57745/fd (opendir: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57933 bstore_ai ceph cwd unknown /proc/56611/task/57933/cwd (readlink: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57933 bstore_ai ceph rtd unknown /proc/56611/task/57933/root (readlink: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57933 bstore_ai ceph txt unknown /proc/56611/task/57933/exe (readlink: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 57933 bstore_ai ceph NOFD /proc/56611/task/57933/fd (opendir: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58115 ceph-osd ceph cwd unknown /proc/56611/task/58115/cwd (readlink: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58115 ceph-osd ceph rtd unknown /proc/56611/task/58115/root (readlink: Permission denied) 2024-08-31T06:49:26.166 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58115 ceph-osd ceph txt unknown /proc/56611/task/58115/exe (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58115 ceph-osd ceph NOFD /proc/56611/task/58115/fd (opendir: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58116 cfin ceph cwd unknown /proc/56611/task/58116/cwd (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58116 cfin ceph rtd unknown /proc/56611/task/58116/root (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58116 cfin ceph txt unknown /proc/56611/task/58116/exe (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58116 cfin ceph NOFD /proc/56611/task/58116/fd (opendir: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58117 bstore_kv ceph cwd unknown /proc/56611/task/58117/cwd (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58117 bstore_kv ceph rtd unknown /proc/56611/task/58117/root (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58117 bstore_kv ceph txt unknown /proc/56611/task/58117/exe (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58117 bstore_kv ceph NOFD /proc/56611/task/58117/fd (opendir: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58118 bstore_kv ceph cwd unknown /proc/56611/task/58118/cwd (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58118 bstore_kv ceph rtd unknown /proc/56611/task/58118/root (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58118 bstore_kv ceph txt unknown /proc/56611/task/58118/exe (readlink: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58118 bstore_kv ceph NOFD /proc/56611/task/58118/fd (opendir: Permission denied) 2024-08-31T06:49:26.167 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58119 bstore_me ceph cwd unknown /proc/56611/task/58119/cwd (readlink: Permission denied) 2024-08-31T06:49:26.168 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58119 bstore_me ceph rtd unknown /proc/56611/task/58119/root (readlink: Permission denied) 2024-08-31T06:49:26.168 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58119 bstore_me ceph txt unknown /proc/56611/task/58119/exe (readlink: Permission denied) 2024-08-31T06:49:26.168 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58119 bstore_me ceph NOFD /proc/56611/task/58119/fd (opendir: Permission denied) 2024-08-31T06:49:26.168 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58120 ms_dispat ceph cwd unknown /proc/56611/task/58120/cwd (readlink: Permission denied) 2024-08-31T06:49:26.168 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58120 ms_dispat ceph rtd unknown /proc/56611/task/58120/root (readlink: Permission denied) 2024-08-31T06:49:26.168 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58120 ms_dispat ceph txt unknown /proc/56611/task/58120/exe (readlink: Permission denied) 2024-08-31T06:49:26.168 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58120 ms_dispat ceph NOFD /proc/56611/task/58120/fd (opendir: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58121 ms_local ceph cwd unknown /proc/56611/task/58121/cwd (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58121 ms_local ceph rtd unknown /proc/56611/task/58121/root (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58121 ms_local ceph txt unknown /proc/56611/task/58121/exe (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58121 ms_local ceph NOFD /proc/56611/task/58121/fd (opendir: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58122 safe_time ceph cwd unknown /proc/56611/task/58122/cwd (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58122 safe_time ceph rtd unknown /proc/56611/task/58122/root (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58122 safe_time ceph txt unknown /proc/56611/task/58122/exe (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58122 safe_time ceph NOFD /proc/56611/task/58122/fd (opendir: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58123 safe_time ceph cwd unknown /proc/56611/task/58123/cwd (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58123 safe_time ceph rtd unknown /proc/56611/task/58123/root (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58123 safe_time ceph txt unknown /proc/56611/task/58123/exe (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58123 safe_time ceph NOFD /proc/56611/task/58123/fd (opendir: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58124 ms_dispat ceph cwd unknown /proc/56611/task/58124/cwd (readlink: Permission denied) 2024-08-31T06:49:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58124 ms_dispat ceph rtd unknown /proc/56611/task/58124/root (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58124 ms_dispat ceph txt unknown /proc/56611/task/58124/exe (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58124 ms_dispat ceph NOFD /proc/56611/task/58124/fd (opendir: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58125 ms_local ceph cwd unknown /proc/56611/task/58125/cwd (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58125 ms_local ceph rtd unknown /proc/56611/task/58125/root (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58125 ms_local ceph txt unknown /proc/56611/task/58125/exe (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58125 ms_local ceph NOFD /proc/56611/task/58125/fd (opendir: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58126 ms_dispat ceph cwd unknown /proc/56611/task/58126/cwd (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58126 ms_dispat ceph rtd unknown /proc/56611/task/58126/root (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58126 ms_dispat ceph txt unknown /proc/56611/task/58126/exe (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58126 ms_dispat ceph NOFD /proc/56611/task/58126/fd (opendir: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58127 ms_local ceph cwd unknown /proc/56611/task/58127/cwd (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58127 ms_local ceph rtd unknown /proc/56611/task/58127/root (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58127 ms_local ceph txt unknown /proc/56611/task/58127/exe (readlink: Permission denied) 2024-08-31T06:49:26.170 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58127 ms_local ceph NOFD /proc/56611/task/58127/fd (opendir: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58128 ms_dispat ceph cwd unknown /proc/56611/task/58128/cwd (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58128 ms_dispat ceph rtd unknown /proc/56611/task/58128/root (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58128 ms_dispat ceph txt unknown /proc/56611/task/58128/exe (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58128 ms_dispat ceph NOFD /proc/56611/task/58128/fd (opendir: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58129 ms_local ceph cwd unknown /proc/56611/task/58129/cwd (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58129 ms_local ceph rtd unknown /proc/56611/task/58129/root (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58129 ms_local ceph txt unknown /proc/56611/task/58129/exe (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58129 ms_local ceph NOFD /proc/56611/task/58129/fd (opendir: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58130 ms_dispat ceph cwd unknown /proc/56611/task/58130/cwd (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58130 ms_dispat ceph rtd unknown /proc/56611/task/58130/root (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58130 ms_dispat ceph txt unknown /proc/56611/task/58130/exe (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58130 ms_dispat ceph NOFD /proc/56611/task/58130/fd (opendir: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58131 ms_local ceph cwd unknown /proc/56611/task/58131/cwd (readlink: Permission denied) 2024-08-31T06:49:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58131 ms_local ceph rtd unknown /proc/56611/task/58131/root (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58131 ms_local ceph txt unknown /proc/56611/task/58131/exe (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58131 ms_local ceph NOFD /proc/56611/task/58131/fd (opendir: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58132 ms_dispat ceph cwd unknown /proc/56611/task/58132/cwd (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58132 ms_dispat ceph rtd unknown /proc/56611/task/58132/root (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58132 ms_dispat ceph txt unknown /proc/56611/task/58132/exe (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58132 ms_dispat ceph NOFD /proc/56611/task/58132/fd (opendir: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58133 ms_local ceph cwd unknown /proc/56611/task/58133/cwd (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58133 ms_local ceph rtd unknown /proc/56611/task/58133/root (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58133 ms_local ceph txt unknown /proc/56611/task/58133/exe (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58133 ms_local ceph NOFD /proc/56611/task/58133/fd (opendir: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58134 ms_dispat ceph cwd unknown /proc/56611/task/58134/cwd (readlink: Permission denied) 2024-08-31T06:49:26.172 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58134 ms_dispat ceph rtd unknown /proc/56611/task/58134/root (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58134 ms_dispat ceph txt unknown /proc/56611/task/58134/exe (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58134 ms_dispat ceph NOFD /proc/56611/task/58134/fd (opendir: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58135 ms_local ceph cwd unknown /proc/56611/task/58135/cwd (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58135 ms_local ceph rtd unknown /proc/56611/task/58135/root (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58135 ms_local ceph txt unknown /proc/56611/task/58135/exe (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58135 ms_local ceph NOFD /proc/56611/task/58135/fd (opendir: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58136 fn_anonym ceph cwd unknown /proc/56611/task/58136/cwd (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58136 fn_anonym ceph rtd unknown /proc/56611/task/58136/root (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58136 fn_anonym ceph txt unknown /proc/56611/task/58136/exe (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58136 fn_anonym ceph NOFD /proc/56611/task/58136/fd (opendir: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58137 finisher ceph cwd unknown /proc/56611/task/58137/cwd (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58137 finisher ceph rtd unknown /proc/56611/task/58137/root (readlink: Permission denied) 2024-08-31T06:49:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58137 finisher ceph txt unknown /proc/56611/task/58137/exe (readlink: Permission denied) 2024-08-31T06:49:26.174 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58137 finisher ceph NOFD /proc/56611/task/58137/fd (opendir: Permission denied) 2024-08-31T06:49:26.174 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58138 safe_time ceph cwd unknown /proc/56611/task/58138/cwd (readlink: Permission denied) 2024-08-31T06:49:26.174 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58138 safe_time ceph rtd unknown /proc/56611/task/58138/root (readlink: Permission denied) 2024-08-31T06:49:26.174 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58138 safe_time ceph txt unknown /proc/56611/task/58138/exe (readlink: Permission denied) 2024-08-31T06:49:26.174 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58138 safe_time ceph NOFD /proc/56611/task/58138/fd (opendir: Permission denied) 2024-08-31T06:49:26.174 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58139 safe_time ceph cwd unknown /proc/56611/task/58139/cwd (readlink: Permission denied) 2024-08-31T06:49:26.175 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58139 safe_time ceph rtd unknown /proc/56611/task/58139/root (readlink: Permission denied) 2024-08-31T06:49:26.175 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58139 safe_time ceph txt unknown /proc/56611/task/58139/exe (readlink: Permission denied) 2024-08-31T06:49:26.175 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58139 safe_time ceph NOFD /proc/56611/task/58139/fd (opendir: Permission denied) 2024-08-31T06:49:26.175 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58140 ceph-osd ceph cwd unknown /proc/56611/task/58140/cwd (readlink: Permission denied) 2024-08-31T06:49:26.175 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58140 ceph-osd ceph rtd unknown /proc/56611/task/58140/root (readlink: Permission denied) 2024-08-31T06:49:26.176 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58140 ceph-osd ceph txt unknown /proc/56611/task/58140/exe (readlink: Permission denied) 2024-08-31T06:49:26.176 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58140 ceph-osd ceph NOFD /proc/56611/task/58140/fd (opendir: Permission denied) 2024-08-31T06:49:26.176 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58141 osd_srv_a ceph cwd unknown /proc/56611/task/58141/cwd (readlink: Permission denied) 2024-08-31T06:49:26.176 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58141 osd_srv_a ceph rtd unknown /proc/56611/task/58141/root (readlink: Permission denied) 2024-08-31T06:49:26.176 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58141 osd_srv_a ceph txt unknown /proc/56611/task/58141/exe (readlink: Permission denied) 2024-08-31T06:49:26.176 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58141 osd_srv_a ceph NOFD /proc/56611/task/58141/fd (opendir: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58142 tp_osd_tp ceph cwd unknown /proc/56611/task/58142/cwd (readlink: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58142 tp_osd_tp ceph rtd unknown /proc/56611/task/58142/root (readlink: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58142 tp_osd_tp ceph txt unknown /proc/56611/task/58142/exe (readlink: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58142 tp_osd_tp ceph NOFD /proc/56611/task/58142/fd (opendir: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58143 tp_osd_tp ceph cwd unknown /proc/56611/task/58143/cwd (readlink: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58143 tp_osd_tp ceph rtd unknown /proc/56611/task/58143/root (readlink: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58143 tp_osd_tp ceph txt unknown /proc/56611/task/58143/exe (readlink: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58143 tp_osd_tp ceph NOFD /proc/56611/task/58143/fd (opendir: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58144 tp_osd_tp ceph cwd unknown /proc/56611/task/58144/cwd (readlink: Permission denied) 2024-08-31T06:49:26.177 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58144 tp_osd_tp ceph rtd unknown /proc/56611/task/58144/root (readlink: Permission denied) 2024-08-31T06:49:26.178 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58144 tp_osd_tp ceph txt unknown /proc/56611/task/58144/exe (readlink: Permission denied) 2024-08-31T06:49:26.178 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58144 tp_osd_tp ceph NOFD /proc/56611/task/58144/fd (opendir: Permission denied) 2024-08-31T06:49:26.178 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58145 tp_osd_tp ceph cwd unknown /proc/56611/task/58145/cwd (readlink: Permission denied) 2024-08-31T06:49:26.178 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58145 tp_osd_tp ceph rtd unknown /proc/56611/task/58145/root (readlink: Permission denied) 2024-08-31T06:49:26.178 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58145 tp_osd_tp ceph txt unknown /proc/56611/task/58145/exe (readlink: Permission denied) 2024-08-31T06:49:26.178 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58145 tp_osd_tp ceph NOFD /proc/56611/task/58145/fd (opendir: Permission denied) 2024-08-31T06:49:26.178 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58146 tp_osd_tp ceph cwd unknown /proc/56611/task/58146/cwd (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58146 tp_osd_tp ceph rtd unknown /proc/56611/task/58146/root (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58146 tp_osd_tp ceph txt unknown /proc/56611/task/58146/exe (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58146 tp_osd_tp ceph NOFD /proc/56611/task/58146/fd (opendir: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58147 tp_osd_tp ceph cwd unknown /proc/56611/task/58147/cwd (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58147 tp_osd_tp ceph rtd unknown /proc/56611/task/58147/root (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58147 tp_osd_tp ceph txt unknown /proc/56611/task/58147/exe (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58147 tp_osd_tp ceph NOFD /proc/56611/task/58147/fd (opendir: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58148 tp_osd_tp ceph cwd unknown /proc/56611/task/58148/cwd (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58148 tp_osd_tp ceph rtd unknown /proc/56611/task/58148/root (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58148 tp_osd_tp ceph txt unknown /proc/56611/task/58148/exe (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58148 tp_osd_tp ceph NOFD /proc/56611/task/58148/fd (opendir: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58149 tp_osd_tp ceph cwd unknown /proc/56611/task/58149/cwd (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58149 tp_osd_tp ceph rtd unknown /proc/56611/task/58149/root (readlink: Permission denied) 2024-08-31T06:49:26.179 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58149 tp_osd_tp ceph txt unknown /proc/56611/task/58149/exe (readlink: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58149 tp_osd_tp ceph NOFD /proc/56611/task/58149/fd (opendir: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58150 tp_osd_tp ceph cwd unknown /proc/56611/task/58150/cwd (readlink: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58150 tp_osd_tp ceph rtd unknown /proc/56611/task/58150/root (readlink: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58150 tp_osd_tp ceph txt unknown /proc/56611/task/58150/exe (readlink: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58150 tp_osd_tp ceph NOFD /proc/56611/task/58150/fd (opendir: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58151 tp_osd_tp ceph cwd unknown /proc/56611/task/58151/cwd (readlink: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58151 tp_osd_tp ceph rtd unknown /proc/56611/task/58151/root (readlink: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58151 tp_osd_tp ceph txt unknown /proc/56611/task/58151/exe (readlink: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58151 tp_osd_tp ceph NOFD /proc/56611/task/58151/fd (opendir: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58152 tp_osd_tp ceph cwd unknown /proc/56611/task/58152/cwd (readlink: Permission denied) 2024-08-31T06:49:26.180 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58152 tp_osd_tp ceph rtd unknown /proc/56611/task/58152/root (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58152 tp_osd_tp ceph txt unknown /proc/56611/task/58152/exe (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58152 tp_osd_tp ceph NOFD /proc/56611/task/58152/fd (opendir: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58153 tp_osd_tp ceph cwd unknown /proc/56611/task/58153/cwd (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58153 tp_osd_tp ceph rtd unknown /proc/56611/task/58153/root (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58153 tp_osd_tp ceph txt unknown /proc/56611/task/58153/exe (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58153 tp_osd_tp ceph NOFD /proc/56611/task/58153/fd (opendir: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58154 tp_osd_tp ceph cwd unknown /proc/56611/task/58154/cwd (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58154 tp_osd_tp ceph rtd unknown /proc/56611/task/58154/root (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58154 tp_osd_tp ceph txt unknown /proc/56611/task/58154/exe (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58154 tp_osd_tp ceph NOFD /proc/56611/task/58154/fd (opendir: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58155 tp_osd_tp ceph cwd unknown /proc/56611/task/58155/cwd (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58155 tp_osd_tp ceph rtd unknown /proc/56611/task/58155/root (readlink: Permission denied) 2024-08-31T06:49:26.181 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58155 tp_osd_tp ceph txt unknown /proc/56611/task/58155/exe (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58155 tp_osd_tp ceph NOFD /proc/56611/task/58155/fd (opendir: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58156 tp_osd_tp ceph cwd unknown /proc/56611/task/58156/cwd (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58156 tp_osd_tp ceph rtd unknown /proc/56611/task/58156/root (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58156 tp_osd_tp ceph txt unknown /proc/56611/task/58156/exe (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58156 tp_osd_tp ceph NOFD /proc/56611/task/58156/fd (opendir: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58157 tp_osd_tp ceph cwd unknown /proc/56611/task/58157/cwd (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58157 tp_osd_tp ceph rtd unknown /proc/56611/task/58157/root (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58157 tp_osd_tp ceph txt unknown /proc/56611/task/58157/exe (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58157 tp_osd_tp ceph NOFD /proc/56611/task/58157/fd (opendir: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58158 osd_srv_h ceph cwd unknown /proc/56611/task/58158/cwd (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58158 osd_srv_h ceph rtd unknown /proc/56611/task/58158/root (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58158 osd_srv_h ceph txt unknown /proc/56611/task/58158/exe (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-osd 56611 58158 osd_srv_h ceph NOFD /proc/56611/task/58158/fd (opendir: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 57278 root cwd unknown /proc/57278/cwd (readlink: Permission denied) 2024-08-31T06:49:26.182 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 57278 root rtd unknown /proc/57278/root (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 57278 root txt unknown /proc/57278/exe (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 57278 root NOFD /proc/57278/fd (opendir: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 57309 root cwd unknown /proc/57309/cwd (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 57309 root rtd unknown /proc/57309/root (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 57309 root txt unknown /proc/57309/exe (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 57309 root NOFD /proc/57309/fd (opendir: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61054 root cwd unknown /proc/61054/cwd (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61054 root rtd unknown /proc/61054/root (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61054 root txt unknown /proc/61054/exe (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61054 root NOFD /proc/61054/fd (opendir: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61071 root cwd unknown /proc/61071/cwd (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61071 root rtd unknown /proc/61071/root (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61071 root txt unknown /proc/61071/exe (readlink: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61071 root NOFD /proc/61071/fd (opendir: Permission denied) 2024-08-31T06:49:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61072 root cwd unknown /proc/61072/cwd (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61072 root rtd unknown /proc/61072/root (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61072 root txt unknown /proc/61072/exe (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61072 root NOFD /proc/61072/fd (opendir: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61089 root cwd unknown /proc/61089/cwd (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61089 root rtd unknown /proc/61089/root (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61089 root txt unknown /proc/61089/exe (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61089 root NOFD /proc/61089/fd (opendir: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61090 root cwd unknown /proc/61090/cwd (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61090 root rtd unknown /proc/61090/root (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61090 root txt unknown /proc/61090/exe (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61090 root NOFD /proc/61090/fd (opendir: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61107 root cwd unknown /proc/61107/cwd (readlink: Permission denied) 2024-08-31T06:49:26.184 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61107 root rtd unknown /proc/61107/root (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61107 root txt unknown /proc/61107/exe (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61107 root NOFD /proc/61107/fd (opendir: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61108 root cwd unknown /proc/61108/cwd (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61108 root rtd unknown /proc/61108/root (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61108 root txt unknown /proc/61108/exe (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 61108 root NOFD /proc/61108/fd (opendir: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61125 root cwd unknown /proc/61125/cwd (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61125 root rtd unknown /proc/61125/root (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61125 root txt unknown /proc/61125/exe (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:journalct 61125 root NOFD /proc/61125/fd (opendir: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 61650 root cwd unknown /proc/61650/cwd (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 61650 root rtd unknown /proc/61650/root (readlink: Permission denied) 2024-08-31T06:49:26.185 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 61650 root txt unknown /proc/61650/exe (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 61650 root NOFD /proc/61650/fd (opendir: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 61652 root cwd unknown /proc/61652/cwd (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 61652 root rtd unknown /proc/61652/root (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 61652 root txt unknown /proc/61652/exe (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 61652 root NOFD /proc/61652/fd (opendir: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 ceph cwd unknown /proc/61661/cwd (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 ceph rtd unknown /proc/61661/root (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 ceph txt unknown /proc/61661/exe (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 ceph NOFD /proc/61661/fd (opendir: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61666 log ceph cwd unknown /proc/61661/task/61666/cwd (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61666 log ceph rtd unknown /proc/61661/task/61666/root (readlink: Permission denied) 2024-08-31T06:49:26.186 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61666 log ceph txt unknown /proc/61661/task/61666/exe (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61666 log ceph NOFD /proc/61661/task/61666/fd (opendir: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61668 msgr-work ceph cwd unknown /proc/61661/task/61668/cwd (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61668 msgr-work ceph rtd unknown /proc/61661/task/61668/root (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61668 msgr-work ceph txt unknown /proc/61661/task/61668/exe (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61668 msgr-work ceph NOFD /proc/61661/task/61668/fd (opendir: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61669 msgr-work ceph cwd unknown /proc/61661/task/61669/cwd (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61669 msgr-work ceph rtd unknown /proc/61661/task/61669/root (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61669 msgr-work ceph txt unknown /proc/61661/task/61669/exe (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61669 msgr-work ceph NOFD /proc/61661/task/61669/fd (opendir: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61670 msgr-work ceph cwd unknown /proc/61661/task/61670/cwd (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61670 msgr-work ceph rtd unknown /proc/61661/task/61670/root (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61670 msgr-work ceph txt unknown /proc/61661/task/61670/exe (readlink: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61670 msgr-work ceph NOFD /proc/61661/task/61670/fd (opendir: Permission denied) 2024-08-31T06:49:26.187 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61674 service ceph cwd unknown /proc/61661/task/61674/cwd (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61674 service ceph rtd unknown /proc/61661/task/61674/root (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61674 service ceph txt unknown /proc/61661/task/61674/exe (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61674 service ceph NOFD /proc/61661/task/61674/fd (opendir: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61675 admin_soc ceph cwd unknown /proc/61661/task/61675/cwd (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61675 admin_soc ceph rtd unknown /proc/61661/task/61675/root (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61675 admin_soc ceph txt unknown /proc/61661/task/61675/exe (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61675 admin_soc ceph NOFD /proc/61661/task/61675/fd (opendir: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61676 signal_ha ceph cwd unknown /proc/61661/task/61676/cwd (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61676 signal_ha ceph rtd unknown /proc/61661/task/61676/root (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61676 signal_ha ceph txt unknown /proc/61661/task/61676/exe (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61676 signal_ha ceph NOFD /proc/61661/task/61676/fd (opendir: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61677 io_contex ceph cwd unknown /proc/61661/task/61677/cwd (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61677 io_contex ceph rtd unknown /proc/61661/task/61677/root (readlink: Permission denied) 2024-08-31T06:49:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61677 io_contex ceph txt unknown /proc/61661/task/61677/exe (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61677 io_contex ceph NOFD /proc/61661/task/61677/fd (opendir: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61678 io_contex ceph cwd unknown /proc/61661/task/61678/cwd (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61678 io_contex ceph rtd unknown /proc/61661/task/61678/root (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61678 io_contex ceph txt unknown /proc/61661/task/61678/exe (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61678 io_contex ceph NOFD /proc/61661/task/61678/fd (opendir: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61679 ms_dispat ceph cwd unknown /proc/61661/task/61679/cwd (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61679 ms_dispat ceph rtd unknown /proc/61661/task/61679/root (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61679 ms_dispat ceph txt unknown /proc/61661/task/61679/exe (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61679 ms_dispat ceph NOFD /proc/61661/task/61679/fd (opendir: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61680 ms_local ceph cwd unknown /proc/61661/task/61680/cwd (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61680 ms_local ceph rtd unknown /proc/61661/task/61680/root (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61680 ms_local ceph txt unknown /proc/61661/task/61680/exe (readlink: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61680 ms_local ceph NOFD /proc/61661/task/61680/fd (opendir: Permission denied) 2024-08-31T06:49:26.189 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61681 safe_time ceph cwd unknown /proc/61661/task/61681/cwd (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61681 safe_time ceph rtd unknown /proc/61661/task/61681/root (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61681 safe_time ceph txt unknown /proc/61661/task/61681/exe (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61681 safe_time ceph NOFD /proc/61661/task/61681/fd (opendir: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61682 safe_time ceph cwd unknown /proc/61661/task/61682/cwd (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61682 safe_time ceph rtd unknown /proc/61661/task/61682/root (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61682 safe_time ceph txt unknown /proc/61661/task/61682/exe (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61682 safe_time ceph NOFD /proc/61661/task/61682/fd (opendir: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61683 ceph-mds ceph cwd unknown /proc/61661/task/61683/cwd (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61683 ceph-mds ceph rtd unknown /proc/61661/task/61683/root (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61683 ceph-mds ceph txt unknown /proc/61661/task/61683/exe (readlink: Permission denied) 2024-08-31T06:49:26.190 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61683 ceph-mds ceph NOFD /proc/61661/task/61683/fd (opendir: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61684 safe_time ceph cwd unknown /proc/61661/task/61684/cwd (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61684 safe_time ceph rtd unknown /proc/61661/task/61684/root (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61684 safe_time ceph txt unknown /proc/61661/task/61684/exe (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 61661 61684 safe_time ceph NOFD /proc/61661/task/61684/fd (opendir: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 62048 root cwd unknown /proc/62048/cwd (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 62048 root rtd unknown /proc/62048/root (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 62048 root txt unknown /proc/62048/exe (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 62048 root NOFD /proc/62048/fd (opendir: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 62050 root cwd unknown /proc/62050/cwd (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 62050 root rtd unknown /proc/62050/root (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 62050 root txt unknown /proc/62050/exe (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 62050 root NOFD /proc/62050/fd (opendir: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 ceph cwd unknown /proc/62052/cwd (readlink: Permission denied) 2024-08-31T06:49:26.191 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 ceph rtd unknown /proc/62052/root (readlink: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 ceph txt unknown /proc/62052/exe (readlink: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 ceph NOFD /proc/62052/fd (opendir: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62053 log ceph cwd unknown /proc/62052/task/62053/cwd (readlink: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62053 log ceph rtd unknown /proc/62052/task/62053/root (readlink: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62053 log ceph txt unknown /proc/62052/task/62053/exe (readlink: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62053 log ceph NOFD /proc/62052/task/62053/fd (opendir: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62055 msgr-work ceph cwd unknown /proc/62052/task/62055/cwd (readlink: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62055 msgr-work ceph rtd unknown /proc/62052/task/62055/root (readlink: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62055 msgr-work ceph txt unknown /proc/62052/task/62055/exe (readlink: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62055 msgr-work ceph NOFD /proc/62052/task/62055/fd (opendir: Permission denied) 2024-08-31T06:49:26.192 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62056 msgr-work ceph cwd unknown /proc/62052/task/62056/cwd (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62056 msgr-work ceph rtd unknown /proc/62052/task/62056/root (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62056 msgr-work ceph txt unknown /proc/62052/task/62056/exe (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62056 msgr-work ceph NOFD /proc/62052/task/62056/fd (opendir: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62057 msgr-work ceph cwd unknown /proc/62052/task/62057/cwd (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62057 msgr-work ceph rtd unknown /proc/62052/task/62057/root (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62057 msgr-work ceph txt unknown /proc/62052/task/62057/exe (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62057 msgr-work ceph NOFD /proc/62052/task/62057/fd (opendir: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62061 service ceph cwd unknown /proc/62052/task/62061/cwd (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62061 service ceph rtd unknown /proc/62052/task/62061/root (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62061 service ceph txt unknown /proc/62052/task/62061/exe (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62061 service ceph NOFD /proc/62052/task/62061/fd (opendir: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62062 admin_soc ceph cwd unknown /proc/62052/task/62062/cwd (readlink: Permission denied) 2024-08-31T06:49:26.193 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62062 admin_soc ceph rtd unknown /proc/62052/task/62062/root (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62062 admin_soc ceph txt unknown /proc/62052/task/62062/exe (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62062 admin_soc ceph NOFD /proc/62052/task/62062/fd (opendir: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62063 signal_ha ceph cwd unknown /proc/62052/task/62063/cwd (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62063 signal_ha ceph rtd unknown /proc/62052/task/62063/root (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62063 signal_ha ceph txt unknown /proc/62052/task/62063/exe (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62063 signal_ha ceph NOFD /proc/62052/task/62063/fd (opendir: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62064 io_contex ceph cwd unknown /proc/62052/task/62064/cwd (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62064 io_contex ceph rtd unknown /proc/62052/task/62064/root (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62064 io_contex ceph txt unknown /proc/62052/task/62064/exe (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62064 io_contex ceph NOFD /proc/62052/task/62064/fd (opendir: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62065 io_contex ceph cwd unknown /proc/62052/task/62065/cwd (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62065 io_contex ceph rtd unknown /proc/62052/task/62065/root (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62065 io_contex ceph txt unknown /proc/62052/task/62065/exe (readlink: Permission denied) 2024-08-31T06:49:26.194 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62065 io_contex ceph NOFD /proc/62052/task/62065/fd (opendir: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62066 ms_dispat ceph cwd unknown /proc/62052/task/62066/cwd (readlink: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62066 ms_dispat ceph rtd unknown /proc/62052/task/62066/root (readlink: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62066 ms_dispat ceph txt unknown /proc/62052/task/62066/exe (readlink: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62066 ms_dispat ceph NOFD /proc/62052/task/62066/fd (opendir: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62067 ms_local ceph cwd unknown /proc/62052/task/62067/cwd (readlink: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62067 ms_local ceph rtd unknown /proc/62052/task/62067/root (readlink: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62067 ms_local ceph txt unknown /proc/62052/task/62067/exe (readlink: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62067 ms_local ceph NOFD /proc/62052/task/62067/fd (opendir: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62068 safe_time ceph cwd unknown /proc/62052/task/62068/cwd (readlink: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62068 safe_time ceph rtd unknown /proc/62052/task/62068/root (readlink: Permission denied) 2024-08-31T06:49:26.195 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62068 safe_time ceph txt unknown /proc/62052/task/62068/exe (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62068 safe_time ceph NOFD /proc/62052/task/62068/fd (opendir: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62069 safe_time ceph cwd unknown /proc/62052/task/62069/cwd (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62069 safe_time ceph rtd unknown /proc/62052/task/62069/root (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62069 safe_time ceph txt unknown /proc/62052/task/62069/exe (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62069 safe_time ceph NOFD /proc/62052/task/62069/fd (opendir: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62070 ceph-mds ceph cwd unknown /proc/62052/task/62070/cwd (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62070 ceph-mds ceph rtd unknown /proc/62052/task/62070/root (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62070 ceph-mds ceph txt unknown /proc/62052/task/62070/exe (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62070 ceph-mds ceph NOFD /proc/62052/task/62070/fd (opendir: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62147 safe_time ceph cwd unknown /proc/62052/task/62147/cwd (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62147 safe_time ceph rtd unknown /proc/62052/task/62147/root (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62147 safe_time ceph txt unknown /proc/62052/task/62147/exe (readlink: Permission denied) 2024-08-31T06:49:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62052 62147 safe_time ceph NOFD /proc/62052/task/62147/fd (opendir: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 62846 root cwd unknown /proc/62846/cwd (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 62846 root rtd unknown /proc/62846/root (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 62846 root txt unknown /proc/62846/exe (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 62846 root NOFD /proc/62846/fd (opendir: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 62848 root cwd unknown /proc/62848/cwd (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 62848 root rtd unknown /proc/62848/root (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 62848 root txt unknown /proc/62848/exe (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 62848 root NOFD /proc/62848/fd (opendir: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 ceph cwd unknown /proc/62852/cwd (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 ceph rtd unknown /proc/62852/root (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 ceph txt unknown /proc/62852/exe (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 ceph NOFD /proc/62852/fd (opendir: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62864 log ceph cwd unknown /proc/62852/task/62864/cwd (readlink: Permission denied) 2024-08-31T06:49:26.197 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62864 log ceph rtd unknown /proc/62852/task/62864/root (readlink: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62864 log ceph txt unknown /proc/62852/task/62864/exe (readlink: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62864 log ceph NOFD /proc/62852/task/62864/fd (opendir: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62866 msgr-work ceph cwd unknown /proc/62852/task/62866/cwd (readlink: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62866 msgr-work ceph rtd unknown /proc/62852/task/62866/root (readlink: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62866 msgr-work ceph txt unknown /proc/62852/task/62866/exe (readlink: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62866 msgr-work ceph NOFD /proc/62852/task/62866/fd (opendir: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62867 msgr-work ceph cwd unknown /proc/62852/task/62867/cwd (readlink: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62867 msgr-work ceph rtd unknown /proc/62852/task/62867/root (readlink: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62867 msgr-work ceph txt unknown /proc/62852/task/62867/exe (readlink: Permission denied) 2024-08-31T06:49:26.198 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62867 msgr-work ceph NOFD /proc/62852/task/62867/fd (opendir: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62868 msgr-work ceph cwd unknown /proc/62852/task/62868/cwd (readlink: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62868 msgr-work ceph rtd unknown /proc/62852/task/62868/root (readlink: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62868 msgr-work ceph txt unknown /proc/62852/task/62868/exe (readlink: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62868 msgr-work ceph NOFD /proc/62852/task/62868/fd (opendir: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62872 service ceph cwd unknown /proc/62852/task/62872/cwd (readlink: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62872 service ceph rtd unknown /proc/62852/task/62872/root (readlink: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62872 service ceph txt unknown /proc/62852/task/62872/exe (readlink: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62872 service ceph NOFD /proc/62852/task/62872/fd (opendir: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62873 admin_soc ceph cwd unknown /proc/62852/task/62873/cwd (readlink: Permission denied) 2024-08-31T06:49:26.199 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62873 admin_soc ceph rtd unknown /proc/62852/task/62873/root (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62873 admin_soc ceph txt unknown /proc/62852/task/62873/exe (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62873 admin_soc ceph NOFD /proc/62852/task/62873/fd (opendir: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62874 signal_ha ceph cwd unknown /proc/62852/task/62874/cwd (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62874 signal_ha ceph rtd unknown /proc/62852/task/62874/root (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62874 signal_ha ceph txt unknown /proc/62852/task/62874/exe (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62874 signal_ha ceph NOFD /proc/62852/task/62874/fd (opendir: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62875 io_contex ceph cwd unknown /proc/62852/task/62875/cwd (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62875 io_contex ceph rtd unknown /proc/62852/task/62875/root (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62875 io_contex ceph txt unknown /proc/62852/task/62875/exe (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62875 io_contex ceph NOFD /proc/62852/task/62875/fd (opendir: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62876 io_contex ceph cwd unknown /proc/62852/task/62876/cwd (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62876 io_contex ceph rtd unknown /proc/62852/task/62876/root (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62876 io_contex ceph txt unknown /proc/62852/task/62876/exe (readlink: Permission denied) 2024-08-31T06:49:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62876 io_contex ceph NOFD /proc/62852/task/62876/fd (opendir: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62877 ms_dispat ceph cwd unknown /proc/62852/task/62877/cwd (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62877 ms_dispat ceph rtd unknown /proc/62852/task/62877/root (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62877 ms_dispat ceph txt unknown /proc/62852/task/62877/exe (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62877 ms_dispat ceph NOFD /proc/62852/task/62877/fd (opendir: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62878 ms_local ceph cwd unknown /proc/62852/task/62878/cwd (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62878 ms_local ceph rtd unknown /proc/62852/task/62878/root (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62878 ms_local ceph txt unknown /proc/62852/task/62878/exe (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62878 ms_local ceph NOFD /proc/62852/task/62878/fd (opendir: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62879 safe_time ceph cwd unknown /proc/62852/task/62879/cwd (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62879 safe_time ceph rtd unknown /proc/62852/task/62879/root (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62879 safe_time ceph txt unknown /proc/62852/task/62879/exe (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62879 safe_time ceph NOFD /proc/62852/task/62879/fd (opendir: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62880 safe_time ceph cwd unknown /proc/62852/task/62880/cwd (readlink: Permission denied) 2024-08-31T06:49:26.201 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62880 safe_time ceph rtd unknown /proc/62852/task/62880/root (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62880 safe_time ceph txt unknown /proc/62852/task/62880/exe (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62880 safe_time ceph NOFD /proc/62852/task/62880/fd (opendir: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62881 ceph-mds ceph cwd unknown /proc/62852/task/62881/cwd (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62881 ceph-mds ceph rtd unknown /proc/62852/task/62881/root (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62881 ceph-mds ceph txt unknown /proc/62852/task/62881/exe (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62881 ceph-mds ceph NOFD /proc/62852/task/62881/fd (opendir: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62884 safe_time ceph cwd unknown /proc/62852/task/62884/cwd (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62884 safe_time ceph rtd unknown /proc/62852/task/62884/root (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62884 safe_time ceph txt unknown /proc/62852/task/62884/exe (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 62852 62884 safe_time ceph NOFD /proc/62852/task/62884/fd (opendir: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 63247 root cwd unknown /proc/63247/cwd (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 63247 root rtd unknown /proc/63247/root (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 63247 root txt unknown /proc/63247/exe (readlink: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:conmon 63247 root NOFD /proc/63247/fd (opendir: Permission denied) 2024-08-31T06:49:26.202 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 63249 root cwd unknown /proc/63249/cwd (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 63249 root rtd unknown /proc/63249/root (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 63249 root txt unknown /proc/63249/exe (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:podman-in 63249 root NOFD /proc/63249/fd (opendir: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 ceph cwd unknown /proc/63251/cwd (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 ceph rtd unknown /proc/63251/root (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 ceph txt unknown /proc/63251/exe (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 ceph NOFD /proc/63251/fd (opendir: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63252 log ceph cwd unknown /proc/63251/task/63252/cwd (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63252 log ceph rtd unknown /proc/63251/task/63252/root (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63252 log ceph txt unknown /proc/63251/task/63252/exe (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63252 log ceph NOFD /proc/63251/task/63252/fd (opendir: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63254 msgr-work ceph cwd unknown /proc/63251/task/63254/cwd (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63254 msgr-work ceph rtd unknown /proc/63251/task/63254/root (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63254 msgr-work ceph txt unknown /proc/63251/task/63254/exe (readlink: Permission denied) 2024-08-31T06:49:26.203 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63254 msgr-work ceph NOFD /proc/63251/task/63254/fd (opendir: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63255 msgr-work ceph cwd unknown /proc/63251/task/63255/cwd (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63255 msgr-work ceph rtd unknown /proc/63251/task/63255/root (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63255 msgr-work ceph txt unknown /proc/63251/task/63255/exe (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63255 msgr-work ceph NOFD /proc/63251/task/63255/fd (opendir: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63256 msgr-work ceph cwd unknown /proc/63251/task/63256/cwd (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63256 msgr-work ceph rtd unknown /proc/63251/task/63256/root (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63256 msgr-work ceph txt unknown /proc/63251/task/63256/exe (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63256 msgr-work ceph NOFD /proc/63251/task/63256/fd (opendir: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63260 service ceph cwd unknown /proc/63251/task/63260/cwd (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63260 service ceph rtd unknown /proc/63251/task/63260/root (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63260 service ceph txt unknown /proc/63251/task/63260/exe (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63260 service ceph NOFD /proc/63251/task/63260/fd (opendir: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63261 admin_soc ceph cwd unknown /proc/63251/task/63261/cwd (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63261 admin_soc ceph rtd unknown /proc/63251/task/63261/root (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63261 admin_soc ceph txt unknown /proc/63251/task/63261/exe (readlink: Permission denied) 2024-08-31T06:49:26.204 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63261 admin_soc ceph NOFD /proc/63251/task/63261/fd (opendir: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63262 signal_ha ceph cwd unknown /proc/63251/task/63262/cwd (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63262 signal_ha ceph rtd unknown /proc/63251/task/63262/root (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63262 signal_ha ceph txt unknown /proc/63251/task/63262/exe (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63262 signal_ha ceph NOFD /proc/63251/task/63262/fd (opendir: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63263 io_contex ceph cwd unknown /proc/63251/task/63263/cwd (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63263 io_contex ceph rtd unknown /proc/63251/task/63263/root (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63263 io_contex ceph txt unknown /proc/63251/task/63263/exe (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63263 io_contex ceph NOFD /proc/63251/task/63263/fd (opendir: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63264 io_contex ceph cwd unknown /proc/63251/task/63264/cwd (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63264 io_contex ceph rtd unknown /proc/63251/task/63264/root (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63264 io_contex ceph txt unknown /proc/63251/task/63264/exe (readlink: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63264 io_contex ceph NOFD /proc/63251/task/63264/fd (opendir: Permission denied) 2024-08-31T06:49:26.205 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63265 ms_dispat ceph cwd unknown /proc/63251/task/63265/cwd (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63265 ms_dispat ceph rtd unknown /proc/63251/task/63265/root (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63265 ms_dispat ceph txt unknown /proc/63251/task/63265/exe (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63265 ms_dispat ceph NOFD /proc/63251/task/63265/fd (opendir: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63266 ms_local ceph cwd unknown /proc/63251/task/63266/cwd (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63266 ms_local ceph rtd unknown /proc/63251/task/63266/root (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63266 ms_local ceph txt unknown /proc/63251/task/63266/exe (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63266 ms_local ceph NOFD /proc/63251/task/63266/fd (opendir: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63267 safe_time ceph cwd unknown /proc/63251/task/63267/cwd (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63267 safe_time ceph rtd unknown /proc/63251/task/63267/root (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63267 safe_time ceph txt unknown /proc/63251/task/63267/exe (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63267 safe_time ceph NOFD /proc/63251/task/63267/fd (opendir: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63268 safe_time ceph cwd unknown /proc/63251/task/63268/cwd (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63268 safe_time ceph rtd unknown /proc/63251/task/63268/root (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63268 safe_time ceph txt unknown /proc/63251/task/63268/exe (readlink: Permission denied) 2024-08-31T06:49:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63268 safe_time ceph NOFD /proc/63251/task/63268/fd (opendir: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63269 ceph-mds ceph cwd unknown /proc/63251/task/63269/cwd (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63269 ceph-mds ceph rtd unknown /proc/63251/task/63269/root (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63269 ceph-mds ceph txt unknown /proc/63251/task/63269/exe (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63269 ceph-mds ceph NOFD /proc/63251/task/63269/fd (opendir: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63292 safe_time ceph cwd unknown /proc/63251/task/63292/cwd (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63292 safe_time ceph rtd unknown /proc/63251/task/63292/root (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63292 safe_time ceph txt unknown /proc/63251/task/63292/exe (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-mds 63251 63292 safe_time ceph NOFD /proc/63251/task/63292/fd (opendir: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 63388 root cwd unknown /proc/63388/cwd (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 63388 root rtd unknown /proc/63388/root (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 63388 root txt unknown /proc/63388/exe (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/u 63388 root NOFD /proc/63388/fd (opendir: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 63588 root cwd unknown /proc/63588/cwd (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 63588 root rtd unknown /proc/63588/root (readlink: Permission denied) 2024-08-31T06:49:26.207 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 63588 root txt unknown /proc/63588/exe (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/0 63588 root NOFD /proc/63588/fd (opendir: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 63724 root cwd unknown /proc/63724/cwd (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 63724 root rtd unknown /proc/63724/root (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 63724 root txt unknown /proc/63724/exe (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 63724 root NOFD /proc/63724/fd (opendir: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 65179 root cwd unknown /proc/65179/cwd (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 65179 root rtd unknown /proc/65179/root (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 65179 root txt unknown /proc/65179/exe (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 65179 root NOFD /proc/65179/fd (opendir: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 65778 root cwd unknown /proc/65778/cwd (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 65778 root rtd unknown /proc/65778/root (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 65778 root txt unknown /proc/65778/exe (readlink: Permission denied) 2024-08-31T06:49:26.208 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 65778 root NOFD /proc/65778/fd (opendir: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 71629 root cwd unknown /proc/71629/cwd (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 71629 root rtd unknown /proc/71629/root (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 71629 root txt unknown /proc/71629/exe (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/1 71629 root NOFD /proc/71629/fd (opendir: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 72814 root cwd unknown /proc/72814/cwd (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 72814 root rtd unknown /proc/72814/root (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 72814 root txt unknown /proc/72814/exe (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/5 72814 root NOFD /proc/72814/fd (opendir: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 72887 root cwd unknown /proc/72887/cwd (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 72887 root rtd unknown /proc/72887/root (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 72887 root txt unknown /proc/72887/exe (readlink: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/6 72887 root NOFD /proc/72887/fd (opendir: Permission denied) 2024-08-31T06:49:26.209 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu cwd DIR 8,1 4096 5553 /home/ubuntu 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu rtd DIR 8,1 4096 2 / 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-08-31T06:49:26.210 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu 0r FIFO 0,13 0t0 180172 pipe 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu 1w FIFO 0,13 0t0 180173 pipe 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:bash 73603 ubuntu 2w FIFO 0,13 0t0 180174 pipe 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 73633 root cwd unknown /proc/73633/cwd (readlink: Permission denied) 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 73633 root rtd unknown /proc/73633/root (readlink: Permission denied) 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 73633 root txt unknown /proc/73633/exe (readlink: Permission denied) 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 73633 root NOFD /proc/73633/fd (opendir: Permission denied) 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 73638 root cwd unknown /proc/73638/cwd (readlink: Permission denied) 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 73638 root rtd unknown /proc/73638/root (readlink: Permission denied) 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 73638 root txt unknown /proc/73638/exe (readlink: Permission denied) 2024-08-31T06:49:26.211 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 73638 root NOFD /proc/73638/fd (opendir: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:daemon-he 73641 root cwd unknown /proc/73641/cwd (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:daemon-he 73641 root rtd unknown /proc/73641/root (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:daemon-he 73641 root txt unknown /proc/73641/exe (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:daemon-he 73641 root NOFD /proc/73641/fd (opendir: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 root cwd unknown /proc/73644/cwd (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 root rtd unknown /proc/73644/root (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 root txt unknown /proc/73644/exe (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 root NOFD /proc/73644/fd (opendir: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73662 log root cwd unknown /proc/73644/task/73662/cwd (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73662 log root rtd unknown /proc/73644/task/73662/root (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73662 log root txt unknown /proc/73644/task/73662/exe (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73662 log root NOFD /proc/73644/task/73662/fd (opendir: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73664 msgr-work root cwd unknown /proc/73644/task/73664/cwd (readlink: Permission denied) 2024-08-31T06:49:26.212 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73664 msgr-work root rtd unknown /proc/73644/task/73664/root (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73664 msgr-work root txt unknown /proc/73644/task/73664/exe (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73664 msgr-work root NOFD /proc/73644/task/73664/fd (opendir: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73665 msgr-work root cwd unknown /proc/73644/task/73665/cwd (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73665 msgr-work root rtd unknown /proc/73644/task/73665/root (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73665 msgr-work root txt unknown /proc/73644/task/73665/exe (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73665 msgr-work root NOFD /proc/73644/task/73665/fd (opendir: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73666 msgr-work root cwd unknown /proc/73644/task/73666/cwd (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73666 msgr-work root rtd unknown /proc/73644/task/73666/root (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73666 msgr-work root txt unknown /proc/73644/task/73666/exe (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73666 msgr-work root NOFD /proc/73644/task/73666/fd (opendir: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73670 service root cwd unknown /proc/73644/task/73670/cwd (readlink: Permission denied) 2024-08-31T06:49:26.213 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73670 service root rtd unknown /proc/73644/task/73670/root (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73670 service root txt unknown /proc/73644/task/73670/exe (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73670 service root NOFD /proc/73644/task/73670/fd (opendir: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73671 admin_soc root cwd unknown /proc/73644/task/73671/cwd (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73671 admin_soc root rtd unknown /proc/73644/task/73671/root (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73671 admin_soc root txt unknown /proc/73644/task/73671/exe (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73671 admin_soc root NOFD /proc/73644/task/73671/fd (opendir: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73672 signal_ha root cwd unknown /proc/73644/task/73672/cwd (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73672 signal_ha root rtd unknown /proc/73644/task/73672/root (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73672 signal_ha root txt unknown /proc/73644/task/73672/exe (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73672 signal_ha root NOFD /proc/73644/task/73672/fd (opendir: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73673 io_contex root cwd unknown /proc/73644/task/73673/cwd (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73673 io_contex root rtd unknown /proc/73644/task/73673/root (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73673 io_contex root txt unknown /proc/73644/task/73673/exe (readlink: Permission denied) 2024-08-31T06:49:26.214 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73673 io_contex root NOFD /proc/73644/task/73673/fd (opendir: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73674 io_contex root cwd unknown /proc/73644/task/73674/cwd (readlink: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73674 io_contex root rtd unknown /proc/73644/task/73674/root (readlink: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73674 io_contex root txt unknown /proc/73644/task/73674/exe (readlink: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73674 io_contex root NOFD /proc/73644/task/73674/fd (opendir: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73675 ceph_time root cwd unknown /proc/73644/task/73675/cwd (readlink: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73675 ceph_time root rtd unknown /proc/73644/task/73675/root (readlink: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73675 ceph_time root txt unknown /proc/73644/task/73675/exe (readlink: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73675 ceph_time root NOFD /proc/73644/task/73675/fd (opendir: Permission denied) 2024-08-31T06:49:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73676 fn_anonym root cwd unknown /proc/73644/task/73676/cwd (readlink: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73676 fn_anonym root rtd unknown /proc/73644/task/73676/root (readlink: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73676 fn_anonym root txt unknown /proc/73644/task/73676/exe (readlink: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73676 fn_anonym root NOFD /proc/73644/task/73676/fd (opendir: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73677 fn_anonym root cwd unknown /proc/73644/task/73677/cwd (readlink: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73677 fn_anonym root rtd unknown /proc/73644/task/73677/root (readlink: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73677 fn_anonym root txt unknown /proc/73644/task/73677/exe (readlink: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73677 fn_anonym root NOFD /proc/73644/task/73677/fd (opendir: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73678 fn_anonym root cwd unknown /proc/73644/task/73678/cwd (readlink: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73678 fn_anonym root rtd unknown /proc/73644/task/73678/root (readlink: Permission denied) 2024-08-31T06:49:26.216 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73678 fn_anonym root txt unknown /proc/73644/task/73678/exe (readlink: Permission denied) 2024-08-31T06:49:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73678 fn_anonym root NOFD /proc/73644/task/73678/fd (opendir: Permission denied) 2024-08-31T06:49:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73679 fn_anonym root cwd unknown /proc/73644/task/73679/cwd (readlink: Permission denied) 2024-08-31T06:49:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73679 fn_anonym root rtd unknown /proc/73644/task/73679/root (readlink: Permission denied) 2024-08-31T06:49:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73679 fn_anonym root txt unknown /proc/73644/task/73679/exe (readlink: Permission denied) 2024-08-31T06:49:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73679 fn_anonym root NOFD /proc/73644/task/73679/fd (opendir: Permission denied) 2024-08-31T06:49:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73680 fn_anonym root cwd unknown /proc/73644/task/73680/cwd (readlink: Permission denied) 2024-08-31T06:49:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73680 fn_anonym root rtd unknown /proc/73644/task/73680/root (readlink: Permission denied) 2024-08-31T06:49:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73680 fn_anonym root txt unknown /proc/73644/task/73680/exe (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73680 fn_anonym root NOFD /proc/73644/task/73680/fd (opendir: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73681 safe_time root cwd unknown /proc/73644/task/73681/cwd (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73681 safe_time root rtd unknown /proc/73644/task/73681/root (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73681 safe_time root txt unknown /proc/73644/task/73681/exe (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73681 safe_time root NOFD /proc/73644/task/73681/fd (opendir: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73682 fn_anonym root cwd unknown /proc/73644/task/73682/cwd (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73682 fn_anonym root rtd unknown /proc/73644/task/73682/root (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73682 fn_anonym root txt unknown /proc/73644/task/73682/exe (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73682 fn_anonym root NOFD /proc/73644/task/73682/fd (opendir: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73683 flusher root cwd unknown /proc/73644/task/73683/cwd (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73683 flusher root rtd unknown /proc/73644/task/73683/root (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73683 flusher root txt unknown /proc/73644/task/73683/exe (readlink: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73683 flusher root NOFD /proc/73644/task/73683/fd (opendir: Permission denied) 2024-08-31T06:49:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73684 ms_dispat root cwd unknown /proc/73644/task/73684/cwd (readlink: Permission denied) 2024-08-31T06:49:26.219 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73684 ms_dispat root rtd unknown /proc/73644/task/73684/root (readlink: Permission denied) 2024-08-31T06:49:26.219 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73684 ms_dispat root txt unknown /proc/73644/task/73684/exe (readlink: Permission denied) 2024-08-31T06:49:26.219 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73684 ms_dispat root NOFD /proc/73644/task/73684/fd (opendir: Permission denied) 2024-08-31T06:49:26.219 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73685 ms_local root cwd unknown /proc/73644/task/73685/cwd (readlink: Permission denied) 2024-08-31T06:49:26.219 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73685 ms_local root rtd unknown /proc/73644/task/73685/root (readlink: Permission denied) 2024-08-31T06:49:26.219 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73685 ms_local root txt unknown /proc/73644/task/73685/exe (readlink: Permission denied) 2024-08-31T06:49:26.219 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73685 ms_local root NOFD /proc/73644/task/73685/fd (opendir: Permission denied) 2024-08-31T06:49:26.220 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73686 safe_time root cwd unknown /proc/73644/task/73686/cwd (readlink: Permission denied) 2024-08-31T06:49:26.220 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73686 safe_time root rtd unknown /proc/73644/task/73686/root (readlink: Permission denied) 2024-08-31T06:49:26.220 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73686 safe_time root txt unknown /proc/73644/task/73686/exe (readlink: Permission denied) 2024-08-31T06:49:26.220 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73686 safe_time root NOFD /proc/73644/task/73686/fd (opendir: Permission denied) 2024-08-31T06:49:26.220 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73687 ceph-fuse root cwd unknown /proc/73644/task/73687/cwd (readlink: Permission denied) 2024-08-31T06:49:26.221 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73687 ceph-fuse root rtd unknown /proc/73644/task/73687/root (readlink: Permission denied) 2024-08-31T06:49:26.221 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73687 ceph-fuse root txt unknown /proc/73644/task/73687/exe (readlink: Permission denied) 2024-08-31T06:49:26.221 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73687 ceph-fuse root NOFD /proc/73644/task/73687/fd (opendir: Permission denied) 2024-08-31T06:49:26.221 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73705 ceph-fuse root cwd unknown /proc/73644/task/73705/cwd (readlink: Permission denied) 2024-08-31T06:49:26.221 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73705 ceph-fuse root rtd unknown /proc/73644/task/73705/root (readlink: Permission denied) 2024-08-31T06:49:26.221 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73705 ceph-fuse root txt unknown /proc/73644/task/73705/exe (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73705 ceph-fuse root NOFD /proc/73644/task/73705/fd (opendir: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73707 ceph-fuse root cwd unknown /proc/73644/task/73707/cwd (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73707 ceph-fuse root rtd unknown /proc/73644/task/73707/root (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73707 ceph-fuse root txt unknown /proc/73644/task/73707/exe (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 73707 ceph-fuse root NOFD /proc/73644/task/73707/fd (opendir: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80431 ceph-fuse root cwd unknown /proc/73644/task/80431/cwd (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80431 ceph-fuse root rtd unknown /proc/73644/task/80431/root (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80431 ceph-fuse root txt unknown /proc/73644/task/80431/exe (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80431 ceph-fuse root NOFD /proc/73644/task/80431/fd (opendir: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80472 ceph-fuse root cwd unknown /proc/73644/task/80472/cwd (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80472 ceph-fuse root rtd unknown /proc/73644/task/80472/root (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80472 ceph-fuse root txt unknown /proc/73644/task/80472/exe (readlink: Permission denied) 2024-08-31T06:49:26.222 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80472 ceph-fuse root NOFD /proc/73644/task/80472/fd (opendir: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80505 ceph-fuse root cwd unknown /proc/73644/task/80505/cwd (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80505 ceph-fuse root rtd unknown /proc/73644/task/80505/root (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80505 ceph-fuse root txt unknown /proc/73644/task/80505/exe (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80505 ceph-fuse root NOFD /proc/73644/task/80505/fd (opendir: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80587 ceph-fuse root cwd unknown /proc/73644/task/80587/cwd (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80587 ceph-fuse root rtd unknown /proc/73644/task/80587/root (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80587 ceph-fuse root txt unknown /proc/73644/task/80587/exe (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80587 ceph-fuse root NOFD /proc/73644/task/80587/fd (opendir: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80639 ceph-fuse root cwd unknown /proc/73644/task/80639/cwd (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80639 ceph-fuse root rtd unknown /proc/73644/task/80639/root (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80639 ceph-fuse root txt unknown /proc/73644/task/80639/exe (readlink: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:ceph-fuse 73644 80639 ceph-fuse root NOFD /proc/73644/task/80639/fd (opendir: Permission denied) 2024-08-31T06:49:26.223 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 74282 root cwd unknown /proc/74282/cwd (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 74282 root rtd unknown /proc/74282/root (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 74282 root txt unknown /proc/74282/exe (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/7 74282 root NOFD /proc/74282/fd (opendir: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 74947 root cwd unknown /proc/74947/cwd (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 74947 root rtd unknown /proc/74947/root (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 74947 root txt unknown /proc/74947/exe (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:sudo 74947 root NOFD /proc/74947/fd (opendir: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:daemon-he 74981 root cwd unknown /proc/74981/cwd (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:daemon-he 74981 root rtd unknown /proc/74981/root (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:daemon-he 74981 root txt unknown /proc/74981/exe (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:daemon-he 74981 root NOFD /proc/74981/fd (opendir: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:bash 74994 root cwd unknown /proc/74994/cwd (readlink: Permission denied) 2024-08-31T06:49:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:bash 74994 root rtd unknown /proc/74994/root (readlink: Permission denied) 2024-08-31T06:49:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:bash 74994 root txt unknown /proc/74994/exe (readlink: Permission denied) 2024-08-31T06:49:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:bash 74994 root NOFD /proc/74994/fd (opendir: Permission denied) 2024-08-31T06:49:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 76941 root cwd unknown /proc/76941/cwd (readlink: Permission denied) 2024-08-31T06:49:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 76941 root rtd unknown /proc/76941/root (readlink: Permission denied) 2024-08-31T06:49:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 76941 root txt unknown /proc/76941/exe (readlink: Permission denied) 2024-08-31T06:49:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 76941 root NOFD /proc/76941/fd (opendir: Permission denied) 2024-08-31T06:49:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 78087 root cwd unknown /proc/78087/cwd (readlink: Permission denied) 2024-08-31T06:49:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 78087 root rtd unknown /proc/78087/root (readlink: Permission denied) 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 78087 root txt unknown /proc/78087/exe (readlink: Permission denied) 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/3 78087 root NOFD /proc/78087/fd (opendir: Permission denied) 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 78285 root cwd unknown /proc/78285/cwd (readlink: Permission denied) 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 78285 root rtd unknown /proc/78285/root (readlink: Permission denied) 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 78285 root txt unknown /proc/78285/exe (readlink: Permission denied) 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/2 78285 root NOFD /proc/78285/fd (opendir: Permission denied) 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu cwd DIR 0,121 194241656 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu rtd DIR 8,1 4096 2 / 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-08-31T06:49:26.226 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu 0r FIFO 0,13 0t0 192430 pipe 2024-08-31T06:49:26.227 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu 1w FIFO 0,13 0t0 192431 pipe 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:timeout 79140 ubuntu 2w FIFO 0,13 0t0 192432 pipe 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu cwd DIR 0,121 194241656 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu rtd DIR 8,1 4096 2 / 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-08-31T06:49:26.228 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu 0r FIFO 0,13 0t0 192430 pipe 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu 1w FIFO 0,13 0t0 192431 pipe 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu 2w FIFO 0,13 0t0 192432 pipe 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:fsync-tes 80433 ubuntu 255r REG 8,1 207 524492 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 81217 root cwd unknown /proc/81217/cwd (readlink: Permission denied) 2024-08-31T06:49:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 81217 root rtd unknown /proc/81217/root (readlink: Permission denied) 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 81217 root txt unknown /proc/81217/exe (readlink: Permission denied) 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:kworker/4 81217 root NOFD /proc/81217/fd (opendir: Permission denied) 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:sleep 81778 root cwd unknown /proc/81778/cwd (readlink: Permission denied) 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:sleep 81778 root rtd unknown /proc/81778/root (readlink: Permission denied) 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:sleep 81778 root txt unknown /proc/81778/exe (readlink: Permission denied) 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:sleep 81778 root NOFD /proc/81778/fd (opendir: Permission denied) 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu cwd DIR 0,121 194241656 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu rtd DIR 8,1 4096 2 / 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 5436040 11595 /usr/lib64/libcrypto.so.3.2.2 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-08-31T06:49:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu 0r FIFO 0,13 0t0 192430 pipe 2024-08-31T06:49:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu 1w FIFO 0,13 0t0 192431 pipe 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu 2w FIFO 0,13 0t0 192432 pipe 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu 3r DIR 0,20 0 1 /proc 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu 4r DIR 0,20 0 199654 /proc/81780/fd 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu 5w FIFO 0,13 0t0 199659 pipe 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81780 ubuntu 6r FIFO 0,13 0t0 199660 pipe 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu cwd DIR 0,121 194241656 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu rtd DIR 8,1 4096 2 / 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 5436040 11595 /usr/lib64/libcrypto.so.3.2.2 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-08-31T06:49:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu 4r FIFO 0,13 0t0 199659 pipe 2024-08-31T06:49:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:lsof 81781 ubuntu 7w FIFO 0,13 0t0 199660 pipe 2024-08-31T06:49:26.234 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-31T06:49:26.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-31T06:49:26.235 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:25 smithi037 ceph-mon[18612]: pgmap v397: 97 pgs: 97 active+clean; 447 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.67k op/s 2024-08-31T06:49:26.235 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:25 smithi066 ceph-mon[22244]: pgmap v397: 97 pgs: 97 active+clean; 447 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.67k op/s 2024-08-31T06:49:26.304 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-08-31T06:49:26.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-31T06:49:26.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:25 smithi106 ceph-mon[22134]: pgmap v397: 97 pgs: 97 active+clean; 447 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 3.67k op/s 2024-08-31T06:49:26.594 DEBUG:teuthology.parallel:result is None 2024-08-31T06:49:26.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-31T06:49:26.630 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-31T06:49:26.630 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-31T06:49:26.644 INFO:tasks.quiescer:joining Quiescers 2024-08-31T06:49:26.644 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-31T06:49:26.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:49:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 -- 172.21.15.37:0/3938926295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db80754d0 msgr2=0x7f9db80758e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/3938926295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db80754d0 0x7f9db80758e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009900 tx=0x7f9dac02a410 comp rx=0 tx=0).stop 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 -- 172.21.15.37:0/3938926295 shutdown_connections 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/3938926295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9db810fee0 0x7f9db8112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/3938926295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9db8075e20 0x7f9db810f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/3938926295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db80754d0 0x7f9db80758e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 -- 172.21.15.37:0/3938926295 >> 172.21.15.37:0/3938926295 conn(0x7f9db807b5f0 msgr2=0x7f9db807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 -- 172.21.15.37:0/3938926295 shutdown_connections 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.486+0000 7f9dbebe5640 1 -- 172.21.15.37:0/3938926295 wait complete. 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbebe5640 1 Processor -- start 2024-08-31T06:49:27.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbebe5640 1 -- start start 2024-08-31T06:49:27.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbebe5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9db80754d0 0x7f9db819c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:27.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbebe5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9db8075e20 0x7f9db819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:27.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbebe5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db810fee0 0x7f9db81a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbebe5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81158f0 con 0x7f9db810fee0 2024-08-31T06:49:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbebe5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8115770 con 0x7f9db8075e20 2024-08-31T06:49:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbebe5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8115a70 con 0x7f9db80754d0 2024-08-31T06:49:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbd182640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db810fee0 0x7f9db81a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbd182640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db810fee0 0x7f9db81a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41804/0 (socket says 172.21.15.37:41804) 2024-08-31T06:49:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbd182640 1 -- 172.21.15.37:0/2509763347 learned_addr learned my addr 172.21.15.37:0/2509763347 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9dbc981640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9db80754d0 0x7f9db819c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.487+0000 7f9db7fff640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9db8075e20 0x7f9db819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9dbd182640 1 -- 172.21.15.37:0/2509763347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9db80754d0 msgr2=0x7f9db819c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9dbd182640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9db80754d0 0x7f9db819c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9dbd182640 1 -- 172.21.15.37:0/2509763347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9db8075e20 msgr2=0x7f9db819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9dbd182640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9db8075e20 0x7f9db819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9dbd182640 1 -- 172.21.15.37:0/2509763347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db81a2370 con 0x7f9db810fee0 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9dbd182640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db810fee0 0x7f9db81a1c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9db000eb10 tx=0x7f9db000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9db5ffb640 1 -- 172.21.15.37:0/2509763347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0004b20 con 0x7f9db810fee0 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9db5ffb640 1 -- 172.21.15.37:0/2509763347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db0004cc0 con 0x7f9db810fee0 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9db5ffb640 1 -- 172.21.15.37:0/2509763347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0010690 con 0x7f9db810fee0 2024-08-31T06:49:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db81a2660 con 0x7f9db810fee0 2024-08-31T06:49:27.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.488+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db81a8dc0 con 0x7f9db810fee0 2024-08-31T06:49:27.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.489+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db80758e0 con 0x7f9db810fee0 2024-08-31T06:49:27.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.491+0000 7f9db5ffb640 1 -- 172.21.15.37:0/2509763347 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f9db0005000 con 0x7f9db810fee0 2024-08-31T06:49:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.492+0000 7f9db5ffb640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9da80b4d20 0x7f9da80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.492+0000 7f9dbc981640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9da80b4d20 0x7f9da80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.492+0000 7f9db5ffb640 1 -- 172.21.15.37:0/2509763347 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9db00e5cc0 con 0x7f9db810fee0 2024-08-31T06:49:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.492+0000 7f9dbc981640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9da80b4d20 0x7f9da80b7230 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0057c0 tx=0x7f9dac0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:27.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.495+0000 7f9db5ffb640 1 -- 172.21.15.37:0/2509763347 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9db0056130 con 0x7f9db810fee0 2024-08-31T06:49:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.721+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9db819d530 con 0x7f9db810fee0 2024-08-31T06:49:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.721+0000 7f9db5ffb640 1 -- 172.21.15.37:0/2509763347 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f9db819d530 con 0x7f9db810fee0 2024-08-31T06:49:27.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:49:27.723 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:49:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:49:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9da80b4d20 msgr2=0x7f9da80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9da80b4d20 0x7f9da80b7230 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9dac0057c0 tx=0x7f9dac0058d0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db810fee0 msgr2=0x7f9db81a1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db810fee0 0x7f9db81a1c40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9db000eb10 tx=0x7f9db000c2d0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 shutdown_connections 2024-08-31T06:49:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9da80b4d20 0x7f9da80b7230 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9db810fee0 0x7f9db81a1c40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9db8075e20 0x7f9db819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 --2- 172.21.15.37:0/2509763347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9db80754d0 0x7f9db819c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 >> 172.21.15.37:0/2509763347 conn(0x7f9db807b5f0 msgr2=0x7f9db81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 shutdown_connections 2024-08-31T06:49:27.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:27.724+0000 7f9dbebe5640 1 -- 172.21.15.37:0/2509763347 wait complete. 2024-08-31T06:49:28.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:27 smithi037 ceph-mon[18612]: pgmap v398: 97 pgs: 97 active+clean; 458 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 4.11k op/s 2024-08-31T06:49:28.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:27 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2509763347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:49:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:27 smithi066 ceph-mon[22244]: pgmap v398: 97 pgs: 97 active+clean; 458 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 4.11k op/s 2024-08-31T06:49:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:27 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2509763347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:49:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:27 smithi106 ceph-mon[22134]: pgmap v398: 97 pgs: 97 active+clean; 458 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 18 MiB/s wr, 4.11k op/s 2024-08-31T06:49:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:27 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2509763347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:49:28.794 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --cancel --all' 2024-08-31T06:49:28.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --cancel --all 2024-08-31T06:49:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:29.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 -- 172.21.15.37:0/30197418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 msgr2=0x7ffa3010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 --2- 172.21.15.37:0/30197418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 0x7ffa3010f2e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009ca0 tx=0x7ffa2802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 -- 172.21.15.37:0/30197418 shutdown_connections 2024-08-31T06:49:29.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 --2- 172.21.15.37:0/30197418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 0x7ffa3010f2e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 --2- 172.21.15.37:0/30197418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa30108160 0x7ffa30108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 --2- 172.21.15.37:0/30197418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30102820 0x7ffa30102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 -- 172.21.15.37:0/30197418 >> 172.21.15.37:0/30197418 conn(0x7ffa300794e0 msgr2=0x7ffa300798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:29.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 -- 172.21.15.37:0/30197418 shutdown_connections 2024-08-31T06:49:29.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.575+0000 7ffa3746d640 1 -- 172.21.15.37:0/30197418 wait complete. 2024-08-31T06:49:29.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa3746d640 1 Processor -- start 2024-08-31T06:49:29.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa3746d640 1 -- start start 2024-08-31T06:49:29.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa3746d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa30102820 0x7ffa3006b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa3746d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30108160 0x7ffa3006be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa3746d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 0x7ffa3019c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa3746d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa30112630 con 0x7ffa30108ab0 2024-08-31T06:49:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa3746d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301124b0 con 0x7ffa30102820 2024-08-31T06:49:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa3746d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301127b0 con 0x7ffa30108160 2024-08-31T06:49:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa34a08640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30108160 0x7ffa3006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa35a0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 0x7ffa3019c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa35209640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa30102820 0x7ffa3006b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa34a08640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30108160 0x7ffa3006be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:37150/0 (socket says 172.21.15.37:37150) 2024-08-31T06:49:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa35a0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 0x7ffa3019c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41810/0 (socket says 172.21.15.37:41810) 2024-08-31T06:49:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.576+0000 7ffa34a08640 1 -- 172.21.15.37:0/2006778186 learned_addr learned my addr 172.21.15.37:0/2006778186 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa35209640 1 -- 172.21.15.37:0/2006778186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30108160 msgr2=0x7ffa3006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa35209640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30108160 0x7ffa3006be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa35209640 1 -- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 msgr2=0x7ffa3019c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa35209640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 0x7ffa3019c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa35209640 1 -- 172.21.15.37:0/2006778186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3019ce10 con 0x7ffa30102820 2024-08-31T06:49:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa34a08640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30108160 0x7ffa3006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa35209640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa30102820 0x7ffa3006b870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00e9f0 tx=0x7ffa2c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa267fc640 1 -- 172.21.15.37:0/2006778186 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00ccc0 con 0x7ffa30102820 2024-08-31T06:49:29.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa267fc640 1 -- 172.21.15.37:0/2006778186 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa2c005020 con 0x7ffa30102820 2024-08-31T06:49:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa3746d640 1 -- 172.21.15.37:0/2006778186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3019d100 con 0x7ffa30102820 2024-08-31T06:49:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa267fc640 1 -- 172.21.15.37:0/2006778186 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00ce60 con 0x7ffa30102820 2024-08-31T06:49:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.577+0000 7ffa3746d640 1 -- 172.21.15.37:0/2006778186 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa301a6aa0 con 0x7ffa30102820 2024-08-31T06:49:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.580+0000 7ffa267fc640 1 -- 172.21.15.37:0/2006778186 <== mon.2 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7ffa2c004a40 con 0x7ffa30102820 2024-08-31T06:49:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.580+0000 7ffa3d9e2740 1 Processor -- start 2024-08-31T06:49:29.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.580+0000 7ffa3d9e2740 1 -- start start 2024-08-31T06:49:29.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a0ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b001640410 0x55b001a0f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a0f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b001985610 con 0x55b0016692d0 2024-08-31T06:49:29.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b001974ba0 con 0x55b0016485f0 2024-08-31T06:49:29.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b001978b50 con 0x55b001640410 2024-08-31T06:49:29.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a0ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a0ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41818/0 (socket says 172.21.15.37:41818) 2024-08-31T06:49:29.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35209640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b001640410 0x55b001a0f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 -- 172.21.15.37:0/3354555775 learned_addr learned my addr 172.21.15.37:0/3354555775 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:29.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa267fc640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa1c0b4ca0 0x7ffa1c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa34a08640 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a0f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 -- 172.21.15.37:0/3354555775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b001640410 msgr2=0x55b001a0f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b001640410 0x55b001a0f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 -- 172.21.15.37:0/3354555775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 msgr2=0x55b001a0f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a0f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 -- 172.21.15.37:0/3354555775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0016d48b0 con 0x55b0016692d0 2024-08-31T06:49:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35209640 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b001640410 0x55b001a0f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa34a08640 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a0f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa267fc640 1 -- 172.21.15.37:0/2006778186 <== mon.2 v2:172.21.15.66:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ffa2c0e54a0 con 0x7ffa30102820 2024-08-31T06:49:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.581+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa1c0b4ca0 0x7ffa1c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.582+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a0ed00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009ca0 tx=0x7ffa28031450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ead0dce6c5495f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:29.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.582+0000 7ffa1b7fe640 1 -- 172.21.15.37:0/3354555775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa28042040 con 0x55b0016692d0 2024-08-31T06:49:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.582+0000 7ffa1b7fe640 1 -- 172.21.15.37:0/3354555775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa28036070 con 0x55b0016692d0 2024-08-31T06:49:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.582+0000 7ffa1b7fe640 1 -- 172.21.15.37:0/3354555775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa280305c0 con 0x55b0016692d0 2024-08-31T06:49:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.582+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa1c0b4ca0 0x7ffa1c0b71b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffa2804d000 tx=0x7ffa2804e000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/3354555775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 msgr2=0x55b001a0ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a0ed00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009ca0 tx=0x7ffa28031450 comp rx=0 tx=0).stop 2024-08-31T06:49:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/3354555775 shutdown_connections 2024-08-31T06:49:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a0f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b001640410 0x55b001a0f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/3354555775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a0ed00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/3354555775 >> 172.21.15.37:0/3354555775 conn(0x55b00165d6c0 msgr2=0x55b001a0cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/3354555775 shutdown_connections 2024-08-31T06:49:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/3354555775 wait complete. 2024-08-31T06:49:29.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 -- start start 2024-08-31T06:49:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.583+0000 7ffa3d9e2740 1 Processor -- start 2024-08-31T06:49:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b001640410 0x55b001a1a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a1ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b0017d7810 con 0x55b001640410 2024-08-31T06:49:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b0018fb960 con 0x55b0016485f0 2024-08-31T06:49:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b001a1d4e0 con 0x55b0016692d0 2024-08-31T06:49:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa3d9e2740 10 client.0 _ll_register_callbacks cb 0x55b001680b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b001640410 0x55b001a1a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b001640410 0x55b001a1a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41822/0 (socket says 172.21.15.37:41822) 2024-08-31T06:49:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 -- 172.21.15.37:0/1886405146 learned_addr learned my addr 172.21.15.37:0/1886405146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a1ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 -- 172.21.15.37:0/1886405146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 msgr2=0x55b001a267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a267d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 -- 172.21.15.37:0/1886405146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 msgr2=0x55b001a1ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a1ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 -- 172.21.15.37:0/1886405146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b001a26de0 con 0x55b001640410 2024-08-31T06:49:29.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:29.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa35209640 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b001640410 0x55b001a1a8f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0abb60 tx=0x7ffa2c0ab5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab4927ddf2ca5b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:29.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.584+0000 7ffa18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:29.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.585+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1886405146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c01c070 con 0x55b001640410 2024-08-31T06:49:29.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.585+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1886405146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ffa2c0a7e60 con 0x55b001640410 2024-08-31T06:49:29.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.585+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1886405146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa28036070 con 0x55b001640410 2024-08-31T06:49:29.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.585+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1886405146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa2c0e8e40 con 0x55b001640410 2024-08-31T06:49:29.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.585+0000 7ffa3d9e2740 10 client.16278 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:29.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.585+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1886405146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b001a29710 con 0x55b001640410 2024-08-31T06:49:29.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1886405146 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa28036070 con 0x55b001640410 2024-08-31T06:49:29.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1886405146 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa2c0a7040 con 0x55b001640410 2024-08-31T06:49:29.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa3d9e2740 10 client.16278 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:29.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa3d9e2740 10 client.16278 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:49:29.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa3d9e2740 20 client.16278 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:29.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b001627c50 0x55b001a2cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa3d9e2740 4 client.16278 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1886405146 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b001987560 con 0x55b001627c50 2024-08-31T06:49:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.586+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b001627c50 0x55b001a2cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.587+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b001627c50 0x55b001a2cbf0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1191ba2aa666740 server_cookie=93141dfbcf2b0141 in_seq=0 out_seq=0 2024-08-31T06:49:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.587+0000 7ffa18ff9640 10 client.16278 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.587+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1886405146 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b001987560 con 0x55b001627c50 2024-08-31T06:49:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.587+0000 7ffa18ff9640 10 client.16278 handle_command_reply: tid=0 2024-08-31T06:49:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.587+0000 7ffa3d9e2740 1 client.16278 shutdown 2024-08-31T06:49:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.587+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1886405146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b001640410 msgr2=0x55b001a1a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.587+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b001640410 0x55b001a1a8f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0abb60 tx=0x7ffa2c0ab5e0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1886405146 shutdown_connections 2024-08-31T06:49:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b001627c50 0x55b001a2cbf0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b0016485f0 0x55b001a1ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1886405146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b001640410 0x55b001a1a8f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa18ff9640 0 client.16278 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1886405146 >> 172.21.15.37:0/1886405146 conn(0x55b00165d6c0 msgr2=0x55b001a11ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1886405146 shutdown_connections 2024-08-31T06:49:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1886405146 wait complete. 2024-08-31T06:49:29.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.588+0000 7ffa3d9e2740 20 client.16278 trim_cache size 0 max 16384 2024-08-31T06:49:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.605+0000 7ffa3d9e2740 1 Processor -- start 2024-08-31T06:49:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.605+0000 7ffa3d9e2740 1 -- start start 2024-08-31T06:49:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.605+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a19e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.605+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016485f0 0x55b001a10440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.605+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a13f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301b1bb0 con 0x55b0016485f0 2024-08-31T06:49:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301af480 con 0x55b001640410 2024-08-31T06:49:29.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ad2d0 con 0x55b0016692d0 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016485f0 0x55b001a10440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016485f0 0x55b001a10440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41836/0 (socket says 172.21.15.37:41836) 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 -- 172.21.15.37:0/1240484215 learned_addr learned my addr 172.21.15.37:0/1240484215 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a13f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa35209640 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a19e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 -- 172.21.15.37:0/1240484215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 msgr2=0x55b001a13f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a13f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 -- 172.21.15.37:0/1240484215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 msgr2=0x55b001a19e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a19e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 -- 172.21.15.37:0/1240484215 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b001a1cf70 con 0x55b0016485f0 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa35209640 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a19e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa35a0a640 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a13f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016485f0 0x55b001a10440 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ffa20004700 tx=0x7ffa20012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7735f26e10a82052 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:29.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.606+0000 7ffa1affd640 1 -- 172.21.15.37:0/1240484215 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20004230 con 0x55b0016485f0 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa1affd640 1 -- 172.21.15.37:0/1240484215 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa200043d0 con 0x55b0016485f0 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa1affd640 1 -- 172.21.15.37:0/1240484215 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20003d10 con 0x55b0016485f0 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1240484215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016485f0 msgr2=0x55b001a10440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016485f0 0x55b001a10440 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ffa20004700 tx=0x7ffa20012b80 comp rx=0 tx=0).stop 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1240484215 shutdown_connections 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016485f0 0x55b001a10440 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016692d0 0x55b001a13f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1240484215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a19e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1240484215 >> 172.21.15.37:0/1240484215 conn(0x55b00165d6c0 msgr2=0x55b001a0fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1240484215 shutdown_connections 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.607+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1240484215 wait complete. 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 1 -- start start 2024-08-31T06:49:29.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 1 Processor -- start 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a22960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016485f0 0x55b001a22f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a1d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ad940 con 0x55b0016692d0 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301aedb0 con 0x55b001640410 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa301ae010 con 0x55b0016485f0 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.608+0000 7ffa3d9e2740 10 client.0 _ll_register_callbacks cb 0x7ffa2c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35a0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a1d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35209640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a22960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35a0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a1d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41846/0 (socket says 172.21.15.37:41846) 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35a0a640 1 -- 172.21.15.37:0/1425264755 learned_addr learned my addr 172.21.15.37:0/1425264755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35209640 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a22960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:51702/0 (socket says 172.21.15.37:51702) 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016485f0 0x55b001a22f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35209640 1 -- 172.21.15.37:0/1425264755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016485f0 msgr2=0x55b001a22f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35209640 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016485f0 0x55b001a22f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35209640 1 -- 172.21.15.37:0/1425264755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 msgr2=0x55b001a1d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35209640 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a1d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35209640 1 -- 172.21.15.37:0/1425264755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b001a1de30 con 0x55b001640410 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa35209640 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a22960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0e2ce0 tx=0x7ffa2c0e5430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b527740f0dce0058 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1425264755 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c01c040 con 0x55b001640410 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1425264755 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ffa2c0b4a60 con 0x55b001640410 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.609+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1425264755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa200043d0 con 0x55b001640410 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1425264755 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa2c0ab6e0 con 0x55b001640410 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa3d9e2740 10 client.25778 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1425264755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b001a97fe0 con 0x55b001640410 2024-08-31T06:49:29.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1425264755 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa200043d0 con 0x55b001640410 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1425264755 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa2c0a7540 con 0x55b001640410 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa3d9e2740 10 client.25778 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa3d9e2740 10 client.25778 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa3d9e2740 20 client.25778 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b0015fd000 0x55b001a9a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa3d9e2740 4 client.25778 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1425264755 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55b001983000 con 0x55b0015fd000 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.610+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b0015fd000 0x55b001a9a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa34a08640 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b0015fd000 0x55b001a9a7a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0296583fb08895 server_cookie=a0fbbb6e59b02a1d in_seq=0 out_seq=0 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa18ff9640 10 client.25778 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa18ff9640 1 -- 172.21.15.37:0/1425264755 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x55b001983000 con 0x55b0015fd000 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa18ff9640 10 client.25778 handle_command_reply: tid=0 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 client.25778 shutdown 2024-08-31T06:49:29.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 msgr2=0x55b001a22960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a22960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0e2ce0 tx=0x7ffa2c0e5430 comp rx=0 tx=0).stop 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1425264755 shutdown_connections 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b0015fd000 0x55b001a9a7a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b0016692d0 0x55b001a1d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b0016485f0 0x55b001a22f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa18ff9640 0 client.25778 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 --2- 172.21.15.37:0/1425264755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b001640410 0x55b001a22960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1425264755 >> 172.21.15.37:0/1425264755 conn(0x55b00165d6c0 msgr2=0x55b001a10620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1425264755 shutdown_connections 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 1 -- 172.21.15.37:0/1425264755 wait complete. 2024-08-31T06:49:29.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.611+0000 7ffa3d9e2740 20 client.25778 trim_cache size 0 max 16384 2024-08-31T06:49:29.625 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:49:29.625 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 25, 2024-08-31T06:49:29.625 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-31T06:49:29.625 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 8, 2024-08-31T06:49:29.625 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": {} 2024-08-31T06:49:29.625 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 -- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa1c0b4ca0 msgr2=0x7ffa1c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa1c0b4ca0 0x7ffa1c0b71b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffa2804d000 tx=0x7ffa2804e000 comp rx=0 tx=0).stop 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 -- 172.21.15.37:0/2006778186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa30102820 msgr2=0x7ffa3006b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa30102820 0x7ffa3006b870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00e9f0 tx=0x7ffa2c00eeb0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 -- 172.21.15.37:0/2006778186 shutdown_connections 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa1c0b4ca0 0x7ffa1c0b71b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa30108ab0 0x7ffa3019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa30108160 0x7ffa3006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 --2- 172.21.15.37:0/2006778186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa30102820 0x7ffa3006b870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 -- 172.21.15.37:0/2006778186 >> 172.21.15.37:0/2006778186 conn(0x7ffa300794e0 msgr2=0x7ffa30104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 -- 172.21.15.37:0/2006778186 shutdown_connections 2024-08-31T06:49:29.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:29.612+0000 7ffa3746d640 1 -- 172.21.15.37:0/2006778186 wait complete. 2024-08-31T06:49:30.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:29 smithi037 ceph-mon[18612]: pgmap v399: 97 pgs: 97 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 3.61k op/s 2024-08-31T06:49:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:29 smithi066 ceph-mon[22244]: pgmap v399: 97 pgs: 97 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 3.61k op/s 2024-08-31T06:49:30.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:29 smithi106 ceph-mon[22134]: pgmap v399: 97 pgs: 97 active+clean; 462 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 3.61k op/s 2024-08-31T06:49:30.365 INFO:tasks.quiescer:done joining Quiescers 2024-08-31T06:49:30.365 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-31T06:49:30.378 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:49:30.386 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-08-31T06:49:30.397 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-08-31T06:49:30.397 INFO:teuthology.task.exec:Executing custom commands... 2024-08-31T06:49:30.398 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:49:30.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-08-31T06:49:30.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-08-31T06:49:32.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:31 smithi037 ceph-mon[18612]: pgmap v400: 97 pgs: 97 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.45k op/s 2024-08-31T06:49:32.116 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:31 smithi106 ceph-mon[22134]: pgmap v400: 97 pgs: 97 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.45k op/s 2024-08-31T06:49:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:31 smithi066 ceph-mon[22244]: pgmap v400: 97 pgs: 97 active+clean; 449 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 3.45k op/s 2024-08-31T06:49:32.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:49:33.065 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:33.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 -- 172.21.15.37:0/2527291905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 msgr2=0x7fb568108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/2527291905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 0x7fb568108550 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb558009900 tx=0x7fb55802a410 comp rx=0 tx=0).stop 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 -- 172.21.15.37:0/2527291905 shutdown_connections 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/2527291905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 0x7fb568108550 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/2527291905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb568108a90 0x7fb56810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/2527291905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb568102800 0x7fb568102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 -- 172.21.15.37:0/2527291905 >> 172.21.15.37:0/2527291905 conn(0x7fb5680794d0 msgr2=0x7fb5680798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 -- 172.21.15.37:0/2527291905 shutdown_connections 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 -- 172.21.15.37:0/2527291905 wait complete. 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.579+0000 7fb56f3a6640 1 Processor -- start 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56f3a6640 1 -- start start 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56f3a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb568102800 0x7fb5681991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56f3a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 0x7fb568199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56f3a6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb568108a90 0x7fb56819e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56f3a6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112590 con 0x7fb568108140 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56f3a6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112410 con 0x7fb568102800 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56f3a6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112710 con 0x7fb568108a90 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56c941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 0x7fb568199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56c941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 0x7fb568199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41862/0 (socket says 172.21.15.37:41862) 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56c941640 1 -- 172.21.15.37:0/1389880757 learned_addr learned my addr 172.21.15.37:0/1389880757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56d142640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb568102800 0x7fb5681991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56d943640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb568108a90 0x7fb56819e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56d943640 1 -- 172.21.15.37:0/1389880757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb568102800 msgr2=0x7fb5681991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56d943640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb568102800 0x7fb5681991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56d943640 1 -- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 msgr2=0x7fb568199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56d943640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 0x7fb568199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56d943640 1 -- 172.21.15.37:0/1389880757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56819f110 con 0x7fb568108a90 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56d142640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb568102800 0x7fb5681991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.580+0000 7fb56c941640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 0x7fb568199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.581+0000 7fb56d943640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb568108a90 0x7fb56819e9e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb560009fd0 tx=0x7fb56000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.581+0000 7fb55e7fc640 1 -- 172.21.15.37:0/1389880757 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56000ce20 con 0x7fb568108a90 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.581+0000 7fb56f3a6640 1 -- 172.21.15.37:0/1389880757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56819f400 con 0x7fb568108a90 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.581+0000 7fb55e7fc640 1 -- 172.21.15.37:0/1389880757 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb560005020 con 0x7fb568108a90 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.581+0000 7fb55e7fc640 1 -- 172.21.15.37:0/1389880757 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb560010690 con 0x7fb568108a90 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.581+0000 7fb56f3a6640 1 -- 172.21.15.37:0/1389880757 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56806ac00 con 0x7fb568108a90 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.583+0000 7fb57591b740 1 Processor -- start 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb55e7fc640 1 -- 172.21.15.37:0/1389880757 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fb560004a40 con 0x7fb568108a90 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb57591b740 1 -- start start 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb57591b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7a9070 0x55771fb4e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb57591b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb57591b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f788390 0x55771fb4ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb57591b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55771fac5630 con 0x55771f7801b0 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb57591b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55771fab4bc0 con 0x55771f7a9070 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb57591b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55771fab8b70 con 0x55771f788390 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb56d142640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb56c941640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7a9070 0x55771fb4e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb56d142640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41878/0 (socket says 172.21.15.37:41878) 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb56d142640 1 -- 172.21.15.37:0/718164526 learned_addr learned my addr 172.21.15.37:0/718164526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.584+0000 7fb56c941640 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f788390 0x55771fb4ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb56d142640 1 -- 172.21.15.37:0/718164526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f788390 msgr2=0x55771fb4ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb56d142640 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f788390 0x55771fb4ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb56d142640 1 -- 172.21.15.37:0/718164526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7a9070 msgr2=0x55771fb4e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb56d142640 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7a9070 0x55771fb4e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb56d142640 1 -- 172.21.15.37:0/718164526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55771f814650 con 0x55771f7801b0 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb56c941640 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7a9070 0x55771fb4e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb55e7fc640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5540b4ca0 0x7fb5540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb56c941640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5540b4ca0 0x7fb5540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb56d142640 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4e840 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb5640104d0 tx=0x7fb564010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334c3291d1e80c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb55e7fc640 1 -- 172.21.15.37:0/1389880757 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb5600e5b00 con 0x7fb568108a90 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb5537fe640 1 -- 172.21.15.37:0/718164526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb564004220 con 0x55771f7801b0 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb5537fe640 1 -- 172.21.15.37:0/718164526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5640043c0 con 0x55771f7801b0 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.585+0000 7fb5537fe640 1 -- 172.21.15.37:0/718164526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb564011940 con 0x55771f7801b0 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 -- 172.21.15.37:0/718164526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 msgr2=0x55771fb4e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4e840 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb5640104d0 tx=0x7fb564010990 comp rx=0 tx=0).stop 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb56c941640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5540b4ca0 0x7fb5540b71b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb568107810 tx=0x7fb55803a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 -- 172.21.15.37:0/718164526 shutdown_connections 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4e840 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f788390 0x55771fb4ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 --2- 172.21.15.37:0/718164526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7a9070 0x55771fb4e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 -- 172.21.15.37:0/718164526 >> 172.21.15.37:0/718164526 conn(0x55771f79d460 msgr2=0x55771fb4c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 -- 172.21.15.37:0/718164526 shutdown_connections 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 -- 172.21.15.37:0/718164526 wait complete. 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.586+0000 7fb57591b740 1 -- start start 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb57591b740 1 Processor -- start 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb57591b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7801b0 0x55771fb59a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb57591b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb59f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb57591b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7a9070 0x55771fb65dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb57591b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55771f917700 con 0x55771f788390 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb57591b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55771fa3b700 con 0x55771f7801b0 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb57591b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55771fb5cae0 con 0x55771f7a9070 2024-08-31T06:49:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb57591b740 10 client.0 _ll_register_callbacks cb 0x55771fa6adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56c941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb59f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56c941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb59f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41880/0 (socket says 172.21.15.37:41880) 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56c941640 1 -- 172.21.15.37:0/3223845607 learned_addr learned my addr 172.21.15.37:0/3223845607 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56d142640 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7801b0 0x55771fb59a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56d943640 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7a9070 0x55771fb65dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56c941640 1 -- 172.21.15.37:0/3223845607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7a9070 msgr2=0x55771fb65dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56c941640 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7a9070 0x55771fb65dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56c941640 1 -- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7801b0 msgr2=0x55771fb59a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56c941640 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7801b0 0x55771fb59a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56c941640 1 -- 172.21.15.37:0/3223845607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55771fa748b0 con 0x55771f788390 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.587+0000 7fb56d142640 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7801b0 0x55771fb59a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb56c941640 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb59f80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb558006010 tx=0x7fb55802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99605d3625903e20 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb550ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb550ff9640 1 -- 172.21.15.37:0/3223845607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558035040 con 0x55771f788390 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb550ff9640 1 -- 172.21.15.37:0/3223845607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb558041070 con 0x55771f788390 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb57591b740 1 -- 172.21.15.37:0/3223845607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5640043c0 con 0x55771f788390 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb550ff9640 1 -- 172.21.15.37:0/3223845607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5580038c0 con 0x55771f788390 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb57591b740 10 client.16296 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb57591b740 1 -- 172.21.15.37:0/3223845607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55771fb68850 con 0x55771f788390 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb550ff9640 1 -- 172.21.15.37:0/3223845607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5640043c0 con 0x55771f788390 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.588+0000 7fb550ff9640 1 -- 172.21.15.37:0/3223845607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb558047040 con 0x55771f788390 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb57591b740 10 client.16296 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb57591b740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb57591b740 20 client.16296 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb57591b740 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55771f7679f0 0x55771fb6be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb57591b740 4 client.16296 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb57591b740 1 -- 172.21.15.37:0/3223845607 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55771fac7580 con 0x55771f7679f0 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb56d142640 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55771f7679f0 0x55771fb6be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb550ff9640 10 client.16296 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.589+0000 7fb56d142640 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55771f7679f0 0x55771fb6be00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b6964be5b04f856 server_cookie=b169f09cfec2a78e in_seq=0 out_seq=0 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb550ff9640 1 -- 172.21.15.37:0/3223845607 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55771fac7580 con 0x55771f7679f0 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb550ff9640 10 client.16296 handle_command_reply: tid=0 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 client.16296 shutdown 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 -- 172.21.15.37:0/3223845607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 msgr2=0x55771fb59f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb59f80 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb558006010 tx=0x7fb55802a410 comp rx=0 tx=0).stop 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 -- 172.21.15.37:0/3223845607 shutdown_connections 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55771f7679f0 0x55771fb6be00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb59f80 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb550ff9640 0 client.16296 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7a9070 0x55771fb65dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 --2- 172.21.15.37:0/3223845607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7801b0 0x55771fb59a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 -- 172.21.15.37:0/3223845607 >> 172.21.15.37:0/3223845607 conn(0x55771f79d460 msgr2=0x55771fb514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 -- 172.21.15.37:0/3223845607 shutdown_connections 2024-08-31T06:49:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 1 -- 172.21.15.37:0/3223845607 wait complete. 2024-08-31T06:49:33.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.590+0000 7fb57591b740 20 client.16296 trim_cache size 0 max 16384 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.608+0000 7fb57591b740 1 Processor -- start 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.608+0000 7fb57591b740 1 -- start start 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb57591b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7679f0 0x55771fb5b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb57591b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb57591b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f788390 0x55771fb65cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb57591b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681afaa0 con 0x55771f7801b0 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb57591b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681ad370 con 0x55771f788390 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb57591b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681ab1c0 con 0x55771f7679f0 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41896/0 (socket says 172.21.15.37:41896) 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 -- 172.21.15.37:0/2304393463 learned_addr learned my addr 172.21.15.37:0/2304393463 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56d142640 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7679f0 0x55771fb5b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56d943640 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f788390 0x55771fb65cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 -- 172.21.15.37:0/2304393463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7679f0 msgr2=0x55771fb5b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7679f0 0x55771fb5b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 -- 172.21.15.37:0/2304393463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f788390 msgr2=0x55771fb65cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f788390 0x55771fb65cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 -- 172.21.15.37:0/2304393463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55771fb5ad00 con 0x55771f7801b0 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56d142640 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7679f0 0x55771fb5b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb56c941640 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4fa40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb558009230 tx=0x7fb558004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9d845e7645f2fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.609+0000 7fb552ffd640 1 -- 172.21.15.37:0/2304393463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5580386b0 con 0x55771f7801b0 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb552ffd640 1 -- 172.21.15.37:0/2304393463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb558038850 con 0x55771f7801b0 2024-08-31T06:49:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb552ffd640 1 -- 172.21.15.37:0/2304393463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558004920 con 0x55771f7801b0 2024-08-31T06:49:33.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb57591b740 1 -- 172.21.15.37:0/2304393463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 msgr2=0x55771fb4fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb57591b740 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4fa40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb558009230 tx=0x7fb558004610 comp rx=0 tx=0).stop 2024-08-31T06:49:33.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb57591b740 1 -- 172.21.15.37:0/2304393463 shutdown_connections 2024-08-31T06:49:33.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb57591b740 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f7801b0 0x55771fb4fa40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb57591b740 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f788390 0x55771fb65cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb57591b740 1 --2- 172.21.15.37:0/2304393463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7679f0 0x55771fb5b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.610+0000 7fb57591b740 1 -- 172.21.15.37:0/2304393463 >> 172.21.15.37:0/2304393463 conn(0x55771f79d460 msgr2=0x55771fb4f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.611+0000 7fb57591b740 1 -- 172.21.15.37:0/2304393463 shutdown_connections 2024-08-31T06:49:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.611+0000 7fb57591b740 1 -- 172.21.15.37:0/2304393463 wait complete. 2024-08-31T06:49:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.611+0000 7fb57591b740 1 -- start start 2024-08-31T06:49:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.611+0000 7fb57591b740 1 Processor -- start 2024-08-31T06:49:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb57591b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7679f0 0x55771fb5ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb57591b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7801b0 0x55771fb60450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb57591b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb60990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb57591b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681ab830 con 0x55771f788390 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb57591b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681acca0 con 0x55771f7679f0 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb57591b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681abf00 con 0x55771f7801b0 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb57591b740 10 client.0 _ll_register_callbacks cb 0x7fb558004110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb60990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb60990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41910/0 (socket says 172.21.15.37:41910) 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 -- 172.21.15.37:0/3260288541 learned_addr learned my addr 172.21.15.37:0/3260288541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d142640 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7679f0 0x55771fb5ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56c941640 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7801b0 0x55771fb60450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 -- 172.21.15.37:0/3260288541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7801b0 msgr2=0x55771fb60450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7801b0 0x55771fb60450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 -- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7679f0 msgr2=0x55771fb5ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7679f0 0x55771fb5ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 -- 172.21.15.37:0/3260288541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55771fbd59d0 con 0x55771f788390 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d142640 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7679f0 0x55771fb5ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb56d943640 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb60990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb5600a82b0 tx=0x7fb560005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6050f9dd4745fbec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb550ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb550ff9640 1 -- 172.21.15.37:0/3260288541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5600b0aa0 con 0x55771f788390 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb550ff9640 1 -- 172.21.15.37:0/3260288541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb5600a84c0 con 0x55771f788390 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.612+0000 7fb57591b740 1 -- 172.21.15.37:0/3260288541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb558038850 con 0x55771f788390 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb550ff9640 1 -- 172.21.15.37:0/3260288541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5600b5550 con 0x55771f788390 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb57591b740 10 client.16302 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb57591b740 1 -- 172.21.15.37:0/3260288541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55771fbd6ca0 con 0x55771f788390 2024-08-31T06:49:33.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb550ff9640 1 -- 172.21.15.37:0/3260288541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb558038850 con 0x55771f788390 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb550ff9640 1 -- 172.21.15.37:0/3260288541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5600a7da0 con 0x55771f788390 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb57591b740 10 client.16302 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb57591b740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb57591b740 20 client.16302 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb57591b740 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55771f7a9070 0x55771fbd93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb57591b740 4 client.16302 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb57591b740 1 -- 172.21.15.37:0/3260288541 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55771fac3020 con 0x55771f7a9070 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.613+0000 7fb56d142640 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55771f7a9070 0x55771fbd93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb550ff9640 10 client.16302 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb56d142640 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55771f7a9070 0x55771fbd93e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85461b24662998a7 server_cookie=799e2df899413853 in_seq=0 out_seq=0 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb550ff9640 1 -- 172.21.15.37:0/3260288541 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55771fac3020 con 0x55771f7a9070 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb550ff9640 10 client.16302 handle_command_reply: tid=0 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 client.16302 shutdown 2024-08-31T06:49:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 -- 172.21.15.37:0/3260288541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 msgr2=0x55771fb60990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb60990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb5600a82b0 tx=0x7fb560005700 comp rx=0 tx=0).stop 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 -- 172.21.15.37:0/3260288541 shutdown_connections 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55771f7a9070 0x55771fbd93e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55771f788390 0x55771fb60990 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55771f7801b0 0x55771fb60450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 --2- 172.21.15.37:0/3260288541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55771f7679f0 0x55771fb5ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 -- 172.21.15.37:0/3260288541 >> 172.21.15.37:0/3260288541 conn(0x55771f79d460 msgr2=0x55771fb5b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb550ff9640 0 client.16302 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.614+0000 7fb57591b740 1 -- 172.21.15.37:0/3260288541 shutdown_connections 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb57591b740 1 -- 172.21.15.37:0/3260288541 wait complete. 2024-08-31T06:49:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb57591b740 20 client.16302 trim_cache size 0 max 16384 2024-08-31T06:49:33.622 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:49:33.622 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:49:33.622 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:49:33.622 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:49:33.622 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:49:33.622 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:49:33.622 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:33.622 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:33.623 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:49:33.624 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:33.625 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:33.625 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:33.625 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:33.625 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:33.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:49:33.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:49:33.625 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:49:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 -- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5540b4ca0 msgr2=0x7fb5540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5540b4ca0 0x7fb5540b71b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb568107810 tx=0x7fb55803a040 comp rx=0 tx=0).stop 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 -- 172.21.15.37:0/1389880757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb568108a90 msgr2=0x7fb56819e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb568108a90 0x7fb56819e9e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb560009fd0 tx=0x7fb56000ef10 comp rx=0 tx=0).stop 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 -- 172.21.15.37:0/1389880757 shutdown_connections 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5540b4ca0 0x7fb5540b71b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb568108140 0x7fb568199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb568108a90 0x7fb56819e9e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 --2- 172.21.15.37:0/1389880757 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb568102800 0x7fb5681991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 -- 172.21.15.37:0/1389880757 >> 172.21.15.37:0/1389880757 conn(0x7fb5680794d0 msgr2=0x7fb5681051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 -- 172.21.15.37:0/1389880757 shutdown_connections 2024-08-31T06:49:33.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:33.615+0000 7fb56f3a6640 1 -- 172.21.15.37:0/1389880757 wait complete. 2024-08-31T06:49:34.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:33 smithi037 ceph-mon[18612]: pgmap v401: 97 pgs: 97 active+clean; 405 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 2.61k op/s 2024-08-31T06:49:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:33 smithi066 ceph-mon[22244]: pgmap v401: 97 pgs: 97 active+clean; 405 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 2.61k op/s 2024-08-31T06:49:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:33 smithi106 ceph-mon[22134]: pgmap v401: 97 pgs: 97 active+clean; 405 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 2.61k op/s 2024-08-31T06:49:34.523 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:49:34.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:49:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:35.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.270+0000 7f0d8173c640 1 -- 172.21.15.37:0/2504294825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c103900 msgr2=0x7f0d7c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:35.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.270+0000 7f0d8173c640 1 --2- 172.21.15.37:0/2504294825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c103900 0x7f0d7c103d10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009900 tx=0x7f0d6c02a410 comp rx=0 tx=0).stop 2024-08-31T06:49:35.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.270+0000 7f0d8173c640 1 -- 172.21.15.37:0/2504294825 shutdown_connections 2024-08-31T06:49:35.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.270+0000 7f0d8173c640 1 --2- 172.21.15.37:0/2504294825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d7c109b90 0x7f0d7c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.270+0000 7f0d8173c640 1 --2- 172.21.15.37:0/2504294825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d7c109240 0x7f0d7c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.270+0000 7f0d8173c640 1 --2- 172.21.15.37:0/2504294825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c103900 0x7f0d7c103d10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.270+0000 7f0d8173c640 1 -- 172.21.15.37:0/2504294825 >> 172.21.15.37:0/2504294825 conn(0x7f0d7c07b5f0 msgr2=0x7f0d7c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:35.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.271+0000 7f0d8173c640 1 -- 172.21.15.37:0/2504294825 shutdown_connections 2024-08-31T06:49:35.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.271+0000 7f0d8173c640 1 -- 172.21.15.37:0/2504294825 wait complete. 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.271+0000 7f0d8173c640 1 Processor -- start 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.271+0000 7f0d8173c640 1 -- start start 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d8173c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d7c103900 0x7f0d7c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d8173c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c109240 0x7f0d7c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d8173c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d7c109b90 0x7f0d7c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d8173c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c113750 con 0x7f0d7c109240 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d8173c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1135d0 con 0x7f0d7c103900 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d8173c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c1138d0 con 0x7f0d7c109b90 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c109240 0x7f0d7c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:35.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c109240 0x7f0d7c0759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45122/0 (socket says 172.21.15.37:45122) 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 -- 172.21.15.37:0/3445140821 learned_addr learned my addr 172.21.15.37:0/3445140821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7b7fe640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d7c109b90 0x7f0d7c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7affd640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d7c103900 0x7f0d7c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 -- 172.21.15.37:0/3445140821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d7c109b90 msgr2=0x7f0d7c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d7c109b90 0x7f0d7c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 -- 172.21.15.37:0/3445140821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d7c103900 msgr2=0x7f0d7c0754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d7c103900 0x7f0d7c0754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 -- 172.21.15.37:0/3445140821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c1a8480 con 0x7f0d7c109240 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.272+0000 7f0d7a7fc640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c109240 0x7f0d7c0759f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000d750 tx=0x7f0d7000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.273+0000 7f0d63fff640 1 -- 172.21.15.37:0/3445140821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70017070 con 0x7f0d7c109240 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.273+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c1a8770 con 0x7f0d7c109240 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.273+0000 7f0d63fff640 1 -- 172.21.15.37:0/3445140821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d700054b0 con 0x7f0d7c109240 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.273+0000 7f0d63fff640 1 -- 172.21.15.37:0/3445140821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70004bc0 con 0x7f0d7c109240 2024-08-31T06:49:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.273+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c1a8cb0 con 0x7f0d7c109240 2024-08-31T06:49:35.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.274+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7c103d10 con 0x7f0d7c109240 2024-08-31T06:49:35.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.276+0000 7f0d63fff640 1 -- 172.21.15.37:0/3445140821 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f0d70009c30 con 0x7f0d7c109240 2024-08-31T06:49:35.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.277+0000 7f0d63fff640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0d640b4d20 0x7f0d640b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.277+0000 7f0d7affd640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0d640b4d20 0x7f0d640b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.277+0000 7f0d63fff640 1 -- 172.21.15.37:0/3445140821 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0d700e5350 con 0x7f0d7c109240 2024-08-31T06:49:35.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.278+0000 7f0d7affd640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0d640b4d20 0x7f0d640b7230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c076f00 tx=0x7f0d6c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:35.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.280+0000 7f0d63fff640 1 -- 172.21.15.37:0/3445140821 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0d700ac1a0 con 0x7f0d7c109240 2024-08-31T06:49:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.507+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d7c0767b0 con 0x7f0d7c109240 2024-08-31T06:49:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.507+0000 7f0d63fff640 1 -- 172.21.15.37:0/3445140821 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f0d7c0767b0 con 0x7f0d7c109240 2024-08-31T06:49:35.509 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:49:35.509 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:49:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:49:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0d640b4d20 msgr2=0x7f0d640b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0d640b4d20 0x7f0d640b7230 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c076f00 tx=0x7f0d6c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c109240 msgr2=0x7f0d7c0759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c109240 0x7f0d7c0759f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000d750 tx=0x7f0d7000dc10 comp rx=0 tx=0).stop 2024-08-31T06:49:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 shutdown_connections 2024-08-31T06:49:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0d640b4d20 0x7f0d640b7230 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d7c109240 0x7f0d7c0759f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d7c109b90 0x7f0d7c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 --2- 172.21.15.37:0/3445140821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d7c103900 0x7f0d7c0754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 >> 172.21.15.37:0/3445140821 conn(0x7f0d7c07b5f0 msgr2=0x7f0d7c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 shutdown_connections 2024-08-31T06:49:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:35.510+0000 7f0d8173c640 1 -- 172.21.15.37:0/3445140821 wait complete. 2024-08-31T06:49:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:35 smithi066 ceph-mon[22244]: pgmap v402: 97 pgs: 97 active+clean; 366 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.7 MiB/s wr, 1.98k op/s 2024-08-31T06:49:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:35 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3445140821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:49:36.276 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:35 smithi037 ceph-mon[18612]: pgmap v402: 97 pgs: 97 active+clean; 366 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.7 MiB/s wr, 1.98k op/s 2024-08-31T06:49:36.276 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:35 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3445140821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:49:36.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:49:36.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:35 smithi106 ceph-mon[22134]: pgmap v402: 97 pgs: 97 active+clean; 366 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.7 MiB/s wr, 1.98k op/s 2024-08-31T06:49:36.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:35 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3445140821' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:49:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 -- 172.21.15.37:0/3740180403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c105050 msgr2=0x7fb55c10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 --2- 172.21.15.37:0/3740180403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c105050 0x7fb55c10d690 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb550009900 tx=0x7fb55002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 -- 172.21.15.37:0/3740180403 shutdown_connections 2024-08-31T06:49:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 --2- 172.21.15.37:0/3740180403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c105050 0x7fb55c10d690 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 --2- 172.21.15.37:0/3740180403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb55c10dbd0 0x7fb55c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 --2- 172.21.15.37:0/3740180403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb55c104620 0x7fb55c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 -- 172.21.15.37:0/3740180403 >> 172.21.15.37:0/3740180403 conn(0x7fb55c0794d0 msgr2=0x7fb55c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 -- 172.21.15.37:0/3740180403 shutdown_connections 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.028+0000 7fb56135f640 1 -- 172.21.15.37:0/3740180403 wait complete. 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb56135f640 1 Processor -- start 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb56135f640 1 -- start start 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb56135f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb55c104620 0x7fb55c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb56135f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb55c105050 0x7fb55c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb56135f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c10dbd0 0x7fb55c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb56135f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c1136a0 con 0x7fb55c10dbd0 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb56135f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c113520 con 0x7fb55c105050 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb56135f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c113820 con 0x7fb55c104620 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb55b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c10dbd0 0x7fb55c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb55b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c10dbd0 0x7fb55c19f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45132/0 (socket says 172.21.15.37:45132) 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.029+0000 7fb55b7fe640 1 -- 172.21.15.37:0/401852102 learned_addr learned my addr 172.21.15.37:0/401852102 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb55c105050 0x7fb55c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55affd640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb55c104620 0x7fb55c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55b7fe640 1 -- 172.21.15.37:0/401852102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb55c104620 msgr2=0x7fb55c19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55b7fe640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb55c104620 0x7fb55c19a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55b7fe640 1 -- 172.21.15.37:0/401852102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb55c105050 msgr2=0x7fb55c19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55b7fe640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb55c105050 0x7fb55c19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55b7fe640 1 -- 172.21.15.37:0/401852102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55c1a0000 con 0x7fb55c10dbd0 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55affd640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb55c104620 0x7fb55c19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb55b7fe640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c10dbd0 0x7fb55c19f990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb55400cce0 tx=0x7fb55400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb543fff640 1 -- 172.21.15.37:0/401852102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55400f450 con 0x7fb55c10dbd0 2024-08-31T06:49:37.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb543fff640 1 -- 172.21.15.37:0/401852102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb55400fa80 con 0x7fb55c10dbd0 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb56135f640 1 -- 172.21.15.37:0/401852102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55c1a02f0 con 0x7fb55c10dbd0 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb543fff640 1 -- 172.21.15.37:0/401852102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554018ad0 con 0x7fb55c10dbd0 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.030+0000 7fb56135f640 1 -- 172.21.15.37:0/401852102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55c1a07b0 con 0x7fb55c10dbd0 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb543fff640 1 -- 172.21.15.37:0/401852102 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fb55400f5f0 con 0x7fb55c10dbd0 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb5678d4740 1 Processor -- start 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb5678d4740 1 -- start start 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e487f070 0x5642e4c24310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e48561b0 0x5642e4c24850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c24d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb5678d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5642e4b9b680 con 0x5642e485e390 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb5678d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5642e4b8ac10 con 0x5642e48561b0 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb5678d4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5642e4b8ebc0 con 0x5642e487f070 2024-08-31T06:49:37.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb55a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c24d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb55a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c24d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45136/0 (socket says 172.21.15.37:45136) 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.033+0000 7fb55a7fc640 1 -- 172.21.15.37:0/1453319178 learned_addr learned my addr 172.21.15.37:0/1453319178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e487f070 0x5642e4c24310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55affd640 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e48561b0 0x5642e4c24850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb543fff640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5440b4cd0 0x7fb5440b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55a7fc640 1 -- 172.21.15.37:0/1453319178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e487f070 msgr2=0x5642e4c24310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e487f070 0x5642e4c24310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55a7fc640 1 -- 172.21.15.37:0/1453319178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e48561b0 msgr2=0x5642e4c24850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e48561b0 0x5642e4c24850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55a7fc640 1 -- 172.21.15.37:0/1453319178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642e48ea650 con 0x5642e485e390 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55b7fe640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5440b4cd0 0x7fb5440b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c24d90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb5500096c0 tx=0x7fb550005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292327a2e1728b9d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb543fff640 1 -- 172.21.15.37:0/401852102 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb5540e5ce0 con 0x7fb55c10dbd0 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb5417fa640 1 -- 172.21.15.37:0/1453319178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550035040 con 0x5642e485e390 2024-08-31T06:49:37.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb5417fa640 1 -- 172.21.15.37:0/1453319178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5500044c0 con 0x5642e485e390 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.034+0000 7fb5417fa640 1 -- 172.21.15.37:0/1453319178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550003bc0 con 0x5642e485e390 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 -- 172.21.15.37:0/1453319178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 msgr2=0x5642e4c24d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb55b7fe640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5440b4cd0 0x7fb5440b71e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb5540e3a70 tx=0x7fb5540dc610 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c24d90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb5500096c0 tx=0x7fb550005fd0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 -- 172.21.15.37:0/1453319178 shutdown_connections 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c24d90 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e48561b0 0x5642e4c24850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 --2- 172.21.15.37:0/1453319178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e487f070 0x5642e4c24310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 -- 172.21.15.37:0/1453319178 >> 172.21.15.37:0/1453319178 conn(0x5642e4873460 msgr2=0x5642e4c22200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 -- 172.21.15.37:0/1453319178 shutdown_connections 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.035+0000 7fb5678d4740 1 -- 172.21.15.37:0/1453319178 wait complete. 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 1 -- start start 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 1 Processor -- start 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c2fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c30090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5642e49ed700 con 0x5642e485e390 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5642e4b11750 con 0x5642e487f070 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5642e4c32a90 con 0x5642e48561b0 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb5678d4740 10 client.0 _ll_register_callbacks cb 0x5642e4b40e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb55affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c30090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb55affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c30090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45144/0 (socket says 172.21.15.37:45144) 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb55affd640 1 -- 172.21.15.37:0/453718023 learned_addr learned my addr 172.21.15.37:0/453718023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c2fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.036+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb55affd640 1 -- 172.21.15.37:0/453718023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 msgr2=0x5642e4c2fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb55affd640 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c2fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb55affd640 1 -- 172.21.15.37:0/453718023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 msgr2=0x5642e4c3bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb55affd640 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb55affd640 1 -- 172.21.15.37:0/453718023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642e4b4a900 con 0x5642e485e390 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c2fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb55affd640 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c30090 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00ce90 tx=0x7fb54c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2087c03adfd43c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb53eff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb53eff5640 1 -- 172.21.15.37:0/453718023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c011a90 con 0x5642e485e390 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb53eff5640 1 -- 172.21.15.37:0/453718023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb54c011c30 con 0x5642e485e390 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb5678d4740 1 -- 172.21.15.37:0/453718023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642e4b9d5d0 con 0x5642e485e390 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb53eff5640 1 -- 172.21.15.37:0/453718023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb54c011e30 con 0x5642e485e390 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb5678d4740 10 client.16320 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb5678d4740 1 -- 172.21.15.37:0/453718023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5642e4c3e950 con 0x5642e485e390 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.037+0000 7fb53eff5640 1 -- 172.21.15.37:0/453718023 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5642e4b9d5d0 con 0x5642e485e390 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb53eff5640 1 -- 172.21.15.37:0/453718023 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb54c018070 con 0x5642e485e390 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb5678d4740 10 client.16320 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb5678d4740 10 client.16320 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:49:37.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb5678d4740 20 client.16320 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb5678d4740 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5642e483d9f0 0x5642e4c41f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb5678d4740 4 client.16320 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb5678d4740 1 -- 172.21.15.37:0/453718023 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642e4b99070 con 0x5642e483d9f0 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5642e483d9f0 0x5642e4c41f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5642e483d9f0 0x5642e4c41f10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=72c02f8b83e3dec6 server_cookie=e84a9b70d31f406d in_seq=0 out_seq=0 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.038+0000 7fb53eff5640 10 client.16320 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb53eff5640 1 -- 172.21.15.37:0/453718023 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5642e4b99070 con 0x5642e483d9f0 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb53eff5640 10 client.16320 handle_command_reply: tid=0 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 client.16320 shutdown 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 -- 172.21.15.37:0/453718023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 msgr2=0x5642e4c30090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c30090 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00ce90 tx=0x7fb54c0039c0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 -- 172.21.15.37:0/453718023 shutdown_connections 2024-08-31T06:49:37.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c30090 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5642e483d9f0 0x5642e4c41f10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 --2- 172.21.15.37:0/453718023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c2fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb53eff5640 0 client.16320 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:49:37.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 -- 172.21.15.37:0/453718023 >> 172.21.15.37:0/453718023 conn(0x5642e4873460 msgr2=0x5642e4c274f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:37.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 -- 172.21.15.37:0/453718023 shutdown_connections 2024-08-31T06:49:37.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 1 -- 172.21.15.37:0/453718023 wait complete. 2024-08-31T06:49:37.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.039+0000 7fb5678d4740 20 client.16320 trim_cache size 0 max 16384 2024-08-31T06:49:37.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb5678d4740 1 Processor -- start 2024-08-31T06:49:37.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb5678d4740 1 -- start start 2024-08-31T06:49:37.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c25a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c3bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb5678d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c1b1b60 con 0x5642e485e390 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb5678d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c1af430 con 0x5642e487f070 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb5678d4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c1ad280 con 0x5642e48561b0 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c3bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c3bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45156/0 (socket says 172.21.15.37:45156) 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 -- 172.21.15.37:0/807741585 learned_addr learned my addr 172.21.15.37:0/807741585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c25a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 -- 172.21.15.37:0/807741585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 msgr2=0x5642e4c25a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c25a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 -- 172.21.15.37:0/807741585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 msgr2=0x5642e4c3c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:37.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 -- 172.21.15.37:0/807741585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642e4c26600 con 0x5642e485e390 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.053+0000 7fb55affd640 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c3bc80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb54c005d90 tx=0x7fb54c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ac904d07bbe3c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb540ff9640 1 -- 172.21.15.37:0/807741585 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c026070 con 0x5642e485e390 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb540ff9640 1 -- 172.21.15.37:0/807741585 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb54c00ecc0 con 0x5642e485e390 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb540ff9640 1 -- 172.21.15.37:0/807741585 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0227b0 con 0x5642e485e390 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb5678d4740 1 -- 172.21.15.37:0/807741585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 msgr2=0x5642e4c3bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb5678d4740 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c3bc80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb54c005d90 tx=0x7fb54c00ea50 comp rx=0 tx=0).stop 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb5678d4740 1 -- 172.21.15.37:0/807741585 shutdown_connections 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb5678d4740 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c3bc80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb5678d4740 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c3c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb5678d4740 1 --2- 172.21.15.37:0/807741585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c25a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.054+0000 7fb5678d4740 1 -- 172.21.15.37:0/807741585 >> 172.21.15.37:0/807741585 conn(0x5642e4873460 msgr2=0x5642e4c25340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 -- 172.21.15.37:0/807741585 shutdown_connections 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 -- 172.21.15.37:0/807741585 wait complete. 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 -- start start 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 Processor -- start 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c33ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c34430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c1ad8f0 con 0x5642e485e390 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c1aed60 con 0x5642e487f070 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb55c1adfc0 con 0x5642e48561b0 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb5678d4740 10 client.0 _ll_register_callbacks cb 0x7fb54c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.055+0000 7fb55affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c34430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c34430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45166/0 (socket says 172.21.15.37:45166) 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55affd640 1 -- 172.21.15.37:0/2304338375 learned_addr learned my addr 172.21.15.37:0/2304338375 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c33ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55affd640 1 -- 172.21.15.37:0/2304338375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 msgr2=0x5642e4c33ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55affd640 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c33ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55affd640 1 -- 172.21.15.37:0/2304338375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 msgr2=0x5642e4c349b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55affd640 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c349b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55affd640 1 -- 172.21.15.37:0/2304338375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642e4cabb40 con 0x5642e485e390 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c33ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb55affd640 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c34430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb54c005ad0 tx=0x7fb54c00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd66452354f49a5a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb53eff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb53eff5640 1 -- 172.21.15.37:0/2304338375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c026040 con 0x5642e485e390 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb53eff5640 1 -- 172.21.15.37:0/2304338375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb54c022640 con 0x5642e485e390 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb5678d4740 1 -- 172.21.15.37:0/2304338375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb54c00ecc0 con 0x5642e485e390 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb53eff5640 1 -- 172.21.15.37:0/2304338375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb54c042050 con 0x5642e485e390 2024-08-31T06:49:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb5678d4740 10 client.16326 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.056+0000 7fb5678d4740 1 -- 172.21.15.37:0/2304338375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5642e4cacd30 con 0x5642e485e390 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb53eff5640 1 -- 172.21.15.37:0/2304338375 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb54c00ecc0 con 0x5642e485e390 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb53eff5640 1 -- 172.21.15.37:0/2304338375 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb54c018040 con 0x5642e485e390 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb5678d4740 10 client.16326 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb5678d4740 10 client.16326 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb5678d4740 20 client.16326 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb5678d4740 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5642e4812da0 0x5642e4caf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb5678d4740 4 client.16326 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb5678d4740 1 -- 172.21.15.37:0/2304338375 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642e4b967b0 con 0x5642e4812da0 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.057+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5642e4812da0 0x5642e4caf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb55a7fc640 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5642e4812da0 0x5642e4caf3c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a1284c04349a003 server_cookie=189057f776bd6ee4 in_seq=0 out_seq=0 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb53eff5640 10 client.16326 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:49:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb53eff5640 1 -- 172.21.15.37:0/2304338375 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642e4b967b0 con 0x5642e4812da0 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb53eff5640 10 client.16326 handle_command_reply: tid=0 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 client.16326 shutdown 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 -- 172.21.15.37:0/2304338375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 msgr2=0x5642e4c34430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c34430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb54c005ad0 tx=0x7fb54c00ca80 comp rx=0 tx=0).stop 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 -- 172.21.15.37:0/2304338375 shutdown_connections 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642e485e390 0x5642e4c34430 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5642e4812da0 0x5642e4caf3c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5642e487f070 0x5642e4c349b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 --2- 172.21.15.37:0/2304338375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5642e48561b0 0x5642e4c33ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 -- 172.21.15.37:0/2304338375 >> 172.21.15.37:0/2304338375 conn(0x5642e4873460 msgr2=0x5642e4c30dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb53eff5640 0 client.16326 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 -- 172.21.15.37:0/2304338375 shutdown_connections 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 1 -- 172.21.15.37:0/2304338375 wait complete. 2024-08-31T06:49:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.058+0000 7fb5678d4740 20 client.16326 trim_cache size 0 max 16384 2024-08-31T06:49:37.067 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:49:37.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 -- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5440b4cd0 msgr2=0x7fb5440b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5440b4cd0 0x7fb5440b71e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb5540e3a70 tx=0x7fb5540dc610 comp rx=0 tx=0).stop 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 -- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c10dbd0 msgr2=0x7fb55c19f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c10dbd0 0x7fb55c19f990 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb55400cce0 tx=0x7fb55400a620 comp rx=0 tx=0).stop 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 -- 172.21.15.37:0/401852102 shutdown_connections 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb5440b4cd0 0x7fb5440b71e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb55c10dbd0 0x7fb55c19f990 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb55c105050 0x7fb55c19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 --2- 172.21.15.37:0/401852102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb55c104620 0x7fb55c19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 -- 172.21.15.37:0/401852102 >> 172.21.15.37:0/401852102 conn(0x7fb55c0794d0 msgr2=0x7fb55c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 -- 172.21.15.37:0/401852102 shutdown_connections 2024-08-31T06:49:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:37.059+0000 7fb56135f640 1 -- 172.21.15.37:0/401852102 wait complete. 2024-08-31T06:49:37.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:49:38.103 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:38.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:37 smithi037 ceph-mon[18612]: pgmap v403: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 1.55k op/s 2024-08-31T06:49:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:37 smithi066 ceph-mon[22244]: pgmap v403: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 1.55k op/s 2024-08-31T06:49:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:37 smithi106 ceph-mon[22134]: pgmap v403: 97 pgs: 97 active+clean; 289 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 1.55k op/s 2024-08-31T06:49:38.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 -- 172.21.15.37:0/3734566731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109240 msgr2=0x7f40d8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 --2- 172.21.15.37:0/3734566731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109240 0x7f40d8109650 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009900 tx=0x7f40c402a410 comp rx=0 tx=0).stop 2024-08-31T06:49:38.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 -- 172.21.15.37:0/3734566731 shutdown_connections 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 --2- 172.21.15.37:0/3734566731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109240 0x7f40d8109650 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 --2- 172.21.15.37:0/3734566731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8109b90 0x7f40d81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 --2- 172.21.15.37:0/3734566731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d8103900 0x7f40d8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 -- 172.21.15.37:0/3734566731 >> 172.21.15.37:0/3734566731 conn(0x7f40d807b5f0 msgr2=0x7f40d807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 -- 172.21.15.37:0/3734566731 shutdown_connections 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.588+0000 7f40dee41640 1 -- 172.21.15.37:0/3734566731 wait complete. 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dee41640 1 Processor -- start 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dee41640 1 -- start start 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dee41640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d8103900 0x7f40d80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dee41640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8109240 0x7f40d80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dee41640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109b90 0x7f40d8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dee41640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8113700 con 0x7f40d8109b90 2024-08-31T06:49:38.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dee41640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8113580 con 0x7f40d8109240 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dee41640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8113880 con 0x7f40d8103900 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dd3de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109b90 0x7f40d8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dd3de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109b90 0x7f40d8075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45186/0 (socket says 172.21.15.37:45186) 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dd3de640 1 -- 172.21.15.37:0/3453076389 learned_addr learned my addr 172.21.15.37:0/3453076389 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8109240 0x7f40d80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.589+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d8103900 0x7f40d80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40dd3de640 1 -- 172.21.15.37:0/3453076389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d8103900 msgr2=0x7f40d80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40dd3de640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d8103900 0x7f40d80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40dd3de640 1 -- 172.21.15.37:0/3453076389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8109240 msgr2=0x7f40d80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40dd3de640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8109240 0x7f40d80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40dd3de640 1 -- 172.21.15.37:0/3453076389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d81a8450 con 0x7f40d8109b90 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40dd3de640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109b90 0x7f40d8075f30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40d000eaa0 tx=0x7f40d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:38.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40d5ffb640 1 -- 172.21.15.37:0/3453076389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d000cdb0 con 0x7f40d8109b90 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40d5ffb640 1 -- 172.21.15.37:0/3453076389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40d0005020 con 0x7f40d8109b90 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40dee41640 1 -- 172.21.15.37:0/3453076389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d81a8740 con 0x7f40d8109b90 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40d5ffb640 1 -- 172.21.15.37:0/3453076389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00116d0 con 0x7f40d8109b90 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.590+0000 7f40dee41640 1 -- 172.21.15.37:0/3453076389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d81a8c50 con 0x7f40d8109b90 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.593+0000 7f40d5ffb640 1 -- 172.21.15.37:0/3453076389 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f40d00051d0 con 0x7f40d8109b90 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.593+0000 7f40e53b6740 1 Processor -- start 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.593+0000 7f40e53b6740 1 -- start start 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.593+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c01310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb28331b0 0x561eb2c01850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb283b390 0x561eb2c01d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40e53b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561eb2b78680 con 0x561eb28331b0 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40e53b6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561eb2b67c10 con 0x561eb283b390 2024-08-31T06:49:38.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40e53b6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561eb2b6bbc0 con 0x561eb285c070 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dcbdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb28331b0 0x561eb2c01850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c01310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c01310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51772/0 (socket says 172.21.15.37:51772) 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dcbdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb28331b0 0x561eb2c01850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45194/0 (socket says 172.21.15.37:45194) 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40d7fff640 1 -- 172.21.15.37:0/4096217002 learned_addr learned my addr 172.21.15.37:0/4096217002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40d7fff640 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb283b390 0x561eb2c01d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40d5ffb640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40c80b4d20 0x7f40c80b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dcbdd640 1 -- 172.21.15.37:0/4096217002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 msgr2=0x561eb2c01310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c01310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dcbdd640 1 -- 172.21.15.37:0/4096217002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb283b390 msgr2=0x561eb2c01d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb283b390 0x561eb2c01d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dcbdd640 1 -- 172.21.15.37:0/4096217002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb28c7650 con 0x561eb28331b0 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40d7fff640 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb283b390 0x561eb2c01d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dd3de640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40c80b4d20 0x7f40c80b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40d5ffb640 1 -- 172.21.15.37:0/3453076389 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f40d00e5610 con 0x7f40d8109b90 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.594+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb28331b0 0x561eb2c01850 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f40cc005fd0 tx=0x7f40cc00bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bfd7cf8ae6eac9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.595+0000 7f40c2ffd640 1 -- 172.21.15.37:0/4096217002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc003bd0 con 0x561eb28331b0 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.595+0000 7f40c2ffd640 1 -- 172.21.15.37:0/4096217002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40cc015070 con 0x561eb28331b0 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.595+0000 7f40c2ffd640 1 -- 172.21.15.37:0/4096217002 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc004c40 con 0x561eb28331b0 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.595+0000 7f40e53b6740 1 -- 172.21.15.37:0/4096217002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb28331b0 msgr2=0x561eb2c01850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.595+0000 7f40dd3de640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40c80b4d20 0x7f40c80b7230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f40d00e2e50 tx=0x7f40d00707a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.595+0000 7f40e53b6740 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb28331b0 0x561eb2c01850 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f40cc005fd0 tx=0x7f40cc00bb20 comp rx=0 tx=0).stop 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.595+0000 7f40e53b6740 1 -- 172.21.15.37:0/4096217002 shutdown_connections 2024-08-31T06:49:38.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.595+0000 7f40e53b6740 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb28331b0 0x561eb2c01850 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb283b390 0x561eb2c01d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 --2- 172.21.15.37:0/4096217002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c01310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 -- 172.21.15.37:0/4096217002 >> 172.21.15.37:0/4096217002 conn(0x561eb2850460 msgr2=0x561eb2bff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 -- 172.21.15.37:0/4096217002 shutdown_connections 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 -- 172.21.15.37:0/4096217002 wait complete. 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 -- start start 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 Processor -- start 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c0ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb283b390 0x561eb2c0cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c18de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561eb29ca700 con 0x561eb283b390 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561eb2aee750 con 0x561eb28331b0 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.596+0000 7f40e53b6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561eb2c0faf0 con 0x561eb285c070 2024-08-31T06:49:38.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40e53b6740 10 client.0 _ll_register_callbacks cb 0x561eb2b1de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb283b390 0x561eb2c0cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb283b390 0x561eb2c0cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45204/0 (socket says 172.21.15.37:45204) 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 -- 172.21.15.37:0/3290246645 learned_addr learned my addr 172.21.15.37:0/3290246645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c0ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c18de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 -- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 msgr2=0x561eb2c18de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c18de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 -- 172.21.15.37:0/3290246645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 msgr2=0x561eb2c0ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c0ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 -- 172.21.15.37:0/3290246645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb2b27900 con 0x561eb283b390 2024-08-31T06:49:38.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c18de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb283b390 0x561eb2c0cfb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00b5f0 tx=0x7f40cc003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9610e7c20b2048 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40b7fff640 1 -- 172.21.15.37:0/3290246645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc028060 con 0x561eb283b390 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40b7fff640 1 -- 172.21.15.37:0/3290246645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f40cc011640 con 0x561eb283b390 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40e53b6740 1 -- 172.21.15.37:0/3290246645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40cc015070 con 0x561eb283b390 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40b7fff640 1 -- 172.21.15.37:0/3290246645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f40cc011840 con 0x561eb283b390 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40e53b6740 10 client.16338 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.597+0000 7f40e53b6740 1 -- 172.21.15.37:0/3290246645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561eb2c1b8a0 con 0x561eb283b390 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40b7fff640 1 -- 172.21.15.37:0/3290246645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40cc015070 con 0x561eb283b390 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40b7fff640 1 -- 172.21.15.37:0/3290246645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f40cc022070 con 0x561eb283b390 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40e53b6740 10 client.16338 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40e53b6740 10 client.16338 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40e53b6740 20 client.16338 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:38.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561eb281a9f0 0x561eb2c1ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40e53b6740 4 client.16338 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40e53b6740 1 -- 172.21.15.37:0/3290246645 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561eb2b7a5d0 con 0x561eb281a9f0 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.598+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561eb281a9f0 0x561eb2c1ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.599+0000 7f40b7fff640 10 client.16338 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.599+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561eb281a9f0 0x561eb2c1ecb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fb5c090a413ed081 server_cookie=3a9c81600772452b in_seq=0 out_seq=0 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40b7fff640 1 -- 172.21.15.37:0/3290246645 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561eb2b7a5d0 con 0x561eb281a9f0 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40b7fff640 10 client.16338 handle_command_reply: tid=0 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 client.16338 shutdown 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 -- 172.21.15.37:0/3290246645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb283b390 msgr2=0x561eb2c0cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb283b390 0x561eb2c0cfb0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00b5f0 tx=0x7f40cc003bd0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 -- 172.21.15.37:0/3290246645 shutdown_connections 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561eb281a9f0 0x561eb2c1ecb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb283b390 0x561eb2c0cfb0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb285c070 0x561eb2c18de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40b7fff640 0 client.16338 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:49:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3290246645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c0ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 -- 172.21.15.37:0/3290246645 >> 172.21.15.37:0/3290246645 conn(0x561eb2850460 msgr2=0x561eb2c044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 -- 172.21.15.37:0/3290246645 shutdown_connections 2024-08-31T06:49:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 1 -- 172.21.15.37:0/3290246645 wait complete. 2024-08-31T06:49:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.600+0000 7f40e53b6740 20 client.16338 trim_cache size 0 max 16384 2024-08-31T06:49:38.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40e53b6740 1 Processor -- start 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40e53b6740 1 -- start start 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c04410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c04950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c09c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40e53b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81b3d20 con 0x561eb285c070 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40e53b6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81b15f0 con 0x561eb28331b0 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40e53b6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81af440 con 0x561eb283b390 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c09c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c09c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45214/0 (socket says 172.21.15.37:45214) 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.614+0000 7f40d7fff640 1 -- 172.21.15.37:0/2210912041 learned_addr learned my addr 172.21.15.37:0/2210912041 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c04950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40d7fff640 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c04410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40d7fff640 1 -- 172.21.15.37:0/2210912041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 msgr2=0x561eb2c04950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40d7fff640 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c04950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40d7fff640 1 -- 172.21.15.37:0/2210912041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 msgr2=0x561eb2c04410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40d7fff640 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c04410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40d7fff640 1 -- 172.21.15.37:0/2210912041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561eb2bfa5a0 con 0x561eb285c070 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c04950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40d7fff640 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c09c60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f40d806c790 tx=0x7f40c402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed084c66c3824e66 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40c27fc640 1 -- 172.21.15.37:0/2210912041 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c404d070 con 0x561eb285c070 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40c27fc640 1 -- 172.21.15.37:0/2210912041 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40c4031d30 con 0x561eb285c070 2024-08-31T06:49:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.615+0000 7f40c27fc640 1 -- 172.21.15.37:0/2210912041 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4035040 con 0x561eb285c070 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 -- 172.21.15.37:0/2210912041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 msgr2=0x561eb2c09c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c09c60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f40d806c790 tx=0x7f40c402a410 comp rx=0 tx=0).stop 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 -- 172.21.15.37:0/2210912041 shutdown_connections 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c09c60 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c04950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 --2- 172.21.15.37:0/2210912041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c04410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 -- 172.21.15.37:0/2210912041 >> 172.21.15.37:0/2210912041 conn(0x561eb2850460 msgr2=0x561eb2c0b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 -- 172.21.15.37:0/2210912041 shutdown_connections 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.616+0000 7f40e53b6740 1 -- 172.21.15.37:0/2210912041 wait complete. 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 1 -- start start 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 1 Processor -- start 2024-08-31T06:49:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c1ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c20490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c88430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81afab0 con 0x561eb285c070 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81b0f20 con 0x561eb28331b0 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f40d81b0180 con 0x561eb283b390 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40e53b6740 10 client.0 _ll_register_callbacks cb 0x7f40c4005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c88430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c88430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45224/0 (socket says 172.21.15.37:45224) 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.617+0000 7f40d7fff640 1 -- 172.21.15.37:0/3330857904 learned_addr learned my addr 172.21.15.37:0/3330857904 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c20490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c1ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40d7fff640 1 -- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 msgr2=0x561eb2c20490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c20490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40d7fff640 1 -- 172.21.15.37:0/3330857904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 msgr2=0x561eb2c1ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c1ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40d7fff640 1 -- 172.21.15.37:0/3330857904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561eb2c20ca0 con 0x561eb285c070 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c20490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40d7fff640 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c88430 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f40c4001eb0 tx=0x7f40c4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfe2e9b9d5568a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40b7fff640 1 -- 172.21.15.37:0/3330857904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4035030 con 0x561eb285c070 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40b7fff640 1 -- 172.21.15.37:0/3330857904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f40c4032200 con 0x561eb285c070 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40e53b6740 1 -- 172.21.15.37:0/3330857904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40c4031d30 con 0x561eb285c070 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40b7fff640 1 -- 172.21.15.37:0/3330857904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f40c404d040 con 0x561eb285c070 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40e53b6740 10 client.16344 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.618+0000 7f40e53b6740 1 -- 172.21.15.37:0/3330857904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561eb2c89930 con 0x561eb285c070 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40b7fff640 1 -- 172.21.15.37:0/3330857904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40c4031d30 con 0x561eb285c070 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40b7fff640 1 -- 172.21.15.37:0/3330857904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f40c403d710 con 0x561eb285c070 2024-08-31T06:49:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40e53b6740 10 client.16344 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40e53b6740 10 client.16344 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40e53b6740 20 client.16344 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561eb27efda0 0x561eb2c8c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40e53b6740 4 client.16344 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40e53b6740 1 -- 172.21.15.37:0/3330857904 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561eb2b76070 con 0x561eb27efda0 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.619+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561eb27efda0 0x561eb2c8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40b7fff640 10 client.16344 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40dcbdd640 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561eb27efda0 0x561eb2c8c090 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b572a5ac1dedaf07 server_cookie=9e3753238b8be23e in_seq=0 out_seq=0 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40b7fff640 1 -- 172.21.15.37:0/3330857904 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561eb2b76070 con 0x561eb27efda0 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40b7fff640 10 client.16344 handle_command_reply: tid=0 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 client.16344 shutdown 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 -- 172.21.15.37:0/3330857904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 msgr2=0x561eb2c88430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c88430 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f40c4001eb0 tx=0x7f40c4005fd0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 -- 172.21.15.37:0/3330857904 shutdown_connections 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x561eb27efda0 0x561eb2c8c090 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561eb285c070 0x561eb2c88430 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561eb283b390 0x561eb2c20490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 --2- 172.21.15.37:0/3330857904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561eb28331b0 0x561eb2c1ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 -- 172.21.15.37:0/3330857904 >> 172.21.15.37:0/3330857904 conn(0x561eb2850460 msgr2=0x561eb2c04410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40b7fff640 0 client.16344 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 -- 172.21.15.37:0/3330857904 shutdown_connections 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 1 -- 172.21.15.37:0/3330857904 wait complete. 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.620+0000 7f40e53b6740 20 client.16344 trim_cache size 0 max 16384 2024-08-31T06:49:38.626 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:49:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 -- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40c80b4d20 msgr2=0x7f40c80b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40c80b4d20 0x7f40c80b7230 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f40d00e2e50 tx=0x7f40d00707a0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 -- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109b90 msgr2=0x7f40d8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109b90 0x7f40d8075f30 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f40d000eaa0 tx=0x7f40d000ef60 comp rx=0 tx=0).stop 2024-08-31T06:49:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 -- 172.21.15.37:0/3453076389 shutdown_connections 2024-08-31T06:49:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40c80b4d20 0x7f40c80b7230 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8109b90 0x7f40d8075f30 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40d8109240 0x7f40d80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 --2- 172.21.15.37:0/3453076389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d8103900 0x7f40d80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 -- 172.21.15.37:0/3453076389 >> 172.21.15.37:0/3453076389 conn(0x7f40d807b5f0 msgr2=0x7f40d8105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 -- 172.21.15.37:0/3453076389 shutdown_connections 2024-08-31T06:49:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:38.621+0000 7f40dee41640 1 -- 172.21.15.37:0/3453076389 wait complete. 2024-08-31T06:49:39.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:49:39.647 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:40.045 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:39 smithi037 ceph-mon[18612]: pgmap v404: 97 pgs: 97 active+clean; 266 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.9 MiB/s wr, 679 op/s 2024-08-31T06:49:40.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:39 smithi066 ceph-mon[22244]: pgmap v404: 97 pgs: 97 active+clean; 266 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.9 MiB/s wr, 679 op/s 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 -- 172.21.15.37:0/9050178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930108ab0 msgr2=0x7fc93010f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 --2- 172.21.15.37:0/9050178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930108ab0 0x7fc93010f2e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc928009ca0 tx=0x7fc92802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 -- 172.21.15.37:0/9050178 shutdown_connections 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 --2- 172.21.15.37:0/9050178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930108ab0 0x7fc93010f2e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 --2- 172.21.15.37:0/9050178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc930108160 0x7fc930108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 --2- 172.21.15.37:0/9050178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc930102820 0x7fc930102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 -- 172.21.15.37:0/9050178 >> 172.21.15.37:0/9050178 conn(0x7fc9300794e0 msgr2=0x7fc9300798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 -- 172.21.15.37:0/9050178 shutdown_connections 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.137+0000 7fc937969640 1 -- 172.21.15.37:0/9050178 wait complete. 2024-08-31T06:49:40.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc937969640 1 Processor -- start 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc937969640 1 -- start start 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc937969640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930102820 0x7fc93019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc937969640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc930108160 0x7fc93019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc937969640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc930108ab0 0x7fc93019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc937969640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc930112700 con 0x7fc930102820 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc937969640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc930112580 con 0x7fc930108160 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc937969640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc930112880 con 0x7fc930108ab0 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930102820 0x7fc93019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930102820 0x7fc93019a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45232/0 (socket says 172.21.15.37:45232) 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935705640 1 -- 172.21.15.37:0/327280290 learned_addr learned my addr 172.21.15.37:0/327280290 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935f06640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc930108ab0 0x7fc93019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc934f04640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc930108160 0x7fc93019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935705640 1 -- 172.21.15.37:0/327280290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc930108ab0 msgr2=0x7fc93019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935705640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc930108ab0 0x7fc93019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935705640 1 -- 172.21.15.37:0/327280290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc930108160 msgr2=0x7fc93019a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935705640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc930108160 0x7fc93019a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc935705640 1 -- 172.21.15.37:0/327280290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9301a01f0 con 0x7fc930102820 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.138+0000 7fc934f04640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc930108160 0x7fc93019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.139+0000 7fc935705640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930102820 0x7fc93019a280 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00b4a0 tx=0x7fc92c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.139+0000 7fc9267fc640 1 -- 172.21.15.37:0/327280290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c014070 con 0x7fc930102820 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.139+0000 7fc9267fc640 1 -- 172.21.15.37:0/327280290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc92c010aa0 con 0x7fc930102820 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.139+0000 7fc937969640 1 -- 172.21.15.37:0/327280290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9301a04e0 con 0x7fc930102820 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.139+0000 7fc9267fc640 1 -- 172.21.15.37:0/327280290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c017b70 con 0x7fc930102820 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.139+0000 7fc937969640 1 -- 172.21.15.37:0/327280290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9301a6c40 con 0x7fc930102820 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc9267fc640 1 -- 172.21.15.37:0/327280290 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fc92c017070 con 0x7fc930102820 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc93dede740 1 Processor -- start 2024-08-31T06:49:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc93dede740 1 -- start start 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc93dede740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf9b070 0x55661c340310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc93dede740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 0x55661c340850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc93dede740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c340d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc93dede740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55661c2b7680 con 0x55661bf7a390 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc93dede740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55661c2a6c10 con 0x55661bf721b0 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc93dede740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55661c2aabc0 con 0x55661bf9b070 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc934f04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c340d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc935705640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 0x55661c340850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc934f04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c340d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45236/0 (socket says 172.21.15.37:45236) 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc934f04640 1 -- 172.21.15.37:0/1669318648 learned_addr learned my addr 172.21.15.37:0/1669318648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc9267fc640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc91c0b4d20 0x7fc91c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.142+0000 7fc935f06640 1 --2- 172.21.15.37:0/1669318648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf9b070 0x55661c340310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc935f06640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc91c0b4d20 0x7fc91c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc934f04640 1 -- 172.21.15.37:0/1669318648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf9b070 msgr2=0x55661c340310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc934f04640 1 --2- 172.21.15.37:0/1669318648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf9b070 0x55661c340310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc934f04640 1 -- 172.21.15.37:0/1669318648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 msgr2=0x55661c340850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc934f04640 1 --2- 172.21.15.37:0/1669318648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 0x55661c340850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc9267fc640 1 -- 172.21.15.37:0/327280290 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc92c0e4b00 con 0x7fc930102820 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc934f04640 1 -- 172.21.15.37:0/1669318648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661c006650 con 0x55661bf7a390 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc934f04640 1 --2- 172.21.15.37:0/1669318648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c340d90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc92000a9a0 tx=0x7fc92000ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a72150a25bfe852 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc935f06640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc91c0b4d20 0x7fc91c0b7230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc928031040 tx=0x7fc92802a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc91b7fe640 1 -- 172.21.15.37:0/1669318648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920015070 con 0x55661bf7a390 2024-08-31T06:49:40.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc91b7fe640 1 -- 172.21.15.37:0/1669318648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc92000cba0 con 0x55661bf7a390 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.143+0000 7fc91b7fe640 1 -- 172.21.15.37:0/1669318648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920011e60 con 0x55661bf7a390 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 -- 172.21.15.37:0/1669318648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 msgr2=0x55661c340d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 --2- 172.21.15.37:0/1669318648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c340d90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc92000a9a0 tx=0x7fc92000ae60 comp rx=0 tx=0).stop 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 -- 172.21.15.37:0/1669318648 shutdown_connections 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 --2- 172.21.15.37:0/1669318648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c340d90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 --2- 172.21.15.37:0/1669318648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 0x55661c340850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 --2- 172.21.15.37:0/1669318648 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf9b070 0x55661c340310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 -- 172.21.15.37:0/1669318648 >> 172.21.15.37:0/1669318648 conn(0x55661bf8f460 msgr2=0x55661c33e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 -- 172.21.15.37:0/1669318648 shutdown_connections 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.144+0000 7fc93dede740 1 -- 172.21.15.37:0/1669318648 wait complete. 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 1 -- start start 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 1 Processor -- start 2024-08-31T06:49:40.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c34fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf7a390 0x55661c350370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf9b070 0x55661c35c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55661c109700 con 0x55661bf9b070 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55661c22d750 con 0x55661bf7a390 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55661c352e50 con 0x55661bf721b0 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc93dede740 10 client.0 _ll_register_callbacks cb 0x55661c25ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc935f06640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf9b070 0x55661c35c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc935f06640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf9b070 0x55661c35c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45238/0 (socket says 172.21.15.37:45238) 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc935f06640 1 -- 172.21.15.37:0/3144063775 learned_addr learned my addr 172.21.15.37:0/3144063775 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc935705640 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c34fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.145+0000 7fc934f04640 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf7a390 0x55661c350370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc935705640 1 -- 172.21.15.37:0/3144063775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf7a390 msgr2=0x55661c350370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:40.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc935705640 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf7a390 0x55661c350370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc935705640 1 -- 172.21.15.37:0/3144063775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf9b070 msgr2=0x55661c35c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc935705640 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf9b070 0x55661c35c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc935705640 1 -- 172.21.15.37:0/3144063775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661c266900 con 0x55661bf721b0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc935705640 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c34fe30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0e2290 tx=0x7fc92c017f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f170b6e9f832676f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc918ff9640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc918ff9640 1 -- 172.21.15.37:0/3144063775 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c01e070 con 0x55661bf721b0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc93dede740 1 -- 172.21.15.37:0/3144063775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc92000cba0 con 0x55661bf721b0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc918ff9640 1 -- 172.21.15.37:0/3144063775 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc92c0e2510 con 0x55661bf721b0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc918ff9640 1 -- 172.21.15.37:0/3144063775 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc92c0e2710 con 0x55661bf721b0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc93dede740 10 client.25855 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.146+0000 7fc93dede740 1 -- 172.21.15.37:0/3144063775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55661c35ec80 con 0x55661bf721b0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc918ff9640 1 -- 172.21.15.37:0/3144063775 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc92000cba0 con 0x55661bf721b0 2024-08-31T06:49:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc918ff9640 1 -- 172.21.15.37:0/3144063775 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc92c0ab490 con 0x55661bf721b0 2024-08-31T06:49:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc93dede740 10 client.25855 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc93dede740 10 client.25855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc93dede740 20 client.25855 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc93dede740 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55661bf599f0 0x55661c362100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc93dede740 4 client.25855 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc93dede740 1 -- 172.21.15.37:0/3144063775 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55661c2b95d0 con 0x55661bf599f0 2024-08-31T06:49:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc934f04640 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55661bf599f0 0x55661c362100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc934f04640 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55661bf599f0 0x55661c362100 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba4fc11aaaed3af server_cookie=384bc49f0b84f001 in_seq=0 out_seq=0 2024-08-31T06:49:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.147+0000 7fc918ff9640 10 client.25855 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc918ff9640 1 -- 172.21.15.37:0/3144063775 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55661c2b95d0 con 0x55661bf599f0 2024-08-31T06:49:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc918ff9640 10 client.25855 handle_command_reply: tid=0 2024-08-31T06:49:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 client.25855 shutdown 2024-08-31T06:49:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 -- 172.21.15.37:0/3144063775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 msgr2=0x55661c34fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c34fe30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0e2290 tx=0x7fc92c017f90 comp rx=0 tx=0).stop 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 -- 172.21.15.37:0/3144063775 shutdown_connections 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55661bf599f0 0x55661c362100 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf9b070 0x55661c35c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf7a390 0x55661c350370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc918ff9640 0 client.25855 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 --2- 172.21.15.37:0/3144063775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c34fe30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.148+0000 7fc93dede740 1 -- 172.21.15.37:0/3144063775 >> 172.21.15.37:0/3144063775 conn(0x55661bf8f460 msgr2=0x55661c33c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.149+0000 7fc93dede740 1 -- 172.21.15.37:0/3144063775 shutdown_connections 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.149+0000 7fc93dede740 1 -- 172.21.15.37:0/3144063775 wait complete. 2024-08-31T06:49:40.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.149+0000 7fc93dede740 20 client.25855 trim_cache size 0 max 16384 2024-08-31T06:49:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.162+0000 7fc93dede740 1 Processor -- start 2024-08-31T06:49:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.162+0000 7fc93dede740 1 -- start start 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.162+0000 7fc93dede740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf599f0 0x55661c345bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.162+0000 7fc93dede740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c35c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.162+0000 7fc93dede740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c34d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.162+0000 7fc93dede740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301afab0 con 0x55661bf7a390 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.162+0000 7fc93dede740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301ad380 con 0x55661bf599f0 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.162+0000 7fc93dede740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301ab1f0 con 0x55661bf721b0 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c34d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c34d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45252/0 (socket says 172.21.15.37:45252) 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 -- 172.21.15.37:0/331902689 learned_addr learned my addr 172.21.15.37:0/331902689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935705640 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf599f0 0x55661c345bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc934f04640 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c35c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 -- 172.21.15.37:0/331902689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 msgr2=0x55661c35c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c35c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 -- 172.21.15.37:0/331902689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf599f0 msgr2=0x55661c345bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf599f0 0x55661c345bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 -- 172.21.15.37:0/331902689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661c3395a0 con 0x55661bf7a390 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc935f06640 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c34d020 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc92802ade0 tx=0x7fc928044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e76f8334f67d2f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc91affd640 1 -- 172.21.15.37:0/331902689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928045070 con 0x55661bf7a390 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc91affd640 1 -- 172.21.15.37:0/331902689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc928036040 con 0x55661bf7a390 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.163+0000 7fc91affd640 1 -- 172.21.15.37:0/331902689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92803e690 con 0x55661bf7a390 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 -- 172.21.15.37:0/331902689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 msgr2=0x55661c34d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c34d020 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc92802ade0 tx=0x7fc928044000 comp rx=0 tx=0).stop 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 -- 172.21.15.37:0/331902689 shutdown_connections 2024-08-31T06:49:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf7a390 0x55661c34d020 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf721b0 0x55661c35c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 --2- 172.21.15.37:0/331902689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf599f0 0x55661c345bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 -- 172.21.15.37:0/331902689 >> 172.21.15.37:0/331902689 conn(0x55661bf8f460 msgr2=0x55661c3454b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 -- 172.21.15.37:0/331902689 shutdown_connections 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 -- 172.21.15.37:0/331902689 wait complete. 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.164+0000 7fc93dede740 1 -- start start 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc93dede740 1 Processor -- start 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc93dede740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf599f0 0x55661c3541c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc93dede740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 0x55661c354700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc93dede740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf7a390 0x55661c354c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc93dede740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301ab840 con 0x55661bf599f0 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc93dede740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301accb0 con 0x55661bf721b0 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc93dede740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc9301abf10 con 0x55661bf7a390 2024-08-31T06:49:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc93dede740 10 client.0 _ll_register_callbacks cb 0x7fc92c00b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc935705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf599f0 0x55661c3541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc935705640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf599f0 0x55661c3541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45266/0 (socket says 172.21.15.37:45266) 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc935705640 1 -- 172.21.15.37:0/1380114498 learned_addr learned my addr 172.21.15.37:0/1380114498 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc934f04640 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 0x55661c354700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc935f06640 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf7a390 0x55661c354c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc935705640 1 -- 172.21.15.37:0/1380114498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf7a390 msgr2=0x55661c354c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.165+0000 7fc935705640 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf7a390 0x55661c354c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc935705640 1 -- 172.21.15.37:0/1380114498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 msgr2=0x55661c354700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc935705640 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 0x55661c354700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc935705640 1 -- 172.21.15.37:0/1380114498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661c3cbb90 con 0x55661bf599f0 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc935f06640 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf7a390 0x55661c354c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc935705640 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf599f0 0x55661c3541c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0afb40 tx=0x7fc92c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206ec93890feb866 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc918ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc918ff9640 1 -- 172.21.15.37:0/1380114498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c096070 con 0x55661bf599f0 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc918ff9640 1 -- 172.21.15.37:0/1380114498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fc92c0aa490 con 0x55661bf599f0 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc93dede740 1 -- 172.21.15.37:0/1380114498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc928036040 con 0x55661bf599f0 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc918ff9640 1 -- 172.21.15.37:0/1380114498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc92c0e2710 con 0x55661bf599f0 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc93dede740 10 client.16362 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc93dede740 1 -- 172.21.15.37:0/1380114498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55661c3cce40 con 0x55661bf599f0 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc918ff9640 1 -- 172.21.15.37:0/1380114498 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc928036040 con 0x55661bf599f0 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.166+0000 7fc918ff9640 1 -- 172.21.15.37:0/1380114498 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc92c0a9f00 con 0x55661bf599f0 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc93dede740 10 client.16362 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc93dede740 10 client.16362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc93dede740 20 client.16362 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc93dede740 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55661bf9b070 0x55661c3cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc93dede740 4 client.16362 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc93dede740 1 -- 172.21.15.37:0/1380114498 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55661c2b5070 con 0x55661bf9b070 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc934f04640 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55661bf9b070 0x55661c3cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc934f04640 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55661bf9b070 0x55661c3cf630 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170b1c3958a7ee69 server_cookie=593ec76dec3451f0 in_seq=0 out_seq=0 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc918ff9640 10 client.16362 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc918ff9640 1 -- 172.21.15.37:0/1380114498 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55661c2b5070 con 0x55661bf9b070 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc918ff9640 10 client.16362 handle_command_reply: tid=0 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.167+0000 7fc93dede740 1 client.16362 shutdown 2024-08-31T06:49:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 -- 172.21.15.37:0/1380114498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf599f0 msgr2=0x55661c3541c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf599f0 0x55661c3541c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0afb40 tx=0x7fc92c00bf90 comp rx=0 tx=0).stop 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 -- 172.21.15.37:0/1380114498 shutdown_connections 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55661bf9b070 0x55661c3cf630 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55661bf7a390 0x55661c354c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55661bf721b0 0x55661c354700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc918ff9640 0 client.16362 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 --2- 172.21.15.37:0/1380114498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55661bf599f0 0x55661c3541c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 -- 172.21.15.37:0/1380114498 >> 172.21.15.37:0/1380114498 conn(0x55661bf8f460 msgr2=0x55661c345c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 -- 172.21.15.37:0/1380114498 shutdown_connections 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 1 -- 172.21.15.37:0/1380114498 wait complete. 2024-08-31T06:49:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc93dede740 20 client.16362 trim_cache size 0 max 16384 2024-08-31T06:49:40.179 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:49:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc937969640 1 -- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc91c0b4d20 msgr2=0x7fc91c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc937969640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc91c0b4d20 0x7fc91c0b7230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc928031040 tx=0x7fc92802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc937969640 1 -- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930102820 msgr2=0x7fc93019a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc937969640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930102820 0x7fc93019a280 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00b4a0 tx=0x7fc92c00b960 comp rx=0 tx=0).stop 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc937969640 1 -- 172.21.15.37:0/327280290 shutdown_connections 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.168+0000 7fc937969640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc91c0b4d20 0x7fc91c0b7230 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.169+0000 7fc937969640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc930108ab0 0x7fc93019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.169+0000 7fc937969640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc930108160 0x7fc93019a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.169+0000 7fc937969640 1 --2- 172.21.15.37:0/327280290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc930102820 0x7fc93019a280 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.169+0000 7fc937969640 1 -- 172.21.15.37:0/327280290 >> 172.21.15.37:0/327280290 conn(0x7fc9300794e0 msgr2=0x7fc930100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.169+0000 7fc937969640 1 -- 172.21.15.37:0/327280290 shutdown_connections 2024-08-31T06:49:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:40.169+0000 7fc937969640 1 -- 172.21.15.37:0/327280290 wait complete. 2024-08-31T06:49:40.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:39 smithi106 ceph-mon[22134]: pgmap v404: 97 pgs: 97 active+clean; 266 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.9 MiB/s wr, 679 op/s 2024-08-31T06:49:41.887 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:49:41.888 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:49:42.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:41 smithi066 ceph-mon[22244]: pgmap v405: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.4 MiB/s wr, 326 op/s 2024-08-31T06:49:42.153 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:42.273 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:41 smithi037 ceph-mon[18612]: pgmap v405: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.4 MiB/s wr, 326 op/s 2024-08-31T06:49:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:41 smithi106 ceph-mon[22134]: pgmap v405: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 1.4 MiB/s wr, 326 op/s 2024-08-31T06:49:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.613+0000 7f892254f640 1 -- 172.21.15.37:0/3098835386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c102810 msgr2=0x7f891c102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.613+0000 7f892254f640 1 --2- 172.21.15.37:0/3098835386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c102810 0x7f891c102c20 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f890c009900 tx=0x7f890c02a410 comp rx=0 tx=0).stop 2024-08-31T06:49:42.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.613+0000 7f892254f640 1 -- 172.21.15.37:0/3098835386 shutdown_connections 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.613+0000 7f892254f640 1 --2- 172.21.15.37:0/3098835386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f891c108aa0 0x7f891c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.614+0000 7f892254f640 1 --2- 172.21.15.37:0/3098835386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f891c108150 0x7f891c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.614+0000 7f892254f640 1 --2- 172.21.15.37:0/3098835386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c102810 0x7f891c102c20 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.614+0000 7f892254f640 1 -- 172.21.15.37:0/3098835386 >> 172.21.15.37:0/3098835386 conn(0x7f891c0794d0 msgr2=0x7f891c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.614+0000 7f892254f640 1 -- 172.21.15.37:0/3098835386 shutdown_connections 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.614+0000 7f892254f640 1 -- 172.21.15.37:0/3098835386 wait complete. 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.614+0000 7f892254f640 1 Processor -- start 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.614+0000 7f892254f640 1 -- start start 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f892254f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f891c102810 0x7f891c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f892254f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c108150 0x7f891c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f892254f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f891c108aa0 0x7f891c19f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f892254f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1125b0 con 0x7f891c108150 2024-08-31T06:49:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f892254f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f891c112430 con 0x7f891c102810 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f892254f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f891c112730 con 0x7f891c108aa0 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c108150 0x7f891c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c108150 0x7f891c19a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45280/0 (socket says 172.21.15.37:45280) 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 -- 172.21.15.37:0/2530197466 learned_addr learned my addr 172.21.15.37:0/2530197466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891bfff640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f891c102810 0x7f891c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f8920aec640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f891c108aa0 0x7f891c19f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 -- 172.21.15.37:0/2530197466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f891c108aa0 msgr2=0x7f891c19f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f891c108aa0 0x7f891c19f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 -- 172.21.15.37:0/2530197466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f891c102810 msgr2=0x7f891c19a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f891c102810 0x7f891c19a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 -- 172.21.15.37:0/2530197466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c1a0120 con 0x7f891c108150 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f8920aec640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f891c108aa0 0x7f891c19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:49:42.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.615+0000 7f891b7fe640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c108150 0x7f891c19a750 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8910005fd0 tx=0x7f891000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.616+0000 7f89197fa640 1 -- 172.21.15.37:0/2530197466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910017070 con 0x7f891c108150 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.616+0000 7f89197fa640 1 -- 172.21.15.37:0/2530197466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8910009c30 con 0x7f891c108150 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.616+0000 7f892254f640 1 -- 172.21.15.37:0/2530197466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891c1a0410 con 0x7f891c108150 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.616+0000 7f89197fa640 1 -- 172.21.15.37:0/2530197466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910003c70 con 0x7f891c108150 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.616+0000 7f892254f640 1 -- 172.21.15.37:0/2530197466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891c1a6b70 con 0x7f891c108150 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.618+0000 7f89197fa640 1 -- 172.21.15.37:0/2530197466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f8910003e10 con 0x7f891c108150 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.618+0000 7f8928ac4740 1 Processor -- start 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8928ac4740 1 -- start start 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fd9a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fd9acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fd9b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8928ac4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56080fd105f0 con 0x56080f9cb490 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8928ac4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56080fcffb80 con 0x56080f9f4350 2024-08-31T06:49:42.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8928ac4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56080fd03b30 con 0x56080f9d3670 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fd9acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fd9acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45290/0 (socket says 172.21.15.37:45290) 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891bfff640 1 -- 172.21.15.37:0/3094969541 learned_addr learned my addr 172.21.15.37:0/3094969541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8920aec640 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fd9a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f89197fa640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f89040b4ca0 0x7f89040b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891b7fe640 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fd9b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891bfff640 1 -- 172.21.15.37:0/3094969541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 msgr2=0x56080fd9b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891bfff640 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fd9b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891bfff640 1 -- 172.21.15.37:0/3094969541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 msgr2=0x56080fd9a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891bfff640 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fd9a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891bfff640 1 -- 172.21.15.37:0/3094969541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56080fa5f930 con 0x56080f9cb490 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8920aec640 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fd9a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f891b7fe640 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fd9b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:49:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f89197fa640 1 -- 172.21.15.37:0/2530197466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f89100e51c0 con 0x7f891c108150 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.619+0000 7f8920aec640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f89040b4ca0 0x7f89040b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.620+0000 7f891bfff640 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fd9acc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f890c02a930 tx=0x7f890c031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e2491972d4fe46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.620+0000 7f89027fc640 1 -- 172.21.15.37:0/3094969541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c035030 con 0x56080f9cb490 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.620+0000 7f89027fc640 1 -- 172.21.15.37:0/3094969541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f890c040070 con 0x56080f9cb490 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.620+0000 7f8920aec640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f89040b4ca0 0x7f89040b71b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8914005fd0 tx=0x7f8914004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.620+0000 7f89027fc640 1 -- 172.21.15.37:0/3094969541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c003970 con 0x56080f9cb490 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 -- 172.21.15.37:0/3094969541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 msgr2=0x56080fd9acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fd9acc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f890c02a930 tx=0x7f890c031ba0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 -- 172.21.15.37:0/3094969541 shutdown_connections 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fd9acc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fd9b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 --2- 172.21.15.37:0/3094969541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fd9a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 -- 172.21.15.37:0/3094969541 >> 172.21.15.37:0/3094969541 conn(0x56080f9e8740 msgr2=0x56080fd98670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 -- 172.21.15.37:0/3094969541 shutdown_connections 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 -- 172.21.15.37:0/3094969541 wait complete. 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 -- start start 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.621+0000 7f8928ac4740 1 Processor -- start 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 0x56080fdaa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdaa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8928ac4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56080fb62890 con 0x56080f9f4350 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8928ac4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56080fc86790 con 0x56080f9cb490 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8928ac4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56080fdad260 con 0x56080f9d3670 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8928ac4740 10 client.0 _ll_register_callbacks cb 0x56080fa0bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8920aec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8920aec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45296/0 (socket says 172.21.15.37:45296) 2024-08-31T06:49:42.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8920aec640 1 -- 172.21.15.37:0/1358593920 learned_addr learned my addr 172.21.15.37:0/1358593920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f891bfff640 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 0x56080fdaa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f891b7fe640 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdaa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8920aec640 1 -- 172.21.15.37:0/1358593920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 msgr2=0x56080fdaa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8920aec640 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdaa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8920aec640 1 -- 172.21.15.37:0/1358593920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 msgr2=0x56080fdaa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8920aec640 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 0x56080fdaa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.622+0000 7f8920aec640 1 -- 172.21.15.37:0/1358593920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56080fcbdf30 con 0x56080f9f4350 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8920aec640 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb65c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f89140128a0 tx=0x7f8914004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb739ec6d9e39d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f88fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f88fb7fe640 1 -- 172.21.15.37:0/1358593920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891401cd70 con 0x56080f9f4350 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f88fb7fe640 1 -- 172.21.15.37:0/1358593920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f891401d450 con 0x56080f9f4350 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 1 -- 172.21.15.37:0/1358593920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f890c040070 con 0x56080f9f4350 2024-08-31T06:49:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f88fb7fe640 1 -- 172.21.15.37:0/1358593920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8914012e20 con 0x56080f9f4350 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 10 client.16374 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 1 -- 172.21.15.37:0/1358593920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56080fdb9130 con 0x56080f9f4350 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f88fb7fe640 1 -- 172.21.15.37:0/1358593920 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f890c040070 con 0x56080f9f4350 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f88fb7fe640 1 -- 172.21.15.37:0/1358593920 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f891401a5d0 con 0x56080f9f4350 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 10 client.16374 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 10 client.16374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 20 client.16374 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56080f9b2cd0 0x56080fdbc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 4 client.16374 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.623+0000 7f8928ac4740 1 -- 172.21.15.37:0/1358593920 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56080fd12540 con 0x56080f9b2cd0 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.624+0000 7f891bfff640 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56080f9b2cd0 0x56080fdbc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.624+0000 7f891bfff640 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56080f9b2cd0 0x56080fdbc780 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac0e4c7e0d495419 server_cookie=28b573c81eb37cde in_seq=0 out_seq=0 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.624+0000 7f88fb7fe640 10 client.16374 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f88fb7fe640 1 -- 172.21.15.37:0/1358593920 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56080fd12540 con 0x56080f9b2cd0 2024-08-31T06:49:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f88fb7fe640 10 client.16374 handle_command_reply: tid=0 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 client.16374 shutdown 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 -- 172.21.15.37:0/1358593920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 msgr2=0x56080fdb65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb65c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f89140128a0 tx=0x7f8914004ab0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 -- 172.21.15.37:0/1358593920 shutdown_connections 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56080f9b2cd0 0x56080fdbc780 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb65c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdaa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 --2- 172.21.15.37:0/1358593920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 0x56080fdaa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 -- 172.21.15.37:0/1358593920 >> 172.21.15.37:0/1358593920 conn(0x56080f9e8740 msgr2=0x56080fd96c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f88fb7fe640 0 client.16374 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 -- 172.21.15.37:0/1358593920 shutdown_connections 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 1 -- 172.21.15.37:0/1358593920 wait complete. 2024-08-31T06:49:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.625+0000 7f8928ac4740 20 client.16374 trim_cache size 0 max 16384 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8928ac4740 1 Processor -- start 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8928ac4740 1 -- start start 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 0x56080fda02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdb64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8928ac4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1afa70 con 0x56080f9f4350 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8928ac4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1ad340 con 0x56080f9cb490 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8928ac4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1ab1b0 con 0x56080f9d3670 2024-08-31T06:49:42.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8920aec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.643+0000 7f8920aec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45312/0 (socket says 172.21.15.37:45312) 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8920aec640 1 -- 172.21.15.37:0/3571115052 learned_addr learned my addr 172.21.15.37:0/3571115052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f891b7fe640 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdb64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f891bfff640 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 0x56080fda02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8920aec640 1 -- 172.21.15.37:0/3571115052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 msgr2=0x56080fdb64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8920aec640 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdb64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8920aec640 1 -- 172.21.15.37:0/3571115052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 msgr2=0x56080fda02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8920aec640 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 0x56080fda02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8920aec640 1 -- 172.21.15.37:0/3571115052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56080fd9b570 con 0x56080f9f4350 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f891b7fe640 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdb64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8920aec640 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb6a00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8914012500 tx=0x7f8914012530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521fb515f6d5f54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8901ffb640 1 -- 172.21.15.37:0/3571115052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891403d070 con 0x56080f9f4350 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8901ffb640 1 -- 172.21.15.37:0/3571115052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f891401a440 con 0x56080f9f4350 2024-08-31T06:49:42.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.644+0000 7f8901ffb640 1 -- 172.21.15.37:0/3571115052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891401d840 con 0x56080f9f4350 2024-08-31T06:49:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 -- 172.21.15.37:0/3571115052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 msgr2=0x56080fdb6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb6a00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f8914012500 tx=0x7f8914012530 comp rx=0 tx=0).stop 2024-08-31T06:49:42.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 -- 172.21.15.37:0/3571115052 shutdown_connections 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9f4350 0x56080fdb6a00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdb64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 --2- 172.21.15.37:0/3571115052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9cb490 0x56080fda02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 -- 172.21.15.37:0/3571115052 >> 172.21.15.37:0/3571115052 conn(0x56080f9e8740 msgr2=0x56080fd98620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 -- 172.21.15.37:0/3571115052 shutdown_connections 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.645+0000 7f8928ac4740 1 -- 172.21.15.37:0/3571115052 wait complete. 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 1 -- start start 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 1 Processor -- start 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fdb2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdae360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fdaea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1ab800 con 0x56080f9cb490 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1acc70 con 0x56080f9f4350 2024-08-31T06:49:42.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f891c1abed0 con 0x56080f9d3670 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8928ac4740 10 client.0 _ll_register_callbacks cb 0x7f8914009770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f891bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fdb2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f891bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fdb2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45320/0 (socket says 172.21.15.37:45320) 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f891bfff640 1 -- 172.21.15.37:0/799524670 learned_addr learned my addr 172.21.15.37:0/799524670 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f8920aec640 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fdaea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.646+0000 7f891b7fe640 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f891bfff640 1 -- 172.21.15.37:0/799524670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 msgr2=0x56080fdae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f891bfff640 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f891bfff640 1 -- 172.21.15.37:0/799524670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 msgr2=0x56080fdaea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f891bfff640 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fdaea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f891bfff640 1 -- 172.21.15.37:0/799524670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56080fdaf190 con 0x56080f9cb490 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f891b7fe640 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f891bfff640 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fdb2e60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f890c005f70 tx=0x7f890c009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810ad109561a5782 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:42.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f88fb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f88fb7fe640 1 -- 172.21.15.37:0/799524670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c035040 con 0x56080f9cb490 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f88fb7fe640 1 -- 172.21.15.37:0/799524670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f890c004040 con 0x56080f9cb490 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f8928ac4740 1 -- 172.21.15.37:0/799524670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f891401a440 con 0x56080f9cb490 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f88fb7fe640 1 -- 172.21.15.37:0/799524670 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f890c004240 con 0x56080f9cb490 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f8928ac4740 10 client.16380 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.647+0000 7f8928ac4740 1 -- 172.21.15.37:0/799524670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56080fe27270 con 0x56080f9cb490 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f88fb7fe640 1 -- 172.21.15.37:0/799524670 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f891401a440 con 0x56080f9cb490 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f88fb7fe640 1 -- 172.21.15.37:0/799524670 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f890c04d070 con 0x56080f9cb490 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f8928ac4740 10 client.16380 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f8928ac4740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f8928ac4740 20 client.16380 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f8928ac4740 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56080f988080 0x56080fe295c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f8928ac4740 4 client.16380 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:49:42.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f8928ac4740 1 -- 172.21.15.37:0/799524670 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56080fd0dfe0 con 0x56080f988080 2024-08-31T06:49:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.648+0000 7f891b7fe640 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56080f988080 0x56080fe295c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.649+0000 7f88fb7fe640 10 client.16380 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.649+0000 7f891b7fe640 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56080f988080 0x56080fe295c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4392cf93a8a9c70c server_cookie=6f0bb29915c7a560 in_seq=0 out_seq=0 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.650+0000 7f88fb7fe640 1 -- 172.21.15.37:0/799524670 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56080fd0dfe0 con 0x56080f988080 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.650+0000 7f88fb7fe640 10 client.16380 handle_command_reply: tid=0 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.650+0000 7f8928ac4740 1 client.16380 shutdown 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 -- 172.21.15.37:0/799524670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 msgr2=0x56080fdb2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fdb2e60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f890c005f70 tx=0x7f890c009830 comp rx=0 tx=0).stop 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 -- 172.21.15.37:0/799524670 shutdown_connections 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56080f988080 0x56080fe295c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56080f9f4350 0x56080fdaea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56080f9d3670 0x56080fdae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 --2- 172.21.15.37:0/799524670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56080f9cb490 0x56080fdb2e60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f88fb7fe640 0 client.16380 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 -- 172.21.15.37:0/799524670 >> 172.21.15.37:0/799524670 conn(0x56080f9e8740 msgr2=0x56080fd98620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 -- 172.21.15.37:0/799524670 shutdown_connections 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 1 -- 172.21.15.37:0/799524670 wait complete. 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.651+0000 7f8928ac4740 20 client.16380 trim_cache size 0 max 16384 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "8c6f02a9-24da-4675-a2f0-73d36a5c4bec", 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:49:42.655 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:49:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 -- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f89040b4ca0 msgr2=0x7f89040b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f89040b4ca0 0x7f89040b71b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8914005fd0 tx=0x7f8914004a40 comp rx=0 tx=0).stop 2024-08-31T06:49:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 -- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c108150 msgr2=0x7f891c19a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c108150 0x7f891c19a750 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8910005fd0 tx=0x7f891000dde0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 -- 172.21.15.37:0/2530197466 shutdown_connections 2024-08-31T06:49:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f89040b4ca0 0x7f89040b71b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f891c108150 0x7f891c19a750 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f891c108aa0 0x7f891c19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 --2- 172.21.15.37:0/2530197466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f891c102810 0x7f891c19a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 -- 172.21.15.37:0/2530197466 >> 172.21.15.37:0/2530197466 conn(0x7f891c0794d0 msgr2=0x7f891c106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 -- 172.21.15.37:0/2530197466 shutdown_connections 2024-08-31T06:49:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:42.652+0000 7f892254f640 1 -- 172.21.15.37:0/2530197466 wait complete. 2024-08-31T06:49:43.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:49:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:49:44.121 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:43 smithi037 ceph-mon[18612]: pgmap v406: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 143 KiB/s wr, 27 op/s 2024-08-31T06:49:44.121 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:43 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:49:44.121 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:43 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:44.121 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:43 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:49:44.121 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:43 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:43 smithi066 ceph-mon[22244]: pgmap v406: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 143 KiB/s wr, 27 op/s 2024-08-31T06:49:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:43 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:49:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:43 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:43 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:49:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:43 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:44.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 -- 172.21.15.37:0/807427291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8103900 msgr2=0x7f47f8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/807427291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8103900 0x7f47f8103d10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009ca0 tx=0x7f47e802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 -- 172.21.15.37:0/807427291 shutdown_connections 2024-08-31T06:49:44.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/807427291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f8109b90 0x7f47f81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/807427291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47f8109240 0x7f47f8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/807427291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8103900 0x7f47f8103d10 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 -- 172.21.15.37:0/807427291 >> 172.21.15.37:0/807427291 conn(0x7f47f807b5f0 msgr2=0x7f47f807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:44.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 -- 172.21.15.37:0/807427291 shutdown_connections 2024-08-31T06:49:44.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 -- 172.21.15.37:0/807427291 wait complete. 2024-08-31T06:49:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.303+0000 7f47fc8d9640 1 Processor -- start 2024-08-31T06:49:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47fc8d9640 1 -- start start 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47fc8d9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f8103900 0x7f47f80754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47fc8d9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47f8109240 0x7f47f80759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47fc8d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8109b90 0x7f47f8075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47fc8d9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81137b0 con 0x7f47f8109b90 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47fc8d9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8113630 con 0x7f47f8109240 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47fc8d9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f47f8113930 con 0x7f47f8103900 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8109b90 0x7f47f8075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8109b90 0x7f47f8075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47804/0 (socket says 172.21.15.37:47804) 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f6d9d640 1 -- 172.21.15.37:0/1785602416 learned_addr learned my addr 172.21.15.37:0/1785602416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f659c640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f8103900 0x7f47f80754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47f8109240 0x7f47f80759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f6d9d640 1 -- 172.21.15.37:0/1785602416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f8103900 msgr2=0x7f47f80754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f6d9d640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f8103900 0x7f47f80754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f6d9d640 1 -- 172.21.15.37:0/1785602416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47f8109240 msgr2=0x7f47f80759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f6d9d640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47f8109240 0x7f47f80759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f6d9d640 1 -- 172.21.15.37:0/1785602416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f81a84a0 con 0x7f47f8109b90 2024-08-31T06:49:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.304+0000 7f47f659c640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f8103900 0x7f47f80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:49:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.305+0000 7f47f6d9d640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8109b90 0x7f47f8075f30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009fd0 tx=0x7f47f000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.305+0000 7f47ef7fe640 1 -- 172.21.15.37:0/1785602416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0011830 con 0x7f47f8109b90 2024-08-31T06:49:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.305+0000 7f47ef7fe640 1 -- 172.21.15.37:0/1785602416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47f0016070 con 0x7f47f8109b90 2024-08-31T06:49:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.305+0000 7f47fc8d9640 1 -- 172.21.15.37:0/1785602416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f81a8790 con 0x7f47f8109b90 2024-08-31T06:49:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.305+0000 7f47ef7fe640 1 -- 172.21.15.37:0/1785602416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f0010d20 con 0x7f47f8109b90 2024-08-31T06:49:44.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.305+0000 7f47fc8d9640 1 -- 172.21.15.37:0/1785602416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f81a8c80 con 0x7f47f8109b90 2024-08-31T06:49:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.307+0000 7f47ef7fe640 1 -- 172.21.15.37:0/1785602416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f47f001b460 con 0x7f47f8109b90 2024-08-31T06:49:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f4802e4e740 1 Processor -- start 2024-08-31T06:49:44.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f4802e4e740 1 -- start start 2024-08-31T06:49:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cf9070 0x56262709e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cd01b0 0x56262709e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x56262709ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f4802e4e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562627015630 con 0x562626cd01b0 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f4802e4e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562627004bc0 con 0x562626cf9070 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f4802e4e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x562627008b70 con 0x562626cd8390 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f47f659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cd01b0 0x56262709e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f47f659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cd01b0 0x56262709e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47808/0 (socket says 172.21.15.37:47808) 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f47f659c640 1 -- 172.21.15.37:0/850034307 learned_addr learned my addr 172.21.15.37:0/850034307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.308+0000 7f47ef7fe640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f47e40b4ca0 0x7f47e40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cf9070 0x56262709e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x56262709ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f6d9d640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f47e40b4ca0 0x7f47e40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f659c640 1 -- 172.21.15.37:0/850034307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 msgr2=0x56262709ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f659c640 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x56262709ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f659c640 1 -- 172.21.15.37:0/850034307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cf9070 msgr2=0x56262709e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:44.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47ef7fe640 1 -- 172.21.15.37:0/1785602416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f47f00e4ba0 con 0x7f47f8109b90 2024-08-31T06:49:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f659c640 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cf9070 0x56262709e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f659c640 1 -- 172.21.15.37:0/850034307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562626d64650 con 0x562626cd01b0 2024-08-31T06:49:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f659c640 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cd01b0 0x56262709e800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009ca0 tx=0x7f47e8031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaac7f461b00587e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47f6d9d640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f47e40b4ca0 0x7f47e40b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f47f00a84e0 tx=0x7f47f000bf90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47ecff9640 1 -- 172.21.15.37:0/850034307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8031b80 con 0x562626cd01b0 2024-08-31T06:49:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47ecff9640 1 -- 172.21.15.37:0/850034307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47e8036040 con 0x562626cd01b0 2024-08-31T06:49:44.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.309+0000 7f47ecff9640 1 -- 172.21.15.37:0/850034307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e8004450 con 0x562626cd01b0 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 -- 172.21.15.37:0/850034307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cd01b0 msgr2=0x56262709e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cd01b0 0x56262709e800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009ca0 tx=0x7f47e8031610 comp rx=0 tx=0).stop 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 -- 172.21.15.37:0/850034307 shutdown_connections 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cd01b0 0x56262709e800 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x56262709ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 --2- 172.21.15.37:0/850034307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cf9070 0x56262709e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 -- 172.21.15.37:0/850034307 >> 172.21.15.37:0/850034307 conn(0x562626ced460 msgr2=0x56262709c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 -- 172.21.15.37:0/850034307 shutdown_connections 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.310+0000 7f4802e4e740 1 -- 172.21.15.37:0/850034307 wait complete. 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 1 -- start start 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 1 Processor -- start 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd01b0 0x5626270a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd8390 0x5626270a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cf9070 0x5626270b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562626e67700 con 0x562626cf9070 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562626f8b700 con 0x562626cd8390 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5626270aca40 con 0x562626cd01b0 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f4802e4e740 10 client.0 _ll_register_callbacks cb 0x562626fbadc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cf9070 0x5626270b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cf9070 0x5626270b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47822/0 (socket says 172.21.15.37:47822) 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f47f5d9b640 1 -- 172.21.15.37:0/254015888 learned_addr learned my addr 172.21.15.37:0/254015888 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd01b0 0x5626270a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.311+0000 7f47f659c640 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd8390 0x5626270a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47f5d9b640 1 -- 172.21.15.37:0/254015888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd01b0 msgr2=0x5626270a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd01b0 0x5626270a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47f5d9b640 1 -- 172.21.15.37:0/254015888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd8390 msgr2=0x5626270a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd8390 0x5626270a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47f5d9b640 1 -- 172.21.15.37:0/254015888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562626fc48b0 con 0x562626cf9070 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cf9070 0x5626270b5d30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47e000d340 tx=0x7f47e000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae56b48ac38c1f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47ddffb640 1 -- 172.21.15.37:0/254015888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00140d0 con 0x562626cf9070 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47ddffb640 1 -- 172.21.15.37:0/254015888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f47e0014270 con 0x562626cf9070 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f4802e4e740 1 -- 172.21.15.37:0/254015888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e8036040 con 0x562626cf9070 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f47ddffb640 1 -- 172.21.15.37:0/254015888 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f47e0028050 con 0x562626cf9070 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f4802e4e740 10 client.16392 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.312+0000 7f4802e4e740 1 -- 172.21.15.37:0/254015888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626270b8810 con 0x562626cf9070 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f47ddffb640 1 -- 172.21.15.37:0/254015888 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47e8036040 con 0x562626cf9070 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f47ddffb640 1 -- 172.21.15.37:0/254015888 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f47e0003940 con 0x562626cf9070 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f4802e4e740 10 client.16392 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f4802e4e740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f4802e4e740 20 client.16392 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:44.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f4802e4e740 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x562626cb79f0 0x5626270bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f4802e4e740 4 client.16392 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:49:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f4802e4e740 1 -- 172.21.15.37:0/254015888 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562627017580 con 0x562626cb79f0 2024-08-31T06:49:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.313+0000 7f47f659c640 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x562626cb79f0 0x5626270bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.314+0000 7f47ddffb640 10 client.16392 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:44.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.314+0000 7f47f659c640 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x562626cb79f0 0x5626270bbc70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b443557190328d67 server_cookie=dfb7e71bc66f14d in_seq=0 out_seq=0 2024-08-31T06:49:44.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:43 smithi106 ceph-mon[22134]: pgmap v406: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 143 KiB/s wr, 27 op/s 2024-08-31T06:49:44.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:43 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:49:44.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:43 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:44.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:43 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:49:44.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:43 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:49:44.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.314+0000 7f47ddffb640 1 -- 172.21.15.37:0/254015888 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562627017580 con 0x562626cb79f0 2024-08-31T06:49:44.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.314+0000 7f47ddffb640 10 client.16392 handle_command_reply: tid=0 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.314+0000 7f4802e4e740 1 client.16392 shutdown 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 -- 172.21.15.37:0/254015888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cf9070 msgr2=0x5626270b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cf9070 0x5626270b5d30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47e000d340 tx=0x7f47e000cb50 comp rx=0 tx=0).stop 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 -- 172.21.15.37:0/254015888 shutdown_connections 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x562626cb79f0 0x5626270bbc70 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626cf9070 0x5626270b5d30 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd8390 0x5626270a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f47ddffb640 0 client.16392 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 --2- 172.21.15.37:0/254015888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd01b0 0x5626270a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 -- 172.21.15.37:0/254015888 >> 172.21.15.37:0/254015888 conn(0x562626ced460 msgr2=0x5626270a14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 -- 172.21.15.37:0/254015888 shutdown_connections 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 1 -- 172.21.15.37:0/254015888 wait complete. 2024-08-31T06:49:44.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.315+0000 7f4802e4e740 20 client.16392 trim_cache size 0 max 16384 2024-08-31T06:49:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.332+0000 7f4802e4e740 1 Processor -- start 2024-08-31T06:49:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f4802e4e740 1 -- start start 2024-08-31T06:49:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270ab640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 0x5626270c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x5626270c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f4802e4e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81b3e60 con 0x562626ced460 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f4802e4e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81b1730 con 0x562626cd01b0 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f4802e4e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81af580 con 0x562626cd8390 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270ab640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47834/0 (socket says 172.21.15.37:47834) 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 -- 172.21.15.37:0/3676396589 learned_addr learned my addr 172.21.15.37:0/3676396589 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 -- 172.21.15.37:0/3676396589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 msgr2=0x5626270c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/3676396589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x5626270c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 -- 172.21.15.37:0/3676396589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 msgr2=0x5626270c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/3676396589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 0x5626270c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 -- 172.21.15.37:0/3676396589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626270a05b0 con 0x562626ced460 2024-08-31T06:49:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.333+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/3676396589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270ab640 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f47e000cf50 tx=0x7f47e0005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a31e1083893d97c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f47dffff640 1 -- 172.21.15.37:0/3676396589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00142d0 con 0x562626ced460 2024-08-31T06:49:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f47dffff640 1 -- 172.21.15.37:0/3676396589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47e0003a80 con 0x562626ced460 2024-08-31T06:49:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f47dffff640 1 -- 172.21.15.37:0/3676396589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00042f0 con 0x562626ced460 2024-08-31T06:49:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f4802e4e740 1 -- 172.21.15.37:0/3676396589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 msgr2=0x5626270ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3676396589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270ab640 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f47e000cf50 tx=0x7f47e0005f30 comp rx=0 tx=0).stop 2024-08-31T06:49:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f4802e4e740 1 -- 172.21.15.37:0/3676396589 shutdown_connections 2024-08-31T06:49:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3676396589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x5626270c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3676396589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 0x5626270c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3676396589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270ab640 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f4802e4e740 1 -- 172.21.15.37:0/3676396589 >> 172.21.15.37:0/3676396589 conn(0x5626270a5360 msgr2=0x5626270aaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.334+0000 7f4802e4e740 1 -- 172.21.15.37:0/3676396589 shutdown_connections 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 -- 172.21.15.37:0/3676396589 wait complete. 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 -- start start 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 Processor -- start 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 0x5626270b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x5626270ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81afbf0 con 0x562626ced460 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81b1060 con 0x562626cd01b0 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f47f81b02c0 con 0x562626cd8390 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.335+0000 7f4802e4e740 10 client.0 _ll_register_callbacks cb 0x7f47e000cd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47846/0 (socket says 172.21.15.37:47846) 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 -- 172.21.15.37:0/3895505965 learned_addr learned my addr 172.21.15.37:0/3895505965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 0x5626270b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f659c640 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x5626270ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 -- 172.21.15.37:0/3895505965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 msgr2=0x5626270ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x5626270ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 -- 172.21.15.37:0/3895505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 msgr2=0x5626270b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 0x5626270b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 -- 172.21.15.37:0/3895505965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626270af750 con 0x562626ced460 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47f5d9b640 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270aefc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f47e000e010 tx=0x7f47e0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5cb1870ba72ba2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47ddffb640 1 -- 172.21.15.37:0/3895505965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e00035f0 con 0x562626ced460 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f47ddffb640 1 -- 172.21.15.37:0/3895505965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f47e0003790 con 0x562626ced460 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.336+0000 7f4802e4e740 1 -- 172.21.15.37:0/3895505965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47e0003a80 con 0x562626ced460 2024-08-31T06:49:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f47ddffb640 1 -- 172.21.15.37:0/3895505965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f47e00140d0 con 0x562626ced460 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f4802e4e740 10 client.16398 fetch_fsmap learned FSMap version 25 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f4802e4e740 1 -- 172.21.15.37:0/3895505965 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626271276c0 con 0x562626ced460 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f47ddffb640 1 -- 172.21.15.37:0/3895505965 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47e0003a80 con 0x562626ced460 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f47ddffb640 1 -- 172.21.15.37:0/3895505965 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f47e0037450 con 0x562626ced460 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f4802e4e740 10 client.16398 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f4802e4e740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f4802e4e740 20 client.16398 populate_metadata read hostname 'smithi037' 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x562626cf9070 0x562627129d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f4802e4e740 4 client.16398 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f4802e4e740 1 -- 172.21.15.37:0/3895505965 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562627013020 con 0x562626cf9070 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.337+0000 7f47f659c640 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x562626cf9070 0x562627129d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:49:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f47f659c640 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x562626cf9070 0x562627129d20 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad9a34bd1792b4e5 server_cookie=645ebd5f7e4c4b4e in_seq=0 out_seq=0 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f47ddffb640 10 client.16398 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f47ddffb640 1 -- 172.21.15.37:0/3895505965 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x562627013020 con 0x562626cf9070 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f47ddffb640 10 client.16398 handle_command_reply: tid=0 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 client.16398 shutdown 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 -- 172.21.15.37:0/3895505965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 msgr2=0x5626270aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270aefc0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f47e000e010 tx=0x7f47e0005fd0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 -- 172.21.15.37:0/3895505965 shutdown_connections 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x562626cf9070 0x562627129d20 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562626ced460 0x5626270aefc0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562626cd8390 0x5626270ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 --2- 172.21.15.37:0/3895505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562626cd01b0 0x5626270b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 -- 172.21.15.37:0/3895505965 >> 172.21.15.37:0/3895505965 conn(0x5626270a5360 msgr2=0x5626270aadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f47ddffb640 0 client.16398 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 -- 172.21.15.37:0/3895505965 shutdown_connections 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 1 -- 172.21.15.37:0/3895505965 wait complete. 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.338+0000 7f4802e4e740 20 client.16398 trim_cache size 0 max 16384 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:44.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "8c6f02a9-24da-4675-a2f0-73d36a5c4bec", 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:49:44.346 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:44.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:49:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:49:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:49:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:49:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:49:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:49:44.349 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:49:44.349 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:49:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 -- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f47e40b4ca0 msgr2=0x7f47e40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f47e40b4ca0 0x7f47e40b71b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f47f00a84e0 tx=0x7f47f000bf90 comp rx=0 tx=0).stop 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 -- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8109b90 msgr2=0x7f47f8075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8109b90 0x7f47f8075f30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009fd0 tx=0x7f47f000b8e0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 -- 172.21.15.37:0/1785602416 shutdown_connections 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f47e40b4ca0 0x7f47e40b71b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47f8109b90 0x7f47f8075f30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47f8109240 0x7f47f80759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 --2- 172.21.15.37:0/1785602416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47f8103900 0x7f47f80754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 -- 172.21.15.37:0/1785602416 >> 172.21.15.37:0/1785602416 conn(0x7f47f807b5f0 msgr2=0x7f47f8107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 -- 172.21.15.37:0/1785602416 shutdown_connections 2024-08-31T06:49:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:49:44.339+0000 7f47fc8d9640 1 -- 172.21.15.37:0/1785602416 wait complete. 2024-08-31T06:49:45.062 INFO:tasks.cephfs.filesystem:scrub status for tag:8c6f02a9-24da-4675-a2f0-73d36a5c4bec - {'path': '/', 'tag': '8c6f02a9-24da-4675-a2f0-73d36a5c4bec', 'options': 'recursive,force'} 2024-08-31T06:49:46.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:45 smithi066 ceph-mon[22244]: pgmap v407: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T06:49:46.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:45 smithi106 ceph-mon[22134]: pgmap v407: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T06:49:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:45 smithi037 ceph-mon[18612]: pgmap v407: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-08-31T06:49:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:47 smithi066 ceph-mon[22244]: pgmap v408: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-08-31T06:49:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:47 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:49:48.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:47 smithi106 ceph-mon[22134]: pgmap v408: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-08-31T06:49:48.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:47 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:49:48.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:47 smithi037 ceph-mon[18612]: pgmap v408: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-08-31T06:49:48.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:47 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:49:50.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:49 smithi066 ceph-mon[22244]: pgmap v409: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T06:49:50.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:49 smithi106 ceph-mon[22134]: pgmap v409: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T06:49:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:49 smithi037 ceph-mon[18612]: pgmap v409: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-31T06:49:52.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:51 smithi066 ceph-mon[22244]: pgmap v410: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-31T06:49:52.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:51 smithi106 ceph-mon[22134]: pgmap v410: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-31T06:49:52.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:51 smithi037 ceph-mon[18612]: pgmap v410: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-31T06:49:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:53 smithi066 ceph-mon[22244]: pgmap v411: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T06:49:54.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:53 smithi106 ceph-mon[22134]: pgmap v411: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T06:49:54.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:53 smithi037 ceph-mon[18612]: pgmap v411: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-31T06:49:56.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:55 smithi066 ceph-mon[22244]: pgmap v412: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:49:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:55 smithi106 ceph-mon[22134]: pgmap v412: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:49:56.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:55 smithi037 ceph-mon[18612]: pgmap v412: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:49:57.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:56 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:49:57.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:56 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:49:57.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:56 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:49:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:57 smithi106 ceph-mon[22134]: pgmap v413: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T06:49:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:49:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:49:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:49:58.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:57 smithi037 ceph-mon[18612]: pgmap v413: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T06:49:58.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:49:58.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:49:58.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:49:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:57 smithi066 ceph-mon[22244]: pgmap v413: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 597 B/s wr, 7 op/s 2024-08-31T06:49:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:49:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:49:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:50:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:49:59 smithi106 ceph-mon[22134]: pgmap v414: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:50:00.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:49:59 smithi037 ceph-mon[18612]: pgmap v414: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:50:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:49:59 smithi066 ceph-mon[22244]: pgmap v414: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:50:01.289 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:00 smithi066 ceph-mon[22244]: overall HEALTH_OK 2024-08-31T06:50:01.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:00 smithi106 ceph-mon[22134]: overall HEALTH_OK 2024-08-31T06:50:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:00 smithi037 ceph-mon[18612]: overall HEALTH_OK 2024-08-31T06:50:02.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:01 smithi106 ceph-mon[22134]: pgmap v415: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T06:50:02.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:01 smithi037 ceph-mon[18612]: pgmap v415: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T06:50:02.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:01 smithi066 ceph-mon[22244]: pgmap v415: 97 pgs: 97 active+clean; 259 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-31T06:50:04.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:03 smithi106 ceph-mon[22134]: pgmap v416: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T06:50:04.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:03 smithi037 ceph-mon[18612]: pgmap v416: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T06:50:04.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:03 smithi066 ceph-mon[22244]: pgmap v416: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-31T06:50:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:05 smithi106 ceph-mon[22134]: pgmap v417: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:50:06.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:05 smithi037 ceph-mon[18612]: pgmap v417: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:50:06.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:05 smithi066 ceph-mon[22244]: pgmap v417: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:50:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:07 smithi106 ceph-mon[22134]: pgmap v418: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:50:08.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:07 smithi037 ceph-mon[18612]: pgmap v418: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:50:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:07 smithi066 ceph-mon[22244]: pgmap v418: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:50:10.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:09 smithi106 ceph-mon[22134]: pgmap v419: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:50:10.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:09 smithi037 ceph-mon[18612]: pgmap v419: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:50:10.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:09 smithi066 ceph-mon[22244]: pgmap v419: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:50:12.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:11 smithi106 ceph-mon[22134]: pgmap v420: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:50:12.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:11 smithi037 ceph-mon[18612]: pgmap v420: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:50:12.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:11 smithi066 ceph-mon[22244]: pgmap v420: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:50:14.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:13 smithi106 ceph-mon[22134]: pgmap v421: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:50:14.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:13 smithi037 ceph-mon[18612]: pgmap v421: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:50:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:13 smithi066 ceph-mon[22244]: pgmap v421: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:50:15.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:50:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 -- 172.21.15.37:0/300186198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24102810 msgr2=0x7f3c24102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/300186198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24102810 0x7f3c24102c20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009900 tx=0x7f3c2002a410 comp rx=0 tx=0).stop 2024-08-31T06:50:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 -- 172.21.15.37:0/300186198 shutdown_connections 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/300186198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c24108aa0 0x7f3c2410f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/300186198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c24108150 0x7f3c24108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/300186198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24102810 0x7f3c24102c20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 -- 172.21.15.37:0/300186198 >> 172.21.15.37:0/300186198 conn(0x7f3c240794b0 msgr2=0x7f3c240798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 -- 172.21.15.37:0/300186198 shutdown_connections 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 -- 172.21.15.37:0/300186198 wait complete. 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 Processor -- start 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.831+0000 7f3c2b30c640 1 -- start start 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c2b30c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c24102810 0x7f3c2419c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c2b30c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24108150 0x7f3c2419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c2b30c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c24108aa0 0x7f3c241a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c2b30c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24112600 con 0x7f3c24108150 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c2b30c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24112480 con 0x7f3c24108aa0 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c2b30c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24112780 con 0x7f3c24102810 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24108150 0x7f3c2419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24108150 0x7f3c2419c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35618/0 (socket says 172.21.15.37:35618) 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 -- 172.21.15.37:0/745351625 learned_addr learned my addr 172.21.15.37:0/745351625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c298a9640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c24108aa0 0x7f3c241a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c290a8640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c24102810 0x7f3c2419c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 -- 172.21.15.37:0/745351625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c24102810 msgr2=0x7f3c2419c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c24102810 0x7f3c2419c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 -- 172.21.15.37:0/745351625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c24108aa0 msgr2=0x7f3c241a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c24108aa0 0x7f3c241a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 -- 172.21.15.37:0/745351625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c241a22f0 con 0x7f3c24108150 2024-08-31T06:50:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.832+0000 7f3c288a7640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24108150 0x7f3c2419c920 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400d740 tx=0x7f3c1400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.833+0000 7f3c1a7fc640 1 -- 172.21.15.37:0/745351625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14017070 con 0x7f3c24108150 2024-08-31T06:50:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.833+0000 7f3c1a7fc640 1 -- 172.21.15.37:0/745351625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c1400de50 con 0x7f3c24108150 2024-08-31T06:50:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.833+0000 7f3c1a7fc640 1 -- 172.21.15.37:0/745351625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400f620 con 0x7f3c24108150 2024-08-31T06:50:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.833+0000 7f3c2b30c640 1 -- 172.21.15.37:0/745351625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c241a25e0 con 0x7f3c24108150 2024-08-31T06:50:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.833+0000 7f3c2b30c640 1 -- 172.21.15.37:0/745351625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c241a8d40 con 0x7f3c24108150 2024-08-31T06:50:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.835+0000 7f3c31881740 1 Processor -- start 2024-08-31T06:50:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c31881740 1 -- start start 2024-08-31T06:50:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c1a7fc640 1 -- 172.21.15.37:0/745351625 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f3c1401a070 con 0x7f3c24108150 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c31881740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2685070 0x55dfe2a2a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c31881740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a2a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c31881740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2664390 0x55dfe2a2ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c31881740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dfe29a1630 con 0x55dfe2685070 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c31881740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dfe2990bc0 con 0x55dfe265c1b0 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c31881740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dfe2994b70 con 0x55dfe2664390 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c298a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2685070 0x55dfe2a2a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c298a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2685070 0x55dfe2a2a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35628/0 (socket says 172.21.15.37:35628) 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c298a9640 1 -- 172.21.15.37:0/1025272479 learned_addr learned my addr 172.21.15.37:0/1025272479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c290a8640 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a2a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c288a7640 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2664390 0x55dfe2a2ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c298a9640 1 -- 172.21.15.37:0/1025272479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2664390 msgr2=0x55dfe2a2ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c298a9640 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2664390 0x55dfe2a2ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c298a9640 1 -- 172.21.15.37:0/1025272479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 msgr2=0x55dfe2a2a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c298a9640 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a2a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.836+0000 7f3c298a9640 1 -- 172.21.15.37:0/1025272479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe26f0650 con 0x55dfe2685070 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.837+0000 7f3c298a9640 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2685070 0x55dfe2a2a2c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0039f0 tx=0x7f3c1c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247c8d2dc83fc060 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.837+0000 7f3c1a7fc640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c100b4d20 0x7f3c100b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.837+0000 7f3c0f7fe640 1 -- 172.21.15.37:0/1025272479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c01a470 con 0x55dfe2685070 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.837+0000 7f3c290a8640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c100b4d20 0x7f3c100b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.837+0000 7f3c0f7fe640 1 -- 172.21.15.37:0/1025272479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c1c015070 con 0x55dfe2685070 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.837+0000 7f3c0f7fe640 1 -- 172.21.15.37:0/1025272479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c010770 con 0x55dfe2685070 2024-08-31T06:50:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.837+0000 7f3c1a7fc640 1 -- 172.21.15.37:0/745351625 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3c140e4f00 con 0x7f3c24108150 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 -- 172.21.15.37:0/1025272479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2685070 msgr2=0x55dfe2a2a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2685070 0x55dfe2a2a2c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0039f0 tx=0x7f3c1c003eb0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c290a8640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c100b4d20 0x7f3c100b7230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c20000c00 tx=0x7f3c20005ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 -- 172.21.15.37:0/1025272479 shutdown_connections 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2664390 0x55dfe2a2ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a2a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 --2- 172.21.15.37:0/1025272479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2685070 0x55dfe2a2a2c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 -- 172.21.15.37:0/1025272479 >> 172.21.15.37:0/1025272479 conn(0x55dfe2679460 msgr2=0x55dfe2a281b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:15.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 -- 172.21.15.37:0/1025272479 shutdown_connections 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 -- 172.21.15.37:0/1025272479 wait complete. 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.838+0000 7f3c31881740 1 -- start start 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c31881740 1 Processor -- start 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c31881740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe265c1b0 0x55dfe2a35a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c31881740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a35f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c31881740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2685070 0x55dfe2a41dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c31881740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dfe27f3700 con 0x55dfe2664390 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c31881740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dfe2917700 con 0x55dfe2685070 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c31881740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dfe2a38aa0 con 0x55dfe265c1b0 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c31881740 10 client.0 _ll_register_callbacks cb 0x55dfe2946dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c288a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a35f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c288a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a35f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35634/0 (socket says 172.21.15.37:35634) 2024-08-31T06:50:15.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c288a7640 1 -- 172.21.15.37:0/165120280 learned_addr learned my addr 172.21.15.37:0/165120280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c298a9640 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2685070 0x55dfe2a41dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.839+0000 7f3c290a8640 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe265c1b0 0x55dfe2a35a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c288a7640 1 -- 172.21.15.37:0/165120280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe265c1b0 msgr2=0x55dfe2a35a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c288a7640 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe265c1b0 0x55dfe2a35a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c288a7640 1 -- 172.21.15.37:0/165120280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2685070 msgr2=0x55dfe2a41dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c288a7640 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2685070 0x55dfe2a41dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c288a7640 1 -- 172.21.15.37:0/165120280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe29508b0 con 0x55dfe2664390 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c288a7640 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a35f60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3c140e26f0 tx=0x7f3c140aaf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1aab45c55a68dbc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c0cff9640 1 -- 172.21.15.37:0/165120280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14021070 con 0x55dfe2664390 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c0cff9640 1 -- 172.21.15.37:0/165120280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3c140aa890 con 0x55dfe2664390 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c31881740 1 -- 172.21.15.37:0/165120280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c1c015070 con 0x55dfe2664390 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c0cff9640 1 -- 172.21.15.37:0/165120280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c140ab140 con 0x55dfe2664390 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c31881740 10 client.16410 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c31881740 1 -- 172.21.15.37:0/165120280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dfe2a44860 con 0x55dfe2664390 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.840+0000 7f3c0cff9640 1 -- 172.21.15.37:0/165120280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c1c015070 con 0x55dfe2664390 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c0cff9640 1 -- 172.21.15.37:0/165120280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3c140a6fa0 con 0x55dfe2664390 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c31881740 10 client.16410 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c31881740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c31881740 20 client.16410 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c31881740 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dfe26439f0 0x55dfe2a47d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c31881740 4 client.16410 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:50:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c31881740 1 -- 172.21.15.37:0/165120280 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfe29a3580 con 0x55dfe26439f0 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c290a8640 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dfe26439f0 0x55dfe2a47d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c0cff9640 10 client.16410 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.841+0000 7f3c290a8640 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dfe26439f0 0x55dfe2a47d30 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb0cbd5716965572 server_cookie=e87175113fb74a7a in_seq=0 out_seq=0 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.842+0000 7f3c0cff9640 1 -- 172.21.15.37:0/165120280 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfe29a3580 con 0x55dfe26439f0 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.842+0000 7f3c0cff9640 10 client.16410 handle_command_reply: tid=0 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.842+0000 7f3c31881740 1 client.16410 shutdown 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.842+0000 7f3c31881740 1 -- 172.21.15.37:0/165120280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 msgr2=0x55dfe2a35f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.842+0000 7f3c31881740 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a35f60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3c140e26f0 tx=0x7f3c140aaf80 comp rx=0 tx=0).stop 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.842+0000 7f3c31881740 1 -- 172.21.15.37:0/165120280 shutdown_connections 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.842+0000 7f3c31881740 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dfe26439f0 0x55dfe2a47d30 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.843+0000 7f3c31881740 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a35f60 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.843+0000 7f3c31881740 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2685070 0x55dfe2a41dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.843+0000 7f3c31881740 1 --2- 172.21.15.37:0/165120280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe265c1b0 0x55dfe2a35a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.843+0000 7f3c31881740 1 -- 172.21.15.37:0/165120280 >> 172.21.15.37:0/165120280 conn(0x55dfe2679460 msgr2=0x55dfe2a2d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.843+0000 7f3c0cff9640 0 client.16410 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.843+0000 7f3c31881740 1 -- 172.21.15.37:0/165120280 shutdown_connections 2024-08-31T06:50:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.843+0000 7f3c31881740 1 -- 172.21.15.37:0/165120280 wait complete. 2024-08-31T06:50:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.843+0000 7f3c31881740 20 client.16410 trim_cache size 0 max 16384 2024-08-31T06:50:15.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.860+0000 7f3c31881740 1 Processor -- start 2024-08-31T06:50:15.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.860+0000 7f3c31881740 1 -- start start 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c31881740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a41cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c31881740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a2d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c31881740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2a2d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c31881740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c241b3e60 con 0x55dfe2664390 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c31881740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c241b1730 con 0x55dfe265c1b0 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c31881740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c241af580 con 0x55dfe2685070 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a2d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a2d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35636/0 (socket says 172.21.15.37:35636) 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 -- 172.21.15.37:0/1175671957 learned_addr learned my addr 172.21.15.37:0/1175671957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c290a8640 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a41cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c298a9640 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2a2d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 -- 172.21.15.37:0/1175671957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 msgr2=0x55dfe2a2d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2a2d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 -- 172.21.15.37:0/1175671957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 msgr2=0x55dfe2a41cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a41cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 -- 172.21.15.37:0/1175671957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe2a38160 con 0x55dfe2664390 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c290a8640 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a41cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c288a7640 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a2d3c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3c140ab2e0 tx=0x7f3c140ab0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba53c402b99e129 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.861+0000 7f3c0effd640 1 -- 172.21.15.37:0/1175671957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14021070 con 0x55dfe2664390 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c0effd640 1 -- 172.21.15.37:0/1175671957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c140b4950 con 0x55dfe2664390 2024-08-31T06:50:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c0effd640 1 -- 172.21.15.37:0/1175671957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c140a6fa0 con 0x55dfe2664390 2024-08-31T06:50:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 -- 172.21.15.37:0/1175671957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 msgr2=0x55dfe2a2d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a2d3c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3c140ab2e0 tx=0x7f3c140ab0b0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 -- 172.21.15.37:0/1175671957 shutdown_connections 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe2664390 0x55dfe2a2d3c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2a2d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 --2- 172.21.15.37:0/1175671957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe265c1b0 0x55dfe2a41cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 -- 172.21.15.37:0/1175671957 >> 172.21.15.37:0/1175671957 conn(0x55dfe2679460 msgr2=0x55dfe2a342a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 -- 172.21.15.37:0/1175671957 shutdown_connections 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.862+0000 7f3c31881740 1 -- 172.21.15.37:0/1175671957 wait complete. 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 1 -- start start 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 1 Processor -- start 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe265c1b0 0x55dfe2a3a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2664390 0x55dfe2a3add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2aab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c241afbf0 con 0x55dfe265c1b0 2024-08-31T06:50:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c241b1060 con 0x55dfe2664390 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c241b02c0 con 0x55dfe2685070 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c31881740 10 client.0 _ll_register_callbacks cb 0x7f3c14010b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c290a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe265c1b0 0x55dfe2a3a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c290a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe265c1b0 0x55dfe2a3a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35640/0 (socket says 172.21.15.37:35640) 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.863+0000 7f3c290a8640 1 -- 172.21.15.37:0/662707073 learned_addr learned my addr 172.21.15.37:0/662707073 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c288a7640 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2664390 0x55dfe2a3add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c298a9640 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2aab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c290a8640 1 -- 172.21.15.37:0/662707073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 msgr2=0x55dfe2aab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c290a8640 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2aab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c290a8640 1 -- 172.21.15.37:0/662707073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2664390 msgr2=0x55dfe2a3add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c290a8640 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2664390 0x55dfe2a3add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c290a8640 1 -- 172.21.15.37:0/662707073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe2aabd90 con 0x55dfe265c1b0 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c298a9640 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2aab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c290a8640 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe265c1b0 0x55dfe2a3a830 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009900 tx=0x7f3c20009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55eaeee30e289558 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c0cff9640 1 -- 172.21.15.37:0/662707073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20058060 con 0x55dfe265c1b0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c0cff9640 1 -- 172.21.15.37:0/662707073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3c20005040 con 0x55dfe265c1b0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c31881740 1 -- 172.21.15.37:0/662707073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c140b4950 con 0x55dfe265c1b0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c0cff9640 1 -- 172.21.15.37:0/662707073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c20035040 con 0x55dfe265c1b0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c31881740 10 client.16416 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.864+0000 7f3c31881740 1 -- 172.21.15.37:0/662707073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dfe2ab31f0 con 0x55dfe265c1b0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c0cff9640 1 -- 172.21.15.37:0/662707073 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c140b4950 con 0x55dfe265c1b0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c0cff9640 1 -- 172.21.15.37:0/662707073 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3c20052070 con 0x55dfe265c1b0 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c31881740 10 client.16416 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c31881740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c31881740 20 client.16416 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c31881740 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dfe2618da0 0x55dfe2ab59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c31881740 4 client.16416 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c31881740 1 -- 172.21.15.37:0/662707073 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dfe299f020 con 0x55dfe2618da0 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.865+0000 7f3c288a7640 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dfe2618da0 0x55dfe2ab59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c288a7640 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dfe2618da0 0x55dfe2ab59e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e5bb75735562d2e server_cookie=d58f81f5aaffdea9 in_seq=0 out_seq=0 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c0cff9640 10 client.16416 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c0cff9640 1 -- 172.21.15.37:0/662707073 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55dfe299f020 con 0x55dfe2618da0 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c0cff9640 10 client.16416 handle_command_reply: tid=0 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 client.16416 shutdown 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 -- 172.21.15.37:0/662707073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe265c1b0 msgr2=0x55dfe2a3a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe265c1b0 0x55dfe2a3a830 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009900 tx=0x7f3c20009260 comp rx=0 tx=0).stop 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 -- 172.21.15.37:0/662707073 shutdown_connections 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55dfe2618da0 0x55dfe2ab59e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c0cff9640 0 client.16416 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dfe2685070 0x55dfe2aab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dfe2664390 0x55dfe2a3add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 --2- 172.21.15.37:0/662707073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dfe265c1b0 0x55dfe2a3a830 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 -- 172.21.15.37:0/662707073 >> 172.21.15.37:0/662707073 conn(0x55dfe2679460 msgr2=0x55dfe2a2b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 -- 172.21.15.37:0/662707073 shutdown_connections 2024-08-31T06:50:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 1 -- 172.21.15.37:0/662707073 wait complete. 2024-08-31T06:50:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.866+0000 7f3c31881740 20 client.16416 trim_cache size 0 max 16384 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:15.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:15.875 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:15.876 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:15.877 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:15.877 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:15.877 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:15.877 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:50:15.877 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:50:15.877 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 -- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c100b4d20 msgr2=0x7f3c100b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c100b4d20 0x7f3c100b7230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3c20000c00 tx=0x7f3c20005ed0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 -- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24108150 msgr2=0x7f3c2419c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24108150 0x7f3c2419c920 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400d740 tx=0x7f3c1400dc00 comp rx=0 tx=0).stop 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 -- 172.21.15.37:0/745351625 shutdown_connections 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c100b4d20 0x7f3c100b7230 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c24108150 0x7f3c2419c920 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c24108aa0 0x7f3c241a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 --2- 172.21.15.37:0/745351625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c24102810 0x7f3c2419c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 -- 172.21.15.37:0/745351625 >> 172.21.15.37:0/745351625 conn(0x7f3c240794b0 msgr2=0x7f3c241064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 -- 172.21.15.37:0/745351625 shutdown_connections 2024-08-31T06:50:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:15.867+0000 7f3c2b30c640 1 -- 172.21.15.37:0/745351625 wait complete. 2024-08-31T06:50:16.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:15 smithi037 ceph-mon[18612]: pgmap v422: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:50:16.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:15 smithi106 ceph-mon[22134]: pgmap v422: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:50:16.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:15 smithi066 ceph-mon[22244]: pgmap v422: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:50:16.697 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:50:16.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:50:16.954 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.425+0000 7f4eea1ae640 1 -- 172.21.15.37:0/1690755663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4109240 msgr2=0x7f4ee4109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.425+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/1690755663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4109240 0x7f4ee4109650 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009900 tx=0x7f4ecc02a410 comp rx=0 tx=0).stop 2024-08-31T06:50:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.425+0000 7f4eea1ae640 1 -- 172.21.15.37:0/1690755663 shutdown_connections 2024-08-31T06:50:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.425+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/1690755663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4109240 0x7f4ee4109650 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.425+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/1690755663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ee4109b90 0x7f4ee41103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.425+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/1690755663 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ee4103900 0x7f4ee4103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.426+0000 7f4eea1ae640 1 -- 172.21.15.37:0/1690755663 >> 172.21.15.37:0/1690755663 conn(0x7f4ee407b5f0 msgr2=0x7f4ee407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.426+0000 7f4eea1ae640 1 -- 172.21.15.37:0/1690755663 shutdown_connections 2024-08-31T06:50:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.426+0000 7f4eea1ae640 1 -- 172.21.15.37:0/1690755663 wait complete. 2024-08-31T06:50:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.426+0000 7f4eea1ae640 1 Processor -- start 2024-08-31T06:50:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.426+0000 7f4eea1ae640 1 -- start start 2024-08-31T06:50:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4eea1ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4103900 0x7f4ee40754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4eea1ae640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ee4109240 0x7f4ee40759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:17.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4eea1ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ee4109b90 0x7f4ee4075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4eea1ae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee4113700 con 0x7f4ee4103900 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4eea1ae640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee4113580 con 0x7f4ee4109b90 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4eea1ae640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee4113880 con 0x7f4ee4109240 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4103900 0x7f4ee40754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4103900 0x7f4ee40754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35662/0 (socket says 172.21.15.37:35662) 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 -- 172.21.15.37:0/2587620658 learned_addr learned my addr 172.21.15.37:0/2587620658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee3fff640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ee4109b90 0x7f4ee4075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4edaffd640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ee4109240 0x7f4ee40759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 -- 172.21.15.37:0/2587620658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ee4109240 msgr2=0x7f4ee40759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ee4109240 0x7f4ee40759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 -- 172.21.15.37:0/2587620658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ee4109b90 msgr2=0x7f4ee4075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ee4109b90 0x7f4ee4075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 -- 172.21.15.37:0/2587620658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee41a8470 con 0x7f4ee4103900 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4edaffd640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ee4109240 0x7f4ee40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:50:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.427+0000 7f4ee37fe640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4103900 0x7f4ee40754b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400d950 tx=0x7f4ed400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:17.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.428+0000 7f4ee17fa640 1 -- 172.21.15.37:0/2587620658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4017070 con 0x7f4ee4103900 2024-08-31T06:50:17.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.428+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee41a8760 con 0x7f4ee4103900 2024-08-31T06:50:17.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.428+0000 7f4ee17fa640 1 -- 172.21.15.37:0/2587620658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ed4009c30 con 0x7f4ee4103900 2024-08-31T06:50:17.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.428+0000 7f4ee17fa640 1 -- 172.21.15.37:0/2587620658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed400f620 con 0x7f4ee4103900 2024-08-31T06:50:17.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.428+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee41a8ca0 con 0x7f4ee4103900 2024-08-31T06:50:17.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.429+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee4103d10 con 0x7f4ee4103900 2024-08-31T06:50:17.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.430+0000 7f4ee17fa640 1 -- 172.21.15.37:0/2587620658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f4ed4010460 con 0x7f4ee4103900 2024-08-31T06:50:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.431+0000 7f4ee17fa640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4ed00b4ca0 0x7f4ed00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.431+0000 7f4edaffd640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4ed00b4ca0 0x7f4ed00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:17.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.431+0000 7f4ee17fa640 1 -- 172.21.15.37:0/2587620658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f4ed40e50b0 con 0x7f4ee4103900 2024-08-31T06:50:17.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.432+0000 7f4edaffd640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4ed00b4ca0 0x7f4ed00b71b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc006010 tx=0x7f4ecc000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.434+0000 7f4ee17fa640 1 -- 172.21.15.37:0/2587620658 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4ed40abf80 con 0x7f4ee4103900 2024-08-31T06:50:17.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.656+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ee40767b0 con 0x7f4ee4103900 2024-08-31T06:50:17.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.657+0000 7f4ee17fa640 1 -- 172.21.15.37:0/2587620658 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f4ed4009de0 con 0x7f4ee4103900 2024-08-31T06:50:17.658 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:50:17.659 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:50:17.659 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.659+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4ed00b4ca0 msgr2=0x7f4ed00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.659+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4ed00b4ca0 0x7f4ed00b71b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc006010 tx=0x7f4ecc000bc0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.659+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4103900 msgr2=0x7f4ee40754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.659+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4103900 0x7f4ee40754b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400d950 tx=0x7f4ed400de10 comp rx=0 tx=0).stop 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.660+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 shutdown_connections 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.660+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f4ed00b4ca0 0x7f4ed00b71b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.660+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ee4109b90 0x7f4ee4075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.660+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4ee4109240 0x7f4ee40759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.660+0000 7f4eea1ae640 1 --2- 172.21.15.37:0/2587620658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee4103900 0x7f4ee40754b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.660+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 >> 172.21.15.37:0/2587620658 conn(0x7f4ee407b5f0 msgr2=0x7f4ee4105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.660+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 shutdown_connections 2024-08-31T06:50:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:17.660+0000 7f4eea1ae640 1 -- 172.21.15.37:0/2587620658 wait complete. 2024-08-31T06:50:18.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:17 smithi106 ceph-mon[22134]: pgmap v423: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T06:50:18.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:17 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2587620658' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:50:18.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:17 smithi037 ceph-mon[18612]: pgmap v423: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T06:50:18.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:17 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2587620658' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:50:18.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:17 smithi066 ceph-mon[22244]: pgmap v423: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T06:50:18.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:17 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2587620658' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:50:18.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:50:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 -- 172.21.15.37:0/459468638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 msgr2=0x7f81ec103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 --2- 172.21.15.37:0/459468638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 0x7f81ec103d10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009900 tx=0x7f81e802a410 comp rx=0 tx=0).stop 2024-08-31T06:50:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 -- 172.21.15.37:0/459468638 shutdown_connections 2024-08-31T06:50:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 --2- 172.21.15.37:0/459468638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ec109b90 0x7f81ec1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 --2- 172.21.15.37:0/459468638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81ec109240 0x7f81ec109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 --2- 172.21.15.37:0/459468638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 0x7f81ec103d10 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 -- 172.21.15.37:0/459468638 >> 172.21.15.37:0/459468638 conn(0x7f81ec07b5f0 msgr2=0x7f81ec07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 -- 172.21.15.37:0/459468638 shutdown_connections 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.186+0000 7f81f405e640 1 -- 172.21.15.37:0/459468638 wait complete. 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f405e640 1 Processor -- start 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f405e640 1 -- start start 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f405e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 0x7f81ec19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f405e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ec109240 0x7f81ec19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f405e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81ec109b90 0x7f81ec19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f405e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec113700 con 0x7f81ec103900 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f405e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec113580 con 0x7f81ec109b90 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f405e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec113880 con 0x7f81ec109240 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f1dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 0x7f81ec19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f1dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 0x7f81ec19a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35672/0 (socket says 172.21.15.37:35672) 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f1dfa640 1 -- 172.21.15.37:0/1043785971 learned_addr learned my addr 172.21.15.37:0/1043785971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f25fb640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81ec109b90 0x7f81ec19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f15f9640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ec109240 0x7f81ec19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f1dfa640 1 -- 172.21.15.37:0/1043785971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ec109240 msgr2=0x7f81ec19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ec109240 0x7f81ec19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f1dfa640 1 -- 172.21.15.37:0/1043785971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81ec109b90 msgr2=0x7f81ec19fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81ec109b90 0x7f81ec19fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f1dfa640 1 -- 172.21.15.37:0/1043785971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec1a0160 con 0x7f81ec103900 2024-08-31T06:50:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.187+0000 7f81f15f9640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ec109240 0x7f81ec19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.188+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 0x7f81ec19a1f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009a20 tx=0x7f81e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.188+0000 7f81e2ffd640 1 -- 172.21.15.37:0/1043785971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e803f030 con 0x7f81ec103900 2024-08-31T06:50:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.188+0000 7f81f405e640 1 -- 172.21.15.37:0/1043785971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec1a03f0 con 0x7f81ec103900 2024-08-31T06:50:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.188+0000 7f81e2ffd640 1 -- 172.21.15.37:0/1043785971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81e80035f0 con 0x7f81ec103900 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.188+0000 7f81e2ffd640 1 -- 172.21.15.37:0/1043785971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8035070 con 0x7f81ec103900 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.188+0000 7f81f405e640 1 -- 172.21.15.37:0/1043785971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec1a6bb0 con 0x7f81ec103900 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.190+0000 7f81fa5d3740 1 Processor -- start 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81fa5d3740 1 -- start start 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81e2ffd640 1 -- 172.21.15.37:0/1043785971 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f81e8003aa0 con 0x7f81ec103900 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a76310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a76850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a76d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5561989ed680 con 0x5561986b0390 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5561989dcc10 con 0x5561986a81b0 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5561989e0bc0 con 0x5561986d1070 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81f15f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a76d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81f15f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a76d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35680/0 (socket says 172.21.15.37:35680) 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81f15f9640 1 -- 172.21.15.37:0/1665581349 learned_addr learned my addr 172.21.15.37:0/1665581349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a76850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.191+0000 7f81f25fb640 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a76310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81f15f9640 1 -- 172.21.15.37:0/1665581349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 msgr2=0x556198a76310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81f15f9640 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a76310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81f15f9640 1 -- 172.21.15.37:0/1665581349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 msgr2=0x556198a76850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81f15f9640 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a76850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81f15f9640 1 -- 172.21.15.37:0/1665581349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619873c650 con 0x5561986b0390 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81e2ffd640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81d80b4ca0 0x7f81d80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81f25fb640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81d80b4ca0 0x7f81d80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81f15f9640 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a76d90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00cc00 tx=0x7f81dc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160cd46af0688033 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81e2ffd640 1 -- 172.21.15.37:0/1043785971 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f81e8105e90 con 0x7f81ec103900 2024-08-31T06:50:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81d7fff640 1 -- 172.21.15.37:0/1665581349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc005220 con 0x5561986b0390 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81d7fff640 1 -- 172.21.15.37:0/1665581349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81dc004c30 con 0x5561986b0390 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.192+0000 7f81d7fff640 1 -- 172.21.15.37:0/1665581349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc010690 con 0x5561986b0390 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1665581349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 msgr2=0x556198a76d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81f25fb640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81d80b4ca0 0x7f81d80b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f81e400ae90 tx=0x7f81e400a4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a76d90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00cc00 tx=0x7f81dc00e720 comp rx=0 tx=0).stop 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1665581349 shutdown_connections 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a76d90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a76850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1665581349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a76310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1665581349 >> 172.21.15.37:0/1665581349 conn(0x5561986c5460 msgr2=0x556198a74200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1665581349 shutdown_connections 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.193+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1665581349 wait complete. 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 1 -- start start 2024-08-31T06:50:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 1 Processor -- start 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986a81b0 0x556198a85e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986b0390 0x556198a86390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55619883f700 con 0x5561986a81b0 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x556198963750 con 0x5561986b0390 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x556198a88e20 con 0x5561986d1070 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81fa5d3740 10 client.0 _ll_register_callbacks cb 0x556198992e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.194+0000 7f81f1dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986a81b0 0x556198a85e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f1dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986a81b0 0x556198a85e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35696/0 (socket says 172.21.15.37:35696) 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f1dfa640 1 -- 172.21.15.37:0/563915076 learned_addr learned my addr 172.21.15.37:0/563915076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f25fb640 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f15f9640 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986b0390 0x556198a86390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f1dfa640 1 -- 172.21.15.37:0/563915076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 msgr2=0x556198a92150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f1dfa640 1 -- 172.21.15.37:0/563915076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986b0390 msgr2=0x556198a86390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986b0390 0x556198a86390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f1dfa640 1 -- 172.21.15.37:0/563915076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619899c900 con 0x5561986a81b0 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986a81b0 0x556198a85e50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f81e8103680 tx=0x7f81e80c8540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e46491af7bab5fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81d57fa640 1 -- 172.21.15.37:0/563915076 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e8049040 con 0x5561986a81b0 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81d57fa640 1 -- 172.21.15.37:0/563915076 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f81e81038a0 con 0x5561986a81b0 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81fa5d3740 1 -- 172.21.15.37:0/563915076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81dc004c30 con 0x5561986a81b0 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81d57fa640 1 -- 172.21.15.37:0/563915076 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81e80cbd30 con 0x5561986a81b0 2024-08-31T06:50:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81fa5d3740 10 client.16434 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.195+0000 7f81fa5d3740 1 -- 172.21.15.37:0/563915076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556198a94bf0 con 0x5561986a81b0 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81d57fa640 1 -- 172.21.15.37:0/563915076 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81dc004c30 con 0x5561986a81b0 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81d57fa640 1 -- 172.21.15.37:0/563915076 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81e80c6ce0 con 0x5561986a81b0 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81fa5d3740 10 client.16434 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81fa5d3740 10 client.16434 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81fa5d3740 20 client.16434 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55619868f9f0 0x556198a98000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81fa5d3740 4 client.16434 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81fa5d3740 1 -- 172.21.15.37:0/563915076 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561989ef5d0 con 0x55619868f9f0 2024-08-31T06:50:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.196+0000 7f81f15f9640 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55619868f9f0 0x556198a98000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.197+0000 7f81f15f9640 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55619868f9f0 0x556198a98000 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=60af98734dc695a9 server_cookie=824cb2b769a19f18 in_seq=0 out_seq=0 2024-08-31T06:50:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.197+0000 7f81d57fa640 10 client.16434 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:50:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81d57fa640 1 -- 172.21.15.37:0/563915076 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561989ef5d0 con 0x55619868f9f0 2024-08-31T06:50:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81d57fa640 10 client.16434 handle_command_reply: tid=0 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 client.16434 shutdown 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 -- 172.21.15.37:0/563915076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986a81b0 msgr2=0x556198a85e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986a81b0 0x556198a85e50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f81e8103680 tx=0x7f81e80c8540 comp rx=0 tx=0).stop 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 -- 172.21.15.37:0/563915076 shutdown_connections 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55619868f9f0 0x556198a98000 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986b0390 0x556198a86390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/563915076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986a81b0 0x556198a85e50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81d57fa640 0 client.16434 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 -- 172.21.15.37:0/563915076 >> 172.21.15.37:0/563915076 conn(0x5561986c5460 msgr2=0x556198a727c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 -- 172.21.15.37:0/563915076 shutdown_connections 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 1 -- 172.21.15.37:0/563915076 wait complete. 2024-08-31T06:50:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.198+0000 7f81fa5d3740 20 client.16434 trim_cache size 0 max 16384 2024-08-31T06:50:19.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81fa5d3740 1 Processor -- start 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81fa5d3740 1 -- start start 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a7bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a87a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1afa40 con 0x5561986b0390 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1ad310 con 0x5561986a81b0 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1ab160 con 0x5561986d1070 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f15f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a87a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f15f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a87a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35706/0 (socket says 172.21.15.37:35706) 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f15f9640 1 -- 172.21.15.37:0/2486753251 learned_addr learned my addr 172.21.15.37:0/2486753251 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f25fb640 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a7bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f15f9640 1 -- 172.21.15.37:0/2486753251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 msgr2=0x556198a92050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f15f9640 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f15f9640 1 -- 172.21.15.37:0/2486753251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 msgr2=0x556198a7bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f15f9640 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a7bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f15f9640 1 -- 172.21.15.37:0/2486753251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556198a80a50 con 0x5561986b0390 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f25fb640 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.212+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a7bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.213+0000 7f81f15f9640 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a87a80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0058c0 tx=0x7f81dc01c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d82b8b47c4df890a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.213+0000 7f81d77fe640 1 -- 172.21.15.37:0/2486753251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc004020 con 0x5561986b0390 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.213+0000 7f81d77fe640 1 -- 172.21.15.37:0/2486753251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81dc01cc10 con 0x5561986b0390 2024-08-31T06:50:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.213+0000 7f81d77fe640 1 -- 172.21.15.37:0/2486753251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc004420 con 0x5561986b0390 2024-08-31T06:50:19.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.213+0000 7f81fa5d3740 1 -- 172.21.15.37:0/2486753251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 msgr2=0x556198a87a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.213+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a87a80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f81dc0058c0 tx=0x7f81dc01c610 comp rx=0 tx=0).stop 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 -- 172.21.15.37:0/2486753251 shutdown_connections 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a87a80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198a92050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/2486753251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a7bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 -- 172.21.15.37:0/2486753251 >> 172.21.15.37:0/2486753251 conn(0x5561986c5460 msgr2=0x556198a87370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 -- 172.21.15.37:0/2486753251 shutdown_connections 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 -- 172.21.15.37:0/2486753251 wait complete. 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 -- start start 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 Processor -- start 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a8a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.214+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a8ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81fa5d3740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198b019c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1ab7d0 con 0x5561986b0390 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1acc40 con 0x5561986a81b0 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81fa5d3740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec1abea0 con 0x5561986d1070 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81fa5d3740 10 client.0 _ll_register_callbacks cb 0x7f81e81098e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a8ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a8ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35716/0 (socket says 172.21.15.37:35716) 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 -- 172.21.15.37:0/1901270594 learned_addr learned my addr 172.21.15.37:0/1901270594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a8a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f25fb640 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198b019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 -- 172.21.15.37:0/1901270594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 msgr2=0x556198b019c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198b019c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 -- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 msgr2=0x556198a8a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a8a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 -- 172.21.15.37:0/1901270594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556198b01f50 con 0x5561986b0390 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a8a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81f15f9640 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a8ad50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c550 tx=0x7f81dc0046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbafbc1bae32968 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81d57fa640 1 -- 172.21.15.37:0/1901270594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc01c110 con 0x5561986b0390 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81d57fa640 1 -- 172.21.15.37:0/1901270594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f81dc01c2b0 con 0x5561986b0390 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.215+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1901270594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81dc01cc10 con 0x5561986b0390 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81d57fa640 1 -- 172.21.15.37:0/1901270594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81dc004020 con 0x5561986b0390 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81fa5d3740 10 client.16440 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1901270594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556198b031d0 con 0x5561986b0390 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81d57fa640 1 -- 172.21.15.37:0/1901270594 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81dc01cc10 con 0x5561986b0390 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81d57fa640 1 -- 172.21.15.37:0/1901270594 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81dc003a80 con 0x5561986b0390 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81fa5d3740 10 client.16440 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81fa5d3740 10 client.16440 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81fa5d3740 20 client.16440 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x556198664da0 0x556198b056c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81fa5d3740 4 client.16440 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1901270594 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5561989eb070 con 0x556198664da0 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.216+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x556198664da0 0x556198b056c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81d57fa640 10 client.16440 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81f1dfa640 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x556198664da0 0x556198b056c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f4c4dc1e7d8f0986 server_cookie=d0decdb7e3b005ed in_seq=0 out_seq=0 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81d57fa640 1 -- 172.21.15.37:0/1901270594 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5561989eb070 con 0x556198664da0 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81d57fa640 10 client.16440 handle_command_reply: tid=0 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 client.16440 shutdown 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1901270594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 msgr2=0x556198a8ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a8ad50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f81dc00c550 tx=0x7f81dc0046f0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1901270594 shutdown_connections 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5561986b0390 0x556198a8ad50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x556198664da0 0x556198b056c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561986d1070 0x556198b019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 --2- 172.21.15.37:0/1901270594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5561986a81b0 0x556198a8a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1901270594 >> 172.21.15.37:0/1901270594 conn(0x5561986c5460 msgr2=0x556198a7bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81d57fa640 0 client.16440 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1901270594 shutdown_connections 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.217+0000 7f81fa5d3740 1 -- 172.21.15.37:0/1901270594 wait complete. 2024-08-31T06:50:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81fa5d3740 20 client.16440 trim_cache size 0 max 16384 2024-08-31T06:50:19.224 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 -- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81d80b4ca0 msgr2=0x7f81d80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81d80b4ca0 0x7f81d80b71b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f81e400ae90 tx=0x7f81e400a4d0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 -- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 msgr2=0x7f81ec19a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 0x7f81ec19a1f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009a20 tx=0x7f81e8004270 comp rx=0 tx=0).stop 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 -- 172.21.15.37:0/1043785971 shutdown_connections 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f81d80b4ca0 0x7f81d80b71b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81ec109b90 0x7f81ec19fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81ec109240 0x7f81ec19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 --2- 172.21.15.37:0/1043785971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81ec103900 0x7f81ec19a1f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 -- 172.21.15.37:0/1043785971 >> 172.21.15.37:0/1043785971 conn(0x7f81ec07b5f0 msgr2=0x7f81ec1073f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 -- 172.21.15.37:0/1043785971 shutdown_connections 2024-08-31T06:50:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:19.218+0000 7f81f405e640 1 -- 172.21.15.37:0/1043785971 wait complete. 2024-08-31T06:50:19.984 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:50:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:20.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:19 smithi106 ceph-mon[22134]: pgmap v424: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:50:20.341 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:19 smithi037 ceph-mon[18612]: pgmap v424: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:50:20.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:19 smithi066 ceph-mon[22244]: pgmap v424: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:50:20.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.720+0000 7fdc23d98640 1 -- 172.21.15.37:0/1205055025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c109240 msgr2=0x7fdc1c109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.720+0000 7fdc23d98640 1 --2- 172.21.15.37:0/1205055025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c109240 0x7fdc1c109650 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009900 tx=0x7fdc0c02a410 comp rx=0 tx=0).stop 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.720+0000 7fdc23d98640 1 -- 172.21.15.37:0/1205055025 shutdown_connections 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.720+0000 7fdc23d98640 1 --2- 172.21.15.37:0/1205055025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c109240 0x7fdc1c109650 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.720+0000 7fdc23d98640 1 --2- 172.21.15.37:0/1205055025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc1c109b90 0x7fdc1c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.720+0000 7fdc23d98640 1 --2- 172.21.15.37:0/1205055025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc1c103900 0x7fdc1c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.720+0000 7fdc23d98640 1 -- 172.21.15.37:0/1205055025 >> 172.21.15.37:0/1205055025 conn(0x7fdc1c07b5f0 msgr2=0x7fdc1c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.721+0000 7fdc23d98640 1 -- 172.21.15.37:0/1205055025 shutdown_connections 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.721+0000 7fdc23d98640 1 -- 172.21.15.37:0/1205055025 wait complete. 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.721+0000 7fdc23d98640 1 Processor -- start 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.721+0000 7fdc23d98640 1 -- start start 2024-08-31T06:50:20.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.721+0000 7fdc23d98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c103900 0x7fdc1c19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.721+0000 7fdc23d98640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc1c109240 0x7fdc1c19a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.721+0000 7fdc23d98640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc1c109b90 0x7fdc1c19f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc23d98640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c113700 con 0x7fdc1c103900 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc23d98640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c113580 con 0x7fdc1c109b90 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc23d98640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c113880 con 0x7fdc1c109240 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c103900 0x7fdc1c19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c103900 0x7fdc1c19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35732/0 (socket says 172.21.15.37:35732) 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 -- 172.21.15.37:0/4067842746 learned_addr learned my addr 172.21.15.37:0/4067842746 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21333640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc1c109240 0x7fdc1c19a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc22335640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc1c109b90 0x7fdc1c19f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 -- 172.21.15.37:0/4067842746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc1c109240 msgr2=0x7fdc1c19a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc1c109240 0x7fdc1c19a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 -- 172.21.15.37:0/4067842746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc1c109b90 msgr2=0x7fdc1c19f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc1c109b90 0x7fdc1c19f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 -- 172.21.15.37:0/4067842746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1c1a0060 con 0x7fdc1c103900 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21333640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc1c109240 0x7fdc1c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc21b34640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c103900 0x7fdc1c19a1b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800d770 tx=0x7fdc1800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc12ffd640 1 -- 172.21.15.37:0/4067842746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18017070 con 0x7fdc1c103900 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc23d98640 1 -- 172.21.15.37:0/4067842746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1c1a0350 con 0x7fdc1c103900 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc12ffd640 1 -- 172.21.15.37:0/4067842746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc180054b0 con 0x7fdc1c103900 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc12ffd640 1 -- 172.21.15.37:0/4067842746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18004c60 con 0x7fdc1c103900 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.722+0000 7fdc23d98640 1 -- 172.21.15.37:0/4067842746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1c1a0810 con 0x7fdc1c103900 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc2a30d740 1 Processor -- start 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc2a30d740 1 -- start start 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718d9070 0x55c471c7e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b01b0 0x55c471c7e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b8390 0x55c471c7ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c471bf5680 con 0x55c4718d9070 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c471be4c10 con 0x55c4718b01b0 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55c471be8bc0 con 0x55c4718b8390 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc22335640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718d9070 0x55c471c7e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc12ffd640 1 -- 172.21.15.37:0/4067842746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fdc18004e00 con 0x7fdc1c103900 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc22335640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718d9070 0x55c471c7e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35738/0 (socket says 172.21.15.37:35738) 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.725+0000 7fdc22335640 1 -- 172.21.15.37:0/448856481 learned_addr learned my addr 172.21.15.37:0/448856481 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc21333640 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b8390 0x55c471c7ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc22335640 1 -- 172.21.15.37:0/448856481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b8390 msgr2=0x55c471c7ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc22335640 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b8390 0x55c471c7ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc22335640 1 -- 172.21.15.37:0/448856481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b01b0 msgr2=0x55c471c7e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc22335640 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b01b0 0x55c471c7e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc22335640 1 -- 172.21.15.37:0/448856481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c471944650 con 0x55c4718d9070 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc21333640 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b8390 0x55c471c7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:50:20.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc22335640 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718d9070 0x55c471c7e310 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdc14008da0 tx=0x7fdc1400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ee8a63c7c846c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc07fff640 1 -- 172.21.15.37:0/448856481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400f830 con 0x55c4718d9070 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc07fff640 1 -- 172.21.15.37:0/448856481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc1400de20 con 0x55c4718d9070 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc07fff640 1 -- 172.21.15.37:0/448856481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14018cf0 con 0x55c4718d9070 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.726+0000 7fdc12ffd640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc080b4cd0 0x7fdc080b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc21b34640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc080b4cd0 0x7fdc080b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc12ffd640 1 -- 172.21.15.37:0/4067842746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fdc180e5010 con 0x7fdc1c103900 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 -- 172.21.15.37:0/448856481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718d9070 msgr2=0x55c471c7e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc21b34640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc080b4cd0 0x7fdc080b71e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55c471c7cf90 tx=0x7fdc180ce040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718d9070 0x55c471c7e310 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdc14008da0 tx=0x7fdc1400d710 comp rx=0 tx=0).stop 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 -- 172.21.15.37:0/448856481 shutdown_connections 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b8390 0x55c471c7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b01b0 0x55c471c7e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/448856481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718d9070 0x55c471c7e310 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 -- 172.21.15.37:0/448856481 >> 172.21.15.37:0/448856481 conn(0x55c4718cd460 msgr2=0x55c471c7c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 -- 172.21.15.37:0/448856481 shutdown_connections 2024-08-31T06:50:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.727+0000 7fdc2a30d740 1 -- 172.21.15.37:0/448856481 wait complete. 2024-08-31T06:50:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 1 -- start start 2024-08-31T06:50:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 1 Processor -- start 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c89a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c89f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 0x55c471c95e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c471a47700 con 0x55c4718b8390 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c471b6b750 con 0x55c4718d9070 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55c471c8caf0 con 0x55c4718b01b0 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.728+0000 7fdc2a30d740 10 client.0 _ll_register_callbacks cb 0x55c471b9ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c89f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c89f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35744/0 (socket says 172.21.15.37:35744) 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 -- 172.21.15.37:0/835973712 learned_addr learned my addr 172.21.15.37:0/835973712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc22335640 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c89a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc22335640 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 0x55c471c95e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 -- 172.21.15.37:0/835973712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 msgr2=0x55c471c89a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c89a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 -- 172.21.15.37:0/835973712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 msgr2=0x55c471c95e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 0x55c471c95e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 -- 172.21.15.37:0/835973712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c471ba4900 con 0x55c4718b8390 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc21333640 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c89f90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c000c00 tx=0x7fdc0c0316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728afa553a47daf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc057fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc057fa640 1 -- 172.21.15.37:0/835973712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c03f070 con 0x55c4718b8390 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc057fa640 1 -- 172.21.15.37:0/835973712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fdc0c004250 con 0x55c4718b8390 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.729+0000 7fdc2a30d740 1 -- 172.21.15.37:0/835973712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc1400de20 con 0x55c4718b8390 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc057fa640 1 -- 172.21.15.37:0/835973712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdc0c035070 con 0x55c4718b8390 2024-08-31T06:50:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc2a30d740 10 client.16452 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc2a30d740 1 -- 172.21.15.37:0/835973712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c471c98800 con 0x55c4718b8390 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc057fa640 1 -- 172.21.15.37:0/835973712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc1400de20 con 0x55c4718b8390 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc057fa640 1 -- 172.21.15.37:0/835973712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdc0c004a30 con 0x55c4718b8390 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc2a30d740 10 client.16452 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc2a30d740 10 client.16452 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc2a30d740 20 client.16452 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c4718979f0 0x55c471c9bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc2a30d740 4 client.16452 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc2a30d740 1 -- 172.21.15.37:0/835973712 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c471bf75d0 con 0x55c4718979f0 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.730+0000 7fdc22335640 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c4718979f0 0x55c471c9bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.731+0000 7fdc22335640 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c4718979f0 0x55c471c9bd20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=359f00c2dd5abbab server_cookie=18d0d9920bb7c78 in_seq=0 out_seq=0 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.731+0000 7fdc057fa640 10 client.16452 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:50:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc057fa640 1 -- 172.21.15.37:0/835973712 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c471bf75d0 con 0x55c4718979f0 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc057fa640 10 client.16452 handle_command_reply: tid=0 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 client.16452 shutdown 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 -- 172.21.15.37:0/835973712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 msgr2=0x55c471c89f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c89f90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c000c00 tx=0x7fdc0c0316b0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 -- 172.21.15.37:0/835973712 shutdown_connections 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c4718979f0 0x55c471c9bd20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c89f90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 0x55c471c95e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/835973712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c89a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc057fa640 0 client.16452 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 -- 172.21.15.37:0/835973712 >> 172.21.15.37:0/835973712 conn(0x55c4718cd460 msgr2=0x55c471c814f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 -- 172.21.15.37:0/835973712 shutdown_connections 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 1 -- 172.21.15.37:0/835973712 wait complete. 2024-08-31T06:50:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.732+0000 7fdc2a30d740 20 client.16452 trim_cache size 0 max 16384 2024-08-31T06:50:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.745+0000 7fdc2a30d740 1 Processor -- start 2024-08-31T06:50:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.745+0000 7fdc2a30d740 1 -- start start 2024-08-31T06:50:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b01b0 0x55c471c89f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b8390 0x55c471c81410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718d9070 0x55c471c81950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c1b1c10 con 0x55c4718b01b0 2024-08-31T06:50:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c1af4e0 con 0x55c4718b8390 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c1ad330 con 0x55c4718d9070 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b01b0 0x55c471c89f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b01b0 0x55c471c89f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35750/0 (socket says 172.21.15.37:35750) 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 -- 172.21.15.37:0/1435073309 learned_addr learned my addr 172.21.15.37:0/1435073309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc21333640 1 --2- 172.21.15.37:0/1435073309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b8390 0x55c471c81410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 -- 172.21.15.37:0/1435073309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718d9070 msgr2=0x55c471c81950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 --2- 172.21.15.37:0/1435073309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718d9070 0x55c471c81950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 -- 172.21.15.37:0/1435073309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b8390 msgr2=0x55c471c81410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 --2- 172.21.15.37:0/1435073309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b8390 0x55c471c81410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 -- 172.21.15.37:0/1435073309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c471c80600 con 0x55c4718b01b0 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc22335640 1 --2- 172.21.15.37:0/1435073309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b01b0 0x55c471c89f10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdc14005c40 tx=0x7fdc14000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76846d9f8662106b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc077fe640 1 -- 172.21.15.37:0/1435073309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1402c030 con 0x55c4718b01b0 2024-08-31T06:50:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc077fe640 1 -- 172.21.15.37:0/1435073309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc14004d20 con 0x55c4718b01b0 2024-08-31T06:50:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.746+0000 7fdc077fe640 1 -- 172.21.15.37:0/1435073309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14022040 con 0x55c4718b01b0 2024-08-31T06:50:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 -- 172.21.15.37:0/1435073309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b01b0 msgr2=0x55c471c89f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/1435073309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b01b0 0x55c471c89f10 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fdc14005c40 tx=0x7fdc14000f40 comp rx=0 tx=0).stop 2024-08-31T06:50:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 -- 172.21.15.37:0/1435073309 shutdown_connections 2024-08-31T06:50:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/1435073309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718d9070 0x55c471c81950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/1435073309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718b8390 0x55c471c81410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/1435073309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b01b0 0x55c471c89f10 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 -- 172.21.15.37:0/1435073309 >> 172.21.15.37:0/1435073309 conn(0x55c4718cd460 msgr2=0x55c471c89800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 -- 172.21.15.37:0/1435073309 shutdown_connections 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 -- 172.21.15.37:0/1435073309 wait complete. 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.747+0000 7fdc2a30d740 1 -- start start 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc2a30d740 1 Processor -- start 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c8e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c8e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc2a30d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 0x55c471d056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c1ad9a0 con 0x55c4718b8390 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c1aee10 con 0x55c4718d9070 2024-08-31T06:50:20.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc2a30d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1c1ae070 con 0x55c4718b01b0 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc2a30d740 10 client.0 _ll_register_callbacks cb 0x7fdc0c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc21333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c8e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc21333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c8e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35762/0 (socket says 172.21.15.37:35762) 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc21333640 1 -- 172.21.15.37:0/3192890598 learned_addr learned my addr 172.21.15.37:0/3192890598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc22335640 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 0x55c471d056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc22335640 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c8e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc21333640 1 -- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 msgr2=0x55c471c8e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.748+0000 7fdc21333640 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c8e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc21333640 1 -- 172.21.15.37:0/3192890598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 msgr2=0x55c471d056b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc21333640 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 0x55c471d056b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc21333640 1 -- 172.21.15.37:0/3192890598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c471d05bf0 con 0x55c4718b8390 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc22335640 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c8e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:20.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc21333640 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c8e690 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c004dd0 tx=0x7fdc0c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce70dcdb6dad742 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc057fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc057fa640 1 -- 172.21.15.37:0/3192890598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c03f070 con 0x55c4718b8390 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc057fa640 1 -- 172.21.15.37:0/3192890598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fdc0c003cd0 con 0x55c4718b8390 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc2a30d740 1 -- 172.21.15.37:0/3192890598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc14004d20 con 0x55c4718b8390 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc057fa640 1 -- 172.21.15.37:0/3192890598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdc0c050070 con 0x55c4718b8390 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc2a30d740 10 client.16458 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc2a30d740 1 -- 172.21.15.37:0/3192890598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c471d06db0 con 0x55c4718b8390 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc057fa640 1 -- 172.21.15.37:0/3192890598 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc14004d20 con 0x55c4718b8390 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc057fa640 1 -- 172.21.15.37:0/3192890598 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdc0c0051c0 con 0x55c4718b8390 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc2a30d740 10 client.16458 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.749+0000 7fdc2a30d740 10 client.16458 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc2a30d740 20 client.16458 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c47186cda0 0x55c471d09550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc2a30d740 4 client.16458 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc2a30d740 1 -- 172.21.15.37:0/3192890598 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c471bf3070 con 0x55c47186cda0 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc22335640 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c47186cda0 0x55c471d09550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc22335640 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c47186cda0 0x55c471d09550 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8090eb4f524fc141 server_cookie=9f9a2d0d07a15da9 in_seq=0 out_seq=0 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc057fa640 10 client.16458 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc057fa640 1 -- 172.21.15.37:0/3192890598 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c471bf3070 con 0x55c47186cda0 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.750+0000 7fdc057fa640 10 client.16458 handle_command_reply: tid=0 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 client.16458 shutdown 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 -- 172.21.15.37:0/3192890598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 msgr2=0x55c471c8e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c8e690 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c004dd0 tx=0x7fdc0c0098b0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 -- 172.21.15.37:0/3192890598 shutdown_connections 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c47186cda0 0x55c471d09550 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4718b8390 0x55c471c8e690 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c4718d9070 0x55c471d056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc057fa640 0 client.16458 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 --2- 172.21.15.37:0/3192890598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c4718b01b0 0x55c471c8e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 -- 172.21.15.37:0/3192890598 >> 172.21.15.37:0/3192890598 conn(0x55c4718cd460 msgr2=0x55c471c81410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 -- 172.21.15.37:0/3192890598 shutdown_connections 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 1 -- 172.21.15.37:0/3192890598 wait complete. 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc2a30d740 20 client.16458 trim_cache size 0 max 16384 2024-08-31T06:50:20.757 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:50:20.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc23d98640 1 -- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc080b4cd0 msgr2=0x7fdc080b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc23d98640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc080b4cd0 0x7fdc080b71e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55c471c7cf90 tx=0x7fdc180ce040 comp rx=0 tx=0).stop 2024-08-31T06:50:20.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc23d98640 1 -- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c103900 msgr2=0x7fdc1c19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:20.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc23d98640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c103900 0x7fdc1c19a1b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800d770 tx=0x7fdc1800dc30 comp rx=0 tx=0).stop 2024-08-31T06:50:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc23d98640 1 -- 172.21.15.37:0/4067842746 shutdown_connections 2024-08-31T06:50:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc23d98640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fdc080b4cd0 0x7fdc080b71e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.751+0000 7fdc23d98640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdc1c109b90 0x7fdc1c19f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.752+0000 7fdc23d98640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc1c109240 0x7fdc1c19a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.752+0000 7fdc23d98640 1 --2- 172.21.15.37:0/4067842746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc1c103900 0x7fdc1c19a1b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.752+0000 7fdc23d98640 1 -- 172.21.15.37:0/4067842746 >> 172.21.15.37:0/4067842746 conn(0x7fdc1c07b5f0 msgr2=0x7fdc1c105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.752+0000 7fdc23d98640 1 -- 172.21.15.37:0/4067842746 shutdown_connections 2024-08-31T06:50:20.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:20.752+0000 7fdc23d98640 1 -- 172.21.15.37:0/4067842746 wait complete. 2024-08-31T06:50:21.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:50:21.771 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:22.196 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:21 smithi037 ceph-mon[18612]: pgmap v425: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:50:22.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 -- 172.21.15.37:0/3870150858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754010db90 msgr2=0x7f75401100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 --2- 172.21.15.37:0/3870150858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754010db90 0x7f75401100a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7538009ca0 tx=0x7f753802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 -- 172.21.15.37:0/3870150858 shutdown_connections 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 --2- 172.21.15.37:0/3870150858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f754010db90 0x7f75401100a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 --2- 172.21.15.37:0/3870150858 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7540105010 0x7f754010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 --2- 172.21.15.37:0/3870150858 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75401045e0 0x7f75401049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 -- 172.21.15.37:0/3870150858 >> 172.21.15.37:0/3870150858 conn(0x7f75400794d0 msgr2=0x7f75400798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 -- 172.21.15.37:0/3870150858 shutdown_connections 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 -- 172.21.15.37:0/3870150858 wait complete. 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.195+0000 7f75460ed640 1 Processor -- start 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f75460ed640 1 -- start start 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f75460ed640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75401045e0 0x7f75401024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f75460ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7540105010 0x7f7540102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f75460ed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f754010db90 0x7f7540102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f75460ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7540113730 con 0x7f7540105010 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f75460ed640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75401135b0 con 0x7f754010db90 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f75460ed640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f75401138b0 con 0x7f75401045e0 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f7537fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7540105010 0x7f7540102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f7537fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7540105010 0x7f7540102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35774/0 (socket says 172.21.15.37:35774) 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f7537fff640 1 -- 172.21.15.37:0/1483515519 learned_addr learned my addr 172.21.15.37:0/1483515519 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75401045e0 0x7f75401024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f753ffff640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f754010db90 0x7f7540102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f7537fff640 1 -- 172.21.15.37:0/1483515519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75401045e0 msgr2=0x7f75401024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f7537fff640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75401045e0 0x7f75401024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f7537fff640 1 -- 172.21.15.37:0/1483515519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f754010db90 msgr2=0x7f7540102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f7537fff640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f754010db90 0x7f7540102f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.196+0000 7f7537fff640 1 -- 172.21.15.37:0/1483515519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75401a8440 con 0x7f7540105010 2024-08-31T06:50:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.197+0000 7f7537fff640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7540105010 0x7f7540102a30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f752800d750 tx=0x7f752800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.197+0000 7f753d7fa640 1 -- 172.21.15.37:0/1483515519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528017070 con 0x7f7540105010 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.197+0000 7f753d7fa640 1 -- 172.21.15.37:0/1483515519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75280054b0 con 0x7f7540105010 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.197+0000 7f75460ed640 1 -- 172.21.15.37:0/1483515519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75401a8730 con 0x7f7540105010 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.197+0000 7f753d7fa640 1 -- 172.21.15.37:0/1483515519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528004bc0 con 0x7f7540105010 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.197+0000 7f75460ed640 1 -- 172.21.15.37:0/1483515519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75401a8c20 con 0x7f7540105010 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.199+0000 7f754c662740 1 Processor -- start 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.199+0000 7f754c662740 1 -- start start 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753d7fa640 1 -- 172.21.15.37:0/1483515519 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f7528009c30 con 0x7f7540105010 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f754c662740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 0x5652f423a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f754c662740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f423a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f754c662740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e74390 0x5652f423ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f754c662740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5652f41b1680 con 0x5652f3e6c1b0 2024-08-31T06:50:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f754c662740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5652f41a0c10 con 0x5652f3e95070 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f754c662740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5652f41a4bc0 con 0x5652f3e74390 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f423a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f423a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35790/0 (socket says 172.21.15.37:35790) 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 -- 172.21.15.37:0/1052161617 learned_addr learned my addr 172.21.15.37:0/1052161617 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753ffff640 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 0x5652f423a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f7537fff640 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e74390 0x5652f423ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 -- 172.21.15.37:0/1052161617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e74390 msgr2=0x5652f423ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e74390 0x5652f423ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 -- 172.21.15.37:0/1052161617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 msgr2=0x5652f423a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 0x5652f423a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 -- 172.21.15.37:0/1052161617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f3f00650 con 0x5652f3e6c1b0 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.200+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f423a850 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f753000bc70 tx=0x7f753000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204b7478f269f8c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.201+0000 7f753d7fa640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f752c0b4ca0 0x7f752c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.201+0000 7f7535ffb640 1 -- 172.21.15.37:0/1052161617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530015070 con 0x5652f3e6c1b0 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.201+0000 7f7535ffb640 1 -- 172.21.15.37:0/1052161617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75300035f0 con 0x5652f3e6c1b0 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.201+0000 7f7535ffb640 1 -- 172.21.15.37:0/1052161617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75300116a0 con 0x5652f3e6c1b0 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.201+0000 7f753ffff640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f752c0b4ca0 0x7f752c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.201+0000 7f753d7fa640 1 -- 172.21.15.37:0/1483515519 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f75280e4ff0 con 0x7f7540105010 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 -- 172.21.15.37:0/1052161617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 msgr2=0x5652f423a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f753ffff640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f752c0b4ca0 0x7f752c0b71b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7538006010 tx=0x7f7538009410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f423a850 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f753000bc70 tx=0x7f753000f730 comp rx=0 tx=0).stop 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 -- 172.21.15.37:0/1052161617 shutdown_connections 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f423a850 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e74390 0x5652f423ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 --2- 172.21.15.37:0/1052161617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 0x5652f423a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 -- 172.21.15.37:0/1052161617 >> 172.21.15.37:0/1052161617 conn(0x5652f3e89460 msgr2=0x5652f4238200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 -- 172.21.15.37:0/1052161617 shutdown_connections 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 -- 172.21.15.37:0/1052161617 wait complete. 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.202+0000 7f754c662740 1 -- start start 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f754c662740 1 Processor -- start 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f754c662740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f4245a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f754c662740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4245fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f754c662740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e95070 0x5652f4251e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f754c662740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5652f4003700 con 0x5652f3e6c1b0 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f754c662740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5652f4127750 con 0x5652f3e74390 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f754c662740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5652f4248af0 con 0x5652f3e95070 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f754c662740 10 client.0 _ll_register_callbacks cb 0x5652f4156e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f753f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f4245a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f753f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f4245a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35802/0 (socket says 172.21.15.37:35802) 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f753f7fe640 1 -- 172.21.15.37:0/1748232629 learned_addr learned my addr 172.21.15.37:0/1748232629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f7537fff640 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4245fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.203+0000 7f753ffff640 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e95070 0x5652f4251e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f753f7fe640 1 -- 172.21.15.37:0/1748232629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e95070 msgr2=0x5652f4251e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e95070 0x5652f4251e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f753f7fe640 1 -- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 msgr2=0x5652f4245fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4245fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f753f7fe640 1 -- 172.21.15.37:0/1748232629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f4160900 con 0x5652f3e6c1b0 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f7537fff640 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4245fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f4245a90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f753000ba30 tx=0x7f753000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b097696a86bea09 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f751effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f751effd640 1 -- 172.21.15.37:0/1748232629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530015070 con 0x5652f3e6c1b0 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f751effd640 1 -- 172.21.15.37:0/1748232629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7530004370 con 0x5652f3e6c1b0 2024-08-31T06:50:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f754c662740 1 -- 172.21.15.37:0/1748232629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75300035f0 con 0x5652f3e6c1b0 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f751effd640 1 -- 172.21.15.37:0/1748232629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75300037a0 con 0x5652f3e6c1b0 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f754c662740 10 client.16470 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f754c662740 1 -- 172.21.15.37:0/1748232629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5652f42548d0 con 0x5652f3e6c1b0 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.204+0000 7f751effd640 1 -- 172.21.15.37:0/1748232629 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75300035f0 con 0x5652f3e6c1b0 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.205+0000 7f751effd640 1 -- 172.21.15.37:0/1748232629 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f75300046e0 con 0x5652f3e6c1b0 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.205+0000 7f754c662740 10 client.16470 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.205+0000 7f754c662740 10 client.16470 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.205+0000 7f754c662740 20 client.16470 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.205+0000 7f754c662740 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5652f3e539f0 0x5652f4257ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.205+0000 7f754c662740 4 client.16470 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.205+0000 7f754c662740 1 -- 172.21.15.37:0/1748232629 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652f41b35d0 con 0x5652f3e539f0 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.205+0000 7f7537fff640 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5652f3e539f0 0x5652f4257ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.206+0000 7f7537fff640 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5652f3e539f0 0x5652f4257ce0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ddc60b767344903 server_cookie=1dc4e6ce5d06c361 in_seq=0 out_seq=0 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.206+0000 7f751effd640 10 client.16470 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.206+0000 7f751effd640 1 -- 172.21.15.37:0/1748232629 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652f41b35d0 con 0x5652f3e539f0 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.206+0000 7f751effd640 10 client.16470 handle_command_reply: tid=0 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.206+0000 7f754c662740 1 client.16470 shutdown 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 -- 172.21.15.37:0/1748232629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 msgr2=0x5652f4245a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f4245a90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f753000ba30 tx=0x7f753000bf90 comp rx=0 tx=0).stop 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 -- 172.21.15.37:0/1748232629 shutdown_connections 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5652f3e539f0 0x5652f4257ce0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e95070 0x5652f4251e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4245fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 --2- 172.21.15.37:0/1748232629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e6c1b0 0x5652f4245a90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 -- 172.21.15.37:0/1748232629 >> 172.21.15.37:0/1748232629 conn(0x5652f3e89460 msgr2=0x5652f423d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f751effd640 0 client.16470 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 -- 172.21.15.37:0/1748232629 shutdown_connections 2024-08-31T06:50:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 1 -- 172.21.15.37:0/1748232629 wait complete. 2024-08-31T06:50:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.207+0000 7f754c662740 20 client.16470 trim_cache size 0 max 16384 2024-08-31T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f754c662740 1 Processor -- start 2024-08-31T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f754c662740 1 -- start start 2024-08-31T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f754c662740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f4244310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f754c662740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e74390 0x5652f4244850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f754c662740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 0x5652f423d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f754c662740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b3e40 con 0x5652f3e74390 2024-08-31T06:50:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f754c662740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b1710 con 0x5652f3e95070 2024-08-31T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f754c662740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f75401af560 con 0x5652f3e6c1b0 2024-08-31T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f7537fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e74390 0x5652f4244850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.220+0000 7f7537fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e74390 0x5652f4244850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35808/0 (socket says 172.21.15.37:35808) 2024-08-31T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f7537fff640 1 -- 172.21.15.37:0/246177214 learned_addr learned my addr 172.21.15.37:0/246177214 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f753ffff640 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 0x5652f423d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f753f7fe640 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f4244310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f7537fff640 1 -- 172.21.15.37:0/246177214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 msgr2=0x5652f4244310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:22.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f7537fff640 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f4244310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f7537fff640 1 -- 172.21.15.37:0/246177214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 msgr2=0x5652f423d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f7537fff640 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 0x5652f423d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f7537fff640 1 -- 172.21.15.37:0/246177214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652f42463c0 con 0x5652f3e74390 2024-08-31T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f753f7fe640 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f4244310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f7537fff640 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e74390 0x5652f4244850 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f752800d720 tx=0x7f75280e52f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65252dd4c334aceb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f75357fa640 1 -- 172.21.15.37:0/246177214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528020040 con 0x5652f3e74390 2024-08-31T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f75357fa640 1 -- 172.21.15.37:0/246177214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75280ab230 con 0x5652f3e74390 2024-08-31T06:50:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.221+0000 7f75357fa640 1 -- 172.21.15.37:0/246177214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280a79b0 con 0x5652f3e74390 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 -- 172.21.15.37:0/246177214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e74390 msgr2=0x5652f4244850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e74390 0x5652f4244850 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f752800d720 tx=0x7f75280e52f0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 -- 172.21.15.37:0/246177214 shutdown_connections 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e74390 0x5652f4244850 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e95070 0x5652f423d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 --2- 172.21.15.37:0/246177214 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f4244310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 -- 172.21.15.37:0/246177214 >> 172.21.15.37:0/246177214 conn(0x5652f3e89460 msgr2=0x5652f4240bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 -- 172.21.15.37:0/246177214 shutdown_connections 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 -- 172.21.15.37:0/246177214 wait complete. 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.222+0000 7f754c662740 1 -- start start 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f754c662740 1 Processor -- start 2024-08-31T06:50:22.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f754c662740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f42497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f754c662740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4249db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f754c662740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e95070 0x5652f42ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f754c662740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75401afbd0 con 0x5652f3e95070 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f754c662740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b1040 con 0x5652f3e74390 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f754c662740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f75401b02a0 con 0x5652f3e6c1b0 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f754c662740 10 client.0 _ll_register_callbacks cb 0x7f753000baf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f753ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e95070 0x5652f42ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f753ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e95070 0x5652f42ba5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35822/0 (socket says 172.21.15.37:35822) 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f753ffff640 1 -- 172.21.15.37:0/1123286708 learned_addr learned my addr 172.21.15.37:0/1123286708 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f7537fff640 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4249db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.223+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f42497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f753ffff640 1 -- 172.21.15.37:0/1123286708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 msgr2=0x5652f42497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:22.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f753ffff640 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f42497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f753ffff640 1 -- 172.21.15.37:0/1123286708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 msgr2=0x5652f4249db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f753ffff640 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4249db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f753ffff640 1 -- 172.21.15.37:0/1123286708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652f42bac30 con 0x5652f3e95070 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f753ffff640 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e95070 0x5652f42ba5c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7538035000 tx=0x7f75380095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3279da04f49646 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f751effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f751effd640 1 -- 172.21.15.37:0/1123286708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538056060 con 0x5652f3e95070 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f751effd640 1 -- 172.21.15.37:0/1123286708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7538030d90 con 0x5652f3e95070 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f754c662740 1 -- 172.21.15.37:0/1123286708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75280ab230 con 0x5652f3e95070 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f751effd640 1 -- 172.21.15.37:0/1123286708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7538003970 con 0x5652f3e95070 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f754c662740 10 client.16476 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f754c662740 1 -- 172.21.15.37:0/1123286708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5652f42c1fc0 con 0x5652f3e95070 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.224+0000 7f751effd640 1 -- 172.21.15.37:0/1123286708 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75280ab230 con 0x5652f3e95070 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f751effd640 1 -- 172.21.15.37:0/1123286708 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7538044040 con 0x5652f3e95070 2024-08-31T06:50:22.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f754c662740 10 client.16476 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f754c662740 10 client.16476 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f754c662740 20 client.16476 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f754c662740 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5652f3e28da0 0x5652f42c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f754c662740 4 client.16476 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f754c662740 1 -- 172.21.15.37:0/1123286708 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5652f41af070 con 0x5652f3e28da0 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5652f3e28da0 0x5652f42c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f751effd640 10 client.16476 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.225+0000 7f753f7fe640 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5652f3e28da0 0x5652f42c47e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdfb8ccc23c628ae server_cookie=3b721e45947b5283 in_seq=0 out_seq=0 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f751effd640 1 -- 172.21.15.37:0/1123286708 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5652f41af070 con 0x5652f3e28da0 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f751effd640 10 client.16476 handle_command_reply: tid=0 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 client.16476 shutdown 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 -- 172.21.15.37:0/1123286708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e95070 msgr2=0x5652f42ba5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e95070 0x5652f42ba5c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7538035000 tx=0x7f75380095c0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 -- 172.21.15.37:0/1123286708 shutdown_connections 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5652f3e28da0 0x5652f42c47e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f751effd640 0 client.16476 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5652f3e95070 0x5652f42ba5c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5652f3e74390 0x5652f4249db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 --2- 172.21.15.37:0/1123286708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5652f3e6c1b0 0x5652f42497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 -- 172.21.15.37:0/1123286708 >> 172.21.15.37:0/1123286708 conn(0x5652f3e89460 msgr2=0x5652f4244250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 -- 172.21.15.37:0/1123286708 shutdown_connections 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 1 -- 172.21.15.37:0/1123286708 wait complete. 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.226+0000 7f754c662740 20 client.16476 trim_cache size 0 max 16384 2024-08-31T06:50:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:50:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 -- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f752c0b4ca0 msgr2=0x7f752c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f752c0b4ca0 0x7f752c0b71b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7538006010 tx=0x7f7538009410 comp rx=0 tx=0).stop 2024-08-31T06:50:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 -- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7540105010 msgr2=0x7f7540102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7540105010 0x7f7540102a30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f752800d750 tx=0x7f752800dc10 comp rx=0 tx=0).stop 2024-08-31T06:50:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 -- 172.21.15.37:0/1483515519 shutdown_connections 2024-08-31T06:50:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f752c0b4ca0 0x7f752c0b71b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7540105010 0x7f7540102a30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f754010db90 0x7f7540102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 --2- 172.21.15.37:0/1483515519 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75401045e0 0x7f75401024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 -- 172.21.15.37:0/1483515519 >> 172.21.15.37:0/1483515519 conn(0x7f75400794d0 msgr2=0x7f7540107730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 -- 172.21.15.37:0/1483515519 shutdown_connections 2024-08-31T06:50:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:22.227+0000 7f75460ed640 1 -- 172.21.15.37:0/1483515519 wait complete. 2024-08-31T06:50:22.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:21 smithi106 ceph-mon[22134]: pgmap v425: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:50:22.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:21 smithi066 ceph-mon[22244]: pgmap v425: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:50:23.962 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:50:23.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:50:24.226 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:23 smithi106 ceph-mon[22134]: pgmap v426: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-31T06:50:24.333 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:23 smithi037 ceph-mon[18612]: pgmap v426: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-31T06:50:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:23 smithi066 ceph-mon[22244]: pgmap v426: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-31T06:50:24.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 -- 172.21.15.37:0/2514709893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 msgr2=0x7f44fc108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 --2- 172.21.15.37:0/2514709893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 0x7f44fc108570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009900 tx=0x7f44ec02a410 comp rx=0 tx=0).stop 2024-08-31T06:50:24.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 -- 172.21.15.37:0/2514709893 shutdown_connections 2024-08-31T06:50:24.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 --2- 172.21.15.37:0/2514709893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 0x7f44fc108570 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 --2- 172.21.15.37:0/2514709893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc108ab0 0x7f44fc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 --2- 172.21.15.37:0/2514709893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44fc102820 0x7f44fc102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 -- 172.21.15.37:0/2514709893 >> 172.21.15.37:0/2514709893 conn(0x7f44fc0794e0 msgr2=0x7f44fc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 -- 172.21.15.37:0/2514709893 shutdown_connections 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.688+0000 7f4503818640 1 -- 172.21.15.37:0/2514709893 wait complete. 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4503818640 1 Processor -- start 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4503818640 1 -- start start 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4503818640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44fc102820 0x7f44fc19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4503818640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 0x7f44fc19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4503818640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc108ab0 0x7f44fc19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4503818640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc112610 con 0x7f44fc108160 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4503818640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc112490 con 0x7f44fc102820 2024-08-31T06:50:24.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4503818640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc112790 con 0x7f44fc108ab0 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4500db3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 0x7f44fc19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4500db3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 0x7f44fc19b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49582/0 (socket says 172.21.15.37:49582) 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4500db3640 1 -- 172.21.15.37:0/4042551971 learned_addr learned my addr 172.21.15.37:0/4042551971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.689+0000 7f4501db5640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc108ab0 0x7f44fc19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f45015b4640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44fc102820 0x7f44fc19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4500db3640 1 -- 172.21.15.37:0/4042551971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc108ab0 msgr2=0x7f44fc19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4500db3640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc108ab0 0x7f44fc19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4500db3640 1 -- 172.21.15.37:0/4042551971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44fc102820 msgr2=0x7f44fc19b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4500db3640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44fc102820 0x7f44fc19b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4500db3640 1 -- 172.21.15.37:0/4042551971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc1a63b0 con 0x7f44fc108160 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4501db5640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc108ab0 0x7f44fc19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:24.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f45015b4640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44fc102820 0x7f44fc19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4500db3640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 0x7f44fc19b660 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f44ec005940 tx=0x7f44ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f44f27fc640 1 -- 172.21.15.37:0/4042551971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec03f030 con 0x7f44fc108160 2024-08-31T06:50:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4503818640 1 -- 172.21.15.37:0/4042551971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc1a6640 con 0x7f44fc108160 2024-08-31T06:50:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f44f27fc640 1 -- 172.21.15.37:0/4042551971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44ec003c90 con 0x7f44fc108160 2024-08-31T06:50:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f44f27fc640 1 -- 172.21.15.37:0/4042551971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec035070 con 0x7f44fc108160 2024-08-31T06:50:24.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.690+0000 7f4503818640 1 -- 172.21.15.37:0/4042551971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc1a6b20 con 0x7f44fc108160 2024-08-31T06:50:24.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.694+0000 7f44f27fc640 1 -- 172.21.15.37:0/4042551971 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f44ec042030 con 0x7f44fc108160 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.694+0000 7f4509d8d740 1 Processor -- start 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.694+0000 7f4509d8d740 1 -- start start 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb55607350 0x55cb559ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 0x55cb559ae200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4509d8d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb559235f0 con 0x55cb55607350 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4509d8d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cb55912b80 con 0x55cb555e6670 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4509d8d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55cb55916b30 con 0x55cb555de490 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4501db5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb55607350 0x55cb559ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4501db5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb55607350 0x55cb559ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49588/0 (socket says 172.21.15.37:49588) 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4501db5640 1 -- 172.21.15.37:0/2949274187 learned_addr learned my addr 172.21.15.37:0/2949274187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4500db3640 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 0x55cb559ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f45015b4640 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f44f27fc640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44e80b4cd0 0x7f44e80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4501db5640 1 -- 172.21.15.37:0/2949274187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 msgr2=0x55cb559adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4501db5640 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4501db5640 1 -- 172.21.15.37:0/2949274187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 msgr2=0x55cb559ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4501db5640 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 0x55cb559ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.695+0000 7f4501db5640 1 -- 172.21.15.37:0/2949274187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb55672930 con 0x55cb55607350 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.696+0000 7f45015b4640 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.696+0000 7f44f27fc640 1 -- 172.21.15.37:0/4042551971 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f44ec105be0 con 0x7f44fc108160 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.696+0000 7f4501db5640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44e80b4cd0 0x7f44e80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.696+0000 7f4501db5640 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb55607350 0x55cb559ad780 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c450 tx=0x7f44f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afc1a0e4e375e36 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.696+0000 7f44e77fe640 1 -- 172.21.15.37:0/2949274187 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f401f070 con 0x55cb55607350 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.696+0000 7f44e77fe640 1 -- 172.21.15.37:0/2949274187 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f4019de0 con 0x55cb55607350 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.696+0000 7f44e77fe640 1 -- 172.21.15.37:0/2949274187 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f400a8d0 con 0x55cb55607350 2024-08-31T06:50:24.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 -- 172.21.15.37:0/2949274187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb55607350 msgr2=0x55cb559ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4501db5640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44e80b4cd0 0x7f44e80b71e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f44f401c000 tx=0x7f44f401f000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb55607350 0x55cb559ad780 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f44f400c450 tx=0x7f44f400c910 comp rx=0 tx=0).stop 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 -- 172.21.15.37:0/2949274187 shutdown_connections 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 0x55cb559ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2949274187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb55607350 0x55cb559ad780 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 -- 172.21.15.37:0/2949274187 >> 172.21.15.37:0/2949274187 conn(0x55cb555fb740 msgr2=0x55cb559ab670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 -- 172.21.15.37:0/2949274187 shutdown_connections 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.697+0000 7f4509d8d740 1 -- 172.21.15.37:0/2949274187 wait complete. 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 1 -- start start 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 1 Processor -- start 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555de490 0x55cb559bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 0x55cb559bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb55607350 0x55cb559c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cb55775890 con 0x55cb555de490 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55cb55899790 con 0x55cb555e6670 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55cb559c0290 con 0x55cb55607350 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4509d8d740 10 client.0 _ll_register_callbacks cb 0x55cb5561eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f45015b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555de490 0x55cb559bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f45015b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555de490 0x55cb559bd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49596/0 (socket says 172.21.15.37:49596) 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f45015b4640 1 -- 172.21.15.37:0/43792397 learned_addr learned my addr 172.21.15.37:0/43792397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.698+0000 7f4501db5640 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb55607350 0x55cb559c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f4500db3640 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 0x55cb559bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f45015b4640 1 -- 172.21.15.37:0/43792397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb55607350 msgr2=0x55cb559c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f45015b4640 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb55607350 0x55cb559c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f45015b4640 1 -- 172.21.15.37:0/43792397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 msgr2=0x55cb559bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f45015b4640 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 0x55cb559bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f45015b4640 1 -- 172.21.15.37:0/43792397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb558d0f30 con 0x55cb555de490 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f45015b4640 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555de490 0x55cb559bd2c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f44f80107d0 tx=0x7f44f8010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77bc2f8968badd4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f44e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f44e4ff9640 1 -- 172.21.15.37:0/43792397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f800ed40 con 0x55cb555de490 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f44e4ff9640 1 -- 172.21.15.37:0/43792397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f44f8004020 con 0x55cb555de490 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f4509d8d740 1 -- 172.21.15.37:0/43792397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f4019de0 con 0x55cb555de490 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f44e4ff9640 1 -- 172.21.15.37:0/43792397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44f8004220 con 0x55cb555de490 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f4509d8d740 10 client.16488 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.699+0000 7f4509d8d740 1 -- 172.21.15.37:0/43792397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cb559cc0c0 con 0x55cb555de490 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f44e4ff9640 1 -- 172.21.15.37:0/43792397 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f4019de0 con 0x55cb555de490 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f44e4ff9640 1 -- 172.21.15.37:0/43792397 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f44f8024440 con 0x55cb555de490 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f4509d8d740 10 client.16488 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f4509d8d740 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:24.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f4509d8d740 20 client.16488 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f4509d8d740 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb555c5cd0 0x55cb559cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f4509d8d740 4 client.16488 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:50:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f4509d8d740 1 -- 172.21.15.37:0/43792397 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb55925540 con 0x55cb555c5cd0 2024-08-31T06:50:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.700+0000 7f4500db3640 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb555c5cd0 0x55cb559cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.701+0000 7f4500db3640 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb555c5cd0 0x55cb559cf570 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35ef30f37d317b82 server_cookie=41bf424fe0392384 in_seq=0 out_seq=0 2024-08-31T06:50:24.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.701+0000 7f44e4ff9640 10 client.16488 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.701+0000 7f44e4ff9640 1 -- 172.21.15.37:0/43792397 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb55925540 con 0x55cb555c5cd0 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.701+0000 7f44e4ff9640 10 client.16488 handle_command_reply: tid=0 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 client.16488 shutdown 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 -- 172.21.15.37:0/43792397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555de490 msgr2=0x55cb559bd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555de490 0x55cb559bd2c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f44f80107d0 tx=0x7f44f8010c90 comp rx=0 tx=0).stop 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 -- 172.21.15.37:0/43792397 shutdown_connections 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb555c5cd0 0x55cb559cf570 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb55607350 0x55cb559c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f44e4ff9640 0 client.16488 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555e6670 0x55cb559bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 --2- 172.21.15.37:0/43792397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555de490 0x55cb559bd2c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 -- 172.21.15.37:0/43792397 >> 172.21.15.37:0/43792397 conn(0x55cb555fb740 msgr2=0x55cb559b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 -- 172.21.15.37:0/43792397 shutdown_connections 2024-08-31T06:50:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 1 -- 172.21.15.37:0/43792397 wait complete. 2024-08-31T06:50:24.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.702+0000 7f4509d8d740 20 client.16488 trim_cache size 0 max 16384 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4509d8d740 1 Processor -- start 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4509d8d740 1 -- start start 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4509d8d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1afac0 con 0x55cb555e6670 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4509d8d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ad390 con 0x55cb555c5cd0 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4509d8d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ab1e0 con 0x55cb555de490 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4501db5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4501db5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49610/0 (socket says 172.21.15.37:49610) 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4501db5640 1 -- 172.21.15.37:0/370963946 learned_addr learned my addr 172.21.15.37:0/370963946 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4500db3640 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f45015b4640 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4501db5640 1 -- 172.21.15.37:0/370963946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 msgr2=0x55cb559aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4501db5640 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4501db5640 1 -- 172.21.15.37:0/370963946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 msgr2=0x55cb559b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4501db5640 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f4501db5640 1 -- 172.21.15.37:0/370963946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb559abf60 con 0x55cb555e6670 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.720+0000 7f45015b4640 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.721+0000 7f4501db5640 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c94c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009380 tx=0x7f44f4024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd21f607acba5792 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.721+0000 7f44e6ffd640 1 -- 172.21.15.37:0/370963946 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007d90 con 0x55cb555e6670 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.721+0000 7f44e6ffd640 1 -- 172.21.15.37:0/370963946 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f4019d60 con 0x55cb555e6670 2024-08-31T06:50:24.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.721+0000 7f44e6ffd640 1 -- 172.21.15.37:0/370963946 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f400a880 con 0x55cb555e6670 2024-08-31T06:50:24.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 -- 172.21.15.37:0/370963946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 msgr2=0x55cb559c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c94c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009380 tx=0x7f44f4024000 comp rx=0 tx=0).stop 2024-08-31T06:50:24.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 -- 172.21.15.37:0/370963946 shutdown_connections 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c94c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 --2- 172.21.15.37:0/370963946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 -- 172.21.15.37:0/370963946 >> 172.21.15.37:0/370963946 conn(0x55cb555fb740 msgr2=0x55cb559ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 -- 172.21.15.37:0/370963946 shutdown_connections 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 -- 172.21.15.37:0/370963946 wait complete. 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 -- start start 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.722+0000 7f4509d8d740 1 Processor -- start 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4509d8d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4509d8d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ab850 con 0x55cb555e6670 2024-08-31T06:50:24.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4509d8d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1accc0 con 0x55cb555c5cd0 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4509d8d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1abf20 con 0x55cb555de490 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4509d8d740 10 client.0 _ll_register_callbacks cb 0x7f44f800c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49626/0 (socket says 172.21.15.37:49626) 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 -- 172.21.15.37:0/2399172437 learned_addr learned my addr 172.21.15.37:0/2399172437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4500db3640 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f45015b4640 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 -- 172.21.15.37:0/2399172437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 msgr2=0x55cb559c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559c1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 -- 172.21.15.37:0/2399172437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 msgr2=0x55cb559c5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 -- 172.21.15.37:0/2399172437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb559c2a50 con 0x55cb555e6670 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f4501db5640 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c24e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f44f401b010 tx=0x7f44f400c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4448cb26fdef78 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f44e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.723+0000 7f44e4ff9640 1 -- 172.21.15.37:0/2399172437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f400abd0 con 0x55cb555e6670 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f44e4ff9640 1 -- 172.21.15.37:0/2399172437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f44f400a610 con 0x55cb555e6670 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 1 -- 172.21.15.37:0/2399172437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f4019d60 con 0x55cb555e6670 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f44e4ff9640 1 -- 172.21.15.37:0/2399172437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f44f400a830 con 0x55cb555e6670 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 10 client.16494 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 1 -- 172.21.15.37:0/2399172437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cb55a3ac50 con 0x55cb555e6670 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f44e4ff9640 1 -- 172.21.15.37:0/2399172437 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44f4019d60 con 0x55cb555e6670 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f44e4ff9640 1 -- 172.21.15.37:0/2399172437 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f44f4015050 con 0x55cb555e6670 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 10 client.16494 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 20 client.16494 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb55607350 0x55cb55a3d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 4 client.16494 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:50:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.724+0000 7f4509d8d740 1 -- 172.21.15.37:0/2399172437 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cb55920fe0 con 0x55cb55607350 2024-08-31T06:50:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.725+0000 7f45015b4640 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb55607350 0x55cb55a3d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.725+0000 7f45015b4640 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb55607350 0x55cb55a3d210 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c603520aeff4b3c8 server_cookie=259e430b5c0eac10 in_seq=0 out_seq=0 2024-08-31T06:50:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.725+0000 7f44e4ff9640 10 client.16494 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f44e4ff9640 1 -- 172.21.15.37:0/2399172437 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cb55920fe0 con 0x55cb55607350 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f44e4ff9640 10 client.16494 handle_command_reply: tid=0 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 client.16494 shutdown 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 -- 172.21.15.37:0/2399172437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 msgr2=0x55cb559c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c24e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f44f401b010 tx=0x7f44f400c0d0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 -- 172.21.15.37:0/2399172437 shutdown_connections 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55cb55607350 0x55cb55a3d210 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cb555e6670 0x55cb559c24e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cb555de490 0x55cb559c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 --2- 172.21.15.37:0/2399172437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55cb555c5cd0 0x55cb559c5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f44e4ff9640 0 client.16494 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 -- 172.21.15.37:0/2399172437 >> 172.21.15.37:0/2399172437 conn(0x55cb555fb740 msgr2=0x55cb559af170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 -- 172.21.15.37:0/2399172437 shutdown_connections 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 1 -- 172.21.15.37:0/2399172437 wait complete. 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.727+0000 7f4509d8d740 20 client.16494 trim_cache size 0 max 16384 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "7d665108-288f-4fce-9300-5f55bc84ce85", 2024-08-31T06:50:24.732 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:50:24.733 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:50:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 -- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44e80b4cd0 msgr2=0x7f44e80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44e80b4cd0 0x7f44e80b71e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f44f401c000 tx=0x7f44f401f000 comp rx=0 tx=0).stop 2024-08-31T06:50:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 -- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 msgr2=0x7f44fc19b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 0x7f44fc19b660 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f44ec005940 tx=0x7f44ec0042f0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 -- 172.21.15.37:0/4042551971 shutdown_connections 2024-08-31T06:50:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f44e80b4cd0 0x7f44e80b71e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44fc108160 0x7f44fc19b660 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc108ab0 0x7f44fc19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 --2- 172.21.15.37:0/4042551971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44fc102820 0x7f44fc19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 -- 172.21.15.37:0/4042551971 >> 172.21.15.37:0/4042551971 conn(0x7f44fc0794e0 msgr2=0x7f44fc104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 -- 172.21.15.37:0/4042551971 shutdown_connections 2024-08-31T06:50:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:24.728+0000 7f4503818640 1 -- 172.21.15.37:0/4042551971 wait complete. 2024-08-31T06:50:25.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:50:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:26.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:25 smithi037 ceph-mon[18612]: pgmap v427: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:26.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:25 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:50:26.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:25 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:50:26.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:25 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:50:26.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:25 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:50:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 -- 172.21.15.37:0/1841072651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28078030 msgr2=0x7f1f28113fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1841072651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28078030 0x7f1f28113fb0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009900 tx=0x7f1f1c02a410 comp rx=0 tx=0).stop 2024-08-31T06:50:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 -- 172.21.15.37:0/1841072651 shutdown_connections 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1841072651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f28078030 0x7f1f28113fb0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1841072651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f281144f0 0x7f1f28116910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1841072651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f280776e0 0x7f1f28077af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 -- 172.21.15.37:0/1841072651 >> 172.21.15.37:0/1841072651 conn(0x7f1f28101600 msgr2=0x7f1f28103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 -- 172.21.15.37:0/1841072651 shutdown_connections 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.286+0000 7f1f2e242640 1 -- 172.21.15.37:0/1841072651 wait complete. 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f2e242640 1 Processor -- start 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f2e242640 1 -- start start 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f2e242640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f280776e0 0x7f1f281a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f2e242640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f28078030 0x7f1f281a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f2e242640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f281144f0 0x7f1f281a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f2e242640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28119d60 con 0x7f1f281144f0 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f2e242640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28119be0 con 0x7f1f28078030 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f2e242640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1f28119ee0 con 0x7f1f280776e0 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f27fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f281144f0 0x7f1f281a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f27fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f281144f0 0x7f1f281a6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49644/0 (socket says 172.21.15.37:49644) 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f27fff640 1 -- 172.21.15.37:0/1480963662 learned_addr learned my addr 172.21.15.37:0/1480963662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.287+0000 7f1f277fe640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f280776e0 0x7f1f281a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f28078030 0x7f1f281a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f27fff640 1 -- 172.21.15.37:0/1480963662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f280776e0 msgr2=0x7f1f281a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f27fff640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f280776e0 0x7f1f281a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f27fff640 1 -- 172.21.15.37:0/1480963662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f28078030 msgr2=0x7f1f281a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f27fff640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f28078030 0x7f1f281a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f27fff640 1 -- 172.21.15.37:0/1480963662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f281a6780 con 0x7f1f281144f0 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f28078030 0x7f1f281a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f27fff640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f281144f0 0x7f1f281a6050 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000b970 tx=0x7f1f2000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f24ff9640 1 -- 172.21.15.37:0/1480963662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20019070 con 0x7f1f281144f0 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f24ff9640 1 -- 172.21.15.37:0/1480963662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f20014440 con 0x7f1f281144f0 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f2e242640 1 -- 172.21.15.37:0/1480963662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f281a6a70 con 0x7f1f281144f0 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f24ff9640 1 -- 172.21.15.37:0/1480963662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f200075d0 con 0x7f1f281144f0 2024-08-31T06:50:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.288+0000 7f1f2e242640 1 -- 172.21.15.37:0/1480963662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f281ad1d0 con 0x7f1f281144f0 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.291+0000 7f1f347b7740 1 Processor -- start 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.291+0000 7f1f24ff9640 1 -- 172.21.15.37:0/1480963662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f1f2001c070 con 0x7f1f281144f0 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.291+0000 7f1f347b7740 1 -- start start 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.291+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a96070 0x565148e3b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.291+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a6d1b0 0x565148e3b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.291+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e3bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.291+0000 7f1f347b7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565148db2630 con 0x565148a75390 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f347b7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x565148da1bc0 con 0x565148a96070 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f347b7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x565148da5b70 con 0x565148a6d1b0 2024-08-31T06:50:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e3bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e3bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49658/0 (socket says 172.21.15.37:49658) 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 -- 172.21.15.37:0/3837273904 learned_addr learned my addr 172.21.15.37:0/3837273904 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f277fe640 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a6d1b0 0x565148e3b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a96070 0x565148e3b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f24ff9640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1f100b4ca0 0x7f1f100b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 -- 172.21.15.37:0/3837273904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a6d1b0 msgr2=0x565148e3b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a6d1b0 0x565148e3b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 -- 172.21.15.37:0/3837273904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a96070 msgr2=0x565148e3b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a96070 0x565148e3b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 -- 172.21.15.37:0/3837273904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565148b01650 con 0x565148a75390 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f277fe640 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a6d1b0 0x565148e3b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f27fff640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1f100b4ca0 0x7f1f100b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f24ff9640 1 -- 172.21.15.37:0/1480963662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1f200e49b0 con 0x7f1f281144f0 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.292+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e3bd40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c005760 tx=0x7f1f1c0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f39026632c1d5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.293+0000 7f1f0dffb640 1 -- 172.21.15.37:0/3837273904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c035040 con 0x565148a75390 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.293+0000 7f1f0dffb640 1 -- 172.21.15.37:0/3837273904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f1c0044c0 con 0x565148a75390 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.293+0000 7f1f0dffb640 1 -- 172.21.15.37:0/3837273904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c003a20 con 0x565148a75390 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.293+0000 7f1f347b7740 1 -- 172.21.15.37:0/3837273904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 msgr2=0x565148e3bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.293+0000 7f1f27fff640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1f100b4ca0 0x7f1f100b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1f200e21f0 tx=0x7f1f20004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.293+0000 7f1f347b7740 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e3bd40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c005760 tx=0x7f1f1c0056d0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.293+0000 7f1f347b7740 1 -- 172.21.15.37:0/3837273904 shutdown_connections 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.294+0000 7f1f347b7740 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e3bd40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.294+0000 7f1f347b7740 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a6d1b0 0x565148e3b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.294+0000 7f1f347b7740 1 --2- 172.21.15.37:0/3837273904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a96070 0x565148e3b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.294+0000 7f1f347b7740 1 -- 172.21.15.37:0/3837273904 >> 172.21.15.37:0/3837273904 conn(0x565148a8a460 msgr2=0x565148e391b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.294+0000 7f1f347b7740 1 -- 172.21.15.37:0/3837273904 shutdown_connections 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.294+0000 7f1f347b7740 1 -- 172.21.15.37:0/3837273904 wait complete. 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.294+0000 7f1f347b7740 1 -- start start 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.294+0000 7f1f347b7740 1 Processor -- start 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 0x565148e46a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e46f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a96070 0x565148e52d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f347b7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565148c04700 con 0x565148a75390 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f347b7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x565148d28700 con 0x565148a6d1b0 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f347b7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x565148e49a40 con 0x565148a96070 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e46f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e46f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49660/0 (socket says 172.21.15.37:49660) 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 -- 172.21.15.37:0/1058339750 learned_addr learned my addr 172.21.15.37:0/1058339750 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f347b7740 10 client.0 _ll_register_callbacks cb 0x565148d57dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 0x565148e46a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a96070 0x565148e52d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 -- 172.21.15.37:0/1058339750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a96070 msgr2=0x565148e52d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a96070 0x565148e52d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 -- 172.21.15.37:0/1058339750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 msgr2=0x565148e46a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 0x565148e46a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 -- 172.21.15.37:0/1058339750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565148d618b0 con 0x565148a75390 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a96070 0x565148e52d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f277fe640 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e46f90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800ba10 tx=0x7f1f1800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b2cd05dc996bfe3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.295+0000 7f1f06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f06ffd640 1 -- 172.21.15.37:0/1058339750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18003e80 con 0x565148a75390 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f06ffd640 1 -- 172.21.15.37:0/1058339750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1f18011440 con 0x565148a75390 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 1 -- 172.21.15.37:0/1058339750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565148db4580 con 0x565148a75390 2024-08-31T06:50:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f06ffd640 1 -- 172.21.15.37:0/1058339750 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f18011640 con 0x565148a75390 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 10 client.16506 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 1 -- 172.21.15.37:0/1058339750 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565148e55890 con 0x565148a75390 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f06ffd640 1 -- 172.21.15.37:0/1058339750 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x565148db4580 con 0x565148a75390 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f06ffd640 1 -- 172.21.15.37:0/1058339750 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1f1801b920 con 0x565148a75390 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 10 client.16506 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 20 client.16506 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x565148a549f0 0x565148e58dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 4 client.16506 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.296+0000 7f1f347b7740 1 -- 172.21.15.37:0/1058339750 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565148db0020 con 0x565148a549f0 2024-08-31T06:50:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.297+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x565148a549f0 0x565148e58dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.297+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x565148a549f0 0x565148e58dd0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be2ad770e4a3e9eb server_cookie=4233928306e2ad5f in_seq=0 out_seq=0 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.297+0000 7f1f06ffd640 10 client.16506 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f06ffd640 1 -- 172.21.15.37:0/1058339750 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565148db0020 con 0x565148a549f0 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f06ffd640 10 client.16506 handle_command_reply: tid=0 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 client.16506 shutdown 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 -- 172.21.15.37:0/1058339750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 msgr2=0x565148e46f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e46f90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800ba10 tx=0x7f1f1800bed0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 -- 172.21.15.37:0/1058339750 shutdown_connections 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x565148a549f0 0x565148e58dd0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a75390 0x565148e46f90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f06ffd640 0 client.16506 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a96070 0x565148e52d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 --2- 172.21.15.37:0/1058339750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 0x565148e46a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 -- 172.21.15.37:0/1058339750 >> 172.21.15.37:0/1058339750 conn(0x565148a8a460 msgr2=0x565148e3e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 -- 172.21.15.37:0/1058339750 shutdown_connections 2024-08-31T06:50:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.298+0000 7f1f347b7740 1 -- 172.21.15.37:0/1058339750 wait complete. 2024-08-31T06:50:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.299+0000 7f1f347b7740 20 client.16506 trim_cache size 0 max 16384 2024-08-31T06:50:26.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:25 smithi106 ceph-mon[22134]: pgmap v427: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:26.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:25 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:50:26.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:25 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:50:26.318 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:25 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:50:26.319 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:25 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:50:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.316+0000 7f1f347b7740 1 Processor -- start 2024-08-31T06:50:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.316+0000 7f1f347b7740 1 -- start start 2024-08-31T06:50:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a549f0 0x565148e3e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 0x565148e3e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 0x565148e43c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f347b7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f281b8250 con 0x565148a549f0 2024-08-31T06:50:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f347b7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f281b5b20 con 0x565148a6d1b0 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f347b7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1f281b3970 con 0x565148a75390 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a549f0 0x565148e3e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a549f0 0x565148e3e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49668/0 (socket says 172.21.15.37:49668) 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 -- 172.21.15.37:0/2651085098 learned_addr learned my addr 172.21.15.37:0/2651085098 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 -- 172.21.15.37:0/2651085098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 msgr2=0x565148e43c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/2651085098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 0x565148e43c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 -- 172.21.15.37:0/2651085098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 msgr2=0x565148e3e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/2651085098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 0x565148e3e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 -- 172.21.15.37:0/2651085098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565148e53510 con 0x565148a549f0 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/2651085098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a549f0 0x565148e3e3c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c02a930 tx=0x7f1f1c04a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182ba0144f871ddf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f0d7fa640 1 -- 172.21.15.37:0/2651085098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c035040 con 0x565148a549f0 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f0d7fa640 1 -- 172.21.15.37:0/2651085098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f1c03d8e0 con 0x565148a549f0 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.317+0000 7f1f0d7fa640 1 -- 172.21.15.37:0/2651085098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c048670 con 0x565148a549f0 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 -- 172.21.15.37:0/2651085098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a549f0 msgr2=0x565148e3e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 --2- 172.21.15.37:0/2651085098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a549f0 0x565148e3e3c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c02a930 tx=0x7f1f1c04a040 comp rx=0 tx=0).stop 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 -- 172.21.15.37:0/2651085098 shutdown_connections 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 --2- 172.21.15.37:0/2651085098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 0x565148e43c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 --2- 172.21.15.37:0/2651085098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a6d1b0 0x565148e3e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 --2- 172.21.15.37:0/2651085098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a549f0 0x565148e3e3c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 -- 172.21.15.37:0/2651085098 >> 172.21.15.37:0/2651085098 conn(0x565148a8a460 msgr2=0x565148e46800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 -- 172.21.15.37:0/2651085098 shutdown_connections 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.318+0000 7f1f347b7740 1 -- 172.21.15.37:0/2651085098 wait complete. 2024-08-31T06:50:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 1 -- start start 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 1 Processor -- start 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a549f0 0x565148e4b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a6d1b0 0x565148e4b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 0x565148ec27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f281b3fe0 con 0x565148a6d1b0 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1f281b5450 con 0x565148a549f0 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1f281b46b0 con 0x565148a75390 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f347b7740 10 client.0 _ll_register_callbacks cb 0x7f1f180042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a6d1b0 0x565148e4b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a6d1b0 0x565148e4b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49678/0 (socket says 172.21.15.37:49678) 2024-08-31T06:50:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f277fe640 1 -- 172.21.15.37:0/706699707 learned_addr learned my addr 172.21.15.37:0/706699707 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a549f0 0x565148e4b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.319+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 0x565148ec27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f277fe640 1 -- 172.21.15.37:0/706699707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 msgr2=0x565148ec27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f277fe640 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 0x565148ec27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f277fe640 1 -- 172.21.15.37:0/706699707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a549f0 msgr2=0x565148e4b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f277fe640 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a549f0 0x565148e4b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f277fe640 1 -- 172.21.15.37:0/706699707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565148ec2d10 con 0x565148a6d1b0 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f277fe640 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a6d1b0 0x565148e4b630 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1f18005d00 tx=0x7f1f180052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b8f00f8c50bb9e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f06ffd640 1 -- 172.21.15.37:0/706699707 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18028070 con 0x565148a6d1b0 2024-08-31T06:50:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f06ffd640 1 -- 172.21.15.37:0/706699707 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1f18011440 con 0x565148a6d1b0 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f347b7740 1 -- 172.21.15.37:0/706699707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f1c03d8e0 con 0x565148a6d1b0 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f06ffd640 1 -- 172.21.15.37:0/706699707 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f18003e80 con 0x565148a6d1b0 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f347b7740 10 client.16512 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.320+0000 7f1f347b7740 1 -- 172.21.15.37:0/706699707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565148ec3e70 con 0x565148a6d1b0 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f06ffd640 1 -- 172.21.15.37:0/706699707 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1f1c03d8e0 con 0x565148a6d1b0 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f06ffd640 1 -- 172.21.15.37:0/706699707 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1f18010ba0 con 0x565148a6d1b0 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f347b7740 10 client.16512 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f347b7740 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f347b7740 20 client.16512 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f347b7740 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x565148a96070 0x565148ec65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f347b7740 4 client.16512 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f347b7740 1 -- 172.21.15.37:0/706699707 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x565148dad760 con 0x565148a96070 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.321+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x565148a96070 0x565148ec65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f26ffd640 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x565148a96070 0x565148ec65b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daab01d2b760f0c8 server_cookie=53413bbf726f9fda in_seq=0 out_seq=0 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f06ffd640 10 client.16512 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f06ffd640 1 -- 172.21.15.37:0/706699707 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x565148dad760 con 0x565148a96070 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f06ffd640 10 client.16512 handle_command_reply: tid=0 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 client.16512 shutdown 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 -- 172.21.15.37:0/706699707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a6d1b0 msgr2=0x565148e4b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a6d1b0 0x565148e4b630 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f1f18005d00 tx=0x7f1f180052f0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 -- 172.21.15.37:0/706699707 shutdown_connections 2024-08-31T06:50:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x565148a96070 0x565148ec65b0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565148a6d1b0 0x565148e4b630 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565148a75390 0x565148ec27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 --2- 172.21.15.37:0/706699707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x565148a549f0 0x565148e4b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f06ffd640 0 client.16512 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 -- 172.21.15.37:0/706699707 >> 172.21.15.37:0/706699707 conn(0x565148a8a460 msgr2=0x565148e3e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 -- 172.21.15.37:0/706699707 shutdown_connections 2024-08-31T06:50:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 1 -- 172.21.15.37:0/706699707 wait complete. 2024-08-31T06:50:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.322+0000 7f1f347b7740 20 client.16512 trim_cache size 0 max 16384 2024-08-31T06:50:26.333 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:50:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:50:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:50:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:50:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "7d665108-288f-4fce-9300-5f55bc84ce85", 2024-08-31T06:50:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:26.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:26.335 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:50:26.335 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:50:26.335 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:26.335 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:26.336 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:26.336 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:26.336 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:26.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:26.336 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:50:26.336 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:50:26.336 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:26.336 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:26.337 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:26.338 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:26.338 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:26.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:26.338 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:50:26.338 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:50:26.338 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:26.338 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:50:26.339 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:50:26.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 -- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1f100b4ca0 msgr2=0x7f1f100b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1f100b4ca0 0x7f1f100b71b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1f200e21f0 tx=0x7f1f20004a40 comp rx=0 tx=0).stop 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 -- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f281144f0 msgr2=0x7f1f281a6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f281144f0 0x7f1f281a6050 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000b970 tx=0x7f1f2000be30 comp rx=0 tx=0).stop 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 -- 172.21.15.37:0/1480963662 shutdown_connections 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1f100b4ca0 0x7f1f100b71b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f281144f0 0x7f1f281a6050 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f28078030 0x7f1f281a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 --2- 172.21.15.37:0/1480963662 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f280776e0 0x7f1f281a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 -- 172.21.15.37:0/1480963662 >> 172.21.15.37:0/1480963662 conn(0x7f1f28101600 msgr2=0x7f1f28116610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 -- 172.21.15.37:0/1480963662 shutdown_connections 2024-08-31T06:50:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:26.323+0000 7f1f2e242640 1 -- 172.21.15.37:0/1480963662 wait complete. 2024-08-31T06:50:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:25 smithi066 ceph-mon[22244]: pgmap v427: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:25 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:50:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:25 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:50:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:25 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:50:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:25 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:50:27.180 INFO:tasks.cephfs.filesystem:scrub status for tag:7d665108-288f-4fce-9300-5f55bc84ce85 - {'path': '/', 'tag': '7d665108-288f-4fce-9300-5f55bc84ce85', 'options': 'recursive,force'} 2024-08-31T06:50:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:27 smithi106 ceph-mon[22134]: pgmap v428: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-08-31T06:50:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:27 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:50:28.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:27 smithi037 ceph-mon[18612]: pgmap v428: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-08-31T06:50:28.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:27 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:50:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:27 smithi066 ceph-mon[22244]: pgmap v428: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-08-31T06:50:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:27 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:50:30.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:29 smithi106 ceph-mon[22134]: pgmap v429: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:30.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:29 smithi037 ceph-mon[18612]: pgmap v429: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:30.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:29 smithi066 ceph-mon[22244]: pgmap v429: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:32.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:31 smithi106 ceph-mon[22134]: pgmap v430: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:50:32.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:31 smithi037 ceph-mon[18612]: pgmap v430: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:50:32.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:31 smithi066 ceph-mon[22244]: pgmap v430: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:50:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:33 smithi106 ceph-mon[22134]: pgmap v431: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-08-31T06:50:34.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:33 smithi037 ceph-mon[18612]: pgmap v431: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-08-31T06:50:34.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:33 smithi066 ceph-mon[22244]: pgmap v431: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-08-31T06:50:36.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:35 smithi106 ceph-mon[22134]: pgmap v432: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:50:36.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:35 smithi037 ceph-mon[18612]: pgmap v432: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:50:36.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:35 smithi066 ceph-mon[22244]: pgmap v432: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:50:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:37 smithi106 ceph-mon[22134]: pgmap v433: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:50:38.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:37 smithi037 ceph-mon[18612]: pgmap v433: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:50:38.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:37 smithi066 ceph-mon[22244]: pgmap v433: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:50:40.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:39 smithi106 ceph-mon[22134]: pgmap v434: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-08-31T06:50:40.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:39 smithi037 ceph-mon[18612]: pgmap v434: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-08-31T06:50:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:39 smithi066 ceph-mon[22244]: pgmap v434: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-08-31T06:50:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:41 smithi106 ceph-mon[22134]: pgmap v435: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:42.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:41 smithi037 ceph-mon[18612]: pgmap v435: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:41 smithi066 ceph-mon[22244]: pgmap v435: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:44.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:43 smithi106 ceph-mon[22134]: pgmap v436: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:50:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:43 smithi037 ceph-mon[18612]: pgmap v436: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:50:44.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:43 smithi066 ceph-mon[22244]: pgmap v436: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:50:46.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:45 smithi106 ceph-mon[22134]: pgmap v437: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:46.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:45 smithi037 ceph-mon[18612]: pgmap v437: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:46.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:45 smithi066 ceph-mon[22244]: pgmap v437: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:48.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:47 smithi106 ceph-mon[22134]: pgmap v438: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:48.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:47 smithi037 ceph-mon[18612]: pgmap v438: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:48.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:47 smithi066 ceph-mon[22244]: pgmap v438: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:50.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:49 smithi106 ceph-mon[22134]: pgmap v439: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:50:50.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:49 smithi037 ceph-mon[18612]: pgmap v439: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:50:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:49 smithi066 ceph-mon[22244]: pgmap v439: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:50:52.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:51 smithi106 ceph-mon[22134]: pgmap v440: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:52.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:51 smithi037 ceph-mon[18612]: pgmap v440: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:52.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:51 smithi066 ceph-mon[22244]: pgmap v440: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:54.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:53 smithi106 ceph-mon[22134]: pgmap v441: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:50:54.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:53 smithi037 ceph-mon[18612]: pgmap v441: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:50:54.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:53 smithi066 ceph-mon[22244]: pgmap v441: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:50:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:55 smithi106 ceph-mon[22134]: pgmap v442: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:56.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:55 smithi037 ceph-mon[18612]: pgmap v442: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:56.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:55 smithi066 ceph-mon[22244]: pgmap v442: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:50:57.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:50:57.458 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.940+0000 7fbd6e20c640 1 -- 172.21.15.37:0/4195188359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 msgr2=0x7fbd68108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.940+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/4195188359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 0x7fbd68108550 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009900 tx=0x7fbd5002a410 comp rx=0 tx=0).stop 2024-08-31T06:50:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.940+0000 7fbd6e20c640 1 -- 172.21.15.37:0/4195188359 shutdown_connections 2024-08-31T06:50:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.940+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/4195188359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 0x7fbd68108550 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.940+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/4195188359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd68108a90 0x7fbd6810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.940+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/4195188359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd68102800 0x7fbd68102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.940+0000 7fbd6e20c640 1 -- 172.21.15.37:0/4195188359 >> 172.21.15.37:0/4195188359 conn(0x7fbd680794c0 msgr2=0x7fbd680798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.941+0000 7fbd6e20c640 1 -- 172.21.15.37:0/4195188359 shutdown_connections 2024-08-31T06:50:57.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.941+0000 7fbd6e20c640 1 -- 172.21.15.37:0/4195188359 wait complete. 2024-08-31T06:50:57.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.941+0000 7fbd6e20c640 1 Processor -- start 2024-08-31T06:50:57.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.941+0000 7fbd6e20c640 1 -- start start 2024-08-31T06:50:57.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd6e20c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd68102800 0x7fbd6819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd6e20c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 0x7fbd6819b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd6e20c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd68108a90 0x7fbd6819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd6e20c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681125e0 con 0x7fbd68108140 2024-08-31T06:50:57.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd6e20c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68112460 con 0x7fbd68102800 2024-08-31T06:50:57.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd6e20c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68112760 con 0x7fbd68108a90 2024-08-31T06:50:57.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd5effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 0x7fbd6819b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd5effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 0x7fbd6819b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53838/0 (socket says 172.21.15.37:53838) 2024-08-31T06:50:57.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd677fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd68102800 0x7fbd6819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd5effd640 1 -- 172.21.15.37:0/3444099614 learned_addr learned my addr 172.21.15.37:0/3444099614 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd67fff640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd68108a90 0x7fbd6819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd5effd640 1 -- 172.21.15.37:0/3444099614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd68108a90 msgr2=0x7fbd6819ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd5effd640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd68108a90 0x7fbd6819ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd5effd640 1 -- 172.21.15.37:0/3444099614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd68102800 msgr2=0x7fbd6819af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd5effd640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd68102800 0x7fbd6819af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd5effd640 1 -- 172.21.15.37:0/3444099614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd681a62a0 con 0x7fbd68108140 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.942+0000 7fbd67fff640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd68108a90 0x7fbd6819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.943+0000 7fbd5effd640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 0x7fbd6819b4d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbd5002a930 tx=0x7fbd50003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.943+0000 7fbd657fa640 1 -- 172.21.15.37:0/3444099614 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5003f070 con 0x7fbd68108140 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.943+0000 7fbd657fa640 1 -- 172.21.15.37:0/3444099614 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd5003baf0 con 0x7fbd68108140 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.943+0000 7fbd6e20c640 1 -- 172.21.15.37:0/3444099614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd681a6530 con 0x7fbd68108140 2024-08-31T06:50:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.943+0000 7fbd657fa640 1 -- 172.21.15.37:0/3444099614 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50035030 con 0x7fbd68108140 2024-08-31T06:50:57.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.943+0000 7fbd6e20c640 1 -- 172.21.15.37:0/3444099614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a6a10 con 0x7fbd68108140 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.945+0000 7fbd74781740 1 Processor -- start 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd74781740 1 -- start start 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd74781740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f7122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd74781740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f712800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd74781740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 0x55a48f712d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd74781740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a48f689630 con 0x55a48f3441b0 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd74781740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a48f678bc0 con 0x55a48f36d070 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd74781740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a48f67cb70 con 0x55a48f34c390 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f712800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f712800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53844/0 (socket says 172.21.15.37:53844) 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f7122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd677fe640 1 -- 172.21.15.37:0/2766134257 learned_addr learned my addr 172.21.15.37:0/2766134257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd677fe640 1 -- 172.21.15.37:0/2766134257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 msgr2=0x55a48f712d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd677fe640 1 --2- 172.21.15.37:0/2766134257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 0x55a48f712d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd677fe640 1 -- 172.21.15.37:0/2766134257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 msgr2=0x55a48f7122c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd677fe640 1 --2- 172.21.15.37:0/2766134257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f7122c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd677fe640 1 -- 172.21.15.37:0/2766134257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a48f3d8650 con 0x55a48f3441b0 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.946+0000 7fbd67fff640 1 --2- 172.21.15.37:0/2766134257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f7122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.947+0000 7fbd677fe640 1 --2- 172.21.15.37:0/2766134257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f712800 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004650 tx=0x7fbd5800bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc4b91dd99a4c19 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.947+0000 7fbd657fa640 1 -- 172.21.15.37:0/3444099614 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fbd50042070 con 0x7fbd68108140 2024-08-31T06:50:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.947+0000 7fbd5dffb640 1 -- 172.21.15.37:0/2766134257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58003b70 con 0x55a48f3441b0 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.947+0000 7fbd5dffb640 1 -- 172.21.15.37:0/2766134257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd58015070 con 0x55a48f3441b0 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.947+0000 7fbd5dffb640 1 -- 172.21.15.37:0/2766134257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58004c00 con 0x55a48f3441b0 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd657fa640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd540b4ca0 0x7fbd540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd67fff640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd540b4ca0 0x7fbd540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 -- 172.21.15.37:0/2766134257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 msgr2=0x55a48f712800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 --2- 172.21.15.37:0/2766134257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f712800 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbd58004650 tx=0x7fbd5800bba0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd657fa640 1 -- 172.21.15.37:0/3444099614 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbd50105c40 con 0x7fbd68108140 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 -- 172.21.15.37:0/2766134257 shutdown_connections 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 --2- 172.21.15.37:0/2766134257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f712800 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 --2- 172.21.15.37:0/2766134257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 0x55a48f712d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 --2- 172.21.15.37:0/2766134257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f7122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 -- 172.21.15.37:0/2766134257 >> 172.21.15.37:0/2766134257 conn(0x55a48f361460 msgr2=0x55a48f7101b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 -- 172.21.15.37:0/2766134257 shutdown_connections 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.948+0000 7fbd74781740 1 -- 172.21.15.37:0/2766134257 wait complete. 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd67fff640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd540b4ca0 0x7fbd540b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbd6806ca00 tx=0x7fbd60009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd74781740 1 -- start start 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd74781740 1 Processor -- start 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd74781740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 0x55a48f721e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd74781740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f34c390 0x55a48f7223b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd74781740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f36d070 0x55a48f72e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd74781740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a48f4db700 con 0x55a48f36d070 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd74781740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a48f5ff700 con 0x55a48f34c390 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.949+0000 7fbd74781740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a48f724e00 con 0x55a48f3441b0 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd74781740 10 client.0 _ll_register_callbacks cb 0x55a48f62edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f36d070 0x55a48f72e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd5effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f34c390 0x55a48f7223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd67fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f36d070 0x55a48f72e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53860/0 (socket says 172.21.15.37:53860) 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd67fff640 1 -- 172.21.15.37:0/3052744115 learned_addr learned my addr 172.21.15.37:0/3052744115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd677fe640 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 0x55a48f721e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd5effd640 1 -- 172.21.15.37:0/3052744115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 msgr2=0x55a48f721e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd5effd640 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 0x55a48f721e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd5effd640 1 -- 172.21.15.37:0/3052744115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f36d070 msgr2=0x55a48f72e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd5effd640 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f36d070 0x55a48f72e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd5effd640 1 -- 172.21.15.37:0/3052744115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a48f6388b0 con 0x55a48f34c390 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd67fff640 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f36d070 0x55a48f72e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd5effd640 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f34c390 0x55a48f7223b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd501033d0 tx=0x7fbd50031630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf117ab5ccdbff80 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd46ffd640 1 -- 172.21.15.37:0/3052744115 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50049030 con 0x55a48f34c390 2024-08-31T06:50:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd74781740 1 -- 172.21.15.37:0/3052744115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd58015070 con 0x55a48f34c390 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.950+0000 7fbd46ffd640 1 -- 172.21.15.37:0/3052744115 <== mon.2 v2:172.21.15.66:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbd50103650 con 0x55a48f34c390 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd46ffd640 1 -- 172.21.15.37:0/3052744115 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd500cca70 con 0x55a48f34c390 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd74781740 10 client.25970 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd74781740 1 -- 172.21.15.37:0/3052744115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a48f730c40 con 0x55a48f34c390 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd46ffd640 1 -- 172.21.15.37:0/3052744115 <== mon.2 v2:172.21.15.66:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd58015070 con 0x55a48f34c390 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd46ffd640 1 -- 172.21.15.37:0/3052744115 <== mon.2 v2:172.21.15.66:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd500cc5d0 con 0x55a48f34c390 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd74781740 10 client.25970 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd74781740 10 client.25970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd74781740 20 client.25970 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd74781740 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a48f32b9f0 0x55a48f733ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd74781740 4 client.25970 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd74781740 1 -- 172.21.15.37:0/3052744115 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a48f68b580 con 0x55a48f32b9f0 2024-08-31T06:50:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.951+0000 7fbd677fe640 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a48f32b9f0 0x55a48f733ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.952+0000 7fbd46ffd640 10 client.25970 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.952+0000 7fbd677fe640 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a48f32b9f0 0x55a48f733ff0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb1bbff14941e405 server_cookie=7645aadc5693facd in_seq=0 out_seq=0 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.952+0000 7fbd46ffd640 1 -- 172.21.15.37:0/3052744115 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a48f68b580 con 0x55a48f32b9f0 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd46ffd640 10 client.25970 handle_command_reply: tid=0 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 client.25970 shutdown 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 -- 172.21.15.37:0/3052744115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f34c390 msgr2=0x55a48f7223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f34c390 0x55a48f7223b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd501033d0 tx=0x7fbd50031630 comp rx=0 tx=0).stop 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 -- 172.21.15.37:0/3052744115 shutdown_connections 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a48f32b9f0 0x55a48f733ff0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f36d070 0x55a48f72e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd46ffd640 0 client.25970 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f34c390 0x55a48f7223b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 --2- 172.21.15.37:0/3052744115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 0x55a48f721e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 -- 172.21.15.37:0/3052744115 >> 172.21.15.37:0/3052744115 conn(0x55a48f361460 msgr2=0x55a48f713cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 -- 172.21.15.37:0/3052744115 shutdown_connections 2024-08-31T06:50:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 1 -- 172.21.15.37:0/3052744115 wait complete. 2024-08-31T06:50:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.953+0000 7fbd74781740 20 client.25970 trim_cache size 0 max 16384 2024-08-31T06:50:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.970+0000 7fbd74781740 1 Processor -- start 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd74781740 1 -- start start 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd74781740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 0x55a48f71f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd74781740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f34c390 0x55a48f71f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd74781740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f739780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd74781740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681af9b0 con 0x55a48f34c390 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd74781740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681ad280 con 0x55a48f36d070 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd74781740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681ab0d0 con 0x55a48f3441b0 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f34c390 0x55a48f71f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f34c390 0x55a48f71f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53874/0 (socket says 172.21.15.37:53874) 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 -- 172.21.15.37:0/32409956 learned_addr learned my addr 172.21.15.37:0/32409956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd677fe640 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 0x55a48f71f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd67fff640 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f739780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 -- 172.21.15.37:0/32409956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 msgr2=0x55a48f71f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 0x55a48f71f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 -- 172.21.15.37:0/32409956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 msgr2=0x55a48f739780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f739780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 -- 172.21.15.37:0/32409956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a48f734360 con 0x55a48f34c390 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.971+0000 7fbd5effd640 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f34c390 0x55a48f71f5a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbd50105f60 tx=0x7fbd5003bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c846bb401649cef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd5d7fa640 1 -- 172.21.15.37:0/32409956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50049070 con 0x55a48f34c390 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd5d7fa640 1 -- 172.21.15.37:0/32409956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd500cc370 con 0x55a48f34c390 2024-08-31T06:50:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd5d7fa640 1 -- 172.21.15.37:0/32409956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd500cc5d0 con 0x55a48f34c390 2024-08-31T06:50:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd74781740 1 -- 172.21.15.37:0/32409956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f34c390 msgr2=0x55a48f71f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd74781740 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f34c390 0x55a48f71f5a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbd50105f60 tx=0x7fbd5003bf50 comp rx=0 tx=0).stop 2024-08-31T06:50:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd74781740 1 -- 172.21.15.37:0/32409956 shutdown_connections 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd74781740 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f34c390 0x55a48f71f5a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd74781740 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f739780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.972+0000 7fbd74781740 1 --2- 172.21.15.37:0/32409956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f3441b0 0x55a48f71f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 -- 172.21.15.37:0/32409956 >> 172.21.15.37:0/32409956 conn(0x55a48f361460 msgr2=0x55a48f721c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 -- 172.21.15.37:0/32409956 shutdown_connections 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 -- 172.21.15.37:0/32409956 wait complete. 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 -- start start 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 Processor -- start 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f726850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 0x55a48f726d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f79d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681ab740 con 0x55a48f3441b0 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681acbb0 con 0x55a48f36d070 2024-08-31T06:50:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681abe10 con 0x55a48f34c390 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.973+0000 7fbd74781740 10 client.0 _ll_register_callbacks cb 0x7fbd50005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f726850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f726850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53878/0 (socket says 172.21.15.37:53878) 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 -- 172.21.15.37:0/908036974 learned_addr learned my addr 172.21.15.37:0/908036974 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd5effd640 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 0x55a48f726d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd67fff640 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f79d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 -- 172.21.15.37:0/908036974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 msgr2=0x55a48f726d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 0x55a48f726d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 -- 172.21.15.37:0/908036974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 msgr2=0x55a48f79d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f79d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 -- 172.21.15.37:0/908036974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a48f79dec0 con 0x55a48f3441b0 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd677fe640 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f726850 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55a48f710f40 tx=0x7fbd58004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fb963db69ef974 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd46ffd640 1 -- 172.21.15.37:0/908036974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd58032060 con 0x55a48f3441b0 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd46ffd640 1 -- 172.21.15.37:0/908036974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbd58003fc0 con 0x55a48f3441b0 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.974+0000 7fbd74781740 1 -- 172.21.15.37:0/908036974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd500cc370 con 0x55a48f3441b0 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd46ffd640 1 -- 172.21.15.37:0/908036974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd58037470 con 0x55a48f3441b0 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd74781740 10 client.16530 fetch_fsmap learned FSMap version 25 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd74781740 1 -- 172.21.15.37:0/908036974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a48f79f150 con 0x55a48f3441b0 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd46ffd640 1 -- 172.21.15.37:0/908036974 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd500cc370 con 0x55a48f3441b0 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd46ffd640 1 -- 172.21.15.37:0/908036974 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd5802d580 con 0x55a48f3441b0 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd74781740 10 client.16530 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:50:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd74781740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd74781740 20 client.16530 populate_metadata read hostname 'smithi037' 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd74781740 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a48f300da0 0x55a48f7a1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd74781740 4 client.16530 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd74781740 1 -- 172.21.15.37:0/908036974 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a48f687020 con 0x55a48f300da0 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.975+0000 7fbd5effd640 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a48f300da0 0x55a48f7a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd46ffd640 10 client.16530 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd5effd640 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a48f300da0 0x55a48f7a1600 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15a55885de188097 server_cookie=aa9f2c144593b5fc in_seq=0 out_seq=0 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd46ffd640 1 -- 172.21.15.37:0/908036974 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55a48f687020 con 0x55a48f300da0 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd46ffd640 10 client.16530 handle_command_reply: tid=0 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 client.16530 shutdown 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 -- 172.21.15.37:0/908036974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 msgr2=0x55a48f726850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f726850 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55a48f710f40 tx=0x7fbd58004410 comp rx=0 tx=0).stop 2024-08-31T06:50:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 -- 172.21.15.37:0/908036974 shutdown_connections 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a48f300da0 0x55a48f7a1600 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a48f36d070 0x55a48f79d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a48f34c390 0x55a48f726d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 --2- 172.21.15.37:0/908036974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a48f3441b0 0x55a48f726850 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 -- 172.21.15.37:0/908036974 >> 172.21.15.37:0/908036974 conn(0x55a48f361460 msgr2=0x55a48f723130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd46ffd640 0 client.16530 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 -- 172.21.15.37:0/908036974 shutdown_connections 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 1 -- 172.21.15.37:0/908036974 wait complete. 2024-08-31T06:50:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.976+0000 7fbd74781740 20 client.16530 trim_cache size 0 max 16384 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:50:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:50:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:50:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:50:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:50:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:50:57.988 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:50:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 -- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd540b4ca0 msgr2=0x7fbd540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd540b4ca0 0x7fbd540b71b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbd6806ca00 tx=0x7fbd60009500 comp rx=0 tx=0).stop 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 -- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 msgr2=0x7fbd6819b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 0x7fbd6819b4d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbd5002a930 tx=0x7fbd50003b90 comp rx=0 tx=0).stop 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 -- 172.21.15.37:0/3444099614 shutdown_connections 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd540b4ca0 0x7fbd540b71b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68108140 0x7fbd6819b4d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd68108a90 0x7fbd6819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 --2- 172.21.15.37:0/3444099614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd68102800 0x7fbd6819af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 -- 172.21.15.37:0/3444099614 >> 172.21.15.37:0/3444099614 conn(0x7fbd680794c0 msgr2=0x7fbd68104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 -- 172.21.15.37:0/3444099614 shutdown_connections 2024-08-31T06:50:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:57.977+0000 7fbd6e20c640 1 -- 172.21.15.37:0/3444099614 wait complete. 2024-08-31T06:50:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:57 smithi037 ceph-mon[18612]: pgmap v443: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:50:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:50:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:50:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:57 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:50:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:57 smithi106 ceph-mon[22134]: pgmap v443: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:50:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:50:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:50:58.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:50:57 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:50:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:57 smithi066 ceph-mon[22244]: pgmap v443: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:50:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:50:58.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:50:58.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:50:58.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:50:57 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:50:58.786 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:50:58.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:50:59.228 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:50:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 -- 172.21.15.37:0/2983520086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 msgr2=0x7fd4b01085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/2983520086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 0x7fd4b01085d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009900 tx=0x7fd4a002a410 comp rx=0 tx=0).stop 2024-08-31T06:50:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 -- 172.21.15.37:0/2983520086 shutdown_connections 2024-08-31T06:50:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/2983520086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 0x7fd4b01085d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/2983520086 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0108b10 0x7fd4b010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/2983520086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4b0102880 0x7fd4b0102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 -- 172.21.15.37:0/2983520086 >> 172.21.15.37:0/2983520086 conn(0x7fd4b0079510 msgr2=0x7fd4b0079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 -- 172.21.15.37:0/2983520086 shutdown_connections 2024-08-31T06:50:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 -- 172.21.15.37:0/2983520086 wait complete. 2024-08-31T06:50:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 Processor -- start 2024-08-31T06:50:59.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.701+0000 7fd4b6a76640 1 -- start start 2024-08-31T06:50:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4b6a76640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0102880 0x7fd4b0198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:59.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4b6a76640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 0x7fd4b0199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4b6a76640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4b0108b10 0x7fd4b0199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4b6a76640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b0112630 con 0x7fd4b01081c0 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4b6a76640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b01124b0 con 0x7fd4b0102880 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4b6a76640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b01127b0 con 0x7fd4b0108b10 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 0x7fd4b0199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 0x7fd4b0199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53882/0 (socket says 172.21.15.37:53882) 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 -- 172.21.15.37:0/3319418517 learned_addr learned my addr 172.21.15.37:0/3319418517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4b4812640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0102880 0x7fd4b0198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4b5013640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4b0108b10 0x7fd4b0199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 -- 172.21.15.37:0/3319418517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4b0108b10 msgr2=0x7fd4b0199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4b0108b10 0x7fd4b0199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 -- 172.21.15.37:0/3319418517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0102880 msgr2=0x7fd4b0198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:59.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0102880 0x7fd4b0198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 -- 172.21.15.37:0/3319418517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b01a84d0 con 0x7fd4b01081c0 2024-08-31T06:50:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a7fff640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 0x7fd4b0199310 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009230 tx=0x7fd4a00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.702+0000 7fd4a5ffb640 1 -- 172.21.15.37:0/3319418517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a003f030 con 0x7fd4b01081c0 2024-08-31T06:50:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.703+0000 7fd4a5ffb640 1 -- 172.21.15.37:0/3319418517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4a0003a80 con 0x7fd4b01081c0 2024-08-31T06:50:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.703+0000 7fd4a5ffb640 1 -- 172.21.15.37:0/3319418517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0035070 con 0x7fd4b01081c0 2024-08-31T06:50:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.703+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b01a8760 con 0x7fd4b01081c0 2024-08-31T06:50:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.703+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b01a8c90 con 0x7fd4b01081c0 2024-08-31T06:50:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.704+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b0103b00 con 0x7fd4b01081c0 2024-08-31T06:50:59.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.706+0000 7fd4a5ffb640 1 -- 172.21.15.37:0/3319418517 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fd4a0042030 con 0x7fd4b01081c0 2024-08-31T06:50:59.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.707+0000 7fd4a5ffb640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4980b4d20 0x7fd4980b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:50:59.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.707+0000 7fd4b4812640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4980b4d20 0x7fd4980b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:50:59.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.707+0000 7fd4a5ffb640 1 -- 172.21.15.37:0/3319418517 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd4a0105e90 con 0x7fd4b01081c0 2024-08-31T06:50:59.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.708+0000 7fd4b4812640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4980b4d20 0x7fd4980b7230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac005fd0 tx=0x7fd4ac005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:50:59.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.710+0000 7fd4a5ffb640 1 -- 172.21.15.37:0/3319418517 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fd4a00ccc60 con 0x7fd4b01081c0 2024-08-31T06:50:59.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.934+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4b010a950 con 0x7fd4b01081c0 2024-08-31T06:50:59.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.935+0000 7fd4a5ffb640 1 -- 172.21.15.37:0/3319418517 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fd4b010a950 con 0x7fd4b01081c0 2024-08-31T06:50:59.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:50:59.936 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:50:59.937 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:50:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4980b4d20 msgr2=0x7fd4980b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4980b4d20 0x7fd4980b7230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac005fd0 tx=0x7fd4ac005850 comp rx=0 tx=0).stop 2024-08-31T06:50:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 msgr2=0x7fd4b0199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:50:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 0x7fd4b0199310 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009230 tx=0x7fd4a00040e0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 shutdown_connections 2024-08-31T06:50:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd4980b4d20 0x7fd4980b7230 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4b01081c0 0x7fd4b0199310 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4b0108b10 0x7fd4b0199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 --2- 172.21.15.37:0/3319418517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0102880 0x7fd4b0198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:50:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 >> 172.21.15.37:0/3319418517 conn(0x7fd4b0079510 msgr2=0x7fd4b0106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:50:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 shutdown_connections 2024-08-31T06:50:59.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:50:59.937+0000 7fd4b6a76640 1 -- 172.21.15.37:0/3319418517 wait complete. 2024-08-31T06:51:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:00 smithi106 ceph-mon[22134]: pgmap v444: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:51:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:00 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3319418517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:00.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:59 smithi037 ceph-mon[18612]: pgmap v444: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:51:00.315 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:50:59 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3319418517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:00 smithi066 ceph-mon[22244]: pgmap v444: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:51:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:00 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3319418517' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:00.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:51:00.962 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:01.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 -- 172.21.15.37:0/2622625333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98102860 msgr2=0x7efd98102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/2622625333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98102860 0x7efd98102c70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7efd88009900 tx=0x7efd8802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 -- 172.21.15.37:0/2622625333 shutdown_connections 2024-08-31T06:51:01.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/2622625333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd98108aa0 0x7efd9810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/2622625333 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd98108150 0x7efd98108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/2622625333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98102860 0x7efd98102c70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 -- 172.21.15.37:0/2622625333 >> 172.21.15.37:0/2622625333 conn(0x7efd980794c0 msgr2=0x7efd980798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:01.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 -- 172.21.15.37:0/2622625333 shutdown_connections 2024-08-31T06:51:01.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.488+0000 7efd9d7d1640 1 -- 172.21.15.37:0/2622625333 wait complete. 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd9d7d1640 1 Processor -- start 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd9d7d1640 1 -- start start 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd9d7d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd98102860 0x7efd9819a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd9d7d1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd98108150 0x7efd9819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd9d7d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98108aa0 0x7efd9819f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd9d7d1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd98113730 con 0x7efd98108aa0 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd9d7d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efd981135b0 con 0x7efd98102860 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd9d7d1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efd981138b0 con 0x7efd98108150 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98108aa0 0x7efd9819f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98108aa0 0x7efd9819f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53894/0 (socket says 172.21.15.37:53894) 2024-08-31T06:51:01.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd977fe640 1 -- 172.21.15.37:0/3015585608 learned_addr learned my addr 172.21.15.37:0/3015585608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd96ffd640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd98102860 0x7efd9819a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.489+0000 7efd8ffff640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd98108150 0x7efd9819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd977fe640 1 -- 172.21.15.37:0/3015585608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd98108150 msgr2=0x7efd9819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd977fe640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd98108150 0x7efd9819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd977fe640 1 -- 172.21.15.37:0/3015585608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd98102860 msgr2=0x7efd9819a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd977fe640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd98102860 0x7efd9819a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd977fe640 1 -- 172.21.15.37:0/3015585608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9819ffb0 con 0x7efd98108aa0 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd977fe640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98108aa0 0x7efd9819f940 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7efd9000cce0 tx=0x7efd9000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd94ff9640 1 -- 172.21.15.37:0/3015585608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9000f450 con 0x7efd98108aa0 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd94ff9640 1 -- 172.21.15.37:0/3015585608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd9000fa80 con 0x7efd98108aa0 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd94ff9640 1 -- 172.21.15.37:0/3015585608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd900189c0 con 0x7efd98108aa0 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd9d7d1640 1 -- 172.21.15.37:0/3015585608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd981a02a0 con 0x7efd98108aa0 2024-08-31T06:51:01.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.490+0000 7efd9d7d1640 1 -- 172.21.15.37:0/3015585608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd981a6ac0 con 0x7efd98108aa0 2024-08-31T06:51:01.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.493+0000 7efda3d46740 1 Processor -- start 2024-08-31T06:51:01.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.493+0000 7efd94ff9640 1 -- 172.21.15.37:0/3015585608 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7efd9000fc30 con 0x7efd98108aa0 2024-08-31T06:51:01.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.493+0000 7efda3d46740 1 -- start start 2024-08-31T06:51:01.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efda3d46740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fba310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efda3d46740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fba850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efda3d46740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fbad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efda3d46740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558748f31680 con 0x558748bec1b0 2024-08-31T06:51:01.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efda3d46740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558748f20c10 con 0x558748bf4390 2024-08-31T06:51:01.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efda3d46740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558748f24bc0 con 0x558748c15070 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fba850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53906/0 (socket says 172.21.15.37:53906) 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd96ffd640 1 -- 172.21.15.37:0/4280883302 learned_addr learned my addr 172.21.15.37:0/4280883302 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd8ffff640 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd8ffff640 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fbad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd96ffd640 1 -- 172.21.15.37:0/4280883302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 msgr2=0x558748fba310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd96ffd640 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fba310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd96ffd640 1 -- 172.21.15.37:0/4280883302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 msgr2=0x558748fbad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd96ffd640 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fbad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd96ffd640 1 -- 172.21.15.37:0/4280883302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558748c80650 con 0x558748bec1b0 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd94ff9640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efd840b4cd0 0x7efd840b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.494+0000 7efd8ffff640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efd840b4cd0 0x7efd840b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.495+0000 7efd96ffd640 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fba850 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efd88000c00 tx=0x7efd88031d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0adf73777e046f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:01.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.495+0000 7efd94ff9640 1 -- 172.21.15.37:0/3015585608 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7efd900e5900 con 0x7efd98108aa0 2024-08-31T06:51:01.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.495+0000 7efd8d7fa640 1 -- 172.21.15.37:0/4280883302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88035030 con 0x558748bec1b0 2024-08-31T06:51:01.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.495+0000 7efd8d7fa640 1 -- 172.21.15.37:0/4280883302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd88040070 con 0x558748bec1b0 2024-08-31T06:51:01.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.495+0000 7efd8d7fa640 1 -- 172.21.15.37:0/4280883302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd880039b0 con 0x558748bec1b0 2024-08-31T06:51:01.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 -- 172.21.15.37:0/4280883302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 msgr2=0x558748fba850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fba850 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efd88000c00 tx=0x7efd88031d50 comp rx=0 tx=0).stop 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efd8ffff640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efd840b4cd0 0x7efd840b71e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd98104820 tx=0x7efd8000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 -- 172.21.15.37:0/4280883302 shutdown_connections 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fba850 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fbad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 --2- 172.21.15.37:0/4280883302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fba310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 -- 172.21.15.37:0/4280883302 >> 172.21.15.37:0/4280883302 conn(0x558748c09460 msgr2=0x558748fb8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 -- 172.21.15.37:0/4280883302 shutdown_connections 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 -- 172.21.15.37:0/4280883302 wait complete. 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 -- start start 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.496+0000 7efda3d46740 1 Processor -- start 2024-08-31T06:51:01.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efda3d46740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fc5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efda3d46740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fc5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efda3d46740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fd1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efda3d46740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558748d83700 con 0x558748bec1b0 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efda3d46740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558748ea7750 con 0x558748bf4390 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efda3d46740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558748fc8a90 con 0x558748c15070 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efda3d46740 10 client.0 _ll_register_callbacks cb 0x558748ed6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fc5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fc5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53920/0 (socket says 172.21.15.37:53920) 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 -- 172.21.15.37:0/806142139 learned_addr learned my addr 172.21.15.37:0/806142139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd8ffff640 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fc5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 -- 172.21.15.37:0/806142139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 msgr2=0x558748fd1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fd1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 -- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 msgr2=0x558748fc5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:01.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fc5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 -- 172.21.15.37:0/806142139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558748ee0900 con 0x558748bec1b0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd8ffff640 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fc5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd96ffd640 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fc5a70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7efd88005940 tx=0x7efd88031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bffabe3ecdf85e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.497+0000 7efd7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efd7e7fc640 1 -- 172.21.15.37:0/806142139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88035040 con 0x558748bec1b0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efd7e7fc640 1 -- 172.21.15.37:0/806142139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7efd8803c650 con 0x558748bec1b0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 1 -- 172.21.15.37:0/806142139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd88040070 con 0x558748bec1b0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efd7e7fc640 1 -- 172.21.15.37:0/806142139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd88031a70 con 0x558748bec1b0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 10 client.16548 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 1 -- 172.21.15.37:0/806142139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558748fd4840 con 0x558748bec1b0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efd7e7fc640 1 -- 172.21.15.37:0/806142139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd88040070 con 0x558748bec1b0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efd7e7fc640 1 -- 172.21.15.37:0/806142139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efd8804e870 con 0x558748bec1b0 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 10 client.16548 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:01.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 10 client.16548 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:51:01.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 20 client.16548 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:01.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558748bd39f0 0x558748fd7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 4 client.16548 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:01.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.498+0000 7efda3d46740 1 -- 172.21.15.37:0/806142139 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558748f335d0 con 0x558748bd39f0 2024-08-31T06:51:01.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.499+0000 7efd8ffff640 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558748bd39f0 0x558748fd7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.499+0000 7efd7e7fc640 10 client.16548 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:01.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.499+0000 7efd8ffff640 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558748bd39f0 0x558748fd7ba0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=987227acfb4f66ec server_cookie=f05341b012b31dd in_seq=0 out_seq=0 2024-08-31T06:51:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efd7e7fc640 1 -- 172.21.15.37:0/806142139 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558748f335d0 con 0x558748bd39f0 2024-08-31T06:51:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efd7e7fc640 10 client.16548 handle_command_reply: tid=0 2024-08-31T06:51:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 client.16548 shutdown 2024-08-31T06:51:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 -- 172.21.15.37:0/806142139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 msgr2=0x558748fc5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fc5a70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7efd88005940 tx=0x7efd88031630 comp rx=0 tx=0).stop 2024-08-31T06:51:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 -- 172.21.15.37:0/806142139 shutdown_connections 2024-08-31T06:51:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558748bd39f0 0x558748fd7ba0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fd1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bf4390 0x558748fc5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 --2- 172.21.15.37:0/806142139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bec1b0 0x558748fc5a70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 -- 172.21.15.37:0/806142139 >> 172.21.15.37:0/806142139 conn(0x558748c09460 msgr2=0x558748fbd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:01.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efd7e7fc640 0 client.16548 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:01.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 -- 172.21.15.37:0/806142139 shutdown_connections 2024-08-31T06:51:01.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.500+0000 7efda3d46740 1 -- 172.21.15.37:0/806142139 wait complete. 2024-08-31T06:51:01.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.501+0000 7efda3d46740 20 client.16548 trim_cache size 0 max 16384 2024-08-31T06:51:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efda3d46740 1 Processor -- start 2024-08-31T06:51:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efda3d46740 1 -- start start 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efda3d46740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bec1b0 0x558748fbdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efda3d46740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fc2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efda3d46740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fc31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efda3d46740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd981b1a70 con 0x558748bf4390 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efda3d46740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efd981af340 con 0x558748bec1b0 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efda3d46740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efd981ad190 con 0x558748c15070 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efd8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fc2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efd8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fc2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53934/0 (socket says 172.21.15.37:53934) 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efd8ffff640 1 -- 172.21.15.37:0/349777020 learned_addr learned my addr 172.21.15.37:0/349777020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efd96ffd640 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bec1b0 0x558748fbdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.514+0000 7efd977fe640 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fc31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8ffff640 1 -- 172.21.15.37:0/349777020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 msgr2=0x558748fc31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8ffff640 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fc31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8ffff640 1 -- 172.21.15.37:0/349777020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bec1b0 msgr2=0x558748fbdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8ffff640 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bec1b0 0x558748fbdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8ffff640 1 -- 172.21.15.37:0/349777020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558748fc8620 con 0x558748bf4390 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8ffff640 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fc2c60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7efd8000ab10 tx=0x7efd80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7f717a13e9f2cd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8cff9640 1 -- 172.21.15.37:0/349777020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80011d80 con 0x558748bf4390 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8cff9640 1 -- 172.21.15.37:0/349777020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd8001ede0 con 0x558748bf4390 2024-08-31T06:51:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.515+0000 7efd8cff9640 1 -- 172.21.15.37:0/349777020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8002ab30 con 0x558748bf4390 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 -- 172.21.15.37:0/349777020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 msgr2=0x558748fc2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fc2c60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7efd8000ab10 tx=0x7efd80004730 comp rx=0 tx=0).stop 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 -- 172.21.15.37:0/349777020 shutdown_connections 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fc2c60 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748c15070 0x558748fc31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 --2- 172.21.15.37:0/349777020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748bec1b0 0x558748fbdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 -- 172.21.15.37:0/349777020 >> 172.21.15.37:0/349777020 conn(0x558748c09460 msgr2=0x558748fbd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 -- 172.21.15.37:0/349777020 shutdown_connections 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 -- 172.21.15.37:0/349777020 wait complete. 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 -- start start 2024-08-31T06:51:01.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.516+0000 7efda3d46740 1 Processor -- start 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efda3d46740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748bec1b0 0x558748fdb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efda3d46740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fd9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efda3d46740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748c15070 0x558748fd9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efda3d46740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd981ad800 con 0x558748bf4390 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efda3d46740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efd981aec70 con 0x558748c15070 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efda3d46740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efd981aded0 con 0x558748bec1b0 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fd9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efda3d46740 10 client.0 _ll_register_callbacks cb 0x7efd8000add0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fd9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53944/0 (socket says 172.21.15.37:53944) 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 -- 172.21.15.37:0/821000056 learned_addr learned my addr 172.21.15.37:0/821000056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 -- 172.21.15.37:0/821000056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748bec1b0 msgr2=0x558748fdb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:01.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd96ffd640 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748bec1b0 0x558748fdb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd977fe640 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748c15070 0x558748fd9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748bec1b0 0x558748fdb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 -- 172.21.15.37:0/821000056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748c15070 msgr2=0x558748fd9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748c15070 0x558748fd9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 -- 172.21.15.37:0/821000056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558748fda0a0 con 0x558748bf4390 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd96ffd640 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748bec1b0 0x558748fdb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd8ffff640 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fd9620 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7efd8001b040 tx=0x7efd8002a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82763ebc384aa7b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.517+0000 7efd7e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efd7e7fc640 1 -- 172.21.15.37:0/821000056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8001eb60 con 0x558748bf4390 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efd7e7fc640 1 -- 172.21.15.37:0/821000056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7efd8002a930 con 0x558748bf4390 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 1 -- 172.21.15.37:0/821000056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd8001ede0 con 0x558748bf4390 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efd7e7fc640 1 -- 172.21.15.37:0/821000056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd8002ab30 con 0x558748bf4390 2024-08-31T06:51:01.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 10 client.16554 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 1 -- 172.21.15.37:0/821000056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558749042ff0 con 0x558748bf4390 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efd7e7fc640 1 -- 172.21.15.37:0/821000056 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd8001ede0 con 0x558748bf4390 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efd7e7fc640 1 -- 172.21.15.37:0/821000056 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efd80045c20 con 0x558748bf4390 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 10 client.16554 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 10 client.16554 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 20 client.16554 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558748ba8da0 0x558749045680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 4 client.16554 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.518+0000 7efda3d46740 1 -- 172.21.15.37:0/821000056 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558748f2f070 con 0x558748ba8da0 2024-08-31T06:51:01.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.519+0000 7efd96ffd640 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558748ba8da0 0x558749045680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.519+0000 7efd96ffd640 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558748ba8da0 0x558749045680 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e7b38857d8adef98 server_cookie=956d9a18478b7967 in_seq=0 out_seq=0 2024-08-31T06:51:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.519+0000 7efd7e7fc640 10 client.16554 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efd7e7fc640 1 -- 172.21.15.37:0/821000056 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558748f2f070 con 0x558748ba8da0 2024-08-31T06:51:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efd7e7fc640 10 client.16554 handle_command_reply: tid=0 2024-08-31T06:51:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 client.16554 shutdown 2024-08-31T06:51:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 -- 172.21.15.37:0/821000056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 msgr2=0x558748fd9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fd9620 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7efd8001b040 tx=0x7efd8002a700 comp rx=0 tx=0).stop 2024-08-31T06:51:01.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 -- 172.21.15.37:0/821000056 shutdown_connections 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558748bf4390 0x558748fd9620 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558748ba8da0 0x558749045680 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558748c15070 0x558748fd9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 --2- 172.21.15.37:0/821000056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558748bec1b0 0x558748fdb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 -- 172.21.15.37:0/821000056 >> 172.21.15.37:0/821000056 conn(0x558748c09460 msgr2=0x558748fbb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efd7e7fc640 0 client.16554 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 -- 172.21.15.37:0/821000056 shutdown_connections 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 1 -- 172.21.15.37:0/821000056 wait complete. 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.520+0000 7efda3d46740 20 client.16554 trim_cache size 0 max 16384 2024-08-31T06:51:01.526 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 -- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efd840b4cd0 msgr2=0x7efd840b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efd840b4cd0 0x7efd840b71e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd98104820 tx=0x7efd8000a2d0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 -- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98108aa0 msgr2=0x7efd9819f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98108aa0 0x7efd9819f940 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7efd9000cce0 tx=0x7efd9000a620 comp rx=0 tx=0).stop 2024-08-31T06:51:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 -- 172.21.15.37:0/3015585608 shutdown_connections 2024-08-31T06:51:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efd840b4cd0 0x7efd840b71e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd98108aa0 0x7efd9819f940 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd98108150 0x7efd9819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 --2- 172.21.15.37:0/3015585608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efd98102860 0x7efd9819a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:01.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 -- 172.21.15.37:0/3015585608 >> 172.21.15.37:0/3015585608 conn(0x7efd980794c0 msgr2=0x7efd98106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:01.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 -- 172.21.15.37:0/3015585608 shutdown_connections 2024-08-31T06:51:01.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:01.521+0000 7efd9d7d1640 1 -- 172.21.15.37:0/3015585608 wait complete. 2024-08-31T06:51:02.301 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:02 smithi037 ceph-mon[18612]: pgmap v445: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:02.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:02 smithi106 ceph-mon[22134]: pgmap v445: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:02.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:51:02.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:02 smithi066 ceph-mon[22244]: pgmap v445: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:02.588 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.063+0000 7f2e8618d640 1 -- 172.21.15.37:0/3577554495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80108250 msgr2=0x7f2e8010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.063+0000 7f2e8618d640 1 --2- 172.21.15.37:0/3577554495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80108250 0x7f2e8010ea80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009ca0 tx=0x7f2e7802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.063+0000 7f2e8618d640 1 -- 172.21.15.37:0/3577554495 shutdown_connections 2024-08-31T06:51:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.063+0000 7f2e8618d640 1 --2- 172.21.15.37:0/3577554495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80108250 0x7f2e8010ea80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.063+0000 7f2e8618d640 1 --2- 172.21.15.37:0/3577554495 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e80107900 0x7f2e80107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.063+0000 7f2e8618d640 1 --2- 172.21.15.37:0/3577554495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e80101fc0 0x7f2e801023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.064+0000 7f2e8618d640 1 -- 172.21.15.37:0/3577554495 >> 172.21.15.37:0/3577554495 conn(0x7f2e80079bd0 msgr2=0x7f2e80079fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.064+0000 7f2e8618d640 1 -- 172.21.15.37:0/3577554495 shutdown_connections 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.064+0000 7f2e8618d640 1 -- 172.21.15.37:0/3577554495 wait complete. 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.064+0000 7f2e8618d640 1 Processor -- start 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.064+0000 7f2e8618d640 1 -- start start 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e8618d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80101fc0 0x7f2e80199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e8618d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e80107900 0x7f2e801995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e8618d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e80108250 0x7f2e8019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e8618d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80111e00 con 0x7f2e80101fc0 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e8618d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80111c80 con 0x7f2e80107900 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e8618d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2e80111f80 con 0x7f2e80108250 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80101fc0 0x7f2e80199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80101fc0 0x7f2e80199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53972/0 (socket says 172.21.15.37:53972) 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 -- 172.21.15.37:0/283894233 learned_addr learned my addr 172.21.15.37:0/283894233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e80107900 0x7f2e801995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e80108250 0x7f2e8019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 -- 172.21.15.37:0/283894233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e80108250 msgr2=0x7f2e8019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e80108250 0x7f2e8019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 -- 172.21.15.37:0/283894233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e80107900 msgr2=0x7f2e801995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e80107900 0x7f2e801995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 -- 172.21.15.37:0/283894233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8019ef00 con 0x7f2e80101fc0 2024-08-31T06:51:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e80108250 0x7f2e8019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.065+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80101fc0 0x7f2e80199050 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007910 tx=0x7f2e70007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.066+0000 7f2e7d7fa640 1 -- 172.21.15.37:0/283894233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70019070 con 0x7f2e80101fc0 2024-08-31T06:51:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.066+0000 7f2e7d7fa640 1 -- 172.21.15.37:0/283894233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e70005020 con 0x7f2e80101fc0 2024-08-31T06:51:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.066+0000 7f2e8618d640 1 -- 172.21.15.37:0/283894233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8019f1f0 con 0x7f2e80101fc0 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.066+0000 7f2e7d7fa640 1 -- 172.21.15.37:0/283894233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e700049e0 con 0x7f2e80101fc0 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.066+0000 7f2e8618d640 1 -- 172.21.15.37:0/283894233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e800feae0 con 0x7f2e80101fc0 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.068+0000 7f2e8c702740 1 Processor -- start 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e8c702740 1 -- start start 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e7d7fa640 1 -- 172.21.15.37:0/283894233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f2e7001c070 con 0x7f2e80101fc0 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38d3e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 0x563d38d3e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d3ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e8c702740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563d38cb5680 con 0x563d38978390 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e8c702740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563d38ca4c10 con 0x563d38999070 2024-08-31T06:51:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e8c702740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x563d38ca8bc0 con 0x563d389701b0 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d3ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38d3e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d3ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53986/0 (socket says 172.21.15.37:53986) 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e76ffd640 1 -- 172.21.15.37:0/2343925590 learned_addr learned my addr 172.21.15.37:0/2343925590 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/2343925590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 0x563d38d3e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e76ffd640 1 -- 172.21.15.37:0/2343925590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 msgr2=0x563d38d3e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/2343925590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 0x563d38d3e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e76ffd640 1 -- 172.21.15.37:0/2343925590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 msgr2=0x563d38d3e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/2343925590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38d3e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.069+0000 7f2e76ffd640 1 -- 172.21.15.37:0/2343925590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d38a04650 con 0x563d38978390 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.070+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/2343925590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d3ed90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800cbd0 tx=0x7f2e6800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699f356280588a8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.070+0000 7f2e7d7fa640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2e6c0b4cd0 0x7f2e6c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.070+0000 7f2e75ffb640 1 -- 172.21.15.37:0/2343925590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68005220 con 0x563d38978390 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.070+0000 7f2e75ffb640 1 -- 172.21.15.37:0/2343925590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e68004c30 con 0x563d38978390 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.070+0000 7f2e75ffb640 1 -- 172.21.15.37:0/2343925590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68010690 con 0x563d38978390 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.070+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2e6c0b4cd0 0x7f2e6c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.070+0000 7f2e7d7fa640 1 -- 172.21.15.37:0/283894233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f2e70009700 con 0x7f2e80101fc0 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 -- 172.21.15.37:0/2343925590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 msgr2=0x563d38d3ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2e6c0b4cd0 0x7f2e6c0b71e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2e780094e0 tx=0x7f2e78009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2343925590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d3ed90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800cbd0 tx=0x7f2e6800e720 comp rx=0 tx=0).stop 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 -- 172.21.15.37:0/2343925590 shutdown_connections 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2343925590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d3ed90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2343925590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 0x563d38d3e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2343925590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38d3e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 -- 172.21.15.37:0/2343925590 >> 172.21.15.37:0/2343925590 conn(0x563d3898d460 msgr2=0x563d38d3c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 -- 172.21.15.37:0/2343925590 shutdown_connections 2024-08-31T06:51:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 -- 172.21.15.37:0/2343925590 wait complete. 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.071+0000 7f2e8c702740 1 -- start start 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e8c702740 1 Processor -- start 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d389701b0 0x563d38d4de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38978390 0x563d38d4e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38999070 0x563d38d5a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e8c702740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563d38b07700 con 0x563d389701b0 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e8c702740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563d38c2b750 con 0x563d38978390 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e8c702740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x563d38d50e50 con 0x563d38999070 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e8c702740 10 client.0 _ll_register_callbacks cb 0x563d38c5ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d389701b0 0x563d38d4de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d389701b0 0x563d38d4de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53994/0 (socket says 172.21.15.37:53994) 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7f7fe640 1 -- 172.21.15.37:0/2789696200 learned_addr learned my addr 172.21.15.37:0/2789696200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38978390 0x563d38d4e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38999070 0x563d38d5a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7f7fe640 1 -- 172.21.15.37:0/2789696200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38999070 msgr2=0x563d38d5a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38999070 0x563d38d5a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7f7fe640 1 -- 172.21.15.37:0/2789696200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38978390 msgr2=0x563d38d4e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38978390 0x563d38d4e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e7f7fe640 1 -- 172.21.15.37:0/2789696200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d38c64900 con 0x563d389701b0 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.072+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38978390 0x563d38d4e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:03.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d389701b0 0x563d38d4de20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2e70005fd0 tx=0x7f2e700ac9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdb1949d54782d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e5effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e5effd640 1 -- 172.21.15.37:0/2789696200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e700b11d0 con 0x563d389701b0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e5effd640 1 -- 172.21.15.37:0/2789696200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f2e700a8e10 con 0x563d389701b0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 1 -- 172.21.15.37:0/2789696200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e68004c30 con 0x563d389701b0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e5effd640 1 -- 172.21.15.37:0/2789696200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2e700ac690 con 0x563d389701b0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 10 client.16566 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 1 -- 172.21.15.37:0/2789696200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d38d5cbb0 con 0x563d389701b0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e5effd640 1 -- 172.21.15.37:0/2789696200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e68004c30 con 0x563d389701b0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e5effd640 1 -- 172.21.15.37:0/2789696200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2e700cf040 con 0x563d389701b0 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 10 client.16566 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:03.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 10 client.16566 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 20 client.16566 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x563d389579f0 0x563d38d60100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 4 client.16566 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.073+0000 7f2e8c702740 1 -- 172.21.15.37:0/2789696200 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d38cb75d0 con 0x563d389579f0 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.074+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x563d389579f0 0x563d38d60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.074+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x563d389579f0 0x563d38d60100 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ad616e7cf9bb43e server_cookie=fbcaef61a12c2cbe in_seq=0 out_seq=0 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.074+0000 7f2e5effd640 10 client.16566 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e5effd640 1 -- 172.21.15.37:0/2789696200 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d38cb75d0 con 0x563d389579f0 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e5effd640 10 client.16566 handle_command_reply: tid=0 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 client.16566 shutdown 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 -- 172.21.15.37:0/2789696200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d389701b0 msgr2=0x563d38d4de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d389701b0 0x563d38d4de20 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2e70005fd0 tx=0x7f2e700ac9d0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 -- 172.21.15.37:0/2789696200 shutdown_connections 2024-08-31T06:51:03.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x563d389579f0 0x563d38d60100 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38999070 0x563d38d5a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38978390 0x563d38d4e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e5effd640 0 client.16566 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:03.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 --2- 172.21.15.37:0/2789696200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d389701b0 0x563d38d4de20 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 -- 172.21.15.37:0/2789696200 >> 172.21.15.37:0/2789696200 conn(0x563d3898d460 msgr2=0x563d38d3a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:03.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 -- 172.21.15.37:0/2789696200 shutdown_connections 2024-08-31T06:51:03.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 1 -- 172.21.15.37:0/2789696200 wait complete. 2024-08-31T06:51:03.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.075+0000 7f2e8c702740 20 client.16566 trim_cache size 0 max 16384 2024-08-31T06:51:03.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e8c702740 1 Processor -- start 2024-08-31T06:51:03.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e8c702740 1 -- start start 2024-08-31T06:51:03.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d389701b0 0x563d38d5a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38978390 0x563d38d4c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38999070 0x563d38d4cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e8c702740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e801af9a0 con 0x563d38999070 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e8c702740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e801ad270 con 0x563d389701b0 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e8c702740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2e801ab0c0 con 0x563d38978390 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38999070 0x563d38d4cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38999070 0x563d38d4cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54010/0 (socket says 172.21.15.37:54010) 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7ffff640 1 -- 172.21.15.37:0/3684225761 learned_addr learned my addr 172.21.15.37:0/3684225761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d389701b0 0x563d38d5a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38978390 0x563d38d4c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7ffff640 1 -- 172.21.15.37:0/3684225761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38978390 msgr2=0x563d38d4c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38978390 0x563d38d4c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7ffff640 1 -- 172.21.15.37:0/3684225761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d389701b0 msgr2=0x563d38d5a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:03.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d389701b0 0x563d38d5a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e7ffff640 1 -- 172.21.15.37:0/3684225761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d38d3b060 con 0x563d38999070 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.089+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38978390 0x563d38d4c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.090+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38999070 0x563d38d4cbe0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2e78003cc0 tx=0x7f2e78040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46914f6c41a68833 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.090+0000 7f2e757fa640 1 -- 172.21.15.37:0/3684225761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78003cf0 con 0x563d38999070 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.090+0000 7f2e757fa640 1 -- 172.21.15.37:0/3684225761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e78036050 con 0x563d38999070 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.090+0000 7f2e757fa640 1 -- 172.21.15.37:0/3684225761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e780309b0 con 0x563d38999070 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 -- 172.21.15.37:0/3684225761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38999070 msgr2=0x563d38d4cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38999070 0x563d38d4cbe0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f2e78003cc0 tx=0x7f2e78040000 comp rx=0 tx=0).stop 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 -- 172.21.15.37:0/3684225761 shutdown_connections 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38999070 0x563d38d4cbe0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d38978390 0x563d38d4c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3684225761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d389701b0 0x563d38d5a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 -- 172.21.15.37:0/3684225761 >> 172.21.15.37:0/3684225761 conn(0x563d3898d460 msgr2=0x563d38d48fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:03.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 -- 172.21.15.37:0/3684225761 shutdown_connections 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 -- 172.21.15.37:0/3684225761 wait complete. 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 -- start start 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.091+0000 7f2e8c702740 1 Processor -- start 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 0x563d38d52350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d52890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e8c702740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38dc9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e8c702740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e801ab730 con 0x563d38978390 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e8c702740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2e801acba0 con 0x563d38999070 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e8c702740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2e801abe00 con 0x563d389701b0 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e8c702740 10 client.0 _ll_register_callbacks cb 0x7f2e70007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d52890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d52890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54020/0 (socket says 172.21.15.37:54020) 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 -- 172.21.15.37:0/3534789341 learned_addr learned my addr 172.21.15.37:0/3534789341 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:03.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38dc9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 0x563d38d52350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 -- 172.21.15.37:0/3534789341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 msgr2=0x563d38d52350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 0x563d38d52350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 -- 172.21.15.37:0/3534789341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 msgr2=0x563d38dc9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38dc9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 -- 172.21.15.37:0/3534789341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d38d530b0 con 0x563d38978390 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e7ffff640 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38dc9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e76ffd640 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d52890 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c990 tx=0x7f2e68010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126b43afb6a4f56c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e5effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e5effd640 1 -- 172.21.15.37:0/3534789341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e68029070 con 0x563d38978390 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.092+0000 7f2e5effd640 1 -- 172.21.15.37:0/3534789341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f2e68010be0 con 0x563d38978390 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 1 -- 172.21.15.37:0/3534789341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e78036050 con 0x563d38978390 2024-08-31T06:51:03.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e5effd640 1 -- 172.21.15.37:0/3534789341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2e68010de0 con 0x563d38978390 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 10 client.16572 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 1 -- 172.21.15.37:0/3534789341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d38dcaef0 con 0x563d38978390 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e5effd640 1 -- 172.21.15.37:0/3534789341 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e78036050 con 0x563d38978390 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e5effd640 1 -- 172.21.15.37:0/3534789341 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2e68027a80 con 0x563d38978390 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 10 client.16572 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 10 client.16572 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 20 client.16572 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x563d3892cda0 0x563d38dcd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 4 client.16572 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e8c702740 1 -- 172.21.15.37:0/3534789341 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d38cb3070 con 0x563d3892cda0 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.093+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x563d3892cda0 0x563d38dcd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e7f7fe640 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x563d3892cda0 0x563d38dcd3f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5752868878b41d20 server_cookie=e9e35a70f303b9b6 in_seq=0 out_seq=0 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e5effd640 10 client.16572 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:03.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e5effd640 1 -- 172.21.15.37:0/3534789341 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d38cb3070 con 0x563d3892cda0 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e5effd640 10 client.16572 handle_command_reply: tid=0 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 client.16572 shutdown 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 -- 172.21.15.37:0/3534789341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 msgr2=0x563d38d52890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d52890 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c990 tx=0x7f2e68010660 comp rx=0 tx=0).stop 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 -- 172.21.15.37:0/3534789341 shutdown_connections 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x563d3892cda0 0x563d38dcd3f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563d38978390 0x563d38d52890 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563d38999070 0x563d38dc9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 --2- 172.21.15.37:0/3534789341 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563d389701b0 0x563d38d52350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 -- 172.21.15.37:0/3534789341 >> 172.21.15.37:0/3534789341 conn(0x563d3898d460 msgr2=0x563d38d48fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e5effd640 0 client.16572 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 -- 172.21.15.37:0/3534789341 shutdown_connections 2024-08-31T06:51:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.094+0000 7f2e8c702740 1 -- 172.21.15.37:0/3534789341 wait complete. 2024-08-31T06:51:03.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8c702740 20 client.16572 trim_cache size 0 max 16384 2024-08-31T06:51:03.103 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 -- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2e6c0b4cd0 msgr2=0x7f2e6c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2e6c0b4cd0 0x7f2e6c0b71e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2e780094e0 tx=0x7f2e78009360 comp rx=0 tx=0).stop 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 -- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80101fc0 msgr2=0x7f2e80199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80101fc0 0x7f2e80199050 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007910 tx=0x7f2e70007dd0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 -- 172.21.15.37:0/283894233 shutdown_connections 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2e6c0b4cd0 0x7f2e6c0b71e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e80108250 0x7f2e8019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e80107900 0x7f2e801995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 --2- 172.21.15.37:0/283894233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e80101fc0 0x7f2e80199050 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 -- 172.21.15.37:0/283894233 >> 172.21.15.37:0/283894233 conn(0x7f2e80079bd0 msgr2=0x7f2e801046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 -- 172.21.15.37:0/283894233 shutdown_connections 2024-08-31T06:51:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:03.095+0000 7f2e8618d640 1 -- 172.21.15.37:0/283894233 wait complete. 2024-08-31T06:51:03.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:51:04.176 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:04.296 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:04 smithi037 ceph-mon[18612]: pgmap v446: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:51:04.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:04 smithi106 ceph-mon[22134]: pgmap v446: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:51:04.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:04 smithi066 ceph-mon[22244]: pgmap v446: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:51:04.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 -- 172.21.15.37:0/230182005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108140 msgr2=0x7f1bec108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/230182005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108140 0x7f1bec108550 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1bd8009900 tx=0x7f1bd802a3f0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 -- 172.21.15.37:0/230182005 shutdown_connections 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/230182005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108140 0x7f1bec108550 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/230182005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bec108a90 0x7f1bec10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/230182005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bec102800 0x7f1bec102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 -- 172.21.15.37:0/230182005 >> 172.21.15.37:0/230182005 conn(0x7f1bec0794d0 msgr2=0x7f1bec0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 -- 172.21.15.37:0/230182005 shutdown_connections 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.663+0000 7f1bf2f84640 1 -- 172.21.15.37:0/230182005 wait complete. 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.664+0000 7f1bf2f84640 1 Processor -- start 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.664+0000 7f1bf2f84640 1 -- start start 2024-08-31T06:51:04.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.664+0000 7f1bf2f84640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bec102800 0x7f1bec198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.664+0000 7f1bf2f84640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bec108140 0x7f1bec199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.664+0000 7f1bf2f84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108a90 0x7f1bec199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.664+0000 7f1bf2f84640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec112570 con 0x7f1bec108a90 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.664+0000 7f1bf2f84640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1123f0 con 0x7f1bec102800 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.664+0000 7f1bf2f84640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1126f0 con 0x7f1bec108140 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108a90 0x7f1bec199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108a90 0x7f1bec199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42290/0 (socket says 172.21.15.37:42290) 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 -- 172.21.15.37:0/587330639 learned_addr learned my addr 172.21.15.37:0/587330639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bebfff640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bec108140 0x7f1bec199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bec102800 0x7f1bec198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 -- 172.21.15.37:0/587330639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bec108140 msgr2=0x7f1bec199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bec108140 0x7f1bec199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 -- 172.21.15.37:0/587330639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bec102800 msgr2=0x7f1bec198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bec102800 0x7f1bec198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 -- 172.21.15.37:0/587330639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec1a8370 con 0x7f1bec108a90 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf1521640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108a90 0x7f1bec199770 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1be400cce0 tx=0x7f1be400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1be9ffb640 1 -- 172.21.15.37:0/587330639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be400f450 con 0x7f1bec108a90 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1bf2f84640 1 -- 172.21.15.37:0/587330639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec1a8600 con 0x7f1bec108a90 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1be9ffb640 1 -- 172.21.15.37:0/587330639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1be400fa80 con 0x7f1bec108a90 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.665+0000 7f1be9ffb640 1 -- 172.21.15.37:0/587330639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be4018ad0 con 0x7f1bec108a90 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.666+0000 7f1bf2f84640 1 -- 172.21.15.37:0/587330639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec1a8ac0 con 0x7f1bec108a90 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.668+0000 7f1be9ffb640 1 -- 172.21.15.37:0/587330639 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f1be400f5f0 con 0x7f1bec108a90 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.668+0000 7f1bf94f9740 1 Processor -- start 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.668+0000 7f1bf94f9740 1 -- start start 2024-08-31T06:51:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.668+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e06b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.668+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e06b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dca5390 0x55a29e06bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a29dfe2680 con 0x55a29dca5390 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a29dfd1c10 con 0x55a29dcc6070 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a29dfd5bc0 con 0x55a29dc9d1b0 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dca5390 0x55a29e06bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dca5390 0x55a29e06bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42294/0 (socket says 172.21.15.37:42294) 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 -- 172.21.15.37:0/12981564 learned_addr learned my addr 172.21.15.37:0/12981564 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e06b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e06b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 -- 172.21.15.37:0/12981564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 msgr2=0x55a29e06b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e06b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 -- 172.21.15.37:0/12981564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 msgr2=0x55a29e06b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e06b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1be9ffb640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1bdc0b4ca0 0x7f1bdc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 -- 172.21.15.37:0/12981564 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a29dd31650 con 0x55a29dca5390 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e06b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bebfff640 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dca5390 0x55a29e06bd90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80096c0 tx=0x7f1bd8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81741bdbd5d3b047 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1bdc0b4ca0 0x7f1bdc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.669+0000 7f1be9ffb640 1 -- 172.21.15.37:0/587330639 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1be40e5d40 con 0x7f1bec108a90 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.670+0000 7f1bd6ffd640 1 -- 172.21.15.37:0/12981564 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8035040 con 0x55a29dca5390 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.670+0000 7f1bd6ffd640 1 -- 172.21.15.37:0/12981564 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bd80044c0 con 0x55a29dca5390 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.670+0000 7f1bd6ffd640 1 -- 172.21.15.37:0/12981564 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8003bc0 con 0x55a29dca5390 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 -- 172.21.15.37:0/12981564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dca5390 msgr2=0x55a29e06bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dca5390 0x55a29e06bd90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80096c0 tx=0x7f1bd8005fd0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1bdc0b4ca0 0x7f1bdc0b71b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55a29e069f90 tx=0x7f1be000c4b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 -- 172.21.15.37:0/12981564 shutdown_connections 2024-08-31T06:51:04.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dca5390 0x55a29e06bd90 secure :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80096c0 tx=0x7f1bd8005fd0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e06b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/12981564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e06b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 -- 172.21.15.37:0/12981564 >> 172.21.15.37:0/12981564 conn(0x55a29dcba460 msgr2=0x55a29e069200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:04.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 -- 172.21.15.37:0/12981564 shutdown_connections 2024-08-31T06:51:04.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.671+0000 7f1bf94f9740 1 -- 172.21.15.37:0/12981564 wait complete. 2024-08-31T06:51:04.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 1 -- start start 2024-08-31T06:51:04.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 1 Processor -- start 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc9d1b0 0x55a29e076b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e077110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc849f0 0x55a29e082d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a29de34700 con 0x55a29dc9d1b0 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a29df58750 con 0x55a29dcc6070 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a29e079a90 con 0x55a29dc849f0 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf94f9740 10 client.0 _ll_register_callbacks cb 0x55a29df87e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.672+0000 7f1bf0d20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc9d1b0 0x55a29e076b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf0d20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc9d1b0 0x55a29e076b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42306/0 (socket says 172.21.15.37:42306) 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf0d20640 1 -- 172.21.15.37:0/2347650870 learned_addr learned my addr 172.21.15.37:0/2347650870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bebfff640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf1521640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc849f0 0x55a29e082d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf0d20640 1 -- 172.21.15.37:0/2347650870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc849f0 msgr2=0x55a29e082d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc849f0 0x55a29e082d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf0d20640 1 -- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 msgr2=0x55a29e077110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e077110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf0d20640 1 -- 172.21.15.37:0/2347650870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a29df91900 con 0x55a29dc9d1b0 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf1521640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc849f0 0x55a29e082d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bebfff640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e077110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc9d1b0 0x55a29e076b50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1be001ce00 tx=0x7f1be00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a8b515cb7111e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:04.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bcbfff640 1 -- 172.21.15.37:0/2347650870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0029060 con 0x55a29dc9d1b0 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bcbfff640 1 -- 172.21.15.37:0/2347650870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1be000ed40 con 0x55a29dc9d1b0 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.673+0000 7f1bf94f9740 1 -- 172.21.15.37:0/2347650870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a29dfe45d0 con 0x55a29dc9d1b0 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bcbfff640 1 -- 172.21.15.37:0/2347650870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1be000cae0 con 0x55a29dc9d1b0 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bf94f9740 10 client.16584 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bf94f9740 1 -- 172.21.15.37:0/2347650870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a29e085990 con 0x55a29dc9d1b0 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bcbfff640 1 -- 172.21.15.37:0/2347650870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a29dfe45d0 con 0x55a29dc9d1b0 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bcbfff640 1 -- 172.21.15.37:0/2347650870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1be0018040 con 0x55a29dc9d1b0 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bf94f9740 10 client.16584 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bf94f9740 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bf94f9740 20 client.16584 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a29dc59da0 0x55a29e088ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bf94f9740 4 client.16584 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bf94f9740 1 -- 172.21.15.37:0/2347650870 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a29dfe0070 con 0x55a29dc59da0 2024-08-31T06:51:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.674+0000 7f1bebfff640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a29dc59da0 0x55a29e088ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.675+0000 7f1bcbfff640 10 client.16584 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.675+0000 7f1bebfff640 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a29dc59da0 0x55a29e088ec0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9389871285e1e5ba server_cookie=98a0b75e5c4cc4eb in_seq=0 out_seq=0 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.675+0000 7f1bcbfff640 1 -- 172.21.15.37:0/2347650870 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a29dfe0070 con 0x55a29dc59da0 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.675+0000 7f1bcbfff640 10 client.16584 handle_command_reply: tid=0 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 client.16584 shutdown 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 -- 172.21.15.37:0/2347650870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc9d1b0 msgr2=0x55a29e076b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc9d1b0 0x55a29e076b50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1be001ce00 tx=0x7f1be00046c0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 -- 172.21.15.37:0/2347650870 shutdown_connections 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a29dc59da0 0x55a29e088ec0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bcbfff640 0 client.16584 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc849f0 0x55a29e082d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e077110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/2347650870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc9d1b0 0x55a29e076b50 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 -- 172.21.15.37:0/2347650870 >> 172.21.15.37:0/2347650870 conn(0x55a29dcba460 msgr2=0x55a29e06e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:04.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 -- 172.21.15.37:0/2347650870 shutdown_connections 2024-08-31T06:51:04.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 1 -- 172.21.15.37:0/2347650870 wait complete. 2024-08-31T06:51:04.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.676+0000 7f1bf94f9740 20 client.16584 trim_cache size 0 max 16384 2024-08-31T06:51:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.689+0000 7f1bf94f9740 1 Processor -- start 2024-08-31T06:51:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.689+0000 7f1bf94f9740 1 -- start start 2024-08-31T06:51:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.689+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e069250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.689+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e082c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.689+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e0831c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.689+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1b3d20 con 0x55a29dc849f0 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.689+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1b15f0 con 0x55a29dcc6070 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.689+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1af440 con 0x55a29dc9d1b0 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e069250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e069250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42322/0 (socket says 172.21.15.37:42322) 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 -- 172.21.15.37:0/3160552295 learned_addr learned my addr 172.21.15.37:0/3160552295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bebfff640 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e082c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf1521640 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e0831c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 -- 172.21.15.37:0/3160552295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 msgr2=0x55a29e082c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e082c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 -- 172.21.15.37:0/3160552295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 msgr2=0x55a29e0831c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:04.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e0831c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 -- 172.21.15.37:0/3160552295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a29e069af0 con 0x55a29dc849f0 2024-08-31T06:51:04.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e069250 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1be001cfd0 tx=0x7f1be00194f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135415031d0ef158 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:04.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bd67fc640 1 -- 172.21.15.37:0/3160552295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0019c60 con 0x55a29dc849f0 2024-08-31T06:51:04.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bd67fc640 1 -- 172.21.15.37:0/3160552295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1be0019e00 con 0x55a29dc849f0 2024-08-31T06:51:04.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.690+0000 7f1bd67fc640 1 -- 172.21.15.37:0/3160552295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be001a460 con 0x55a29dc849f0 2024-08-31T06:51:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 -- 172.21.15.37:0/3160552295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 msgr2=0x55a29e069250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e069250 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1be001cfd0 tx=0x7f1be00194f0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 -- 172.21.15.37:0/3160552295 shutdown_connections 2024-08-31T06:51:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dcc6070 0x55a29e0831c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dc9d1b0 0x55a29e082c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/3160552295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e069250 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 -- 172.21.15.37:0/3160552295 >> 172.21.15.37:0/3160552295 conn(0x55a29dcba460 msgr2=0x55a29e068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 -- 172.21.15.37:0/3160552295 shutdown_connections 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.691+0000 7f1bf94f9740 1 -- 172.21.15.37:0/3160552295 wait complete. 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 1 -- start start 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 1 Processor -- start 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e07acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dc9d1b0 0x55a29e07b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dcc6070 0x55a29e07b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1afab0 con 0x55a29dc849f0 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1b0f20 con 0x55a29dc9d1b0 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1b0180 con 0x55a29dcc6070 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf94f9740 10 client.0 _ll_register_callbacks cb 0x7f1be001ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf0d20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e07acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf0d20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e07acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42332/0 (socket says 172.21.15.37:42332) 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bf0d20640 1 -- 172.21.15.37:0/189067787 learned_addr learned my addr 172.21.15.37:0/189067787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.692+0000 7f1bebfff640 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dc9d1b0 0x55a29e07b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf1521640 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dcc6070 0x55a29e07b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf0d20640 1 -- 172.21.15.37:0/189067787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dcc6070 msgr2=0x55a29e07b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dcc6070 0x55a29e07b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf0d20640 1 -- 172.21.15.37:0/189067787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dc9d1b0 msgr2=0x55a29e07b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dc9d1b0 0x55a29e07b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf0d20640 1 -- 172.21.15.37:0/189067787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a29e0f28b0 con 0x55a29dc849f0 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf1521640 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dcc6070 0x55a29e07b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf0d20640 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e07acd0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1be000efa0 tx=0x7f1be0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e5d34883909a67 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bcbfff640 1 -- 172.21.15.37:0/189067787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be003e070 con 0x55a29dc849f0 2024-08-31T06:51:04.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bcbfff640 1 -- 172.21.15.37:0/189067787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1be002e670 con 0x55a29dc849f0 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf94f9740 1 -- 172.21.15.37:0/189067787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1be0019e00 con 0x55a29dc849f0 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bcbfff640 1 -- 172.21.15.37:0/189067787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1be0029020 con 0x55a29dc849f0 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf94f9740 10 client.16590 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.693+0000 7f1bf94f9740 1 -- 172.21.15.37:0/189067787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a29e0f3b10 con 0x55a29dc849f0 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bcbfff640 1 -- 172.21.15.37:0/189067787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1be0019e00 con 0x55a29dc849f0 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bcbfff640 1 -- 172.21.15.37:0/189067787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1be0036070 con 0x55a29dc849f0 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bf94f9740 10 client.16590 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bf94f9740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bf94f9740 20 client.16590 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a29e0f4240 0x55a29e0f6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bf94f9740 4 client.16590 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bf94f9740 1 -- 172.21.15.37:0/189067787 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a29dfdd7b0 con 0x55a29e0f4240 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bebfff640 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a29e0f4240 0x55a29e0f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:04.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bebfff640 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a29e0f4240 0x55a29e0f6660 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=844c972f6f83557b server_cookie=65d2d77a533767f4 in_seq=0 out_seq=0 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.694+0000 7f1bcbfff640 10 client.16590 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bcbfff640 1 -- 172.21.15.37:0/189067787 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a29dfdd7b0 con 0x55a29e0f4240 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bcbfff640 10 client.16590 handle_command_reply: tid=0 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 client.16590 shutdown 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 -- 172.21.15.37:0/189067787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 msgr2=0x55a29e07acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e07acd0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1be000efa0 tx=0x7f1be0005740 comp rx=0 tx=0).stop 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 -- 172.21.15.37:0/189067787 shutdown_connections 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a29e0f4240 0x55a29e0f6660 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a29dcc6070 0x55a29e07b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a29dc9d1b0 0x55a29e07b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bcbfff640 0 client.16590 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 --2- 172.21.15.37:0/189067787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a29dc849f0 0x55a29e07acd0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 -- 172.21.15.37:0/189067787 >> 172.21.15.37:0/189067787 conn(0x55a29dcba460 msgr2=0x55a29e075010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 -- 172.21.15.37:0/189067787 shutdown_connections 2024-08-31T06:51:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 1 -- 172.21.15.37:0/189067787 wait complete. 2024-08-31T06:51:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.695+0000 7f1bf94f9740 20 client.16590 trim_cache size 0 max 16384 2024-08-31T06:51:04.702 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:04.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 -- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1bdc0b4ca0 msgr2=0x7f1bdc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1bdc0b4ca0 0x7f1bdc0b71b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x55a29e069f90 tx=0x7f1be000c4b0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 -- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108a90 msgr2=0x7f1bec199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108a90 0x7f1bec199770 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1be400cce0 tx=0x7f1be400a620 comp rx=0 tx=0).stop 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 -- 172.21.15.37:0/587330639 shutdown_connections 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1bdc0b4ca0 0x7f1bdc0b71b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bec108a90 0x7f1bec199770 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bec108140 0x7f1bec199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 --2- 172.21.15.37:0/587330639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bec102800 0x7f1bec198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 -- 172.21.15.37:0/587330639 >> 172.21.15.37:0/587330639 conn(0x7f1bec0794d0 msgr2=0x7f1bec1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 -- 172.21.15.37:0/587330639 shutdown_connections 2024-08-31T06:51:04.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:04.696+0000 7f1bf2f84640 1 -- 172.21.15.37:0/587330639 wait complete. 2024-08-31T06:51:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:06 smithi106 ceph-mon[22134]: pgmap v447: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:51:06.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:06 smithi037 ceph-mon[18612]: pgmap v447: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:51:06.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:06 smithi066 ceph-mon[22244]: pgmap v447: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-08-31T06:51:06.449 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:51:06.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:51:06.715 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 -- 172.21.15.37:0/88285410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3524108b10 msgr2=0x7f352410f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 --2- 172.21.15.37:0/88285410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3524108b10 0x7f352410f340 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f351c009900 tx=0x7f351c02a410 comp rx=0 tx=0).stop 2024-08-31T06:51:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 -- 172.21.15.37:0/88285410 shutdown_connections 2024-08-31T06:51:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 --2- 172.21.15.37:0/88285410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3524108b10 0x7f352410f340 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 --2- 172.21.15.37:0/88285410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35241081c0 0x7f35241085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 --2- 172.21.15.37:0/88285410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3524102880 0x7f3524102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 -- 172.21.15.37:0/88285410 >> 172.21.15.37:0/88285410 conn(0x7f3524079510 msgr2=0x7f3524079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 -- 172.21.15.37:0/88285410 shutdown_connections 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 -- 172.21.15.37:0/88285410 wait complete. 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.224+0000 7f3529a0b640 1 Processor -- start 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3529a0b640 1 -- start start 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3529a0b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3524102880 0x7f352419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3529a0b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35241081c0 0x7f352419a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3529a0b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3524108b10 0x7f352419fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3529a0b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3524112670 con 0x7f35241081c0 2024-08-31T06:51:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3529a0b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f35241124f0 con 0x7f3524102880 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3529a0b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f35241127f0 con 0x7f3524108b10 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35227fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35241081c0 0x7f352419a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35227fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35241081c0 0x7f352419a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42360/0 (socket says 172.21.15.37:42360) 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35227fc640 1 -- 172.21.15.37:0/2340104552 learned_addr learned my addr 172.21.15.37:0/2340104552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3522ffd640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3524102880 0x7f352419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35237fe640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3524108b10 0x7f352419fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35227fc640 1 -- 172.21.15.37:0/2340104552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3524108b10 msgr2=0x7f352419fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35227fc640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3524108b10 0x7f352419fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35227fc640 1 -- 172.21.15.37:0/2340104552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3524102880 msgr2=0x7f352419a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35227fc640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3524102880 0x7f352419a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f35227fc640 1 -- 172.21.15.37:0/2340104552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35241a0120 con 0x7f35241081c0 2024-08-31T06:51:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.225+0000 7f3522ffd640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3524102880 0x7f352419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.226+0000 7f35227fc640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35241081c0 0x7f352419a810 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c8c0 tx=0x7f350c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.226+0000 7f3528a09640 1 -- 172.21.15.37:0/2340104552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c007bb0 con 0x7f35241081c0 2024-08-31T06:51:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.226+0000 7f3529a0b640 1 -- 172.21.15.37:0/2340104552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35241a0410 con 0x7f35241081c0 2024-08-31T06:51:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.226+0000 7f3528a09640 1 -- 172.21.15.37:0/2340104552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f350c007d50 con 0x7f35241081c0 2024-08-31T06:51:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.226+0000 7f3528a09640 1 -- 172.21.15.37:0/2340104552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c018660 con 0x7f35241081c0 2024-08-31T06:51:07.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.226+0000 7f3529a0b640 1 -- 172.21.15.37:0/2340104552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35241a6c30 con 0x7f35241081c0 2024-08-31T06:51:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f352ff80740 1 Processor -- start 2024-08-31T06:51:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f352ff80740 1 -- start start 2024-08-31T06:51:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f3528a09640 1 -- 172.21.15.37:0/2340104552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f350c00fa00 con 0x7f35241081c0 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f352ff80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac39780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f352ff80740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac39cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f352ff80740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac3a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f352ff80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c41abaf5f0 con 0x55c41a893350 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f352ff80740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c41ab9eb80 con 0x55c41a86a490 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f352ff80740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55c41aba2b30 con 0x55c41a872670 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f35237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac39780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f35237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac39780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42362/0 (socket says 172.21.15.37:42362) 2024-08-31T06:51:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f35237fe640 1 -- 172.21.15.37:0/600144481 learned_addr learned my addr 172.21.15.37:0/600144481 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f3522ffd640 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac39cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.229+0000 7f35227fc640 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac3a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f35237fe640 1 -- 172.21.15.37:0/600144481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 msgr2=0x55c41ac3a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f35237fe640 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac3a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f35237fe640 1 -- 172.21.15.37:0/600144481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 msgr2=0x55c41ac39cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f35237fe640 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac39cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f35237fe640 1 -- 172.21.15.37:0/600144481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c41a8fe930 con 0x55c41a893350 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f3522ffd640 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac39cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:51:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f3528a09640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f35100b4cd0 0x7f35100b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f3522ffd640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f35100b4cd0 0x7f35100b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f35237fe640 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac39780 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f351c009a20 tx=0x7f351c032b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644e30c1818ecb91 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f3528a09640 1 -- 172.21.15.37:0/2340104552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f350c0e55f0 con 0x7f35241081c0 2024-08-31T06:51:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f3519ffb640 1 -- 172.21.15.37:0/600144481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c03f070 con 0x55c41a893350 2024-08-31T06:51:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f3519ffb640 1 -- 172.21.15.37:0/600144481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f351c004030 con 0x55c41a893350 2024-08-31T06:51:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.230+0000 7f3519ffb640 1 -- 172.21.15.37:0/600144481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c035070 con 0x55c41a893350 2024-08-31T06:51:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 -- 172.21.15.37:0/600144481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 msgr2=0x55c41ac39780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac39780 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f351c009a20 tx=0x7f351c032b00 comp rx=0 tx=0).stop 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f3522ffd640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f35100b4cd0 0x7f35100b71e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55c41ac38400 tx=0x7f3514009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 -- 172.21.15.37:0/600144481 shutdown_connections 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac3a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac39cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 --2- 172.21.15.37:0/600144481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac39780 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 -- 172.21.15.37:0/600144481 >> 172.21.15.37:0/600144481 conn(0x55c41a887740 msgr2=0x55c41ac37670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 -- 172.21.15.37:0/600144481 shutdown_connections 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.231+0000 7f352ff80740 1 -- 172.21.15.37:0/600144481 wait complete. 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 1 -- start start 2024-08-31T06:51:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 1 Processor -- start 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac492f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac49830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c41aa01890 con 0x55c41a893350 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c41ab25790 con 0x55c41a86a490 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55c41ac4c260 con 0x55c41a872670 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f35237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f35237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42378/0 (socket says 172.21.15.37:42378) 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f35237fe640 1 -- 172.21.15.37:0/1131066523 learned_addr learned my addr 172.21.15.37:0/1131066523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f352ff80740 10 client.0 _ll_register_callbacks cb 0x55c41a8aaba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.232+0000 7f3522ffd640 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f35227fc640 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac49830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f35237fe640 1 -- 172.21.15.37:0/1131066523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 msgr2=0x55c41ac49830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f35237fe640 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac49830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f35237fe640 1 -- 172.21.15.37:0/1131066523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 msgr2=0x55c41ac492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f35237fe640 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f35237fe640 1 -- 172.21.15.37:0/1131066523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c41ab5cf30 con 0x55c41a893350 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f35237fe640 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac555c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f351c005ab0 tx=0x7f351c004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b74af18056874a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f3502ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f3502ffd640 1 -- 172.21.15.37:0/1131066523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c04b020 con 0x55c41a893350 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f3502ffd640 1 -- 172.21.15.37:0/1131066523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f351c031810 con 0x55c41a893350 2024-08-31T06:51:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f352ff80740 1 -- 172.21.15.37:0/1131066523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f351c004030 con 0x55c41a893350 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f3502ffd640 1 -- 172.21.15.37:0/1131066523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f351c056050 con 0x55c41a893350 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f352ff80740 10 client.16602 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.233+0000 7f352ff80740 1 -- 172.21.15.37:0/1131066523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c41ac58060 con 0x55c41a893350 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f3502ffd640 1 -- 172.21.15.37:0/1131066523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f351c004030 con 0x55c41a893350 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f3502ffd640 1 -- 172.21.15.37:0/1131066523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f351c004a30 con 0x55c41a893350 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f352ff80740 10 client.16602 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f352ff80740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f352ff80740 20 client.16602 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f352ff80740 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55c41a851cd0 0x55c41ac5b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f352ff80740 4 client.16602 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f352ff80740 1 -- 172.21.15.37:0/1131066523 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c41abb1540 con 0x55c41a851cd0 2024-08-31T06:51:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.234+0000 7f3522ffd640 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55c41a851cd0 0x55c41ac5b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.235+0000 7f3522ffd640 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55c41a851cd0 0x55c41ac5b3c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c96a9ac7c8986e server_cookie=7f700d12ad164b75 in_seq=0 out_seq=0 2024-08-31T06:51:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.235+0000 7f3502ffd640 10 client.16602 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.235+0000 7f3502ffd640 1 -- 172.21.15.37:0/1131066523 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c41abb1540 con 0x55c41a851cd0 2024-08-31T06:51:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.235+0000 7f3502ffd640 10 client.16602 handle_command_reply: tid=0 2024-08-31T06:51:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.235+0000 7f352ff80740 1 client.16602 shutdown 2024-08-31T06:51:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 -- 172.21.15.37:0/1131066523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 msgr2=0x55c41ac555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac555c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f351c005ab0 tx=0x7f351c004490 comp rx=0 tx=0).stop 2024-08-31T06:51:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 -- 172.21.15.37:0/1131066523 shutdown_connections 2024-08-31T06:51:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55c41a851cd0 0x55c41ac5b3c0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac555c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac49830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 --2- 172.21.15.37:0/1131066523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 -- 172.21.15.37:0/1131066523 >> 172.21.15.37:0/1131066523 conn(0x55c41a887740 msgr2=0x55c41ac35c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f3502ffd640 0 client.16602 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 -- 172.21.15.37:0/1131066523 shutdown_connections 2024-08-31T06:51:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 1 -- 172.21.15.37:0/1131066523 wait complete. 2024-08-31T06:51:07.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.236+0000 7f352ff80740 20 client.16602 trim_cache size 0 max 16384 2024-08-31T06:51:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f352ff80740 1 Processor -- start 2024-08-31T06:51:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f352ff80740 1 -- start start 2024-08-31T06:51:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f352ff80740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f352ff80740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f352ff80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac495e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f352ff80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35241af9b0 con 0x55c41a893350 2024-08-31T06:51:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f352ff80740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f35241ad280 con 0x55c41a86a490 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f352ff80740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f35241ab0d0 con 0x55c41a872670 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42386/0 (socket says 172.21.15.37:42386) 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35237fe640 1 -- 172.21.15.37:0/1674662820 learned_addr learned my addr 172.21.15.37:0/1674662820 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35227fc640 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f3522ffd640 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35237fe640 1 -- 172.21.15.37:0/1674662820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 msgr2=0x55c41ac490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35237fe640 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35237fe640 1 -- 172.21.15.37:0/1674662820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 msgr2=0x55c41ac376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35237fe640 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac376a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.254+0000 7f35237fe640 1 -- 172.21.15.37:0/1674662820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c41ac44b80 con 0x55c41a893350 2024-08-31T06:51:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.255+0000 7f35237fe640 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac495e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f351c004ed0 tx=0x7f351c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e678d58e74875b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.255+0000 7f35197fa640 1 -- 172.21.15.37:0/1674662820 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c04b040 con 0x55c41a893350 2024-08-31T06:51:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.255+0000 7f35197fa640 1 -- 172.21.15.37:0/1674662820 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f351c004b50 con 0x55c41a893350 2024-08-31T06:51:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.255+0000 7f35197fa640 1 -- 172.21.15.37:0/1674662820 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c035070 con 0x55c41a893350 2024-08-31T06:51:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 -- 172.21.15.37:0/1674662820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 msgr2=0x55c41ac495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac495e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f351c004ed0 tx=0x7f351c02a410 comp rx=0 tx=0).stop 2024-08-31T06:51:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 -- 172.21.15.37:0/1674662820 shutdown_connections 2024-08-31T06:51:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41ac495e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 --2- 172.21.15.37:0/1674662820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac376a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 -- 172.21.15.37:0/1674662820 >> 172.21.15.37:0/1674662820 conn(0x55c41a887740 msgr2=0x55c41ac36f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 -- 172.21.15.37:0/1674662820 shutdown_connections 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 -- 172.21.15.37:0/1674662820 wait complete. 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 -- start start 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.256+0000 7f352ff80740 1 Processor -- start 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f352ff80740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac5ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f352ff80740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac5b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f352ff80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41acc4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f352ff80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35241ab740 con 0x55c41a893350 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f352ff80740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f35241acbb0 con 0x55c41a86a490 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f352ff80740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f35241abe10 con 0x55c41a872670 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f352ff80740 10 client.0 _ll_register_callbacks cb 0x7f35140099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41acc4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41acc4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42400/0 (socket says 172.21.15.37:42400) 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 -- 172.21.15.37:0/730279951 learned_addr learned my addr 172.21.15.37:0/730279951 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35227fc640 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac5b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f3522ffd640 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac5ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 -- 172.21.15.37:0/730279951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 msgr2=0x55c41ac5b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac5b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 -- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 msgr2=0x55c41ac5ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac5ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 -- 172.21.15.37:0/730279951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c41acc50a0 con 0x55c41a893350 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f3522ffd640 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac5ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f35237fe640 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41acc4b30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f351c004f70 tx=0x7f351c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fc4789718bcb5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.257+0000 7f3502ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f3502ffd640 1 -- 172.21.15.37:0/730279951 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f351c04b070 con 0x55c41a893350 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f3502ffd640 1 -- 172.21.15.37:0/730279951 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f351c0048c0 con 0x55c41a893350 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 1 -- 172.21.15.37:0/730279951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f351c004b50 con 0x55c41a893350 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f3502ffd640 1 -- 172.21.15.37:0/730279951 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f351c035040 con 0x55c41a893350 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 10 client.16608 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 1 -- 172.21.15.37:0/730279951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c41acc6360 con 0x55c41a893350 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f3502ffd640 1 -- 172.21.15.37:0/730279951 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f351c004b50 con 0x55c41a893350 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f3502ffd640 1 -- 172.21.15.37:0/730279951 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f351c062030 con 0x55c41a893350 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 10 client.16608 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 10 client.16608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 20 client.16608 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55c41a827080 0x55c41acc8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 4 client.16608 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:51:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f352ff80740 1 -- 172.21.15.37:0/730279951 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c41abacfe0 con 0x55c41a827080 2024-08-31T06:51:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.258+0000 7f3522ffd640 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55c41a827080 0x55c41acc8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.259+0000 7f3522ffd640 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55c41a827080 0x55c41acc8a30 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b1c381646e23f1 server_cookie=b4389f7511f939a in_seq=0 out_seq=0 2024-08-31T06:51:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.259+0000 7f3502ffd640 10 client.16608 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f3502ffd640 1 -- 172.21.15.37:0/730279951 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c41abacfe0 con 0x55c41a827080 2024-08-31T06:51:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f3502ffd640 10 client.16608 handle_command_reply: tid=0 2024-08-31T06:51:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 client.16608 shutdown 2024-08-31T06:51:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 -- 172.21.15.37:0/730279951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 msgr2=0x55c41acc4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41acc4b30 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f351c004f70 tx=0x7f351c004d00 comp rx=0 tx=0).stop 2024-08-31T06:51:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 -- 172.21.15.37:0/730279951 shutdown_connections 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55c41a827080 0x55c41acc8a30 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c41a893350 0x55c41acc4b30 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f3502ffd640 0 client.16608 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c41a872670 0x55c41ac5b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 --2- 172.21.15.37:0/730279951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c41a86a490 0x55c41ac5ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 -- 172.21.15.37:0/730279951 >> 172.21.15.37:0/730279951 conn(0x55c41a887740 msgr2=0x55c41ac490a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 -- 172.21.15.37:0/730279951 shutdown_connections 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 1 -- 172.21.15.37:0/730279951 wait complete. 2024-08-31T06:51:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.261+0000 7f352ff80740 20 client.16608 trim_cache size 0 max 16384 2024-08-31T06:51:07.268 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:51:07.268 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:51:07.268 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "4b4e0ea3-9469-463c-8e1a-fe834f4567d5", 2024-08-31T06:51:07.268 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:51:07.268 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:51:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 -- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f35100b4cd0 msgr2=0x7f35100b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f35100b4cd0 0x7f35100b71e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55c41ac38400 tx=0x7f3514009500 comp rx=0 tx=0).stop 2024-08-31T06:51:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 -- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35241081c0 msgr2=0x7f352419a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35241081c0 0x7f352419a810 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c8c0 tx=0x7f350c00cd80 comp rx=0 tx=0).stop 2024-08-31T06:51:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 -- 172.21.15.37:0/2340104552 shutdown_connections 2024-08-31T06:51:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f35100b4cd0 0x7f35100b71e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35241081c0 0x7f352419a810 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3524108b10 0x7f352419fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 --2- 172.21.15.37:0/2340104552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3524102880 0x7f352419a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 -- 172.21.15.37:0/2340104552 >> 172.21.15.37:0/2340104552 conn(0x7f3524079510 msgr2=0x7f3524106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 -- 172.21.15.37:0/2340104552 shutdown_connections 2024-08-31T06:51:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:07.262+0000 7f3529a0b640 1 -- 172.21.15.37:0/2340104552 wait complete. 2024-08-31T06:51:08.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:51:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:08 smithi106 ceph-mon[22134]: pgmap v448: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:51:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:08 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:51:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:08 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:08 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:51:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:08 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:08 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:51:08.319 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:08.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:08 smithi037 ceph-mon[18612]: pgmap v448: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:51:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:08 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:51:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:08 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:08 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:51:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:08 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:08.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:08 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:51:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:08 smithi066 ceph-mon[22244]: pgmap v448: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:51:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:08 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:51:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:08 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:08 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:51:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:08 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:08 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:51:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.822+0000 7f03b69a7640 1 -- 172.21.15.37:0/991074752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0103950 msgr2=0x7f03b0103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.822+0000 7f03b69a7640 1 --2- 172.21.15.37:0/991074752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0103950 0x7f03b0103d60 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009900 tx=0x7f03a002a410 comp rx=0 tx=0).stop 2024-08-31T06:51:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 -- 172.21.15.37:0/991074752 shutdown_connections 2024-08-31T06:51:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 --2- 172.21.15.37:0/991074752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b0109be0 0x7f03b0110410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 --2- 172.21.15.37:0/991074752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03b0109290 0x7f03b01096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 --2- 172.21.15.37:0/991074752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0103950 0x7f03b0103d60 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 -- 172.21.15.37:0/991074752 >> 172.21.15.37:0/991074752 conn(0x7f03b00ff3a0 msgr2=0x7f03b01017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 -- 172.21.15.37:0/991074752 shutdown_connections 2024-08-31T06:51:08.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 -- 172.21.15.37:0/991074752 wait complete. 2024-08-31T06:51:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 Processor -- start 2024-08-31T06:51:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.823+0000 7f03b69a7640 1 -- start start 2024-08-31T06:51:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b69a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03b0103950 0x7f03b00754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b69a7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b0109290 0x7f03b00759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b69a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0109be0 0x7f03b0075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b69a7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0113750 con 0x7f03b0109be0 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b69a7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01135d0 con 0x7f03b0103950 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b69a7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01138d0 con 0x7f03b0109290 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b4f44640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0109be0 0x7f03b0075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b4f44640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0109be0 0x7f03b0075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42412/0 (socket says 172.21.15.37:42412) 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b4f44640 1 -- 172.21.15.37:0/1063836156 learned_addr learned my addr 172.21.15.37:0/1063836156 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03affff640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03b0103950 0x7f03b00754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03af7fe640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b0109290 0x7f03b00759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b4f44640 1 -- 172.21.15.37:0/1063836156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b0109290 msgr2=0x7f03b00759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b4f44640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b0109290 0x7f03b00759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b4f44640 1 -- 172.21.15.37:0/1063836156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03b0103950 msgr2=0x7f03b00754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b4f44640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03b0103950 0x7f03b00754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03b4f44640 1 -- 172.21.15.37:0/1063836156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b01a8480 con 0x7f03b0109be0 2024-08-31T06:51:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.824+0000 7f03affff640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03b0103950 0x7f03b00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.825+0000 7f03b4f44640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0109be0 0x7f03b0075f30 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f03a800eb10 tx=0x7f03a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.825+0000 7f03ad7fa640 1 -- 172.21.15.37:0/1063836156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8004b20 con 0x7f03b0109be0 2024-08-31T06:51:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.825+0000 7f03ad7fa640 1 -- 172.21.15.37:0/1063836156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03a8004cc0 con 0x7f03b0109be0 2024-08-31T06:51:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.825+0000 7f03b69a7640 1 -- 172.21.15.37:0/1063836156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b01a8770 con 0x7f03b0109be0 2024-08-31T06:51:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.825+0000 7f03ad7fa640 1 -- 172.21.15.37:0/1063836156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8010690 con 0x7f03b0109be0 2024-08-31T06:51:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.825+0000 7f03b69a7640 1 -- 172.21.15.37:0/1063836156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b01a8cb0 con 0x7f03b0109be0 2024-08-31T06:51:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.827+0000 7f03bcf1c740 1 Processor -- start 2024-08-31T06:51:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03ad7fa640 1 -- 172.21.15.37:0/1063836156 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f03a8005020 con 0x7f03b0109be0 2024-08-31T06:51:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03bcf1c740 1 -- start start 2024-08-31T06:51:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fd4070 0x55ce243792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce24379800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce24379d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ce242f0630 con 0x55ce23fb3390 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce242dfbc0 con 0x55ce23fab1b0 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ce242e3b70 con 0x55ce23fd4070 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce24379d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce24379d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42420/0 (socket says 172.21.15.37:42420) 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03af7fe640 1 -- 172.21.15.37:0/3484210288 learned_addr learned my addr 172.21.15.37:0/3484210288 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.828+0000 7f03affff640 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce24379800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03af7fe640 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fd4070 0x55ce243792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03af7fe640 1 -- 172.21.15.37:0/3484210288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fd4070 msgr2=0x55ce243792c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03ad7fa640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03980b4ca0 0x7f03980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03af7fe640 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fd4070 0x55ce243792c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03af7fe640 1 -- 172.21.15.37:0/3484210288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 msgr2=0x55ce24379800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03af7fe640 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce24379800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03af7fe640 1 -- 172.21.15.37:0/3484210288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce2403f650 con 0x55ce23fb3390 2024-08-31T06:51:08.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03b4f44640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03980b4ca0 0x7f03980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03af7fe640 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce24379d40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009f70 tx=0x7f03a4009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f461b34ea5e46 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:08.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03ad7fa640 1 -- 172.21.15.37:0/1063836156 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f03a80e5bd0 con 0x7f03b0109be0 2024-08-31T06:51:08.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03967fc640 1 -- 172.21.15.37:0/3484210288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4019030 con 0x55ce23fb3390 2024-08-31T06:51:08.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03967fc640 1 -- 172.21.15.37:0/3484210288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03a40035f0 con 0x55ce23fb3390 2024-08-31T06:51:08.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.829+0000 7f03967fc640 1 -- 172.21.15.37:0/3484210288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a40126b0 con 0x55ce23fb3390 2024-08-31T06:51:08.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 -- 172.21.15.37:0/3484210288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 msgr2=0x55ce24379d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03b4f44640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03980b4ca0 0x7f03980b71b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f03a80e3960 tx=0x7f03a8078500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce24379d40 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009f70 tx=0x7f03a4009680 comp rx=0 tx=0).stop 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 -- 172.21.15.37:0/3484210288 shutdown_connections 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce24379d40 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce24379800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/3484210288 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fd4070 0x55ce243792c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 -- 172.21.15.37:0/3484210288 >> 172.21.15.37:0/3484210288 conn(0x55ce23fc8460 msgr2=0x55ce243771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 -- 172.21.15.37:0/3484210288 shutdown_connections 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.830+0000 7f03bcf1c740 1 -- 172.21.15.37:0/3484210288 wait complete. 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 1 -- start start 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 1 Processor -- start 2024-08-31T06:51:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce24384a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 0x55ce24384fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fd4070 0x55ce24390d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ce24142700 con 0x55ce23fd4070 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ce24266700 con 0x55ce23fab1b0 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ce24387aa0 con 0x55ce23fb3390 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03bcf1c740 10 client.0 _ll_register_callbacks cb 0x55ce24295dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fd4070 0x55ce24390d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fd4070 0x55ce24390d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42428/0 (socket says 172.21.15.37:42428) 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03af7fe640 1 -- 172.21.15.37:0/4134785816 learned_addr learned my addr 172.21.15.37:0/4134785816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03affff640 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 0x55ce24384fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.831+0000 7f03af7fe640 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce24384a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03af7fe640 1 -- 172.21.15.37:0/4134785816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 msgr2=0x55ce24384fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03af7fe640 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 0x55ce24384fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03af7fe640 1 -- 172.21.15.37:0/4134785816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 msgr2=0x55ce24384a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03af7fe640 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce24384a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03af7fe640 1 -- 172.21.15.37:0/4134785816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce2429f8b0 con 0x55ce23fd4070 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03af7fe640 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fd4070 0x55ce24390d90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f03a4003ed0 tx=0x7f03a4003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fb459fc54367d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f038f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f038f7fe640 1 -- 172.21.15.37:0/4134785816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4019050 con 0x55ce23fd4070 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f038f7fe640 1 -- 172.21.15.37:0/4134785816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f03a4004210 con 0x55ce23fd4070 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03bcf1c740 1 -- 172.21.15.37:0/4134785816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03a40035f0 con 0x55ce23fd4070 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f038f7fe640 1 -- 172.21.15.37:0/4134785816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03a4004410 con 0x55ce23fd4070 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03bcf1c740 10 client.16620 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.832+0000 7f03bcf1c740 1 -- 172.21.15.37:0/4134785816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce243938a0 con 0x55ce23fd4070 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f038f7fe640 1 -- 172.21.15.37:0/4134785816 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03a40035f0 con 0x55ce23fd4070 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f038f7fe640 1 -- 172.21.15.37:0/4134785816 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03a401ec60 con 0x55ce23fd4070 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f03bcf1c740 10 client.16620 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f03bcf1c740 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f03bcf1c740 20 client.16620 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce23f929f0 0x55ce24396c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f03bcf1c740 4 client.16620 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f03bcf1c740 1 -- 172.21.15.37:0/4134785816 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce242f2580 con 0x55ce23f929f0 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.833+0000 7f03affff640 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce23f929f0 0x55ce24396c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.834+0000 7f03affff640 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce23f929f0 0x55ce24396c60 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55ff65a60cd8b2cb server_cookie=ec4bbd740fdae40c in_seq=0 out_seq=0 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.834+0000 7f038f7fe640 10 client.16620 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.834+0000 7f038f7fe640 1 -- 172.21.15.37:0/4134785816 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce242f2580 con 0x55ce23f929f0 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.834+0000 7f038f7fe640 10 client.16620 handle_command_reply: tid=0 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.834+0000 7f03bcf1c740 1 client.16620 shutdown 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.834+0000 7f03bcf1c740 1 -- 172.21.15.37:0/4134785816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fd4070 msgr2=0x55ce24390d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fd4070 0x55ce24390d90 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f03a4003ed0 tx=0x7f03a4003f30 comp rx=0 tx=0).stop 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 -- 172.21.15.37:0/4134785816 shutdown_connections 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce23f929f0 0x55ce24396c60 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fd4070 0x55ce24390d90 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f038f7fe640 0 client.16620 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 0x55ce24384fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/4134785816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce24384a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 -- 172.21.15.37:0/4134785816 >> 172.21.15.37:0/4134785816 conn(0x55ce23fc8460 msgr2=0x55ce2437c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 -- 172.21.15.37:0/4134785816 shutdown_connections 2024-08-31T06:51:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 1 -- 172.21.15.37:0/4134785816 wait complete. 2024-08-31T06:51:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.835+0000 7f03bcf1c740 20 client.16620 trim_cache size 0 max 16384 2024-08-31T06:51:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.852+0000 7f03bcf1c740 1 Processor -- start 2024-08-31T06:51:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.852+0000 7f03bcf1c740 1 -- start start 2024-08-31T06:51:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23f929f0 0x55ce24386950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2437aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 0x55ce24390c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b3f50 con 0x55ce23f929f0 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b1820 con 0x55ce23fab1b0 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01af670 con 0x55ce23fb3390 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23f929f0 0x55ce24386950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23f929f0 0x55ce24386950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42444/0 (socket says 172.21.15.37:42444) 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 -- 172.21.15.37:0/1051908955 learned_addr learned my addr 172.21.15.37:0/1051908955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03affff640 1 --2- 172.21.15.37:0/1051908955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2437aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 -- 172.21.15.37:0/1051908955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 msgr2=0x55ce24390c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 --2- 172.21.15.37:0/1051908955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 0x55ce24390c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 -- 172.21.15.37:0/1051908955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 msgr2=0x55ce2437aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 --2- 172.21.15.37:0/1051908955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2437aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 -- 172.21.15.37:0/1051908955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce2437b5b0 con 0x55ce23f929f0 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f03af7fe640 1 --2- 172.21.15.37:0/1051908955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23f929f0 0x55ce24386950 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f03a40128a0 tx=0x7f03a40128d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58d712a3bcef1bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f0395ffb640 1 -- 172.21.15.37:0/1051908955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4035070 con 0x55ce23f929f0 2024-08-31T06:51:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f0395ffb640 1 -- 172.21.15.37:0/1051908955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03a401a040 con 0x55ce23f929f0 2024-08-31T06:51:08.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.853+0000 7f0395ffb640 1 -- 172.21.15.37:0/1051908955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4019040 con 0x55ce23f929f0 2024-08-31T06:51:08.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 -- 172.21.15.37:0/1051908955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23f929f0 msgr2=0x55ce24386950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/1051908955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23f929f0 0x55ce24386950 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f03a40128a0 tx=0x7f03a40128d0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 -- 172.21.15.37:0/1051908955 shutdown_connections 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/1051908955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23fb3390 0x55ce24390c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/1051908955 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2437aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/1051908955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23f929f0 0x55ce24386950 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 -- 172.21.15.37:0/1051908955 >> 172.21.15.37:0/1051908955 conn(0x55ce23fc8460 msgr2=0x55ce2437a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 -- 172.21.15.37:0/1051908955 shutdown_connections 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.854+0000 7f03bcf1c740 1 -- 172.21.15.37:0/1051908955 wait complete. 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 1 -- start start 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 1 Processor -- start 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23f929f0 0x55ce2438ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2438b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce2438b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01afce0 con 0x55ce23fb3390 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b1150 con 0x55ce23fab1b0 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b03b0 con 0x55ce23f929f0 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03bcf1c740 10 client.0 _ll_register_callbacks cb 0x7f03a4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce2438b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce2438b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42448/0 (socket says 172.21.15.37:42448) 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03af7fe640 1 -- 172.21.15.37:0/2377286711 learned_addr learned my addr 172.21.15.37:0/2377286711 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.855+0000 7f03affff640 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2438b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03af7fe640 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23f929f0 0x55ce2438ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03af7fe640 1 -- 172.21.15.37:0/2377286711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23f929f0 msgr2=0x55ce2438ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03af7fe640 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23f929f0 0x55ce2438ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03af7fe640 1 -- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 msgr2=0x55ce2438b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03af7fe640 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2438b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03af7fe640 1 -- 172.21.15.37:0/2377286711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce244004f0 con 0x55ce23fb3390 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03affff640 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2438b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03af7fe640 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce2438b7f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f03a4005dd0 tx=0x7f03a4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4431bd4b2a774ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f038f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f038f7fe640 1 -- 172.21.15.37:0/2377286711 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4035030 con 0x55ce23fb3390 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f038f7fe640 1 -- 172.21.15.37:0/2377286711 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f03a4004210 con 0x55ce23fb3390 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03bcf1c740 1 -- 172.21.15.37:0/2377286711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03a401a040 con 0x55ce23fb3390 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f038f7fe640 1 -- 172.21.15.37:0/2377286711 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03a4019070 con 0x55ce23fb3390 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03bcf1c740 10 client.16626 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.856+0000 7f03bcf1c740 1 -- 172.21.15.37:0/2377286711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce24401780 con 0x55ce23fb3390 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f038f7fe640 1 -- 172.21.15.37:0/2377286711 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03a401a040 con 0x55ce23fb3390 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f038f7fe640 1 -- 172.21.15.37:0/2377286711 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03a403b030 con 0x55ce23fb3390 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f03bcf1c740 10 client.16626 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:08.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f03bcf1c740 10 client.16626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f03bcf1c740 20 client.16626 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce23fd4070 0x55ce24403d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f03bcf1c740 4 client.16626 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f03bcf1c740 1 -- 172.21.15.37:0/2377286711 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ce242ee020 con 0x55ce23fd4070 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.857+0000 7f03affff640 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce23fd4070 0x55ce24403d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03affff640 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce23fd4070 0x55ce24403d40 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcf472d0f58322 server_cookie=3a7e930c2dd6a66a in_seq=0 out_seq=0 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f038f7fe640 10 client.16626 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f038f7fe640 1 -- 172.21.15.37:0/2377286711 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55ce242ee020 con 0x55ce23fd4070 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f038f7fe640 10 client.16626 handle_command_reply: tid=0 2024-08-31T06:51:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 client.16626 shutdown 2024-08-31T06:51:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 -- 172.21.15.37:0/2377286711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 msgr2=0x55ce2438b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce2438b7f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f03a4005dd0 tx=0x7f03a4005850 comp rx=0 tx=0).stop 2024-08-31T06:51:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 -- 172.21.15.37:0/2377286711 shutdown_connections 2024-08-31T06:51:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ce23fd4070 0x55ce24403d40 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce23fb3390 0x55ce2438b7f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ce23fab1b0 0x55ce2438b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f038f7fe640 0 client.16626 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 --2- 172.21.15.37:0/2377286711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ce23f929f0 0x55ce2438ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 -- 172.21.15.37:0/2377286711 >> 172.21.15.37:0/2377286711 conn(0x55ce23fc8460 msgr2=0x55ce243867c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 -- 172.21.15.37:0/2377286711 shutdown_connections 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 1 -- 172.21.15.37:0/2377286711 wait complete. 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.858+0000 7f03bcf1c740 20 client.16626 trim_cache size 0 max 16384 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:51:08.864 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:08.865 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:08.866 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:51:08.867 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:51:08.869 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:51:08.869 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:51:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 -- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03980b4ca0 msgr2=0x7f03980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03980b4ca0 0x7f03980b71b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f03a80e3960 tx=0x7f03a8078500 comp rx=0 tx=0).stop 2024-08-31T06:51:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 -- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0109be0 msgr2=0x7f03b0075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0109be0 0x7f03b0075f30 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f03a800eb10 tx=0x7f03a800c2d0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 -- 172.21.15.37:0/1063836156 shutdown_connections 2024-08-31T06:51:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f03980b4ca0 0x7f03980b71b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03b0109be0 0x7f03b0075f30 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b0109290 0x7f03b00759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 --2- 172.21.15.37:0/1063836156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03b0103950 0x7f03b00754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 -- 172.21.15.37:0/1063836156 >> 172.21.15.37:0/1063836156 conn(0x7f03b00ff3a0 msgr2=0x7f03b01017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 -- 172.21.15.37:0/1063836156 shutdown_connections 2024-08-31T06:51:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:08.859+0000 7f03b69a7640 1 -- 172.21.15.37:0/1063836156 wait complete. 2024-08-31T06:51:09.644 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:51:09.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:51:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:10.288 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:10 smithi037 ceph-mon[18612]: pgmap v449: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:51:10.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:10 smithi106 ceph-mon[22134]: pgmap v449: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:51:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 -- 172.21.15.37:0/963626018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc104660 msgr2=0x7fbffc104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 --2- 172.21.15.37:0/963626018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc104660 0x7fbffc104a70 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009900 tx=0x7fbfec02a410 comp rx=0 tx=0).stop 2024-08-31T06:51:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 -- 172.21.15.37:0/963626018 shutdown_connections 2024-08-31T06:51:10.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 --2- 172.21.15.37:0/963626018 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbffc10dc10 0x7fbffc1100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 --2- 172.21.15.37:0/963626018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc105040 0x7fbffc10d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 --2- 172.21.15.37:0/963626018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc104660 0x7fbffc104a70 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 -- 172.21.15.37:0/963626018 >> 172.21.15.37:0/963626018 conn(0x7fbffc079530 msgr2=0x7fbffc079940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 -- 172.21.15.37:0/963626018 shutdown_connections 2024-08-31T06:51:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.378+0000 7fc002654640 1 -- 172.21.15.37:0/963626018 wait complete. 2024-08-31T06:51:10.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc002654640 1 Processor -- start 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc002654640 1 -- start start 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc002654640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc104660 0x7fbffc19a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc002654640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbffc105040 0x7fbffc19a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc002654640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc10dc10 0x7fbffc19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc002654640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc113780 con 0x7fbffc10dc10 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc002654640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc113600 con 0x7fbffc104660 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc002654640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbffc113900 con 0x7fbffc105040 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc000bf1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc10dc10 0x7fbffc19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc000bf1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc10dc10 0x7fbffc19fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42468/0 (socket says 172.21.15.37:42468) 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fc000bf1640 1 -- 172.21.15.37:0/1143489677 learned_addr learned my addr 172.21.15.37:0/1143489677 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.379+0000 7fbffb7fe640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbffc105040 0x7fbffc19a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fbffbfff640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc104660 0x7fbffc19a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fc000bf1640 1 -- 172.21.15.37:0/1143489677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbffc105040 msgr2=0x7fbffc19a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:10.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fc000bf1640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbffc105040 0x7fbffc19a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fc000bf1640 1 -- 172.21.15.37:0/1143489677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc104660 msgr2=0x7fbffc19a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fc000bf1640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc104660 0x7fbffc19a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fc000bf1640 1 -- 172.21.15.37:0/1143489677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbffc1a0140 con 0x7fbffc10dc10 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fc000bf1640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc10dc10 0x7fbffc19fa10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbff400b970 tx=0x7fbff400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fbff97fa640 1 -- 172.21.15.37:0/1143489677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff4019070 con 0x7fbffc10dc10 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fbff97fa640 1 -- 172.21.15.37:0/1143489677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbff4014440 con 0x7fbffc10dc10 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fbff97fa640 1 -- 172.21.15.37:0/1143489677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff40075d0 con 0x7fbffc10dc10 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbffc1a0430 con 0x7fbffc10dc10 2024-08-31T06:51:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.380+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbffc1a6b90 con 0x7fbffc10dc10 2024-08-31T06:51:10.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.382+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbffc104a70 con 0x7fbffc10dc10 2024-08-31T06:51:10.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.383+0000 7fbff97fa640 1 -- 172.21.15.37:0/1143489677 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fbff401c070 con 0x7fbffc10dc10 2024-08-31T06:51:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.384+0000 7fbff97fa640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfe40b4ca0 0x7fbfe40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.384+0000 7fbffbfff640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfe40b4ca0 0x7fbfe40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.384+0000 7fbff97fa640 1 -- 172.21.15.37:0/1143489677 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbff40e4a10 con 0x7fbffc10dc10 2024-08-31T06:51:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.385+0000 7fbffbfff640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfe40b4ca0 0x7fbfe40b71b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0057c0 tx=0x7fbfec0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:10.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:10 smithi066 ceph-mon[22244]: pgmap v449: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:51:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.389+0000 7fbff97fa640 1 -- 172.21.15.37:0/1143489677 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fbff40ab190 con 0x7fbffc10dc10 2024-08-31T06:51:10.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.612+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbffc19b300 con 0x7fbffc10dc10 2024-08-31T06:51:10.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.613+0000 7fbff97fa640 1 -- 172.21.15.37:0/1143489677 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fbff40af950 con 0x7fbffc10dc10 2024-08-31T06:51:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:51:10.614 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:51:10.614 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:51:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfe40b4ca0 msgr2=0x7fbfe40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfe40b4ca0 0x7fbfe40b71b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0057c0 tx=0x7fbfec0058d0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc10dc10 msgr2=0x7fbffc19fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc10dc10 0x7fbffc19fa10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fbff400b970 tx=0x7fbff400be30 comp rx=0 tx=0).stop 2024-08-31T06:51:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 shutdown_connections 2024-08-31T06:51:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfe40b4ca0 0x7fbfe40b71b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbffc10dc10 0x7fbffc19fa10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbffc105040 0x7fbffc19a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 --2- 172.21.15.37:0/1143489677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc104660 0x7fbffc19a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 >> 172.21.15.37:0/1143489677 conn(0x7fbffc079530 msgr2=0x7fbffc106670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 shutdown_connections 2024-08-31T06:51:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:10.615+0000 7fc002654640 1 -- 172.21.15.37:0/1143489677 wait complete. 2024-08-31T06:51:11.303 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:11 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1143489677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:11.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:51:11.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:11 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1143489677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:11.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:11 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1143489677' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:11.557 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:12.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 -- 172.21.15.37:0/865179646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 msgr2=0x7f0df41021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 --2- 172.21.15.37:0/865179646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 0x7f0df41021b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009900 tx=0x7f0de402a410 comp rx=0 tx=0).stop 2024-08-31T06:51:12.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 -- 172.21.15.37:0/865179646 shutdown_connections 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 --2- 172.21.15.37:0/865179646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0df41069d0 0x7f0df4110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 --2- 172.21.15.37:0/865179646 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0df4106080 0x7f0df4106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 --2- 172.21.15.37:0/865179646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 0x7f0df41021b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 -- 172.21.15.37:0/865179646 >> 172.21.15.37:0/865179646 conn(0x7f0df4079be0 msgr2=0x7f0df4079ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 -- 172.21.15.37:0/865179646 shutdown_connections 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.037+0000 7f0df9358640 1 -- 172.21.15.37:0/865179646 wait complete. 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.038+0000 7f0df9358640 1 Processor -- start 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.038+0000 7f0df9358640 1 -- start start 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.038+0000 7f0df9358640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 0x7f0df4102d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.038+0000 7f0df9358640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0df4106080 0x7f0df4103280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.038+0000 7f0df9358640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0df41069d0 0x7f0df41037c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.038+0000 7f0df9358640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0df4113770 con 0x7f0df4101da0 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.038+0000 7f0df9358640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41135f0 con 0x7f0df4106080 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.038+0000 7f0df9358640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41138f0 con 0x7f0df41069d0 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 0x7f0df4102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 0x7f0df4102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42476/0 (socket says 172.21.15.37:42476) 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 -- 172.21.15.37:0/157502158 learned_addr learned my addr 172.21.15.37:0/157502158 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df37fe640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0df41069d0 0x7f0df41037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0debfff640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0df4106080 0x7f0df4103280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 -- 172.21.15.37:0/157502158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0df41069d0 msgr2=0x7f0df41037c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0df41069d0 0x7f0df41037c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 -- 172.21.15.37:0/157502158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0df4106080 msgr2=0x7f0df4103280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0df4106080 0x7f0df4103280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 -- 172.21.15.37:0/157502158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df41a8400 con 0x7f0df4101da0 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 0x7f0df4102d40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0de402a930 tx=0x7f0de4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df0ff9640 1 -- 172.21.15.37:0/157502158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de403f070 con 0x7f0df4101da0 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df0ff9640 1 -- 172.21.15.37:0/157502158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0de4003e40 con 0x7f0df4101da0 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df9358640 1 -- 172.21.15.37:0/157502158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df41a8690 con 0x7f0df4101da0 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df0ff9640 1 -- 172.21.15.37:0/157502158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4035030 con 0x7f0df4101da0 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.039+0000 7f0df9358640 1 -- 172.21.15.37:0/157502158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df41a8b70 con 0x7f0df4101da0 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.042+0000 7f0df0ff9640 1 -- 172.21.15.37:0/157502158 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f0de4042070 con 0x7f0df4101da0 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.042+0000 7f0dff8cd740 1 Processor -- start 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.042+0000 7f0dff8cd740 1 -- start start 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978b4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 0x5603978b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56039782b680 con 0x5603974e61b0 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56039781ac10 con 0x5603974ee390 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56039781ebc0 con 0x56039750f070 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42484/0 (socket says 172.21.15.37:42484) 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df2ffd640 1 -- 172.21.15.37:0/3656548613 learned_addr learned my addr 172.21.15.37:0/3656548613 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0debfff640 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 0x5603978b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df37fe640 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df0ff9640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0de00b4ca0 0x7f0de00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df2ffd640 1 -- 172.21.15.37:0/3656548613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 msgr2=0x5603978b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df2ffd640 1 -- 172.21.15.37:0/3656548613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 msgr2=0x5603978b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 0x5603978b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df2ffd640 1 -- 172.21.15.37:0/3656548613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56039757a650 con 0x5603974e61b0 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.043+0000 7f0df37fe640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0de00b4ca0 0x7f0de00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.044+0000 7f0df0ff9640 1 -- 172.21.15.37:0/157502158 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0de4105d00 con 0x7f0df4101da0 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.044+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b4890 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0de4103370 tx=0x7f0de40955f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff50d1122882b2e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.044+0000 7f0de97fa640 1 -- 172.21.15.37:0/3656548613 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de40cbdd0 con 0x5603974e61b0 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.044+0000 7f0de97fa640 1 -- 172.21.15.37:0/3656548613 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0de4095660 con 0x5603974e61b0 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.044+0000 7f0de97fa640 1 -- 172.21.15.37:0/3656548613 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de40cbbf0 con 0x5603974e61b0 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3656548613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 msgr2=0x5603978b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0df37fe640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0de00b4ca0 0x7f0de00b71b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0098b0 tx=0x7f0dec004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b4890 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f0de4103370 tx=0x7f0de40955f0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3656548613 shutdown_connections 2024-08-31T06:51:12.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b4890 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 0x5603978b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3656548613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3656548613 >> 172.21.15.37:0/3656548613 conn(0x560397503460 msgr2=0x5603978b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3656548613 shutdown_connections 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3656548613 wait complete. 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 -- start start 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.045+0000 7f0dff8cd740 1 Processor -- start 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974e61b0 0x5603978bfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974ee390 0x5603978c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56039767d700 con 0x5603974ee390 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5603977a1750 con 0x5603974e61b0 2024-08-31T06:51:12.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5603978c28f0 con 0x56039750f070 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0dff8cd740 10 client.0 _ll_register_callbacks cb 0x5603977d0e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974ee390 0x5603978c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974ee390 0x5603978c0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42496/0 (socket says 172.21.15.37:42496) 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 -- 172.21.15.37:0/3775236970 learned_addr learned my addr 172.21.15.37:0/3775236970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974e61b0 0x5603978bfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 -- 172.21.15.37:0/3775236970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 msgr2=0x5603978cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0df37fe640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 -- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974e61b0 msgr2=0x5603978bfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974e61b0 0x5603978bfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 -- 172.21.15.37:0/3775236970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603977da900 con 0x5603974ee390 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974e61b0 0x5603978bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:12.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0df37fe640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0debfff640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974ee390 0x5603978c0000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00bad0 tx=0x7f0ddc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc205f6c3232c84 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.046+0000 7f0dda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3775236970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011440 con 0x5603974ee390 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3775236970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0ddc0115e0 con 0x5603974ee390 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3775236970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56039782d5d0 con 0x5603974ee390 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3775236970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ddc005020 con 0x5603974ee390 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 10 client.16644 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3775236970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5603978ce610 con 0x5603974ee390 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3775236970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56039782d5d0 con 0x5603974ee390 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3775236970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0ddc0047a0 con 0x5603974ee390 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 10 client.16644 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 10 client.16644 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:51:12.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 20 client.16644 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5603974cd9f0 0x5603978d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 4 client.16644 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.047+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3775236970 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560397829070 con 0x5603974cd9f0 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.048+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5603974cd9f0 0x5603978d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.048+0000 7f0dda7fc640 10 client.16644 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.048+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5603974cd9f0 0x5603978d1b10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee6284ef5284c264 server_cookie=e85f11c5d196f414 in_seq=0 out_seq=0 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3775236970 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560397829070 con 0x5603974cd9f0 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dda7fc640 10 client.16644 handle_command_reply: tid=0 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 client.16644 shutdown 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3775236970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974ee390 msgr2=0x5603978c0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974ee390 0x5603978c0000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00bad0 tx=0x7f0ddc00bf90 comp rx=0 tx=0).stop 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3775236970 shutdown_connections 2024-08-31T06:51:12.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974ee390 0x5603978c0000 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5603974cd9f0 0x5603978d1b10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56039750f070 0x5603978cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3775236970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974e61b0 0x5603978bfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dda7fc640 0 client.16644 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:12.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3775236970 >> 172.21.15.37:0/3775236970 conn(0x560397503460 msgr2=0x5603978b74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:12.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3775236970 shutdown_connections 2024-08-31T06:51:12.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3775236970 wait complete. 2024-08-31T06:51:12.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.049+0000 7f0dff8cd740 20 client.16644 trim_cache size 0 max 16384 2024-08-31T06:51:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0dff8cd740 1 Processor -- start 2024-08-31T06:51:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0dff8cd740 1 -- start start 2024-08-31T06:51:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974ee390 0x5603978cba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56039750f070 0x5603978bccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41b3e10 con 0x5603974e61b0 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41b16e0 con 0x56039750f070 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41af530 con 0x5603974ee390 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0df2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0df2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42500/0 (socket says 172.21.15.37:42500) 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0df2ffd640 1 -- 172.21.15.37:0/1220286851 learned_addr learned my addr 172.21.15.37:0/1220286851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0debfff640 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974ee390 0x5603978cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.063+0000 7f0df37fe640 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56039750f070 0x5603978bccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0df2ffd640 1 -- 172.21.15.37:0/1220286851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974ee390 msgr2=0x5603978cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974ee390 0x5603978cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0df2ffd640 1 -- 172.21.15.37:0/1220286851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56039750f070 msgr2=0x5603978bccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56039750f070 0x5603978bccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0df2ffd640 1 -- 172.21.15.37:0/1220286851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603978c0d80 con 0x5603974e61b0 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0df37fe640 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56039750f070 0x5603978bccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b5a90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0de4103490 tx=0x7f0de4095880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d290553ccf68 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0de8ff9640 1 -- 172.21.15.37:0/1220286851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4049050 con 0x5603974e61b0 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0de8ff9640 1 -- 172.21.15.37:0/1220286851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0de40cbf90 con 0x5603974e61b0 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.064+0000 7f0de8ff9640 1 -- 172.21.15.37:0/1220286851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de40d0c40 con 0x5603974e61b0 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 -- 172.21.15.37:0/1220286851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 msgr2=0x5603978b5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b5a90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f0de4103490 tx=0x7f0de4095880 comp rx=0 tx=0).stop 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 -- 172.21.15.37:0/1220286851 shutdown_connections 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56039750f070 0x5603978bccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974ee390 0x5603978cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/1220286851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5603974e61b0 0x5603978b5a90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 -- 172.21.15.37:0/1220286851 >> 172.21.15.37:0/1220286851 conn(0x560397503460 msgr2=0x5603978b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 -- 172.21.15.37:0/1220286851 shutdown_connections 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 -- 172.21.15.37:0/1220286851 wait complete. 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 -- start start 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.065+0000 7f0dff8cd740 1 Processor -- start 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974e61b0 0x5603978c4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 0x5603978c4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0dff8cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039750f070 0x5603979354a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41afba0 con 0x56039750f070 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41b1010 con 0x5603974ee390 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0dff8cd740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0df41b0270 con 0x5603974e61b0 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0dff8cd740 10 client.0 _ll_register_callbacks cb 0x7f0ddc004060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039750f070 0x5603979354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039750f070 0x5603979354a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42506/0 (socket says 172.21.15.37:42506) 2024-08-31T06:51:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 -- 172.21.15.37:0/3670064296 learned_addr learned my addr 172.21.15.37:0/3670064296 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974e61b0 0x5603978c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0debfff640 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 0x5603978c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 -- 172.21.15.37:0/3670064296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974e61b0 msgr2=0x5603978c4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974e61b0 0x5603978c4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 -- 172.21.15.37:0/3670064296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 msgr2=0x5603978c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 0x5603978c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 -- 172.21.15.37:0/3670064296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560397935b10 con 0x56039750f070 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0df37fe640 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039750f070 0x5603979354a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0dec01fb50 tx=0x7f0dec004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee41cf408c17b0ac server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.066+0000 7f0dda7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3670064296 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec02d060 con 0x56039750f070 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3670064296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de40cbf90 con 0x56039750f070 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3670064296 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0dec01dd40 con 0x56039750f070 2024-08-31T06:51:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3670064296 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0dec031420 con 0x56039750f070 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 10 client.16650 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3670064296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56039793cec0 con 0x56039750f070 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3670064296 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0de40cbf90 con 0x56039750f070 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3670064296 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0dec00f040 con 0x56039750f070 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 10 client.16650 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 10 client.16650 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 20 client.16650 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5603974a2da0 0x56039793f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 4 client.16650 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.067+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3670064296 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603978267b0 con 0x5603974a2da0 2024-08-31T06:51:12.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5603974a2da0 0x56039793f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:12.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dda7fc640 10 client.16650 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:12.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0df2ffd640 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5603974a2da0 0x56039793f690 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e50c81039bbbe06 server_cookie=45a6e9110b845ff5 in_seq=0 out_seq=0 2024-08-31T06:51:12.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dda7fc640 1 -- 172.21.15.37:0/3670064296 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603978267b0 con 0x5603974a2da0 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dda7fc640 10 client.16650 handle_command_reply: tid=0 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 client.16650 shutdown 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3670064296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039750f070 msgr2=0x5603979354a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039750f070 0x5603979354a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0dec01fb50 tx=0x7f0dec004ab0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3670064296 shutdown_connections 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039750f070 0x5603979354a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5603974a2da0 0x56039793f690 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5603974ee390 0x5603978c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 --2- 172.21.15.37:0/3670064296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5603974e61b0 0x5603978c4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3670064296 >> 172.21.15.37:0/3670064296 conn(0x560397503460 msgr2=0x5603978b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:12.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.068+0000 7f0dda7fc640 0 client.16650 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3670064296 shutdown_connections 2024-08-31T06:51:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0dff8cd740 1 -- 172.21.15.37:0/3670064296 wait complete. 2024-08-31T06:51:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0dff8cd740 20 client.16650 trim_cache size 0 max 16384 2024-08-31T06:51:12.077 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 -- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0de00b4ca0 msgr2=0x7f0de00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0de00b4ca0 0x7f0de00b71b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0098b0 tx=0x7f0dec004a40 comp rx=0 tx=0).stop 2024-08-31T06:51:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 -- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 msgr2=0x7f0df4102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 0x7f0df4102d40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f0de402a930 tx=0x7f0de4003c20 comp rx=0 tx=0).stop 2024-08-31T06:51:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 -- 172.21.15.37:0/157502158 shutdown_connections 2024-08-31T06:51:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0de00b4ca0 0x7f0de00b71b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0df41069d0 0x7f0df41037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0df4106080 0x7f0df4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 --2- 172.21.15.37:0/157502158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0df4101da0 0x7f0df4102d40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 -- 172.21.15.37:0/157502158 >> 172.21.15.37:0/157502158 conn(0x7f0df4079be0 msgr2=0x7f0df4107df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 -- 172.21.15.37:0/157502158 shutdown_connections 2024-08-31T06:51:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:12.069+0000 7f0df9358640 1 -- 172.21.15.37:0/157502158 wait complete. 2024-08-31T06:51:12.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:12 smithi106 ceph-mon[22134]: pgmap v450: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:51:12.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:12 smithi037 ceph-mon[18612]: pgmap v450: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:51:12.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:12 smithi066 ceph-mon[22244]: pgmap v450: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:51:12.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:51:13.116 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:13.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 -- 172.21.15.37:0/671130573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8102880 msgr2=0x7fa9a8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 --2- 172.21.15.37:0/671130573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8102880 0x7fa9a8102c90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa998009900 tx=0x7fa99802a410 comp rx=0 tx=0).stop 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 -- 172.21.15.37:0/671130573 shutdown_connections 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 --2- 172.21.15.37:0/671130573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9a8108ac0 0x7fa9a810f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 --2- 172.21.15.37:0/671130573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8108170 0x7fa9a8108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 --2- 172.21.15.37:0/671130573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8102880 0x7fa9a8102c90 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 -- 172.21.15.37:0/671130573 >> 172.21.15.37:0/671130573 conn(0x7fa9a8079500 msgr2=0x7fa9a8079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 -- 172.21.15.37:0/671130573 shutdown_connections 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.589+0000 7fa9ad674640 1 -- 172.21.15.37:0/671130573 wait complete. 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9ad674640 1 Processor -- start 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9ad674640 1 -- start start 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9ad674640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9a8102880 0x7fa9a81042c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9ad674640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8108170 0x7fa9a8104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9ad674640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8108ac0 0x7fa9a8104d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9ad674640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81126c0 con 0x7fa9a8108ac0 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9ad674640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8112540 con 0x7fa9a8102880 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9ad674640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8112840 con 0x7fa9a8108170 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9a77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8108ac0 0x7fa9a8104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9a77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8108ac0 0x7fa9a8104d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42528/0 (socket says 172.21.15.37:42528) 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9a77fe640 1 -- 172.21.15.37:0/2771432982 learned_addr learned my addr 172.21.15.37:0/2771432982 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.590+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8108170 0x7fa9a8104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9a8102880 0x7fa9a81042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9a77fe640 1 -- 172.21.15.37:0/2771432982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8108170 msgr2=0x7fa9a8104800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9a77fe640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8108170 0x7fa9a8104800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9a77fe640 1 -- 172.21.15.37:0/2771432982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9a8102880 msgr2=0x7fa9a81042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9a77fe640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9a8102880 0x7fa9a81042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9a77fe640 1 -- 172.21.15.37:0/2771432982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a81a8540 con 0x7fa9a8108ac0 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9a77fe640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8108ac0 0x7fa9a8104d40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b970 tx=0x7fa9a000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa98ffff640 1 -- 172.21.15.37:0/2771432982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0019070 con 0x7fa9a8108ac0 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9ad674640 1 -- 172.21.15.37:0/2771432982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a81a8830 con 0x7fa9a8108ac0 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa98ffff640 1 -- 172.21.15.37:0/2771432982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9a0014440 con 0x7fa9a8108ac0 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa98ffff640 1 -- 172.21.15.37:0/2771432982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00075d0 con 0x7fa9a8108ac0 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.591+0000 7fa9ad674640 1 -- 172.21.15.37:0/2771432982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a81a8df0 con 0x7fa9a8108ac0 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa98ffff640 1 -- 172.21.15.37:0/2771432982 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa9a001c070 con 0x7fa9a8108ac0 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9b3be9740 1 Processor -- start 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9b3be9740 1 -- start start 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 0x55c089f41310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f41850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f41d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c089eb8680 con 0x55c089b7b390 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c089ea7c10 con 0x55c089b9c070 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55c089eabbc0 con 0x55c089b731b0 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9a67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f41d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa98ffff640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9900b4ca0 0x7fa9900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9a67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f41d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42540/0 (socket says 172.21.15.37:42540) 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9a67fc640 1 -- 172.21.15.37:0/2458204631 learned_addr learned my addr 172.21.15.37:0/2458204631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.594+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 0x55c089f41310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f41850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a77fe640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9900b4ca0 0x7fa9900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a67fc640 1 -- 172.21.15.37:0/2458204631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 msgr2=0x55c089f41850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f41850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a67fc640 1 -- 172.21.15.37:0/2458204631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 msgr2=0x55c089f41310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 0x55c089f41310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa98ffff640 1 -- 172.21.15.37:0/2771432982 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa9a00e4980 con 0x7fa9a8108ac0 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a67fc640 1 -- 172.21.15.37:0/2458204631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c089c07650 con 0x55c089b7b390 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f41850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f41d90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa99c017700 tx=0x7fa99c0094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27c40402ccf1d5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa9a77fe640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9900b4ca0 0x7fa9900b71b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00a8320 tx=0x7fa9a000e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa98d7fa640 1 -- 172.21.15.37:0/2458204631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c015760 con 0x55c089b7b390 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa98d7fa640 1 -- 172.21.15.37:0/2458204631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa99c01d070 con 0x55c089b7b390 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.595+0000 7fa98d7fa640 1 -- 172.21.15.37:0/2458204631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c018840 con 0x55c089b7b390 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 -- 172.21.15.37:0/2458204631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 msgr2=0x55c089f41d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f41d90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa99c017700 tx=0x7fa99c0094d0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 -- 172.21.15.37:0/2458204631 shutdown_connections 2024-08-31T06:51:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f41d90 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f41850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/2458204631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 0x55c089f41310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 -- 172.21.15.37:0/2458204631 >> 172.21.15.37:0/2458204631 conn(0x55c089b90460 msgr2=0x55c089f3f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 -- 172.21.15.37:0/2458204631 shutdown_connections 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.596+0000 7fa9b3be9740 1 -- 172.21.15.37:0/2458204631 wait complete. 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 1 -- start start 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 1 Processor -- start 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f4cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f4cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 0x55c089f58d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c089d0a700 con 0x55c089b7b390 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55c089e2e750 con 0x55c089b9c070 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55c089f4fa90 con 0x55c089b731b0 2024-08-31T06:51:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9b3be9740 10 client.0 _ll_register_callbacks cb 0x55c089e5de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f4cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f4cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42546/0 (socket says 172.21.15.37:42546) 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9a6ffd640 1 -- 172.21.15.37:0/1491311075 learned_addr learned my addr 172.21.15.37:0/1491311075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.597+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f4cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 0x55c089f58d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9a6ffd640 1 -- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 msgr2=0x55c089f4cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f4cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9a6ffd640 1 -- 172.21.15.37:0/1491311075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 msgr2=0x55c089f58d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 0x55c089f58d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9a6ffd640 1 -- 172.21.15.37:0/1491311075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c089e67900 con 0x55c089b7b390 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f4cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f4cff0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa99802a930 tx=0x7fa998031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4917fdd467d5338 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa98aff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa98aff5640 1 -- 172.21.15.37:0/1491311075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998035030 con 0x55c089b7b390 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa98aff5640 1 -- 172.21.15.37:0/1491311075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa998004240 con 0x55c089b7b390 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9b3be9740 1 -- 172.21.15.37:0/1491311075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa99c01d070 con 0x55c089b7b390 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa98aff5640 1 -- 172.21.15.37:0/1491311075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa998004440 con 0x55c089b7b390 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9b3be9740 10 client.16662 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa9b3be9740 1 -- 172.21.15.37:0/1491311075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c089f5b8e0 con 0x55c089b7b390 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.598+0000 7fa98aff5640 1 -- 172.21.15.37:0/1491311075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa99c01d070 con 0x55c089b7b390 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa98aff5640 1 -- 172.21.15.37:0/1491311075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa99803c480 con 0x55c089b7b390 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa9b3be9740 10 client.16662 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa9b3be9740 10 client.16662 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa9b3be9740 20 client.16662 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c089b5a9f0 0x55c089f5ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa9b3be9740 4 client.16662 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa9b3be9740 1 -- 172.21.15.37:0/1491311075 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c089eba5d0 con 0x55c089b5a9f0 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c089b5a9f0 0x55c089f5ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c089b5a9f0 0x55c089f5ee00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf68d22f77dde1c2 server_cookie=4deeef2b4b75bb9d in_seq=0 out_seq=0 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.599+0000 7fa98aff5640 10 client.16662 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa98aff5640 1 -- 172.21.15.37:0/1491311075 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c089eba5d0 con 0x55c089b5a9f0 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa98aff5640 10 client.16662 handle_command_reply: tid=0 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa9b3be9740 1 client.16662 shutdown 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa9b3be9740 1 -- 172.21.15.37:0/1491311075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 msgr2=0x55c089f4cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f4cff0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa99802a930 tx=0x7fa998031400 comp rx=0 tx=0).stop 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa9b3be9740 1 -- 172.21.15.37:0/1491311075 shutdown_connections 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c089b5a9f0 0x55c089f5ee00 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b7b390 0x55c089f4cff0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b9c070 0x55c089f58d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa98aff5640 0 client.16662 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:13.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.600+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/1491311075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b731b0 0x55c089f4cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.601+0000 7fa9b3be9740 1 -- 172.21.15.37:0/1491311075 >> 172.21.15.37:0/1491311075 conn(0x55c089b90460 msgr2=0x55c089f444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.601+0000 7fa9b3be9740 1 -- 172.21.15.37:0/1491311075 shutdown_connections 2024-08-31T06:51:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.601+0000 7fa9b3be9740 1 -- 172.21.15.37:0/1491311075 wait complete. 2024-08-31T06:51:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.601+0000 7fa9b3be9740 20 client.16662 trim_cache size 0 max 16384 2024-08-31T06:51:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.614+0000 7fa9b3be9740 1 Processor -- start 2024-08-31T06:51:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.614+0000 7fa9b3be9740 1 -- start start 2024-08-31T06:51:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.614+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b5a9f0 0x55c089f4cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.614+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b731b0 0x55c089f58c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.614+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b7b390 0x55c089f591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.614+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b3df0 con 0x55c089b731b0 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.614+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b16c0 con 0x55c089b5a9f0 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.614+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81af510 con 0x55c089b7b390 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b731b0 0x55c089f58c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b731b0 0x55c089f58c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42560/0 (socket says 172.21.15.37:42560) 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 -- 172.21.15.37:0/3259769502 learned_addr learned my addr 172.21.15.37:0/3259769502 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b5a9f0 0x55c089f4cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b7b390 0x55c089f591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 -- 172.21.15.37:0/3259769502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b7b390 msgr2=0x55c089f591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b7b390 0x55c089f591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 -- 172.21.15.37:0/3259769502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b5a9f0 msgr2=0x55c089f4cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b5a9f0 0x55c089f4cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 -- 172.21.15.37:0/3259769502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c089f44170 con 0x55c089b731b0 2024-08-31T06:51:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b731b0 0x55c089f58c80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa998000c00 tx=0x7fa99802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331915d69b6dcb37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa98cff9640 1 -- 172.21.15.37:0/3259769502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998051070 con 0x55c089b731b0 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa98cff9640 1 -- 172.21.15.37:0/3259769502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa998040070 con 0x55c089b731b0 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.615+0000 7fa98cff9640 1 -- 172.21.15.37:0/3259769502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998035070 con 0x55c089b731b0 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3259769502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b731b0 msgr2=0x55c089f58c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b731b0 0x55c089f58c80 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa998000c00 tx=0x7fa99802a410 comp rx=0 tx=0).stop 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3259769502 shutdown_connections 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b731b0 0x55c089f58c80 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b7b390 0x55c089f591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3259769502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b5a9f0 0x55c089f4cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3259769502 >> 172.21.15.37:0/3259769502 conn(0x55c089b90460 msgr2=0x55c089f4c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3259769502 shutdown_connections 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.616+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3259769502 wait complete. 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 1 -- start start 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 1 Processor -- start 2024-08-31T06:51:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b5a9f0 0x55c089f50dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b7b390 0x55c089f51310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b9c070 0x55c089f51850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81afb80 con 0x55c089b5a9f0 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b0ff0 con 0x55c089b7b390 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a81b0250 con 0x55c089b9c070 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9b3be9740 10 client.0 _ll_register_callbacks cb 0x7fa998009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9a67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b5a9f0 0x55c089f50dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9a67fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b5a9f0 0x55c089f50dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42574/0 (socket says 172.21.15.37:42574) 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9a67fc640 1 -- 172.21.15.37:0/3378930334 learned_addr learned my addr 172.21.15.37:0/3378930334 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b7b390 0x55c089f51310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.617+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b9c070 0x55c089f51850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9a67fc640 1 -- 172.21.15.37:0/3378930334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b9c070 msgr2=0x55c089f51850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b9c070 0x55c089f51850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9a67fc640 1 -- 172.21.15.37:0/3378930334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b7b390 msgr2=0x55c089f51310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b7b390 0x55c089f51310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9a67fc640 1 -- 172.21.15.37:0/3378930334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c089fc88f0 con 0x55c089b5a9f0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9a67fc640 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b5a9f0 0x55c089f50dd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0094a0 tx=0x7fa99c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c236bfa027e59bf4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa98aff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa98aff5640 1 -- 172.21.15.37:0/3378930334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c015930 con 0x55c089b5a9f0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa98aff5640 1 -- 172.21.15.37:0/3378930334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa99c015ad0 con 0x55c089b5a9f0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3378930334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa998040070 con 0x55c089b5a9f0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa98aff5640 1 -- 172.21.15.37:0/3378930334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa99c009d20 con 0x55c089b5a9f0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9b3be9740 10 client.16668 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3378930334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c089fc9b50 con 0x55c089b5a9f0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.618+0000 7fa98aff5640 1 -- 172.21.15.37:0/3378930334 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa998040070 con 0x55c089b5a9f0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.619+0000 7fa98aff5640 1 -- 172.21.15.37:0/3378930334 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa99c033020 con 0x55c089b5a9f0 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.619+0000 7fa9b3be9740 10 client.16668 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.619+0000 7fa9b3be9740 10 client.16668 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:51:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.619+0000 7fa9b3be9740 20 client.16668 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.619+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c089b2fda0 0x55c089fcbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.619+0000 7fa9b3be9740 4 client.16668 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.619+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3378930334 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c089eb6070 con 0x55c089b2fda0 2024-08-31T06:51:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.619+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c089b2fda0 0x55c089fcbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9a6ffd640 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c089b2fda0 0x55c089fcbfa0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e86fcc9f660a852a server_cookie=5ca4d7c822135f16 in_seq=0 out_seq=0 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa98aff5640 10 client.16668 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa98aff5640 1 -- 172.21.15.37:0/3378930334 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c089eb6070 con 0x55c089b2fda0 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa98aff5640 10 client.16668 handle_command_reply: tid=0 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 client.16668 shutdown 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3378930334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b5a9f0 msgr2=0x55c089f50dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b5a9f0 0x55c089f50dd0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa99c0094a0 tx=0x7fa99c008040 comp rx=0 tx=0).stop 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3378930334 shutdown_connections 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55c089b2fda0 0x55c089fcbfa0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c089b9c070 0x55c089f51850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55c089b7b390 0x55c089f51310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 --2- 172.21.15.37:0/3378930334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c089b5a9f0 0x55c089f50dd0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3378930334 >> 172.21.15.37:0/3378930334 conn(0x55c089b90460 msgr2=0x55c089f44410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa98aff5640 0 client.16668 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3378930334 shutdown_connections 2024-08-31T06:51:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 1 -- 172.21.15.37:0/3378930334 wait complete. 2024-08-31T06:51:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.620+0000 7fa9b3be9740 20 client.16668 trim_cache size 0 max 16384 2024-08-31T06:51:13.628 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 -- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9900b4ca0 msgr2=0x7fa9900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9900b4ca0 0x7fa9900b71b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00a8320 tx=0x7fa9a000e040 comp rx=0 tx=0).stop 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 -- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8108ac0 msgr2=0x7fa9a8104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8108ac0 0x7fa9a8104d40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000b970 tx=0x7fa9a000bd70 comp rx=0 tx=0).stop 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 -- 172.21.15.37:0/2771432982 shutdown_connections 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9900b4ca0 0x7fa9900b71b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9a8108ac0 0x7fa9a8104d40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8108170 0x7fa9a8104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 --2- 172.21.15.37:0/2771432982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9a8102880 0x7fa9a81042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 -- 172.21.15.37:0/2771432982 >> 172.21.15.37:0/2771432982 conn(0x7fa9a8079500 msgr2=0x7fa9a8106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 -- 172.21.15.37:0/2771432982 shutdown_connections 2024-08-31T06:51:13.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:13.621+0000 7fa9ad674640 1 -- 172.21.15.37:0/2771432982 wait complete. 2024-08-31T06:51:14.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:14 smithi106 ceph-mon[22134]: pgmap v451: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:51:14.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:14 smithi037 ceph-mon[18612]: pgmap v451: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:51:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:14 smithi066 ceph-mon[22244]: pgmap v451: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:51:14.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:51:14.666 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 -- 172.21.15.37:0/4201935113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200108140 msgr2=0x7f0200108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 --2- 172.21.15.37:0/4201935113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200108140 0x7f0200108550 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009900 tx=0x7f01f402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 -- 172.21.15.37:0/4201935113 shutdown_connections 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 --2- 172.21.15.37:0/4201935113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200108140 0x7f0200108550 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 --2- 172.21.15.37:0/4201935113 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0200108a90 0x7f020010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 --2- 172.21.15.37:0/4201935113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0200102800 0x7f0200102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 -- 172.21.15.37:0/4201935113 >> 172.21.15.37:0/4201935113 conn(0x7f02000794d0 msgr2=0x7f02000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 -- 172.21.15.37:0/4201935113 shutdown_connections 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.175+0000 7f020613d640 1 -- 172.21.15.37:0/4201935113 wait complete. 2024-08-31T06:51:15.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f020613d640 1 Processor -- start 2024-08-31T06:51:15.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f020613d640 1 -- start start 2024-08-31T06:51:15.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f020613d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200102800 0x7f020019a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f020613d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0200108140 0x7f020019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f020613d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0200108a90 0x7f020019fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f020613d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02001136d0 con 0x7f0200102800 2024-08-31T06:51:15.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f020613d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0200113550 con 0x7f0200108140 2024-08-31T06:51:15.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f020613d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0200113850 con 0x7f0200108a90 2024-08-31T06:51:15.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f01ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200102800 0x7f020019a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f01ff7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200102800 0x7f020019a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52794/0 (socket says 172.21.15.37:52794) 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f01ff7fe640 1 -- 172.21.15.37:0/888897824 learned_addr learned my addr 172.21.15.37:0/888897824 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.176+0000 7f01feffd640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0200108140 0x7f020019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01fffff640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0200108a90 0x7f020019fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01ff7fe640 1 -- 172.21.15.37:0/888897824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0200108a90 msgr2=0x7f020019fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01ff7fe640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0200108a90 0x7f020019fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01ff7fe640 1 -- 172.21.15.37:0/888897824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0200108140 msgr2=0x7f020019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01ff7fe640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0200108140 0x7f020019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01ff7fe640 1 -- 172.21.15.37:0/888897824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02001a0090 con 0x7f0200102800 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01ff7fe640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200102800 0x7f020019a1e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c890 tx=0x7f01f000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01fcff9640 1 -- 172.21.15.37:0/888897824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0004220 con 0x7f0200102800 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01fcff9640 1 -- 172.21.15.37:0/888897824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01f0007e40 con 0x7f0200102800 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f020613d640 1 -- 172.21.15.37:0/888897824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02001a0380 con 0x7f0200102800 2024-08-31T06:51:15.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f01fcff9640 1 -- 172.21.15.37:0/888897824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f0004a00 con 0x7f0200102800 2024-08-31T06:51:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.177+0000 7f020613d640 1 -- 172.21.15.37:0/888897824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02001a6ba0 con 0x7f0200102800 2024-08-31T06:51:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.180+0000 7f020c6b2740 1 Processor -- start 2024-08-31T06:51:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.180+0000 7f01fcff9640 1 -- 172.21.15.37:0/888897824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f01f00079b0 con 0x7f0200102800 2024-08-31T06:51:15.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.180+0000 7f020c6b2740 1 -- start start 2024-08-31T06:51:15.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd16d070 0x555bfd512310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd512850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd512d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f020c6b2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bfd489680 con 0x555bfd16d070 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f020c6b2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555bfd478c10 con 0x555bfd14c390 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f020c6b2740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x555bfd47cbc0 con 0x555bfd1441b0 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd16d070 0x555bfd512310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd16d070 0x555bfd512310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52810/0 (socket says 172.21.15.37:52810) 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fffff640 1 -- 172.21.15.37:0/2967061354 learned_addr learned my addr 172.21.15.37:0/2967061354 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01ff7fe640 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd512850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01feffd640 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd512d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fffff640 1 -- 172.21.15.37:0/2967061354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 msgr2=0x555bfd512850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fffff640 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd512850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fffff640 1 -- 172.21.15.37:0/2967061354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 msgr2=0x555bfd512d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fffff640 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd512d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fffff640 1 -- 172.21.15.37:0/2967061354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bfd1d8650 con 0x555bfd16d070 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01fcff9640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01e80b4cd0 0x7f01e80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01feffd640 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd512d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.181+0000 7f01ff7fe640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01e80b4cd0 0x7f01e80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.182+0000 7f01fffff640 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd16d070 0x555bfd512310 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f01f8007dd0 tx=0x7f01f800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c7b868091cd8b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.182+0000 7f01fcff9640 1 -- 172.21.15.37:0/888897824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f01f00e5240 con 0x7f0200102800 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.182+0000 7f01e5ffb640 1 -- 172.21.15.37:0/2967061354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8014070 con 0x555bfd16d070 2024-08-31T06:51:15.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.182+0000 7f01e5ffb640 1 -- 172.21.15.37:0/2967061354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01f8004d20 con 0x555bfd16d070 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.182+0000 7f01e5ffb640 1 -- 172.21.15.37:0/2967061354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8010720 con 0x555bfd16d070 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 -- 172.21.15.37:0/2967061354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd16d070 msgr2=0x555bfd512310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f01ff7fe640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01e80b4cd0 0x7f01e80b71e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01f00e2a80 tx=0x7f01f00e88a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd16d070 0x555bfd512310 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f01f8007dd0 tx=0x7f01f800e720 comp rx=0 tx=0).stop 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 -- 172.21.15.37:0/2967061354 shutdown_connections 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd512d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd512850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 --2- 172.21.15.37:0/2967061354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd16d070 0x555bfd512310 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 -- 172.21.15.37:0/2967061354 >> 172.21.15.37:0/2967061354 conn(0x555bfd161460 msgr2=0x555bfd510200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 -- 172.21.15.37:0/2967061354 shutdown_connections 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 -- 172.21.15.37:0/2967061354 wait complete. 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.183+0000 7f020c6b2740 1 -- start start 2024-08-31T06:51:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f020c6b2740 1 Processor -- start 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd51dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd51e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd16d070 0x555bfd529de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f020c6b2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bfd2db700 con 0x555bfd14c390 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f020c6b2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x555bfd3ff750 con 0x555bfd16d070 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f020c6b2740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x555bfd520af0 con 0x555bfd1441b0 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f020c6b2740 10 client.0 _ll_register_callbacks cb 0x555bfd42ee10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f01feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd51e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f01feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd51e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52820/0 (socket says 172.21.15.37:52820) 2024-08-31T06:51:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f01feffd640 1 -- 172.21.15.37:0/1681752489 learned_addr learned my addr 172.21.15.37:0/1681752489 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f01fffff640 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd51dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.184+0000 7f01fffff640 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd16d070 0x555bfd529de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01feffd640 1 -- 172.21.15.37:0/1681752489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 msgr2=0x555bfd51dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01feffd640 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd51dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01feffd640 1 -- 172.21.15.37:0/1681752489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd16d070 msgr2=0x555bfd529de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01feffd640 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd16d070 0x555bfd529de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01feffd640 1 -- 172.21.15.37:0/1681752489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bfd438900 con 0x555bfd14c390 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01feffd640 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd51e000 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f01f40057c0 tx=0x7f01f4031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6fb86117a7af28 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01deffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01deffd640 1 -- 172.21.15.37:0/1681752489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4035070 con 0x555bfd14c390 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01deffd640 1 -- 172.21.15.37:0/1681752489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f01f4004240 con 0x555bfd14c390 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f020c6b2740 1 -- 172.21.15.37:0/1681752489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01f8004d20 con 0x555bfd14c390 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f01deffd640 1 -- 172.21.15.37:0/1681752489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f01f4004440 con 0x555bfd14c390 2024-08-31T06:51:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f020c6b2740 10 client.16680 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.185+0000 7f020c6b2740 1 -- 172.21.15.37:0/1681752489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555bfd52c8f0 con 0x555bfd14c390 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f01deffd640 1 -- 172.21.15.37:0/1681752489 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01f8004d20 con 0x555bfd14c390 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f01deffd640 1 -- 172.21.15.37:0/1681752489 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f01f4043020 con 0x555bfd14c390 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f020c6b2740 10 client.16680 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f020c6b2740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f020c6b2740 20 client.16680 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f020c6b2740 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555bfd12b9f0 0x555bfd52fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f020c6b2740 4 client.16680 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f020c6b2740 1 -- 172.21.15.37:0/1681752489 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bfd48b5d0 con 0x555bfd12b9f0 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.186+0000 7f01fffff640 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555bfd12b9f0 0x555bfd52fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.187+0000 7f01fffff640 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555bfd12b9f0 0x555bfd52fd90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37db616be84529d0 server_cookie=3af116ade84c580e in_seq=0 out_seq=0 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.187+0000 7f01deffd640 10 client.16680 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f01deffd640 1 -- 172.21.15.37:0/1681752489 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555bfd48b5d0 con 0x555bfd12b9f0 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f01deffd640 10 client.16680 handle_command_reply: tid=0 2024-08-31T06:51:15.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 client.16680 shutdown 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 -- 172.21.15.37:0/1681752489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 msgr2=0x555bfd51e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd51e000 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f01f40057c0 tx=0x7f01f4031480 comp rx=0 tx=0).stop 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 -- 172.21.15.37:0/1681752489 shutdown_connections 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555bfd12b9f0 0x555bfd52fd90 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd51e000 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd16d070 0x555bfd529de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 --2- 172.21.15.37:0/1681752489 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd51dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 -- 172.21.15.37:0/1681752489 >> 172.21.15.37:0/1681752489 conn(0x555bfd161460 msgr2=0x555bfd5154f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f01deffd640 0 client.16680 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 -- 172.21.15.37:0/1681752489 shutdown_connections 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 1 -- 172.21.15.37:0/1681752489 wait complete. 2024-08-31T06:51:15.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.188+0000 7f020c6b2740 20 client.16680 trim_cache size 0 max 16384 2024-08-31T06:51:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f020c6b2740 1 Processor -- start 2024-08-31T06:51:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f020c6b2740 1 -- start start 2024-08-31T06:51:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd161460 0x555bfd515b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd529ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd52a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f020c6b2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02001afac0 con 0x555bfd14c390 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f020c6b2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f02001ad390 con 0x555bfd161460 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f020c6b2740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f02001ab1e0 con 0x555bfd1441b0 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f01fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd161460 0x555bfd515b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f01feffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd529ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f01feffd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd529ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:48042/0 (socket says 172.21.15.37:48042) 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f01fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd161460 0x555bfd515b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:42130/0 (socket says 172.21.15.37:42130) 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f01feffd640 1 -- 172.21.15.37:0/3848147738 learned_addr learned my addr 172.21.15.37:0/3848147738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:15.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.214+0000 7f01fffff640 1 --2- 172.21.15.37:0/3848147738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd52a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01feffd640 1 -- 172.21.15.37:0/3848147738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd161460 msgr2=0x555bfd515b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01feffd640 1 --2- 172.21.15.37:0/3848147738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd161460 0x555bfd515b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01feffd640 1 -- 172.21.15.37:0/3848147738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 msgr2=0x555bfd52a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01feffd640 1 --2- 172.21.15.37:0/3848147738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd52a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01feffd640 1 -- 172.21.15.37:0/3848147738 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bfd514600 con 0x555bfd1441b0 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01feffd640 1 --2- 172.21.15.37:0/3848147738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd529ce0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005ec0 tx=0x7f01f402a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeddd89a91fb7350 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01e57fa640 1 -- 172.21.15.37:0/3848147738 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4035070 con 0x555bfd1441b0 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01e57fa640 1 -- 172.21.15.37:0/3848147738 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01f4053070 con 0x555bfd1441b0 2024-08-31T06:51:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.215+0000 7f01e57fa640 1 -- 172.21.15.37:0/3848147738 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f4045d70 con 0x555bfd1441b0 2024-08-31T06:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.216+0000 7f020c6b2740 1 -- 172.21.15.37:0/3848147738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 msgr2=0x555bfd529ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.216+0000 7f020c6b2740 1 --2- 172.21.15.37:0/3848147738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd529ce0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005ec0 tx=0x7f01f402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.216+0000 7f020c6b2740 1 -- 172.21.15.37:0/3848147738 shutdown_connections 2024-08-31T06:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.216+0000 7f020c6b2740 1 --2- 172.21.15.37:0/3848147738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd14c390 0x555bfd52a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.216+0000 7f020c6b2740 1 --2- 172.21.15.37:0/3848147738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd529ce0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.216+0000 7f020c6b2740 1 --2- 172.21.15.37:0/3848147738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd161460 0x555bfd515b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.216+0000 7f020c6b2740 1 -- 172.21.15.37:0/3848147738 >> 172.21.15.37:0/3848147738 conn(0x555bfd519410 msgr2=0x555bfd515410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.217+0000 7f020c6b2740 1 -- 172.21.15.37:0/3848147738 shutdown_connections 2024-08-31T06:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.217+0000 7f020c6b2740 1 -- 172.21.15.37:0/3848147738 wait complete. 2024-08-31T06:51:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.217+0000 7f020c6b2740 1 -- start start 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.217+0000 7f020c6b2740 1 Processor -- start 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.217+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd5220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.217+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd522630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f020c6b2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd161460 0x555bfd599710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f020c6b2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02001ab850 con 0x555bfd161460 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f020c6b2740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f02001accc0 con 0x555bfd14c390 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f020c6b2740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f02001abf20 con 0x555bfd1441b0 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f020c6b2740 10 client.0 _ll_register_callbacks cb 0x7f01f4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd161460 0x555bfd599710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd161460 0x555bfd599710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52842/0 (socket says 172.21.15.37:52842) 2024-08-31T06:51:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 -- 172.21.15.37:0/340939537 learned_addr learned my addr 172.21.15.37:0/340939537 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd5220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01feffd640 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd522630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 -- 172.21.15.37:0/340939537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 msgr2=0x555bfd5220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd5220f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 -- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 msgr2=0x555bfd522630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd522630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 -- 172.21.15.37:0/340939537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bfd599c50 con 0x555bfd161460 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01feffd640 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd522630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01fffff640 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd161460 0x555bfd599710 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f01f8007b60 tx=0x7f01f80076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbee9d4d0d7b40ee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.218+0000 7f01deffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.219+0000 7f01deffd640 1 -- 172.21.15.37:0/340939537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8014040 con 0x555bfd161460 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.219+0000 7f01deffd640 1 -- 172.21.15.37:0/340939537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f01f802a9c0 con 0x555bfd161460 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.219+0000 7f020c6b2740 1 -- 172.21.15.37:0/340939537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01f4053070 con 0x555bfd161460 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.219+0000 7f01deffd640 1 -- 172.21.15.37:0/340939537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f01f802abc0 con 0x555bfd161460 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.219+0000 7f020c6b2740 10 client.16686 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.219+0000 7f020c6b2740 1 -- 172.21.15.37:0/340939537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555bfd59ad70 con 0x555bfd161460 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.219+0000 7f01deffd640 1 -- 172.21.15.37:0/340939537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01f4053070 con 0x555bfd161460 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f01deffd640 1 -- 172.21.15.37:0/340939537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f01f8026040 con 0x555bfd161460 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f020c6b2740 10 client.16686 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f020c6b2740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f020c6b2740 20 client.16686 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f020c6b2740 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555bfd16d070 0x555bfd59d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f020c6b2740 4 client.16686 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f020c6b2740 1 -- 172.21.15.37:0/340939537 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555bfd487070 con 0x555bfd16d070 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f01feffd640 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555bfd16d070 0x555bfd59d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f01deffd640 10 client.16686 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.220+0000 7f01feffd640 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555bfd16d070 0x555bfd59d390 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=567545d180a1c257 server_cookie=353c339f31d24483 in_seq=0 out_seq=0 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f01deffd640 1 -- 172.21.15.37:0/340939537 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555bfd487070 con 0x555bfd16d070 2024-08-31T06:51:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f01deffd640 10 client.16686 handle_command_reply: tid=0 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 client.16686 shutdown 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 -- 172.21.15.37:0/340939537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd161460 msgr2=0x555bfd599710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd161460 0x555bfd599710 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f01f8007b60 tx=0x7f01f80076c0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 -- 172.21.15.37:0/340939537 shutdown_connections 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x555bfd16d070 0x555bfd59d390 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bfd161460 0x555bfd599710 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x555bfd14c390 0x555bfd522630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 --2- 172.21.15.37:0/340939537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555bfd1441b0 0x555bfd5220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 -- 172.21.15.37:0/340939537 >> 172.21.15.37:0/340939537 conn(0x555bfd519410 msgr2=0x555bfd513340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f01deffd640 0 client.16686 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 -- 172.21.15.37:0/340939537 shutdown_connections 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 1 -- 172.21.15.37:0/340939537 wait complete. 2024-08-31T06:51:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.221+0000 7f020c6b2740 20 client.16686 trim_cache size 0 max 16384 2024-08-31T06:51:15.231 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 -- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01e80b4cd0 msgr2=0x7f01e80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01e80b4cd0 0x7f01e80b71e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01f00e2a80 tx=0x7f01f00e88a0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 -- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200102800 msgr2=0x7f020019a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200102800 0x7f020019a1e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c890 tx=0x7f01f000cd50 comp rx=0 tx=0).stop 2024-08-31T06:51:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 -- 172.21.15.37:0/888897824 shutdown_connections 2024-08-31T06:51:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f01e80b4cd0 0x7f01e80b71e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0200108a90 0x7f020019fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0200108140 0x7f020019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 --2- 172.21.15.37:0/888897824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0200102800 0x7f020019a1e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 -- 172.21.15.37:0/888897824 >> 172.21.15.37:0/888897824 conn(0x7f02000794d0 msgr2=0x7f02001042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 -- 172.21.15.37:0/888897824 shutdown_connections 2024-08-31T06:51:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:15.222+0000 7f020613d640 1 -- 172.21.15.37:0/888897824 wait complete. 2024-08-31T06:51:16.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:16 smithi106 ceph-mon[22134]: pgmap v452: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T06:51:16.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:16 smithi037 ceph-mon[18612]: pgmap v452: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T06:51:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:16 smithi066 ceph-mon[22244]: pgmap v452: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 6 op/s 2024-08-31T06:51:17.007 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:51:17.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:51:17.275 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:17.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 -- 172.21.15.37:0/2732290801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 msgr2=0x7fe26c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 --2- 172.21.15.37:0/2732290801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 0x7fe26c1103d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe264009ca0 tx=0x7fe26402a8e0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 -- 172.21.15.37:0/2732290801 shutdown_connections 2024-08-31T06:51:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 --2- 172.21.15.37:0/2732290801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 0x7fe26c1103d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 --2- 172.21.15.37:0/2732290801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe26c109250 0x7fe26c109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 --2- 172.21.15.37:0/2732290801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe26c103960 0x7fe26c103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 -- 172.21.15.37:0/2732290801 >> 172.21.15.37:0/2732290801 conn(0x7fe26c07b6b0 msgr2=0x7fe26c07bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 -- 172.21.15.37:0/2732290801 shutdown_connections 2024-08-31T06:51:17.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.758+0000 7fe272f68640 1 -- 172.21.15.37:0/2732290801 wait complete. 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe272f68640 1 Processor -- start 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe272f68640 1 -- start start 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe272f68640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe26c103960 0x7fe26c19c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe272f68640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe26c109250 0x7fe26c19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe272f68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 0x7fe26c1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe272f68640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c1137d0 con 0x7fe26c109ba0 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe272f68640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c113650 con 0x7fe26c103960 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe272f68640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c113950 con 0x7fe26c109250 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe271505640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 0x7fe26c1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe271505640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 0x7fe26c1a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52856/0 (socket says 172.21.15.37:52856) 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.759+0000 7fe271505640 1 -- 172.21.15.37:0/3144081840 learned_addr learned my addr 172.21.15.37:0/3144081840 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:17.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe26bfff640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe26c109250 0x7fe26c19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe270d04640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe26c103960 0x7fe26c19c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe271505640 1 -- 172.21.15.37:0/3144081840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe26c109250 msgr2=0x7fe26c19ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe271505640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe26c109250 0x7fe26c19ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe271505640 1 -- 172.21.15.37:0/3144081840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe26c103960 msgr2=0x7fe26c19c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe271505640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe26c103960 0x7fe26c19c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe271505640 1 -- 172.21.15.37:0/3144081840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c1a23d0 con 0x7fe26c109ba0 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe271505640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 0x7fe26c1a1ca0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe264006010 tx=0x7fe264003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe269ffb640 1 -- 172.21.15.37:0/3144081840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264004240 con 0x7fe26c109ba0 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe269ffb640 1 -- 172.21.15.37:0/3144081840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2640305e0 con 0x7fe26c109ba0 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe272f68640 1 -- 172.21.15.37:0/3144081840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26c1a2660 con 0x7fe26c109ba0 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe269ffb640 1 -- 172.21.15.37:0/3144081840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26403b660 con 0x7fe26c109ba0 2024-08-31T06:51:17.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.760+0000 7fe272f68640 1 -- 172.21.15.37:0/3144081840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26c1a8e20 con 0x7fe26c109ba0 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe2794dd740 1 Processor -- start 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe269ffb640 1 -- 172.21.15.37:0/3144081840 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fe264030ad0 con 0x7fe26c109ba0 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe2794dd740 1 -- start start 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bfd350 0x558a75fa3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75fa3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 0x558a75fa4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe2794dd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a75f195f0 con 0x558a75bd4490 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe2794dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558a75f08b80 con 0x558a75bfd350 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe2794dd740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558a75f0cb30 con 0x558a75bdc670 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.763+0000 7fe270d04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75fa3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe270d04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75fa3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52860/0 (socket says 172.21.15.37:52860) 2024-08-31T06:51:17.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe270d04640 1 -- 172.21.15.37:0/2508173064 learned_addr learned my addr 172.21.15.37:0/2508173064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe26bfff640 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bfd350 0x558a75fa3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe26bfff640 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 0x558a75fa4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe269ffb640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe25c0b4ca0 0x7fe25c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe270d04640 1 -- 172.21.15.37:0/2508173064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 msgr2=0x558a75fa4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe270d04640 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 0x558a75fa4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe270d04640 1 -- 172.21.15.37:0/2508173064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bfd350 msgr2=0x558a75fa3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe270d04640 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bfd350 0x558a75fa3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe270d04640 1 -- 172.21.15.37:0/2508173064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a75c68930 con 0x558a75bd4490 2024-08-31T06:51:17.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe269ffb640 1 -- 172.21.15.37:0/3144081840 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe2641068c0 con 0x7fe26c109ba0 2024-08-31T06:51:17.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe271505640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe25c0b4ca0 0x7fe25c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe270d04640 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75fa3cc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe260009a70 tx=0x7fe260009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7933461445d801e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.764+0000 7fe256ffd640 1 -- 172.21.15.37:0/2508173064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260017070 con 0x558a75bd4490 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe256ffd640 1 -- 172.21.15.37:0/2508173064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe260013470 con 0x558a75bd4490 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe256ffd640 1 -- 172.21.15.37:0/2508173064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe260012630 con 0x558a75bd4490 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 -- 172.21.15.37:0/2508173064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 msgr2=0x558a75fa3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe271505640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe25c0b4ca0 0x7fe25c0b71b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe264104050 tx=0x7fe264003e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75fa3cc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe260009a70 tx=0x7fe260009f30 comp rx=0 tx=0).stop 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 -- 172.21.15.37:0/2508173064 shutdown_connections 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75fa3cc0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 0x558a75fa4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 --2- 172.21.15.37:0/2508173064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bfd350 0x558a75fa3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 -- 172.21.15.37:0/2508173064 >> 172.21.15.37:0/2508173064 conn(0x558a75bf1740 msgr2=0x558a75fa1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 -- 172.21.15.37:0/2508173064 shutdown_connections 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.765+0000 7fe2794dd740 1 -- 172.21.15.37:0/2508173064 wait complete. 2024-08-31T06:51:17.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.766+0000 7fe2794dd740 1 -- start start 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.766+0000 7fe2794dd740 1 Processor -- start 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75faefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bdc670 0x558a75faf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bfd350 0x558a75fbb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe2794dd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a75d6b890 con 0x558a75bd4490 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe2794dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558a75e8f790 con 0x558a75bdc670 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe2794dd740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558a75fb1f60 con 0x558a75bfd350 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe2794dd740 10 client.0 _ll_register_callbacks cb 0x558a75c14ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75faefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75faefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52870/0 (socket says 172.21.15.37:52870) 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 -- 172.21.15.37:0/1836928398 learned_addr learned my addr 172.21.15.37:0/1836928398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe270d04640 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bdc670 0x558a75faf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 -- 172.21.15.37:0/1836928398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bfd350 msgr2=0x558a75fbb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bfd350 0x558a75fbb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 -- 172.21.15.37:0/1836928398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bdc670 msgr2=0x558a75faf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bdc670 0x558a75faf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 -- 172.21.15.37:0/1836928398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a75ec6f30 con 0x558a75bd4490 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe26bfff640 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75faefc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe258009bd0 tx=0x7fe258017e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91463e20f04e413 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe24bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe24bfff640 1 -- 172.21.15.37:0/1836928398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25801c070 con 0x558a75bd4490 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe24bfff640 1 -- 172.21.15.37:0/1836928398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe258016b60 con 0x558a75bd4490 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.767+0000 7fe2794dd740 1 -- 172.21.15.37:0/1836928398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe260013470 con 0x558a75bd4490 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe24bfff640 1 -- 172.21.15.37:0/1836928398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe258028050 con 0x558a75bd4490 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe2794dd740 10 client.16698 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe2794dd740 1 -- 172.21.15.37:0/1836928398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558a75fbde50 con 0x558a75bd4490 2024-08-31T06:51:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe24bfff640 1 -- 172.21.15.37:0/1836928398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe260013470 con 0x558a75bd4490 2024-08-31T06:51:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe24bfff640 1 -- 172.21.15.37:0/1836928398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2580203b0 con 0x558a75bd4490 2024-08-31T06:51:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe2794dd740 10 client.16698 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe2794dd740 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe2794dd740 20 client.16698 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a75bbbcd0 0x558a75fc1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe2794dd740 4 client.16698 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe2794dd740 1 -- 172.21.15.37:0/1836928398 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a75f1b540 con 0x558a75bbbcd0 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.768+0000 7fe270d04640 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a75bbbcd0 0x558a75fc1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.769+0000 7fe24bfff640 10 client.16698 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.769+0000 7fe270d04640 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a75bbbcd0 0x558a75fc1320 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45cd23a6268b8e2e server_cookie=318f1bcb0e979fd0 in_seq=0 out_seq=0 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe24bfff640 1 -- 172.21.15.37:0/1836928398 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a75f1b540 con 0x558a75bbbcd0 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe24bfff640 10 client.16698 handle_command_reply: tid=0 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 client.16698 shutdown 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 -- 172.21.15.37:0/1836928398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 msgr2=0x558a75faefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75faefc0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe258009bd0 tx=0x7fe258017e50 comp rx=0 tx=0).stop 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 -- 172.21.15.37:0/1836928398 shutdown_connections 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a75bbbcd0 0x558a75fc1320 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bfd350 0x558a75fbb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bdc670 0x558a75faf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe24bfff640 0 client.16698 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1836928398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bd4490 0x558a75faefc0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 -- 172.21.15.37:0/1836928398 >> 172.21.15.37:0/1836928398 conn(0x558a75bf1740 msgr2=0x558a75fa6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:17.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 -- 172.21.15.37:0/1836928398 shutdown_connections 2024-08-31T06:51:17.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 1 -- 172.21.15.37:0/1836928398 wait complete. 2024-08-31T06:51:17.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.770+0000 7fe2794dd740 20 client.16698 trim_cache size 0 max 16384 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe2794dd740 1 Processor -- start 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe2794dd740 1 -- start start 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bbbcd0 0x558a75fb0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fbb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 0x558a75fbb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe2794dd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c1b3f60 con 0x558a75bbbcd0 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe2794dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c1b1830 con 0x558a75bd4490 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe2794dd740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c1af680 con 0x558a75bdc670 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bbbcd0 0x558a75fb0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bbbcd0 0x558a75fb0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52882/0 (socket says 172.21.15.37:52882) 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.788+0000 7fe26bfff640 1 -- 172.21.15.37:0/3716776598 learned_addr learned my addr 172.21.15.37:0/3716776598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe270d04640 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fbb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe26bfff640 1 -- 172.21.15.37:0/3716776598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 msgr2=0x558a75fbb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe26bfff640 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 0x558a75fbb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe26bfff640 1 -- 172.21.15.37:0/3716776598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 msgr2=0x558a75fbb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe26bfff640 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fbb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe26bfff640 1 -- 172.21.15.37:0/3716776598 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a75fa5a70 con 0x558a75bbbcd0 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe270d04640 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fbb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe26bfff640 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bbbcd0 0x558a75fb0b50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe258020750 tx=0x7fe258009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e2bf79c3899321 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe2567fc640 1 -- 172.21.15.37:0/3716776598 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258031070 con 0x558a75bbbcd0 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe2567fc640 1 -- 172.21.15.37:0/3716776598 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2580203b0 con 0x558a75bbbcd0 2024-08-31T06:51:17.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.789+0000 7fe2567fc640 1 -- 172.21.15.37:0/3716776598 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25801c040 con 0x558a75bbbcd0 2024-08-31T06:51:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 -- 172.21.15.37:0/3716776598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bbbcd0 msgr2=0x558a75fb0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bbbcd0 0x558a75fb0b50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fe258020750 tx=0x7fe258009d40 comp rx=0 tx=0).stop 2024-08-31T06:51:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 -- 172.21.15.37:0/3716776598 shutdown_connections 2024-08-31T06:51:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bdc670 0x558a75fbb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fbb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 --2- 172.21.15.37:0/3716776598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bbbcd0 0x558a75fb0b50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 -- 172.21.15.37:0/3716776598 >> 172.21.15.37:0/3716776598 conn(0x558a75bf1740 msgr2=0x558a75fa5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 -- 172.21.15.37:0/3716776598 shutdown_connections 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 -- 172.21.15.37:0/3716776598 wait complete. 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.790+0000 7fe2794dd740 1 -- start start 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe2794dd740 1 Processor -- start 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bbbcd0 0x558a75fb7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fb5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe2794dd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bdc670 0x558a75fb6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe2794dd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c1afcf0 con 0x558a75bdc670 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe2794dd740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c1b1160 con 0x558a75bd4490 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe2794dd740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c1b03c0 con 0x558a75bbbcd0 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe2794dd740 10 client.0 _ll_register_callbacks cb 0x7fe258009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:17.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bdc670 0x558a75fb6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bdc670 0x558a75fb6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52884/0 (socket says 172.21.15.37:52884) 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe26bfff640 1 -- 172.21.15.37:0/1796001152 learned_addr learned my addr 172.21.15.37:0/1796001152 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe270d04640 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fb5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.791+0000 7fe26bfff640 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bbbcd0 0x558a75fb7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe26bfff640 1 -- 172.21.15.37:0/1796001152 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bbbcd0 msgr2=0x558a75fb7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe26bfff640 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bbbcd0 0x558a75fb7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe26bfff640 1 -- 172.21.15.37:0/1796001152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 msgr2=0x558a75fb5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe26bfff640 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fb5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe26bfff640 1 -- 172.21.15.37:0/1796001152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a75fb6ca0 con 0x558a75bdc670 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe26bfff640 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bdc670 0x558a75fb6540 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe25802f040 tx=0x7fe258009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459c63d8a64df415 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe24bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe24bfff640 1 -- 172.21.15.37:0/1796001152 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258031040 con 0x558a75bdc670 2024-08-31T06:51:17.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe24bfff640 1 -- 172.21.15.37:0/1796001152 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe258020b40 con 0x558a75bdc670 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe2794dd740 1 -- 172.21.15.37:0/1796001152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2580203b0 con 0x558a75bdc670 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe24bfff640 1 -- 172.21.15.37:0/1796001152 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe25803f050 con 0x558a75bdc670 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe2794dd740 10 client.16704 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe2794dd740 1 -- 172.21.15.37:0/1796001152 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558a7602cc80 con 0x558a75bdc670 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.792+0000 7fe24bfff640 1 -- 172.21.15.37:0/1796001152 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2580203b0 con 0x558a75bdc670 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe24bfff640 1 -- 172.21.15.37:0/1796001152 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe258034070 con 0x558a75bdc670 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe2794dd740 10 client.16704 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe2794dd740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe2794dd740 20 client.16704 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a75bfd350 0x558a7602f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe2794dd740 4 client.16704 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe2794dd740 1 -- 172.21.15.37:0/1796001152 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558a75f16fe0 con 0x558a75bfd350 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe270d04640 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a75bfd350 0x558a7602f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe24bfff640 10 client.16704 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:17.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.793+0000 7fe270d04640 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a75bfd350 0x558a7602f340 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdd987f13175b6d5 server_cookie=6d421247e475d921 in_seq=0 out_seq=0 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe24bfff640 1 -- 172.21.15.37:0/1796001152 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558a75f16fe0 con 0x558a75bfd350 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe24bfff640 10 client.16704 handle_command_reply: tid=0 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe2794dd740 1 client.16704 shutdown 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe2794dd740 1 -- 172.21.15.37:0/1796001152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bdc670 msgr2=0x558a75fb6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bdc670 0x558a75fb6540 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fe25802f040 tx=0x7fe258009470 comp rx=0 tx=0).stop 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe2794dd740 1 -- 172.21.15.37:0/1796001152 shutdown_connections 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a75bfd350 0x558a7602f340 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a75bdc670 0x558a75fb6540 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a75bd4490 0x558a75fb5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe2794dd740 1 --2- 172.21.15.37:0/1796001152 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a75bbbcd0 0x558a75fb7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.795+0000 7fe24bfff640 0 client.16704 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe2794dd740 1 -- 172.21.15.37:0/1796001152 >> 172.21.15.37:0/1796001152 conn(0x558a75bf1740 msgr2=0x558a75fa5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe2794dd740 1 -- 172.21.15.37:0/1796001152 shutdown_connections 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe2794dd740 1 -- 172.21.15.37:0/1796001152 wait complete. 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe2794dd740 20 client.16704 trim_cache size 0 max 16384 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "36e66c2a-04e4-40c8-867d-849592d17df3", 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:51:17.801 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:51:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 -- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe25c0b4ca0 msgr2=0x7fe25c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe25c0b4ca0 0x7fe25c0b71b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe264104050 tx=0x7fe264003e80 comp rx=0 tx=0).stop 2024-08-31T06:51:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 -- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 msgr2=0x7fe26c1a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 0x7fe26c1a1ca0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe264006010 tx=0x7fe264003c90 comp rx=0 tx=0).stop 2024-08-31T06:51:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 -- 172.21.15.37:0/3144081840 shutdown_connections 2024-08-31T06:51:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe25c0b4ca0 0x7fe25c0b71b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c109ba0 0x7fe26c1a1ca0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe26c109250 0x7fe26c19ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 --2- 172.21.15.37:0/3144081840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe26c103960 0x7fe26c19c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 -- 172.21.15.37:0/3144081840 >> 172.21.15.37:0/3144081840 conn(0x7fe26c07b6b0 msgr2=0x7fe26c1071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.796+0000 7fe272f68640 1 -- 172.21.15.37:0/3144081840 shutdown_connections 2024-08-31T06:51:17.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:17.797+0000 7fe272f68640 1 -- 172.21.15.37:0/3144081840 wait complete. 2024-08-31T06:51:18.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:18 smithi106 ceph-mon[22134]: pgmap v453: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T06:51:18.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:18 smithi037 ceph-mon[18612]: pgmap v453: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T06:51:18.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:18 smithi066 ceph-mon[22244]: pgmap v453: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T06:51:18.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:51:18.808 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:19.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:19 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:51:19.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:19 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:19.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:19 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:51:19.198 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:19 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 -- 172.21.15.37:0/86266171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98110000 msgr2=0x7f1e98112420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/86266171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98110000 0x7f1e98112420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009ca0 tx=0x7f1e9002a950 comp rx=0 tx=0).stop 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 -- 172.21.15.37:0/86266171 shutdown_connections 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/86266171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98110000 0x7f1e98112420 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/86266171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e98102da0 0x7f1e9810fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/86266171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e98102450 0x7f1e98102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 -- 172.21.15.37:0/86266171 >> 172.21.15.37:0/86266171 conn(0x7f1e98079510 msgr2=0x7f1e98079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 -- 172.21.15.37:0/86266171 shutdown_connections 2024-08-31T06:51:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.289+0000 7f1e9f18b640 1 -- 172.21.15.37:0/86266171 wait complete. 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e9f18b640 1 Processor -- start 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e9f18b640 1 -- start start 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e9f18b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e98102450 0x7f1e9819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e9f18b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98102da0 0x7f1e9819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e9f18b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e98110000 0x7f1e981a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e9f18b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e98115950 con 0x7f1e98102da0 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e9f18b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1e981157d0 con 0x7f1e98102450 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e9f18b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1e98115ad0 con 0x7f1e98110000 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.290+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98102da0 0x7f1e9819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98102da0 0x7f1e9819c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52900/0 (socket says 172.21.15.37:52900) 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8ffff640 1 -- 172.21.15.37:0/2432108838 learned_addr learned my addr 172.21.15.37:0/2432108838 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e9d728640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e98110000 0x7f1e981a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e98102450 0x7f1e9819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8ffff640 1 -- 172.21.15.37:0/2432108838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e98110000 msgr2=0x7f1e981a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e98110000 0x7f1e981a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8ffff640 1 -- 172.21.15.37:0/2432108838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e98102450 msgr2=0x7f1e9819c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e98102450 0x7f1e9819c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8ffff640 1 -- 172.21.15.37:0/2432108838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e981a2250 con 0x7f1e98102da0 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e9d728640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e98110000 0x7f1e981a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98102da0 0x7f1e9819c940 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800d950 tx=0x7f1e8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8dffb640 1 -- 172.21.15.37:0/2432108838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88017070 con 0x7f1e98102da0 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e9f18b640 1 -- 172.21.15.37:0/2432108838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e981a2540 con 0x7f1e98102da0 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8dffb640 1 -- 172.21.15.37:0/2432108838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e88009c30 con 0x7f1e98102da0 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e8dffb640 1 -- 172.21.15.37:0/2432108838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8800f620 con 0x7f1e98102da0 2024-08-31T06:51:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.291+0000 7f1e9f18b640 1 -- 172.21.15.37:0/2432108838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e981a8d60 con 0x7f1e98102da0 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1ea5700740 1 Processor -- start 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1ea5700740 1 -- start start 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1e8dffb640 1 -- 172.21.15.37:0/2432108838 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f1e88010460 con 0x7f1e98102da0 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9304b070 0x558a933f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 0x558a933f0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1ea5700740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a93367630 con 0x558a9304b070 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1ea5700740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558a93356bc0 con 0x558a9302a390 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.294+0000 7f1ea5700740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558a9335ab70 con 0x558a930221b0 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9304b070 0x558a933f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9304b070 0x558a933f02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52902/0 (socket says 172.21.15.37:52902) 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 -- 172.21.15.37:0/4128060557 learned_addr learned my addr 172.21.15.37:0/4128060557 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 0x558a933f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 -- 172.21.15.37:0/4128060557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 msgr2=0x558a933f0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 0x558a933f0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 -- 172.21.15.37:0/4128060557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 msgr2=0x558a933f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933f0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 -- 172.21.15.37:0/4128060557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a930b6650 con 0x558a9304b070 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9d728640 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9304b070 0x558a933f02c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1e9002f6f0 tx=0x7f1e9002f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18f0e18e7945615 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e8dffb640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e800b4cd0 0x7f1e800b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e7effd640 1 -- 172.21.15.37:0/4128060557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90034040 con 0x558a9304b070 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e800b4cd0 0x7f1e800b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e7effd640 1 -- 172.21.15.37:0/4128060557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e90003cb0 con 0x558a9304b070 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.295+0000 7f1e7effd640 1 -- 172.21.15.37:0/4128060557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e900044f0 con 0x558a9304b070 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1e8dffb640 1 -- 172.21.15.37:0/2432108838 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1e880e5200 con 0x7f1e98102da0 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 -- 172.21.15.37:0/4128060557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9304b070 msgr2=0x558a933f02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e800b4cd0 0x7f1e800b71e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x558a933eef40 tx=0x7f1e9400c4b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9304b070 0x558a933f02c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1e9002f6f0 tx=0x7f1e9002f720 comp rx=0 tx=0).stop 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 -- 172.21.15.37:0/4128060557 shutdown_connections 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 0x558a933f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 --2- 172.21.15.37:0/4128060557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9304b070 0x558a933f02c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 -- 172.21.15.37:0/4128060557 >> 172.21.15.37:0/4128060557 conn(0x558a9303f460 msgr2=0x558a933ee1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 -- 172.21.15.37:0/4128060557 shutdown_connections 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.296+0000 7f1ea5700740 1 -- 172.21.15.37:0/4128060557 wait complete. 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 1 -- start start 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 1 Processor -- start 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a933fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933fc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a93407d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a931b9700 con 0x558a930221b0 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558a932dd700 con 0x558a9302a390 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558a933fea40 con 0x558a9304b070 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.297+0000 7f1ea5700740 10 client.0 _ll_register_callbacks cb 0x558a9330cdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a933fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a933fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52904/0 (socket says 172.21.15.37:52904) 2024-08-31T06:51:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 -- 172.21.15.37:0/312092641 learned_addr learned my addr 172.21.15.37:0/312092641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933fc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9d728640 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a93407d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 -- 172.21.15.37:0/312092641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 msgr2=0x558a93407d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a93407d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 -- 172.21.15.37:0/312092641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 msgr2=0x558a933fc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933fc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 -- 172.21.15.37:0/312092641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a933168b0 con 0x558a930221b0 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9d728640 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a93407d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a933fbae0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1e940117c0 tx=0x7f1e940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4856882930e574b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e77fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e77fff640 1 -- 172.21.15.37:0/312092641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94029060 con 0x558a930221b0 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1e77fff640 1 -- 172.21.15.37:0/312092641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1e9401c7d0 con 0x558a930221b0 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.298+0000 7f1ea5700740 1 -- 172.21.15.37:0/312092641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e90003cb0 con 0x558a930221b0 2024-08-31T06:51:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1e77fff640 1 -- 172.21.15.37:0/312092641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e9401c9d0 con 0x558a930221b0 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1ea5700740 10 client.16716 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1ea5700740 1 -- 172.21.15.37:0/312092641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558a9340a8a0 con 0x558a930221b0 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1e77fff640 1 -- 172.21.15.37:0/312092641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e90003cb0 con 0x558a930221b0 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1e77fff640 1 -- 172.21.15.37:0/312092641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1e94018040 con 0x558a930221b0 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1ea5700740 10 client.16716 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1ea5700740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1ea5700740 20 client.16716 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1ea5700740 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a930099f0 0x558a9340ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1ea5700740 4 client.16716 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1ea5700740 1 -- 172.21.15.37:0/312092641 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a93369580 con 0x558a930099f0 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.299+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a930099f0 0x558a9340ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.300+0000 7f1e77fff640 10 client.16716 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.300+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a930099f0 0x558a9340ddd0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=567d877a3c9e383a server_cookie=571b64dc32895d30 in_seq=0 out_seq=0 2024-08-31T06:51:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1e77fff640 1 -- 172.21.15.37:0/312092641 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a93369580 con 0x558a930099f0 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1e77fff640 10 client.16716 handle_command_reply: tid=0 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 client.16716 shutdown 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 -- 172.21.15.37:0/312092641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 msgr2=0x558a933fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a933fbae0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1e940117c0 tx=0x7f1e940046c0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 -- 172.21.15.37:0/312092641 shutdown_connections 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a930099f0 0x558a9340ddd0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a93407d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a933fc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1e77fff640 0 client.16716 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 --2- 172.21.15.37:0/312092641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a933fbae0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 -- 172.21.15.37:0/312092641 >> 172.21.15.37:0/312092641 conn(0x558a9303f460 msgr2=0x558a933f34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 -- 172.21.15.37:0/312092641 shutdown_connections 2024-08-31T06:51:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 1 -- 172.21.15.37:0/312092641 wait complete. 2024-08-31T06:51:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.301+0000 7f1ea5700740 20 client.16716 trim_cache size 0 max 16384 2024-08-31T06:51:19.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:19 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:51:19.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:19 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:19.325 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:19 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:51:19.326 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:19 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1ea5700740 1 Processor -- start 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1ea5700740 1 -- start start 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 0x558a933fd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9302a390 0x558a933f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9304b070 0x558a93407c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1ea5700740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e981b3e60 con 0x558a9302a390 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1ea5700740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1e981b1730 con 0x558a9304b070 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1ea5700740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1e981af580 con 0x558a930221b0 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9302a390 0x558a933f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9302a390 0x558a933f1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52914/0 (socket says 172.21.15.37:52914) 2024-08-31T06:51:19.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e8ffff640 1 -- 172.21.15.37:0/207669032 learned_addr learned my addr 172.21.15.37:0/207669032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 0x558a933fd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e9d728640 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9304b070 0x558a93407c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e8ffff640 1 -- 172.21.15.37:0/207669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 msgr2=0x558a933fd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 0x558a933fd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e8ffff640 1 -- 172.21.15.37:0/207669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9304b070 msgr2=0x558a93407c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9304b070 0x558a93407c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e8ffff640 1 -- 172.21.15.37:0/207669032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a933f3120 con 0x558a9302a390 2024-08-31T06:51:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.319+0000 7f1e9d728640 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9304b070 0x558a93407c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.320+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9302a390 0x558a933f1a00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1e880ab630 tx=0x7f1e880e5400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554cf59c09ef3130 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.320+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/207669032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88020040 con 0x558a9302a390 2024-08-31T06:51:19.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.320+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/207669032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e880ab930 con 0x558a9302a390 2024-08-31T06:51:19.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.320+0000 7f1e7e7fc640 1 -- 172.21.15.37:0/207669032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e880a72a0 con 0x558a9302a390 2024-08-31T06:51:19.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 -- 172.21.15.37:0/207669032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9302a390 msgr2=0x558a933f1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9302a390 0x558a933f1a00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1e880ab630 tx=0x7f1e880e5400 comp rx=0 tx=0).stop 2024-08-31T06:51:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 -- 172.21.15.37:0/207669032 shutdown_connections 2024-08-31T06:51:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a9302a390 0x558a933f1a00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9304b070 0x558a93407c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 --2- 172.21.15.37:0/207669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a930221b0 0x558a933fd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 -- 172.21.15.37:0/207669032 >> 172.21.15.37:0/207669032 conn(0x558a9303f460 msgr2=0x558a933f12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:19.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 -- 172.21.15.37:0/207669032 shutdown_connections 2024-08-31T06:51:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 -- 172.21.15.37:0/207669032 wait complete. 2024-08-31T06:51:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 -- start start 2024-08-31T06:51:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.321+0000 7f1ea5700740 1 Processor -- start 2024-08-31T06:51:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a93402050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a93402590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1ea5700740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a934777a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1ea5700740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e981afbf0 con 0x558a930221b0 2024-08-31T06:51:19.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1ea5700740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f1e981b1060 con 0x558a9302a390 2024-08-31T06:51:19.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1ea5700740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f1e981b02c0 con 0x558a9304b070 2024-08-31T06:51:19.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1ea5700740 10 client.0 _ll_register_callbacks cb 0x7f1e940042c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a93402050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a93402050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52924/0 (socket says 172.21.15.37:52924) 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 -- 172.21.15.37:0/2172011096 learned_addr learned my addr 172.21.15.37:0/2172011096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9d728640 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a934777a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a93402590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 -- 172.21.15.37:0/2172011096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 msgr2=0x558a934777a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a934777a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 -- 172.21.15.37:0/2172011096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 msgr2=0x558a93402590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:19.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a93402590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 -- 172.21.15.37:0/2172011096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a93477ce0 con 0x558a930221b0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9d728640 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a934777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e9cf27640 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a93402050 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1e94000c00 tx=0x7f1e9401c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc947a987dcded6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e77fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e77fff640 1 -- 172.21.15.37:0/2172011096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9401a670 con 0x558a930221b0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1e77fff640 1 -- 172.21.15.37:0/2172011096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f1e9401a810 con 0x558a930221b0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.322+0000 7f1ea5700740 1 -- 172.21.15.37:0/2172011096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e880ab930 con 0x558a930221b0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1e77fff640 1 -- 172.21.15.37:0/2172011096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1e9403f050 con 0x558a930221b0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1ea5700740 10 client.16722 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1ea5700740 1 -- 172.21.15.37:0/2172011096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558a93478df0 con 0x558a930221b0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1e77fff640 1 -- 172.21.15.37:0/2172011096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e880ab930 con 0x558a930221b0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1e77fff640 1 -- 172.21.15.37:0/2172011096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1e94036070 con 0x558a930221b0 2024-08-31T06:51:19.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1ea5700740 10 client.16722 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1ea5700740 10 client.16722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1ea5700740 20 client.16722 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1ea5700740 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a92fdeda0 0x558a9347b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1ea5700740 4 client.16722 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1ea5700740 1 -- 172.21.15.37:0/2172011096 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558a93365020 con 0x558a92fdeda0 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.323+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a92fdeda0 0x558a9347b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.324+0000 7f1e77fff640 10 client.16722 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.324+0000 7f1e8ffff640 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a92fdeda0 0x558a9347b5e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d46310501606c2f server_cookie=e48217b69fc0fac8 in_seq=0 out_seq=0 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.324+0000 7f1e77fff640 1 -- 172.21.15.37:0/2172011096 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x558a93365020 con 0x558a92fdeda0 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.324+0000 7f1e77fff640 10 client.16722 handle_command_reply: tid=0 2024-08-31T06:51:19.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.324+0000 7f1ea5700740 1 client.16722 shutdown 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 -- 172.21.15.37:0/2172011096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 msgr2=0x558a93402050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a93402050 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f1e94000c00 tx=0x7f1e9401c270 comp rx=0 tx=0).stop 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 -- 172.21.15.37:0/2172011096 shutdown_connections 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a92fdeda0 0x558a9347b5e0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a9304b070 0x558a934777a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a9302a390 0x558a93402590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1e77fff640 0 client.16722 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 --2- 172.21.15.37:0/2172011096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a930221b0 0x558a93402050 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 -- 172.21.15.37:0/2172011096 >> 172.21.15.37:0/2172011096 conn(0x558a9303f460 msgr2=0x558a933fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 -- 172.21.15.37:0/2172011096 shutdown_connections 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 1 -- 172.21.15.37:0/2172011096 wait complete. 2024-08-31T06:51:19.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1ea5700740 20 client.16722 trim_cache size 0 max 16384 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "36e66c2a-04e4-40c8-867d-849592d17df3", 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:51:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:51:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:51:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.345 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:51:19.346 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:51:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:19.347 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:51:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:51:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:19.348 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:51:19.349 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:51:19.350 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:51:19.350 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1e9f18b640 1 -- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e800b4cd0 msgr2=0x7f1e800b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e800b4cd0 0x7f1e800b71e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x558a933eef40 tx=0x7f1e9400c4b0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1e9f18b640 1 -- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98102da0 msgr2=0x7f1e9819c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.325+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98102da0 0x7f1e9819c940 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800d950 tx=0x7f1e8800de10 comp rx=0 tx=0).stop 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.326+0000 7f1e9f18b640 1 -- 172.21.15.37:0/2432108838 shutdown_connections 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.326+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f1e800b4cd0 0x7f1e800b71e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.326+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e98102da0 0x7f1e9819c940 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.326+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e98110000 0x7f1e981a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.326+0000 7f1e9f18b640 1 --2- 172.21.15.37:0/2432108838 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e98102450 0x7f1e9819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.326+0000 7f1e9f18b640 1 -- 172.21.15.37:0/2432108838 >> 172.21.15.37:0/2432108838 conn(0x7f1e98079510 msgr2=0x7f1e981115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.326+0000 7f1e9f18b640 1 -- 172.21.15.37:0/2432108838 shutdown_connections 2024-08-31T06:51:19.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:19.326+0000 7f1e9f18b640 1 -- 172.21.15.37:0/2432108838 wait complete. 2024-08-31T06:51:19.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:19 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:51:19.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:19 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:19.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:19 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:51:19.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:19 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:51:20.212 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:20 smithi037 ceph-mon[18612]: pgmap v454: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T06:51:20.239 INFO:tasks.cephfs.filesystem:scrub status for tag:36e66c2a-04e4-40c8-867d-849592d17df3 - {'path': '/', 'tag': '36e66c2a-04e4-40c8-867d-849592d17df3', 'options': 'recursive,force'} 2024-08-31T06:51:20.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:20 smithi106 ceph-mon[22134]: pgmap v454: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T06:51:20.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:20 smithi066 ceph-mon[22244]: pgmap v454: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T06:51:22.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:22 smithi106 ceph-mon[22134]: pgmap v455: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T06:51:22.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:22 smithi037 ceph-mon[18612]: pgmap v455: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T06:51:22.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:22 smithi066 ceph-mon[22244]: pgmap v455: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-31T06:51:23.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:23 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:51:23.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:23 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:51:23.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:23 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:51:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:24 smithi106 ceph-mon[22134]: pgmap v456: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-31T06:51:24.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:24 smithi037 ceph-mon[18612]: pgmap v456: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-31T06:51:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:24 smithi066 ceph-mon[22244]: pgmap v456: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-31T06:51:26.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:26 smithi037 ceph-mon[18612]: pgmap v457: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:51:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:26 smithi066 ceph-mon[22244]: pgmap v457: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:51:26.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:26 smithi106 ceph-mon[22134]: pgmap v457: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:51:28.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:28 smithi037 ceph-mon[18612]: pgmap v458: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:51:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:28 smithi066 ceph-mon[22244]: pgmap v458: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:51:28.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:28 smithi106 ceph-mon[22134]: pgmap v458: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:51:30.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:30 smithi037 ceph-mon[18612]: pgmap v459: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:30.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:30 smithi066 ceph-mon[22244]: pgmap v459: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:30.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:30 smithi106 ceph-mon[22134]: pgmap v459: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:32.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:32 smithi037 ceph-mon[18612]: pgmap v460: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:51:32.367 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:32 smithi106 ceph-mon[22134]: pgmap v460: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:51:32.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:32 smithi066 ceph-mon[22244]: pgmap v460: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:51:34.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:34 smithi037 ceph-mon[18612]: pgmap v461: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-08-31T06:51:34.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:34 smithi066 ceph-mon[22244]: pgmap v461: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-08-31T06:51:34.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:34 smithi106 ceph-mon[22134]: pgmap v461: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-08-31T06:51:36.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:36 smithi037 ceph-mon[18612]: pgmap v462: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:36.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:36 smithi066 ceph-mon[22244]: pgmap v462: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:36.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:36 smithi106 ceph-mon[22134]: pgmap v462: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:38.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:38 smithi037 ceph-mon[18612]: pgmap v463: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:38.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:38 smithi066 ceph-mon[22244]: pgmap v463: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:38.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:38 smithi106 ceph-mon[22134]: pgmap v463: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:40 smithi037 ceph-mon[18612]: pgmap v464: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-08-31T06:51:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:40 smithi066 ceph-mon[22244]: pgmap v464: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-08-31T06:51:40.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:40 smithi106 ceph-mon[22134]: pgmap v464: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-08-31T06:51:42.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:42 smithi037 ceph-mon[18612]: pgmap v465: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:51:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:42 smithi066 ceph-mon[22244]: pgmap v465: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:51:42.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:42 smithi106 ceph-mon[22134]: pgmap v465: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:51:44.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:44 smithi037 ceph-mon[18612]: pgmap v466: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:51:44.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:44 smithi066 ceph-mon[22244]: pgmap v466: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:51:44.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:44 smithi106 ceph-mon[22134]: pgmap v466: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:51:46.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:46 smithi037 ceph-mon[18612]: pgmap v467: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:51:46.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:46 smithi066 ceph-mon[22244]: pgmap v467: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:51:46.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:46 smithi106 ceph-mon[22134]: pgmap v467: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:51:48.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:48 smithi066 ceph-mon[22244]: pgmap v468: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:48.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:48 smithi106 ceph-mon[22134]: pgmap v468: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:48.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:48 smithi037 ceph-mon[18612]: pgmap v468: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:50.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:51:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:50 smithi066 ceph-mon[22244]: pgmap v469: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:51:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:50.567 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:50 smithi106 ceph-mon[22134]: pgmap v469: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:51:50.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:50 smithi037 ceph-mon[18612]: pgmap v469: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:51:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 -- 172.21.15.37:0/728991541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec108a90 msgr2=0x7f6fec10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/728991541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec108a90 0x7f6fec10f2c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009900 tx=0x7f6fe402a410 comp rx=0 tx=0).stop 2024-08-31T06:51:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 -- 172.21.15.37:0/728991541 shutdown_connections 2024-08-31T06:51:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/728991541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec108a90 0x7f6fec10f2c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/728991541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fec108140 0x7f6fec108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/728991541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fec102800 0x7f6fec102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 -- 172.21.15.37:0/728991541 >> 172.21.15.37:0/728991541 conn(0x7f6fec0794d0 msgr2=0x7f6fec0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 -- 172.21.15.37:0/728991541 shutdown_connections 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.011+0000 7f6ff39a3640 1 -- 172.21.15.37:0/728991541 wait complete. 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff39a3640 1 Processor -- start 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff39a3640 1 -- start start 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff39a3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec102800 0x7f6fec19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff39a3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fec108140 0x7f6fec19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff39a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fec108a90 0x7f6fec19f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff39a3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1125c0 con 0x7f6fec102800 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff39a3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec112440 con 0x7f6fec108a90 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff39a3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec112740 con 0x7f6fec108140 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff173f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec102800 0x7f6fec19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff173f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec102800 0x7f6fec19a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48500/0 (socket says 172.21.15.37:48500) 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.012+0000 7f6ff173f640 1 -- 172.21.15.37:0/1510858111 learned_addr learned my addr 172.21.15.37:0/1510858111 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fec108140 0x7f6fec19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fec108a90 0x7f6fec19f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff173f640 1 -- 172.21.15.37:0/1510858111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fec108140 msgr2=0x7f6fec19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fec108140 0x7f6fec19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff173f640 1 -- 172.21.15.37:0/1510858111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fec108a90 msgr2=0x7f6fec19f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fec108a90 0x7f6fec19f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff173f640 1 -- 172.21.15.37:0/1510858111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec1a0090 con 0x7f6fec102800 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fec108a90 0x7f6fec19f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec102800 0x7f6fec19a120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00eab0 tx=0x7f6fdc00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6fea7fc640 1 -- 172.21.15.37:0/1510858111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00ce40 con 0x7f6fec102800 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6fea7fc640 1 -- 172.21.15.37:0/1510858111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fdc011900 con 0x7f6fec102800 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6fea7fc640 1 -- 172.21.15.37:0/1510858111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc010990 con 0x7f6fec102800 2024-08-31T06:51:51.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff39a3640 1 -- 172.21.15.37:0/1510858111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec1a0380 con 0x7f6fec102800 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.013+0000 7f6ff39a3640 1 -- 172.21.15.37:0/1510858111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec1a6ae0 con 0x7f6fec102800 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff9f18740 1 Processor -- start 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff9f18740 1 -- start start 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 0x55e95cc45300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc45840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6fea7fc640 1 -- 172.21.15.37:0/1510858111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f6fdc011470 con 0x7f6fec102800 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 0x55e95cc45d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e95cbbc630 con 0x55e95c8771b0 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e95cbabbc0 con 0x55e95c8a0070 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e95cbafb70 con 0x55e95c87f390 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff173f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc45840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff173f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc45840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48516/0 (socket says 172.21.15.37:48516) 2024-08-31T06:51:51.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.016+0000 7f6ff173f640 1 -- 172.21.15.37:0/1890980601 learned_addr learned my addr 172.21.15.37:0/1890980601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 0x55e95cc45300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 0x55e95cc45d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff173f640 1 -- 172.21.15.37:0/1890980601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 msgr2=0x55e95cc45d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 0x55e95cc45d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff173f640 1 -- 172.21.15.37:0/1890980601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 msgr2=0x55e95cc45300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 0x55e95cc45300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff173f640 1 -- 172.21.15.37:0/1890980601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e95c90b650 con 0x55e95c8771b0 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc45840 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0e3230 tx=0x7f6fdc0e9e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438f0845b895823 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6fea7fc640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6fd40b4d20 0x7f6fd40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6fd37fe640 1 -- 172.21.15.37:0/1890980601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0f5020 con 0x55e95c8771b0 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.017+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6fd40b4d20 0x7f6fd40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6fd37fe640 1 -- 172.21.15.37:0/1890980601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fdc0d8320 con 0x55e95c8771b0 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6fd37fe640 1 -- 172.21.15.37:0/1890980601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0ab9d0 con 0x55e95c8771b0 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6fea7fc640 1 -- 172.21.15.37:0/1510858111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6fdc0e5b30 con 0x7f6fec102800 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1890980601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 msgr2=0x55e95cc45840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6fd40b4d20 0x7f6fd40b7230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4006010 tx=0x7f6fe4032a80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc45840 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0e3230 tx=0x7f6fdc0e9e00 comp rx=0 tx=0).stop 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1890980601 shutdown_connections 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc45840 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 0x55e95cc45d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1890980601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 0x55e95cc45300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.018+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1890980601 >> 172.21.15.37:0/1890980601 conn(0x55e95c894460 msgr2=0x55e95cc431f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1890980601 shutdown_connections 2024-08-31T06:51:51.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1890980601 wait complete. 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 -- start start 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 Processor -- start 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8771b0 0x55e95cc54e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c87f390 0x55e95cc553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc61170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e95ca0e700 con 0x55e95c87f390 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e95cb32700 con 0x55e95c8771b0 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.019+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e95cc57e40 con 0x55e95c8a0070 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff9f18740 10 client.0 _ll_register_callbacks cb 0x55e95cb61dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c87f390 0x55e95cc553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c87f390 0x55e95cc553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48528/0 (socket says 172.21.15.37:48528) 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 -- 172.21.15.37:0/2569403475 learned_addr learned my addr 172.21.15.37:0/2569403475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff173f640 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8771b0 0x55e95cc54e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc61170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 -- 172.21.15.37:0/2569403475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 msgr2=0x55e95cc61170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc61170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 -- 172.21.15.37:0/2569403475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8771b0 msgr2=0x55e95cc54e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8771b0 0x55e95cc54e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 -- 172.21.15.37:0/2569403475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e95cb6b8b0 con 0x55e95c87f390 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c87f390 0x55e95cc553d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0012700 tx=0x7f6fe0012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496123bdeb5fe0ca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6fd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/2569403475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0004260 con 0x55e95c87f390 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/2569403475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6fe0004400 con 0x55e95c87f390 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.020+0000 7f6ff9f18740 1 -- 172.21.15.37:0/2569403475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fdc0d8320 con 0x55e95c87f390 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/2569403475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6fe00119a0 con 0x55e95c87f390 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff9f18740 10 client.16734 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff9f18740 1 -- 172.21.15.37:0/2569403475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e95cc63ce0 con 0x55e95c87f390 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/2569403475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fdc0d8320 con 0x55e95c87f390 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/2569403475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6fe0025440 con 0x55e95c87f390 2024-08-31T06:51:51.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff9f18740 10 client.16734 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff9f18740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff9f18740 20 client.16734 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e95c85e9f0 0x55e95cc671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff9f18740 4 client.16734 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff9f18740 1 -- 172.21.15.37:0/2569403475 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e95cbbe580 con 0x55e95c85e9f0 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.021+0000 7f6ff173f640 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e95c85e9f0 0x55e95cc671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.022+0000 7f6fd0ff9640 10 client.16734 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.022+0000 7f6ff173f640 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e95c85e9f0 0x55e95cc671b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9936c2894f6300f3 server_cookie=7e45e6b6c5461fab in_seq=0 out_seq=0 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.022+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/2569403475 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e95cbbe580 con 0x55e95c85e9f0 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.022+0000 7f6fd0ff9640 10 client.16734 handle_command_reply: tid=0 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 client.16734 shutdown 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 -- 172.21.15.37:0/2569403475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c87f390 msgr2=0x55e95cc553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c87f390 0x55e95cc553d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0012700 tx=0x7f6fe0012bc0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 -- 172.21.15.37:0/2569403475 shutdown_connections 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e95c85e9f0 0x55e95cc671b0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c87f390 0x55e95cc553d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc61170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6fd0ff9640 0 client.16734 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/2569403475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8771b0 0x55e95cc54e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 -- 172.21.15.37:0/2569403475 >> 172.21.15.37:0/2569403475 conn(0x55e95c894460 msgr2=0x55e95cc46cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 -- 172.21.15.37:0/2569403475 shutdown_connections 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 1 -- 172.21.15.37:0/2569403475 wait complete. 2024-08-31T06:51:51.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.023+0000 7f6ff9f18740 20 client.16734 trim_cache size 0 max 16384 2024-08-31T06:51:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.041+0000 7f6ff9f18740 1 Processor -- start 2024-08-31T06:51:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.041+0000 7f6ff9f18740 1 -- start start 2024-08-31T06:51:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.041+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc50040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.041+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c87f390 0x55e95cc61070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.041+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc42b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.041+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1af9b0 con 0x55e95c8771b0 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.041+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1ad280 con 0x55e95c87f390 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.041+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1ab0f0 con 0x55e95c8a0070 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc50040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc50040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48538/0 (socket says 172.21.15.37:48538) 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 -- 172.21.15.37:0/568555873 learned_addr learned my addr 172.21.15.37:0/568555873 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc42b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c87f390 0x55e95cc61070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 -- 172.21.15.37:0/568555873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 msgr2=0x55e95cc42b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc42b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 -- 172.21.15.37:0/568555873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c87f390 msgr2=0x55e95cc61070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c87f390 0x55e95cc61070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 -- 172.21.15.37:0/568555873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e95cc50720 con 0x55e95c8771b0 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc42b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c87f390 0x55e95cc61070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6ff173f640 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc50040 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0a33a0 tx=0x7f6fdc0a4de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4fef89b4afa022 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/568555873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0a47e0 con 0x55e95c8771b0 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/568555873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fdc0b3e50 con 0x55e95c8771b0 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.042+0000 7f6fd2ffd640 1 -- 172.21.15.37:0/568555873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0a4a00 con 0x55e95c8771b0 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 -- 172.21.15.37:0/568555873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 msgr2=0x55e95cc50040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc50040 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0a33a0 tx=0x7f6fdc0a4de0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 -- 172.21.15.37:0/568555873 shutdown_connections 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c8a0070 0x55e95cc42b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c87f390 0x55e95cc61070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/568555873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc50040 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 -- 172.21.15.37:0/568555873 >> 172.21.15.37:0/568555873 conn(0x55e95c894460 msgr2=0x55e95cc53710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 -- 172.21.15.37:0/568555873 shutdown_connections 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.043+0000 7f6ff9f18740 1 -- 172.21.15.37:0/568555873 wait complete. 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 1 -- start start 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 1 Processor -- start 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc594f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 0x55e95cc59a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 0x55e95ccd0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1ab740 con 0x55e95c8771b0 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1acbb0 con 0x55e95c8a0070 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1abe10 con 0x55e95c87f390 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff9f18740 10 client.0 _ll_register_callbacks cb 0x7f6fe00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff173f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff173f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48546/0 (socket says 172.21.15.37:48546) 2024-08-31T06:51:51.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff173f640 1 -- 172.21.15.37:0/1773857538 learned_addr learned my addr 172.21.15.37:0/1773857538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.044+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 0x55e95cc59a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff1f40640 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 0x55e95ccd0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff173f640 1 -- 172.21.15.37:0/1773857538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 msgr2=0x55e95cc59a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 0x55e95cc59a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff173f640 1 -- 172.21.15.37:0/1773857538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 msgr2=0x55e95ccd0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 0x55e95ccd0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff173f640 1 -- 172.21.15.37:0/1773857538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e95ccd10f0 con 0x55e95c8771b0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff173f640 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc594f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0a94d0 tx=0x7f6fdc0ee670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78e62edcbcbe0ce server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6fd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/1773857538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0f5030 con 0x55e95c8771b0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/1773857538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f6fdc0e9190 con 0x55e95c8771b0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1773857538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fdc0b3e50 con 0x55e95c8771b0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/1773857538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6fdc0a4c40 con 0x55e95c8771b0 2024-08-31T06:51:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff9f18740 10 client.16740 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1773857538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e95ccd2250 con 0x55e95c8771b0 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.045+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/1773857538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fdc0b3e50 con 0x55e95c8771b0 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.046+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/1773857538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6fdc00f040 con 0x55e95c8771b0 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.046+0000 7f6ff9f18740 10 client.16740 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.046+0000 7f6ff9f18740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.046+0000 7f6ff9f18740 20 client.16740 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.046+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e95c833da0 0x55e95ccd44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.046+0000 7f6ff9f18740 4 client.16740 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.046+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1773857538 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e95cbba020 con 0x55e95c833da0 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.046+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e95c833da0 0x55e95ccd44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff0f3e640 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e95c833da0 0x55e95ccd44e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2e69bc438625f98 server_cookie=8a35730c4d54bec7 in_seq=0 out_seq=0 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6fd0ff9640 10 client.16740 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6fd0ff9640 1 -- 172.21.15.37:0/1773857538 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55e95cbba020 con 0x55e95c833da0 2024-08-31T06:51:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6fd0ff9640 10 client.16740 handle_command_reply: tid=0 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 client.16740 shutdown 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1773857538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 msgr2=0x55e95cc594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc594f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0a94d0 tx=0x7f6fdc0ee670 comp rx=0 tx=0).stop 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1773857538 shutdown_connections 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e95c833da0 0x55e95ccd44e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e95c8a0070 0x55e95ccd0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e95c87f390 0x55e95cc59a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 --2- 172.21.15.37:0/1773857538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e95c8771b0 0x55e95cc594f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6fd0ff9640 0 client.16740 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1773857538 >> 172.21.15.37:0/1773857538 conn(0x55e95c894460 msgr2=0x55e95cc42ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1773857538 shutdown_connections 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 1 -- 172.21.15.37:0/1773857538 wait complete. 2024-08-31T06:51:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.047+0000 7f6ff9f18740 20 client.16740 trim_cache size 0 max 16384 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:51.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:51.061 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:51.062 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:51:51.064 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:51:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 -- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6fd40b4d20 msgr2=0x7f6fd40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6fd40b4d20 0x7f6fd40b7230 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4006010 tx=0x7f6fe4032a80 comp rx=0 tx=0).stop 2024-08-31T06:51:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 -- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec102800 msgr2=0x7f6fec19a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec102800 0x7f6fec19a120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00eab0 tx=0x7f6fdc00ef70 comp rx=0 tx=0).stop 2024-08-31T06:51:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 -- 172.21.15.37:0/1510858111 shutdown_connections 2024-08-31T06:51:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6fd40b4d20 0x7f6fd40b7230 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6fec108a90 0x7f6fec19f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fec108140 0x7f6fec19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 --2- 172.21.15.37:0/1510858111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fec102800 0x7f6fec19a120 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 -- 172.21.15.37:0/1510858111 >> 172.21.15.37:0/1510858111 conn(0x7f6fec0794d0 msgr2=0x7f6fec101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 -- 172.21.15.37:0/1510858111 shutdown_connections 2024-08-31T06:51:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:51.048+0000 7f6ff39a3640 1 -- 172.21.15.37:0/1510858111 wait complete. 2024-08-31T06:51:51.900 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:51:51.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:51:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:52.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:52 smithi066 ceph-mon[22244]: pgmap v470: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:52.389 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:52 smithi037 ceph-mon[18612]: pgmap v470: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:52.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:52 smithi106 ceph-mon[22134]: pgmap v470: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.631+0000 7feb2795d640 1 -- 172.21.15.37:0/2468150400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 msgr2=0x7feb20102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.631+0000 7feb2795d640 1 --2- 172.21.15.37:0/2468150400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 0x7feb20102c10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7feb18009900 tx=0x7feb1802a410 comp rx=0 tx=0).stop 2024-08-31T06:51:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.631+0000 7feb2795d640 1 -- 172.21.15.37:0/2468150400 shutdown_connections 2024-08-31T06:51:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.631+0000 7feb2795d640 1 --2- 172.21.15.37:0/2468150400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb20108a90 0x7feb2010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.631+0000 7feb2795d640 1 --2- 172.21.15.37:0/2468150400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb20108140 0x7feb20108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.631+0000 7feb2795d640 1 --2- 172.21.15.37:0/2468150400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 0x7feb20102c10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.631+0000 7feb2795d640 1 -- 172.21.15.37:0/2468150400 >> 172.21.15.37:0/2468150400 conn(0x7feb200794d0 msgr2=0x7feb200798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.632+0000 7feb2795d640 1 -- 172.21.15.37:0/2468150400 shutdown_connections 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.632+0000 7feb2795d640 1 -- 172.21.15.37:0/2468150400 wait complete. 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.632+0000 7feb2795d640 1 Processor -- start 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb2795d640 1 -- start start 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb2795d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 0x7feb2019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb2795d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb20108140 0x7feb2019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb2795d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb20108a90 0x7feb2019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb2795d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feb201136c0 con 0x7feb20102800 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb2795d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7feb20113540 con 0x7feb20108a90 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb2795d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7feb20113840 con 0x7feb20108140 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb256f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 0x7feb2019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb256f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 0x7feb2019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48552/0 (socket says 172.21.15.37:48552) 2024-08-31T06:51:52.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb256f9640 1 -- 172.21.15.37:0/3520424990 learned_addr learned my addr 172.21.15.37:0/3520424990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb24ef8640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb20108140 0x7feb2019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb25efa640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb20108a90 0x7feb2019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb256f9640 1 -- 172.21.15.37:0/3520424990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb20108140 msgr2=0x7feb2019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb256f9640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb20108140 0x7feb2019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb256f9640 1 -- 172.21.15.37:0/3520424990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb20108a90 msgr2=0x7feb2019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb256f9640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb20108a90 0x7feb2019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.633+0000 7feb256f9640 1 -- 172.21.15.37:0/3520424990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb201a00e0 con 0x7feb20102800 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.634+0000 7feb256f9640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 0x7feb2019a170 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7feb18009230 tx=0x7feb18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.634+0000 7feb1e7fc640 1 -- 172.21.15.37:0/3520424990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1803f030 con 0x7feb20102800 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.634+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb201a0370 con 0x7feb20102800 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.634+0000 7feb1e7fc640 1 -- 172.21.15.37:0/3520424990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb18003a80 con 0x7feb20102800 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.634+0000 7feb1e7fc640 1 -- 172.21.15.37:0/3520424990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18035070 con 0x7feb20102800 2024-08-31T06:51:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.634+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb201a6b30 con 0x7feb20102800 2024-08-31T06:51:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.635+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb20102c10 con 0x7feb20102800 2024-08-31T06:51:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.636+0000 7feb1e7fc640 1 -- 172.21.15.37:0/3520424990 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7feb18042030 con 0x7feb20102800 2024-08-31T06:51:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.637+0000 7feb1e7fc640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feb080b4ca0 0x7feb080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.637+0000 7feb24ef8640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feb080b4ca0 0x7feb080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.637+0000 7feb1e7fc640 1 -- 172.21.15.37:0/3520424990 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7feb18106000 con 0x7feb20102800 2024-08-31T06:51:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.638+0000 7feb24ef8640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feb080b4ca0 0x7feb080b71b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb20100ba0 tx=0x7feb1400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.640+0000 7feb1e7fc640 1 -- 172.21.15.37:0/3520424990 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7feb180cc7e0 con 0x7feb20102800 2024-08-31T06:51:52.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.863+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb2019b2a0 con 0x7feb20102800 2024-08-31T06:51:52.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.864+0000 7feb1e7fc640 1 -- 172.21.15.37:0/3520424990 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7feb180d5370 con 0x7feb20102800 2024-08-31T06:51:52.865 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:51:52.865 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:51:52.865 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feb080b4ca0 msgr2=0x7feb080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feb080b4ca0 0x7feb080b71b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb20100ba0 tx=0x7feb1400b390 comp rx=0 tx=0).stop 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 msgr2=0x7feb2019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 0x7feb2019a170 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7feb18009230 tx=0x7feb18004270 comp rx=0 tx=0).stop 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 shutdown_connections 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7feb080b4ca0 0x7feb080b71b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb20108a90 0x7feb2019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb20108140 0x7feb2019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 --2- 172.21.15.37:0/3520424990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb20102800 0x7feb2019a170 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 >> 172.21.15.37:0/3520424990 conn(0x7feb200794d0 msgr2=0x7feb20101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 shutdown_connections 2024-08-31T06:51:52.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:52.866+0000 7feb2795d640 1 -- 172.21.15.37:0/3520424990 wait complete. 2024-08-31T06:51:53.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:53 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3520424990' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:53.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:53 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3520424990' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:53.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:53 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3520424990' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:51:53.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:51:53.860 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:54.234 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:54 smithi037 ceph-mon[18612]: pgmap v471: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 -- 172.21.15.37:0/1662843787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0108160 msgr2=0x7f95b0108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1662843787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0108160 0x7f95b0108570 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009900 tx=0x7f95a402a410 comp rx=0 tx=0).stop 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 -- 172.21.15.37:0/1662843787 shutdown_connections 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1662843787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0108160 0x7f95b0108570 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1662843787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95b0108ab0 0x7f95b010f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1662843787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b0102820 0x7f95b0102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 -- 172.21.15.37:0/1662843787 >> 172.21.15.37:0/1662843787 conn(0x7f95b00794e0 msgr2=0x7f95b00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 -- 172.21.15.37:0/1662843787 shutdown_connections 2024-08-31T06:51:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.326+0000 7f95b65fb640 1 -- 172.21.15.37:0/1662843787 wait complete. 2024-08-31T06:51:54.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95b65fb640 1 Processor -- start 2024-08-31T06:51:54.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95b65fb640 1 -- start start 2024-08-31T06:51:54.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95b65fb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0102820 0x7f95b019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95b65fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b0108160 0x7f95b019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95b65fb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95b0108ab0 0x7f95b019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95b65fb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95b0112590 con 0x7f95b0102820 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95b65fb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f95b0112410 con 0x7f95b0108160 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95b65fb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f95b0112710 con 0x7f95b0108ab0 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0102820 0x7f95b019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0102820 0x7f95b019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53896/0 (socket says 172.21.15.37:53896) 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95affff640 1 -- 172.21.15.37:0/1831963360 learned_addr learned my addr 172.21.15.37:0/1831963360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.327+0000 7f95af7fe640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b0108160 0x7f95b019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95b4b98640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95b0108ab0 0x7f95b019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95affff640 1 -- 172.21.15.37:0/1831963360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95b0108ab0 msgr2=0x7f95b019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95affff640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95b0108ab0 0x7f95b019f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95affff640 1 -- 172.21.15.37:0/1831963360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b0108160 msgr2=0x7f95b019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95affff640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b0108160 0x7f95b019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95affff640 1 -- 172.21.15.37:0/1831963360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b01a0100 con 0x7f95b0102820 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95affff640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0102820 0x7f95b019a190 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f95a000e9f0 tx=0x7f95a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95ad7fa640 1 -- 172.21.15.37:0/1831963360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a000cd80 con 0x7f95b0102820 2024-08-31T06:51:54.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95b65fb640 1 -- 172.21.15.37:0/1831963360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b01a03f0 con 0x7f95b0102820 2024-08-31T06:51:54.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95ad7fa640 1 -- 172.21.15.37:0/1831963360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a00108c0 con 0x7f95b0102820 2024-08-31T06:51:54.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95ad7fa640 1 -- 172.21.15.37:0/1831963360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a00187c0 con 0x7f95b0102820 2024-08-31T06:51:54.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.328+0000 7f95b65fb640 1 -- 172.21.15.37:0/1831963360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b01a6b50 con 0x7f95b0102820 2024-08-31T06:51:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95bcb70740 1 Processor -- start 2024-08-31T06:51:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95bcb70740 1 -- start start 2024-08-31T06:51:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95ad7fa640 1 -- 172.21.15.37:0/1831963360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f95a0010430 con 0x7f95b0102820 2024-08-31T06:51:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b526350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b526890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b526dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95bcb70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d63b49d680 con 0x55d63b181070 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95bcb70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d63b48cc10 con 0x55d63b1581b0 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95bcb70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55d63b490bc0 con 0x55d63b160390 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95b4b98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b526350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95b4b98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b526350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53898/0 (socket says 172.21.15.37:53898) 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95b4b98640 1 -- 172.21.15.37:0/1937515359 learned_addr learned my addr 172.21.15.37:0/1937515359 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.331+0000 7f95affff640 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b526890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95af7fe640 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b526dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95affff640 1 -- 172.21.15.37:0/1937515359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 msgr2=0x55d63b526dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95affff640 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b526dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95affff640 1 -- 172.21.15.37:0/1937515359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 msgr2=0x55d63b526350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95affff640 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b526350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95affff640 1 -- 172.21.15.37:0/1937515359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63b1ec650 con 0x55d63b1581b0 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95b4b98640 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b526350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95af7fe640 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b526dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95ad7fa640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95980b4ca0 0x7f95980b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95affff640 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b526890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95a00e3020 tx=0x7f95a00ed690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca3087494745dca server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95b4b98640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95980b4ca0 0x7f95980b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95ad7fa640 1 -- 172.21.15.37:0/1831963360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f95a00e5890 con 0x7f95b0102820 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95967fc640 1 -- 172.21.15.37:0/1937515359 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a0091e60 con 0x55d63b1581b0 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95967fc640 1 -- 172.21.15.37:0/1937515359 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a00abb80 con 0x55d63b1581b0 2024-08-31T06:51:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.332+0000 7f95967fc640 1 -- 172.21.15.37:0/1937515359 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a00ab9c0 con 0x55d63b1581b0 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 -- 172.21.15.37:0/1937515359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 msgr2=0x55d63b526890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95b4b98640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95980b4ca0 0x7f95980b71b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f95a8005f40 tx=0x7f95a80096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b526890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f95a00e3020 tx=0x7f95a00ed690 comp rx=0 tx=0).stop 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 -- 172.21.15.37:0/1937515359 shutdown_connections 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b526dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b526890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1937515359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b526350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 -- 172.21.15.37:0/1937515359 >> 172.21.15.37:0/1937515359 conn(0x55d63b175460 msgr2=0x55d63b524240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 -- 172.21.15.37:0/1937515359 shutdown_connections 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.333+0000 7f95bcb70740 1 -- 172.21.15.37:0/1937515359 wait complete. 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 1 -- start start 2024-08-31T06:51:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 1 Processor -- start 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 0x55d63b531b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b160390 0x55d63b532050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b181070 0x55d63b53de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d63b2ef700 con 0x55d63b160390 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d63b413750 con 0x55d63b181070 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55d63b534b30 con 0x55d63b1581b0 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95bcb70740 10 client.0 _ll_register_callbacks cb 0x55d63b442e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b160390 0x55d63b532050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b160390 0x55d63b532050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53914/0 (socket says 172.21.15.37:53914) 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95af7fe640 1 -- 172.21.15.37:0/3353056359 learned_addr learned my addr 172.21.15.37:0/3353056359 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95b4b98640 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b181070 0x55d63b53de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.334+0000 7f95affff640 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 0x55d63b531b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95af7fe640 1 -- 172.21.15.37:0/3353056359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 msgr2=0x55d63b531b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95af7fe640 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 0x55d63b531b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95af7fe640 1 -- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b181070 msgr2=0x55d63b53de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95af7fe640 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b181070 0x55d63b53de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95af7fe640 1 -- 172.21.15.37:0/3353056359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63b44c900 con 0x55d63b160390 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95b4b98640 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b181070 0x55d63b53de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95af7fe640 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b160390 0x55d63b532050 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f95b006b460 tx=0x7f95a4031d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603883f3bbdd69d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f958f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f958f7fe640 1 -- 172.21.15.37:0/3353056359 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4035070 con 0x55d63b160390 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f958f7fe640 1 -- 172.21.15.37:0/3353056359 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f95a4004040 con 0x55d63b160390 2024-08-31T06:51:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95bcb70740 1 -- 172.21.15.37:0/3353056359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95a00abb80 con 0x55d63b160390 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f958f7fe640 1 -- 172.21.15.37:0/3353056359 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95a4004240 con 0x55d63b160390 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95bcb70740 10 client.16758 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.335+0000 7f95bcb70740 1 -- 172.21.15.37:0/3353056359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d63b540960 con 0x55d63b160390 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f958f7fe640 1 -- 172.21.15.37:0/3353056359 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a00abb80 con 0x55d63b160390 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f958f7fe640 1 -- 172.21.15.37:0/3353056359 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95a404e440 con 0x55d63b160390 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f95bcb70740 10 client.16758 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f95bcb70740 10 client.16758 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f95bcb70740 20 client.16758 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f95bcb70740 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55d63b13f9f0 0x55d63b543e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f95bcb70740 4 client.16758 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f95bcb70740 1 -- 172.21.15.37:0/3353056359 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d63b49f5d0 con 0x55d63b13f9f0 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.336+0000 7f95affff640 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55d63b13f9f0 0x55d63b543e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.337+0000 7f958f7fe640 10 client.16758 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.337+0000 7f95affff640 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55d63b13f9f0 0x55d63b543e20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1598f13181dde31 server_cookie=e04a76927036b467 in_seq=0 out_seq=0 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.337+0000 7f958f7fe640 1 -- 172.21.15.37:0/3353056359 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d63b49f5d0 con 0x55d63b13f9f0 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.337+0000 7f958f7fe640 10 client.16758 handle_command_reply: tid=0 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.337+0000 7f95bcb70740 1 client.16758 shutdown 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 -- 172.21.15.37:0/3353056359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b160390 msgr2=0x55d63b532050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b160390 0x55d63b532050 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f95b006b460 tx=0x7f95a4031d90 comp rx=0 tx=0).stop 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 -- 172.21.15.37:0/3353056359 shutdown_connections 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b160390 0x55d63b532050 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55d63b13f9f0 0x55d63b543e20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b181070 0x55d63b53de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 --2- 172.21.15.37:0/3353056359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 0x55d63b531b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 -- 172.21.15.37:0/3353056359 >> 172.21.15.37:0/3353056359 conn(0x55d63b175460 msgr2=0x55d63b529530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f958f7fe640 0 client.16758 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 -- 172.21.15.37:0/3353056359 shutdown_connections 2024-08-31T06:51:54.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 1 -- 172.21.15.37:0/3353056359 wait complete. 2024-08-31T06:51:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.338+0000 7f95bcb70740 20 client.16758 trim_cache size 0 max 16384 2024-08-31T06:51:54.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.351+0000 7f95bcb70740 1 Processor -- start 2024-08-31T06:51:54.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.351+0000 7f95bcb70740 1 -- start start 2024-08-31T06:51:54.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b524400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b529b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b53dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95bcb70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95b01b1ca0 con 0x55d63b181070 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95bcb70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f95b01af570 con 0x55d63b1581b0 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95bcb70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f95b01ad3c0 con 0x55d63b160390 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b53dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b53dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53930/0 (socket says 172.21.15.37:53930) 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 -- 172.21.15.37:0/410304123 learned_addr learned my addr 172.21.15.37:0/410304123 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95af7fe640 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b529b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95affff640 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b524400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 -- 172.21.15.37:0/410304123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 msgr2=0x55d63b529b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b529b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 -- 172.21.15.37:0/410304123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 msgr2=0x55d63b524400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b524400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 -- 172.21.15.37:0/410304123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d63b52a0a0 con 0x55d63b181070 2024-08-31T06:51:54.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f95b4b98640 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b53dd20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f95a801e760 tx=0x7f95a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b8607896aa45b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:54.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.352+0000 7f9595ffb640 1 -- 172.21.15.37:0/410304123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8011600 con 0x55d63b181070 2024-08-31T06:51:54.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f9595ffb640 1 -- 172.21.15.37:0/410304123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a8011c30 con 0x55d63b181070 2024-08-31T06:51:54.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f9595ffb640 1 -- 172.21.15.37:0/410304123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a801ccf0 con 0x55d63b181070 2024-08-31T06:51:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 -- 172.21.15.37:0/410304123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 msgr2=0x55d63b53dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b53dd20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f95a801e760 tx=0x7f95a8019000 comp rx=0 tx=0).stop 2024-08-31T06:51:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 -- 172.21.15.37:0/410304123 shutdown_connections 2024-08-31T06:51:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b53dd20 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b160390 0x55d63b529b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 --2- 172.21.15.37:0/410304123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b1581b0 0x55d63b524400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 -- 172.21.15.37:0/410304123 >> 172.21.15.37:0/410304123 conn(0x55d63b175460 msgr2=0x55d63b529450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 -- 172.21.15.37:0/410304123 shutdown_connections 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.353+0000 7f95bcb70740 1 -- 172.21.15.37:0/410304123 wait complete. 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 1 -- start start 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 1 Processor -- start 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 0x55d63b53a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b160390 0x55d63b535bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b536300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f95b01ada30 con 0x55d63b181070 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f95b01aeea0 con 0x55d63b160390 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f95b01ae100 con 0x55d63b1581b0 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95bcb70740 10 client.0 _ll_register_callbacks cb 0x7f95a4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.354+0000 7f95b4b98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b536300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95b4b98640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b536300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53932/0 (socket says 172.21.15.37:53932) 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95b4b98640 1 -- 172.21.15.37:0/1172858720 learned_addr learned my addr 172.21.15.37:0/1172858720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95af7fe640 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b160390 0x55d63b535bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95affff640 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 0x55d63b53a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95b4b98640 1 -- 172.21.15.37:0/1172858720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 msgr2=0x55d63b53a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95b4b98640 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 0x55d63b53a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95b4b98640 1 -- 172.21.15.37:0/1172858720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b160390 msgr2=0x55d63b535bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95b4b98640 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b160390 0x55d63b535bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95b4b98640 1 -- 172.21.15.37:0/1172858720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d63b5ad7f0 con 0x55d63b181070 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95b4b98640 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b536300 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f95a801e730 tx=0x7f95a8011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca96fdc153827d15 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f958f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f958f7fe640 1 -- 172.21.15.37:0/1172858720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8036060 con 0x55d63b181070 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95bcb70740 1 -- 172.21.15.37:0/1172858720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95a8011c30 con 0x55d63b181070 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f958f7fe640 1 -- 172.21.15.37:0/1172858720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f95a801c8f0 con 0x55d63b181070 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f958f7fe640 1 -- 172.21.15.37:0/1172858720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95a8011a90 con 0x55d63b181070 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95bcb70740 10 client.16764 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.355+0000 7f95bcb70740 1 -- 172.21.15.37:0/1172858720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d63b5ae910 con 0x55d63b181070 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f958f7fe640 1 -- 172.21.15.37:0/1172858720 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a8011c30 con 0x55d63b181070 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f958f7fe640 1 -- 172.21.15.37:0/1172858720 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95a8029ca0 con 0x55d63b181070 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f95bcb70740 10 client.16764 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f95bcb70740 10 client.16764 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f95bcb70740 20 client.16764 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55d63b114da0 0x55d63b5b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f95bcb70740 4 client.16764 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f95bcb70740 1 -- 172.21.15.37:0/1172858720 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d63b49b070 con 0x55d63b114da0 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.356+0000 7f95affff640 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55d63b114da0 0x55d63b5b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95affff640 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55d63b114da0 0x55d63b5b1010 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ef4f240eac703d9 server_cookie=8914b27bb753225a in_seq=0 out_seq=0 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f958f7fe640 10 client.16764 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f958f7fe640 1 -- 172.21.15.37:0/1172858720 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d63b49b070 con 0x55d63b114da0 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f958f7fe640 10 client.16764 handle_command_reply: tid=0 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 client.16764 shutdown 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 -- 172.21.15.37:0/1172858720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 msgr2=0x55d63b536300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b536300 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f95a801e730 tx=0x7f95a8011de0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 -- 172.21.15.37:0/1172858720 shutdown_connections 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d63b181070 0x55d63b536300 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55d63b114da0 0x55d63b5b1010 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d63b160390 0x55d63b535bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 --2- 172.21.15.37:0/1172858720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d63b1581b0 0x55d63b53a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 -- 172.21.15.37:0/1172858720 >> 172.21.15.37:0/1172858720 conn(0x55d63b175460 msgr2=0x55d63b527380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f958f7fe640 0 client.16764 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:51:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 -- 172.21.15.37:0/1172858720 shutdown_connections 2024-08-31T06:51:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 1 -- 172.21.15.37:0/1172858720 wait complete. 2024-08-31T06:51:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.357+0000 7f95bcb70740 20 client.16764 trim_cache size 0 max 16384 2024-08-31T06:51:54.363 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 -- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95980b4ca0 msgr2=0x7f95980b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95980b4ca0 0x7f95980b71b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f95a8005f40 tx=0x7f95a80096a0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 -- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0102820 msgr2=0x7f95b019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0102820 0x7f95b019a190 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f95a000e9f0 tx=0x7f95a000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 -- 172.21.15.37:0/1831963360 shutdown_connections 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f95980b4ca0 0x7f95980b71b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95b0108ab0 0x7f95b019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b0108160 0x7f95b019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 --2- 172.21.15.37:0/1831963360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95b0102820 0x7f95b019a190 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:54.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 -- 172.21.15.37:0/1831963360 >> 172.21.15.37:0/1831963360 conn(0x7f95b00794e0 msgr2=0x7f95b006bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 -- 172.21.15.37:0/1831963360 shutdown_connections 2024-08-31T06:51:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:54.358+0000 7f95b65fb640 1 -- 172.21.15.37:0/1831963360 wait complete. 2024-08-31T06:51:54.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:54 smithi066 ceph-mon[22244]: pgmap v471: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:51:54.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:54 smithi106 ceph-mon[22134]: pgmap v471: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:51:55.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:51:55.459 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 -- 172.21.15.37:0/3614731430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 msgr2=0x7fa25c10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3614731430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 0x7fa25c10f2c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa254009ca0 tx=0x7fa25402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 -- 172.21.15.37:0/3614731430 shutdown_connections 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3614731430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 0x7fa25c10f2c0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3614731430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa25c108140 0x7fa25c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3614731430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa25c102800 0x7fa25c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 -- 172.21.15.37:0/3614731430 >> 172.21.15.37:0/3614731430 conn(0x7fa25c0794d0 msgr2=0x7fa25c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 -- 172.21.15.37:0/3614731430 shutdown_connections 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.908+0000 7fa2626f0640 1 -- 172.21.15.37:0/3614731430 wait complete. 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa2626f0640 1 Processor -- start 2024-08-31T06:51:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa2626f0640 1 -- start start 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa2626f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa25c102800 0x7fa25c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa2626f0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa25c108140 0x7fa25c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa2626f0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 0x7fa25c19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa2626f0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c113700 con 0x7fa25c108a90 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa2626f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c113580 con 0x7fa25c102800 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa2626f0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c113880 con 0x7fa25c108140 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa260c8d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 0x7fa25c19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa260c8d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 0x7fa25c19f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53964/0 (socket says 172.21.15.37:53964) 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa260c8d640 1 -- 172.21.15.37:0/3750364005 learned_addr learned my addr 172.21.15.37:0/3750364005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa25c102800 0x7fa25c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa253fff640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa25c108140 0x7fa25c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa260c8d640 1 -- 172.21.15.37:0/3750364005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa25c108140 msgr2=0x7fa25c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa260c8d640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa25c108140 0x7fa25c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa260c8d640 1 -- 172.21.15.37:0/3750364005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa25c102800 msgr2=0x7fa25c19a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa260c8d640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa25c102800 0x7fa25c19a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.909+0000 7fa260c8d640 1 -- 172.21.15.37:0/3750364005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c19ff60 con 0x7fa25c108a90 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.910+0000 7fa253fff640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa25c108140 0x7fa25c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.910+0000 7fa260c8d640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 0x7fa25c19f8f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa254005cc0 tx=0x7fa254032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.910+0000 7fa259ffb640 1 -- 172.21.15.37:0/3750364005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254004040 con 0x7fa25c108a90 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.910+0000 7fa2626f0640 1 -- 172.21.15.37:0/3750364005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c1a01f0 con 0x7fa25c108a90 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.910+0000 7fa259ffb640 1 -- 172.21.15.37:0/3750364005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa254004670 con 0x7fa25c108a90 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.910+0000 7fa2626f0640 1 -- 172.21.15.37:0/3750364005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c1a6a70 con 0x7fa25c108a90 2024-08-31T06:51:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.910+0000 7fa259ffb640 1 -- 172.21.15.37:0/3750364005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254030cc0 con 0x7fa25c108a90 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.912+0000 7fa268c65740 1 Processor -- start 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa259ffb640 1 -- 172.21.15.37:0/3750364005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa2540041e0 con 0x7fa25c108a90 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa268c65740 1 -- start start 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa268c65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13a8a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa268c65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136bc1b0 0x562b13a8a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa268c65740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 0x562b13a8ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa268c65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b13a01680 con 0x562b136bc1b0 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa268c65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562b139f0c10 con 0x562b136e5070 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa268c65740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x562b139f4bc0 con 0x562b136c4390 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136bc1b0 0x562b13a8a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136bc1b0 0x562b13a8a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53980/0 (socket says 172.21.15.37:53980) 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa25bfff640 1 -- 172.21.15.37:0/3460697171 learned_addr learned my addr 172.21.15.37:0/3460697171 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa253fff640 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 0x562b13a8ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa253fff640 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13a8a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa25bfff640 1 -- 172.21.15.37:0/3460697171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 msgr2=0x562b13a8ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 0x562b13a8ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa259ffb640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2480b4cd0 0x7fa2480b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa25bfff640 1 -- 172.21.15.37:0/3460697171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 msgr2=0x562b13a8a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13a8a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa25bfff640 1 -- 172.21.15.37:0/3460697171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b13750650 con 0x562b136bc1b0 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.913+0000 7fa253fff640 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13a8a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.914+0000 7fa260c8d640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2480b4cd0 0x7fa2480b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.914+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136bc1b0 0x562b13a8a850 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00ac10 tx=0x7fa24c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b854e966bf1f99 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.914+0000 7fa259ffb640 1 -- 172.21.15.37:0/3750364005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa254106b50 con 0x7fa25c108a90 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.914+0000 7fa2527fc640 1 -- 172.21.15.37:0/3460697171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c01d070 con 0x562b136bc1b0 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.914+0000 7fa2527fc640 1 -- 172.21.15.37:0/3460697171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa24c018ad0 con 0x562b136bc1b0 2024-08-31T06:51:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.914+0000 7fa2527fc640 1 -- 172.21.15.37:0/3460697171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c010960 con 0x562b136bc1b0 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 -- 172.21.15.37:0/3460697171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136bc1b0 msgr2=0x562b13a8a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136bc1b0 0x562b13a8a850 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00ac10 tx=0x7fa24c00f790 comp rx=0 tx=0).stop 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa260c8d640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2480b4cd0 0x7fa2480b71e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa254104390 tx=0x7fa25409a830 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 -- 172.21.15.37:0/3460697171 shutdown_connections 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136bc1b0 0x562b13a8a850 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 0x562b13a8ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 --2- 172.21.15.37:0/3460697171 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13a8a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 -- 172.21.15.37:0/3460697171 >> 172.21.15.37:0/3460697171 conn(0x562b136d9460 msgr2=0x562b13a88200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 -- 172.21.15.37:0/3460697171 shutdown_connections 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 -- 172.21.15.37:0/3460697171 wait complete. 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 -- start start 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.915+0000 7fa268c65740 1 Processor -- start 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa268c65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 0x562b13a95ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa268c65740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 0x562b13a96010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa268c65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136e5070 0x562b13aa1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa268c65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562b13853700 con 0x562b136e5070 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa268c65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x562b13977750 con 0x562b136bc1b0 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa268c65740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x562b13a98af0 con 0x562b136c4390 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa268c65740 10 client.0 _ll_register_callbacks cb 0x562b139a6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136e5070 0x562b13aa1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136e5070 0x562b13aa1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53992/0 (socket says 172.21.15.37:53992) 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 -- 172.21.15.37:0/3390479755 learned_addr learned my addr 172.21.15.37:0/3390479755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 0x562b13a95ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 0x562b13a96010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 -- 172.21.15.37:0/3390479755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 msgr2=0x562b13a96010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 0x562b13a96010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 -- 172.21.15.37:0/3390479755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 msgr2=0x562b13a95ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 0x562b13a95ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.916+0000 7fa253fff640 1 -- 172.21.15.37:0/3390479755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b139b0900 con 0x562b136e5070 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa253fff640 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136e5070 0x562b13aa1de0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa24400bfd0 tx=0x7fa2440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95425c9f9a96c940 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa23b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3390479755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244004460 con 0x562b136e5070 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3390479755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa2440035f0 con 0x562b136e5070 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa268c65740 1 -- 172.21.15.37:0/3390479755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa24c018ad0 con 0x562b136e5070 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3390479755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa244026050 con 0x562b136e5070 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa268c65740 10 client.16776 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa268c65740 1 -- 172.21.15.37:0/3390479755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b13aa48d0 con 0x562b136e5070 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3390479755 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa24c018ad0 con 0x562b136e5070 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.917+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3390479755 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa2440215b0 con 0x562b136e5070 2024-08-31T06:51:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa268c65740 10 client.16776 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa268c65740 10 client.16776 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:51:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa268c65740 20 client.16776 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa268c65740 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x562b136a39f0 0x562b13aa7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa268c65740 4 client.16776 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa268c65740 1 -- 172.21.15.37:0/3390479755 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b13a035d0 con 0x562b136a39f0 2024-08-31T06:51:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x562b136a39f0 0x562b13aa7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x562b136a39f0 0x562b13aa7de0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a25352178f2d2d6 server_cookie=c0790b3f93c214c6 in_seq=0 out_seq=0 2024-08-31T06:51:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.918+0000 7fa23b7fe640 10 client.16776 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3390479755 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b13a035d0 con 0x562b136a39f0 2024-08-31T06:51:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa23b7fe640 10 client.16776 handle_command_reply: tid=0 2024-08-31T06:51:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 client.16776 shutdown 2024-08-31T06:51:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 -- 172.21.15.37:0/3390479755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136e5070 msgr2=0x562b13aa1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136e5070 0x562b13aa1de0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fa24400bfd0 tx=0x7fa2440046c0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 -- 172.21.15.37:0/3390479755 shutdown_connections 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x562b136a39f0 0x562b13aa7de0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136e5070 0x562b13aa1de0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136c4390 0x562b13a96010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 --2- 172.21.15.37:0/3390479755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 0x562b13a95ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 -- 172.21.15.37:0/3390479755 >> 172.21.15.37:0/3390479755 conn(0x562b136d9460 msgr2=0x562b13a8d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa23b7fe640 0 client.16776 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.919+0000 7fa268c65740 1 -- 172.21.15.37:0/3390479755 shutdown_connections 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.920+0000 7fa268c65740 1 -- 172.21.15.37:0/3390479755 wait complete. 2024-08-31T06:51:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.920+0000 7fa268c65740 20 client.16776 trim_cache size 0 max 16384 2024-08-31T06:51:55.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.933+0000 7fa268c65740 1 Processor -- start 2024-08-31T06:51:55.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.933+0000 7fa268c65740 1 -- start start 2024-08-31T06:51:55.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.933+0000 7fa268c65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 0x562b13a96150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.933+0000 7fa268c65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a8d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.933+0000 7fa268c65740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136e5070 0x562b13a8d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.933+0000 7fa268c65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1b1b40 con 0x562b136c4390 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.933+0000 7fa268c65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1af410 con 0x562b136bc1b0 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.933+0000 7fa268c65740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1ad260 con 0x562b136e5070 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a8d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a8d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53998/0 (socket says 172.21.15.37:53998) 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 -- 172.21.15.37:0/871226291 learned_addr learned my addr 172.21.15.37:0/871226291 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa253fff640 1 --2- 172.21.15.37:0/871226291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 0x562b13a96150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 -- 172.21.15.37:0/871226291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136e5070 msgr2=0x562b13a8d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 --2- 172.21.15.37:0/871226291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136e5070 0x562b13a8d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 -- 172.21.15.37:0/871226291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 msgr2=0x562b13a96150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 --2- 172.21.15.37:0/871226291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 0x562b13a96150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 -- 172.21.15.37:0/871226291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b13a96d90 con 0x562b136c4390 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa25bfff640 1 --2- 172.21.15.37:0/871226291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a8d410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x562b13a88f90 tx=0x7fa24c010540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62dad4f48e8ff4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa251ffb640 1 -- 172.21.15.37:0/871226291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c031070 con 0x562b136c4390 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa251ffb640 1 -- 172.21.15.37:0/871226291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa24c01e040 con 0x562b136c4390 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.934+0000 7fa251ffb640 1 -- 172.21.15.37:0/871226291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c01d040 con 0x562b136c4390 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 -- 172.21.15.37:0/871226291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 msgr2=0x562b13a8d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 --2- 172.21.15.37:0/871226291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a8d410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x562b13a88f90 tx=0x7fa24c010540 comp rx=0 tx=0).stop 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 -- 172.21.15.37:0/871226291 shutdown_connections 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 --2- 172.21.15.37:0/871226291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a8d410 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 --2- 172.21.15.37:0/871226291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136e5070 0x562b13a8d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 --2- 172.21.15.37:0/871226291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136bc1b0 0x562b13a96150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 -- 172.21.15.37:0/871226291 >> 172.21.15.37:0/871226291 conn(0x562b136d9460 msgr2=0x562b13a95a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:55.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 -- 172.21.15.37:0/871226291 shutdown_connections 2024-08-31T06:51:55.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.935+0000 7fa268c65740 1 -- 172.21.15.37:0/871226291 wait complete. 2024-08-31T06:51:55.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 1 -- start start 2024-08-31T06:51:55.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 1 Processor -- start 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136bc1b0 0x562b13a99fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a9a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13b117a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1ad8d0 con 0x562b136c4390 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1aed40 con 0x562b136e5070 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1adfa0 con 0x562b136bc1b0 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa268c65740 10 client.0 _ll_register_callbacks cb 0x7fa24400be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a9a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a9a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54002/0 (socket says 172.21.15.37:54002) 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa25bfff640 1 -- 172.21.15.37:0/3779110705 learned_addr learned my addr 172.21.15.37:0/3779110705 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa253fff640 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136bc1b0 0x562b13a99fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.936+0000 7fa253fff640 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13b117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa25bfff640 1 -- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136bc1b0 msgr2=0x562b13a99fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136bc1b0 0x562b13a99fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa25bfff640 1 -- 172.21.15.37:0/3779110705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 msgr2=0x562b13b117a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13b117a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa25bfff640 1 -- 172.21.15.37:0/3779110705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b13a9adb0 con 0x562b136c4390 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa253fff640 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136bc1b0 0x562b13a99fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa25bfff640 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a9a510 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa24c02f040 tx=0x7fa24c00fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61841d2b4b1f1bb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa23b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3779110705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c031030 con 0x562b136c4390 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3779110705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fa24c018760 con 0x562b136c4390 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa268c65740 1 -- 172.21.15.37:0/3779110705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa24c01e040 con 0x562b136c4390 2024-08-31T06:51:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3779110705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa24c00a7f0 con 0x562b136c4390 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa268c65740 10 client.16782 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa268c65740 1 -- 172.21.15.37:0/3779110705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b13b12cd0 con 0x562b136c4390 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3779110705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa24c01e040 con 0x562b136c4390 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.937+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3779110705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa24c02c040 con 0x562b136c4390 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa268c65740 10 client.16782 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa268c65740 10 client.16782 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa268c65740 20 client.16782 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa268c65740 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x562b13678da0 0x562b13b15210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa268c65740 4 client.16782 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa268c65740 1 -- 172.21.15.37:0/3779110705 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562b139ff070 con 0x562b13678da0 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa253fff640 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x562b13678da0 0x562b13b15210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa253fff640 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x562b13678da0 0x562b13b15210 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d57d54f8d8b96674 server_cookie=c9930c7583e519b8 in_seq=0 out_seq=0 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.938+0000 7fa23b7fe640 10 client.16782 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa23b7fe640 1 -- 172.21.15.37:0/3779110705 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562b139ff070 con 0x562b13678da0 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa23b7fe640 10 client.16782 handle_command_reply: tid=0 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 client.16782 shutdown 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 -- 172.21.15.37:0/3779110705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 msgr2=0x562b13a9a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a9a510 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa24c02f040 tx=0x7fa24c00fd40 comp rx=0 tx=0).stop 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 -- 172.21.15.37:0/3779110705 shutdown_connections 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x562b13678da0 0x562b13b15210 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562b136c4390 0x562b13a9a510 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x562b136e5070 0x562b13b117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 --2- 172.21.15.37:0/3779110705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b136bc1b0 0x562b13a99fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 -- 172.21.15.37:0/3779110705 >> 172.21.15.37:0/3779110705 conn(0x562b136d9460 msgr2=0x562b13a8d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa23b7fe640 0 client.16782 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 -- 172.21.15.37:0/3779110705 shutdown_connections 2024-08-31T06:51:55.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 1 -- 172.21.15.37:0/3779110705 wait complete. 2024-08-31T06:51:55.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.939+0000 7fa268c65740 20 client.16782 trim_cache size 0 max 16384 2024-08-31T06:51:55.945 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:55.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 -- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2480b4cd0 msgr2=0x7fa2480b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2480b4cd0 0x7fa2480b71e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa254104390 tx=0x7fa25409a830 comp rx=0 tx=0).stop 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 -- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 msgr2=0x7fa25c19f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 0x7fa25c19f8f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fa254005cc0 tx=0x7fa254032c40 comp rx=0 tx=0).stop 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 -- 172.21.15.37:0/3750364005 shutdown_connections 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2480b4cd0 0x7fa2480b71e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa25c108a90 0x7fa25c19f8f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa25c108140 0x7fa25c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 --2- 172.21.15.37:0/3750364005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa25c102800 0x7fa25c19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 -- 172.21.15.37:0/3750364005 >> 172.21.15.37:0/3750364005 conn(0x7fa25c0794d0 msgr2=0x7fa25c104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 -- 172.21.15.37:0/3750364005 shutdown_connections 2024-08-31T06:51:55.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:55.940+0000 7fa2626f0640 1 -- 172.21.15.37:0/3750364005 wait complete. 2024-08-31T06:51:56.313 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:56 smithi037 ceph-mon[18612]: pgmap v472: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:56.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:56 smithi066 ceph-mon[22244]: pgmap v472: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:56.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:56 smithi106 ceph-mon[22134]: pgmap v472: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:51:56.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:51:57.109 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:51:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 -- 172.21.15.37:0/2005232011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 msgr2=0x7f0a08102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 --2- 172.21.15.37:0/2005232011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 0x7f0a08102c30 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009900 tx=0x7f09f802a410 comp rx=0 tx=0).stop 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 -- 172.21.15.37:0/2005232011 shutdown_connections 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 --2- 172.21.15.37:0/2005232011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a08108ab0 0x7f0a0810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 --2- 172.21.15.37:0/2005232011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a08108160 0x7f0a08108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 --2- 172.21.15.37:0/2005232011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 0x7f0a08102c30 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 -- 172.21.15.37:0/2005232011 >> 172.21.15.37:0/2005232011 conn(0x7f0a080794e0 msgr2=0x7f0a080798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 -- 172.21.15.37:0/2005232011 shutdown_connections 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.601+0000 7f0a0d606640 1 -- 172.21.15.37:0/2005232011 wait complete. 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.602+0000 7f0a0d606640 1 Processor -- start 2024-08-31T06:51:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.602+0000 7f0a0d606640 1 -- start start 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.602+0000 7f0a0d606640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 0x7f0a0819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.602+0000 7f0a0d606640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a08108160 0x7f0a0819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a0d606640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a08108ab0 0x7f0a0819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a0d606640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a081126b0 con 0x7f0a08102820 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a0d606640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0a08112530 con 0x7f0a08108160 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a0d606640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0a08112830 con 0x7f0a08108ab0 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 0x7f0a0819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 0x7f0a0819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54018/0 (socket says 172.21.15.37:54018) 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 -- 172.21.15.37:0/3595564307 learned_addr learned my addr 172.21.15.37:0/3595564307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a077fe640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a08108ab0 0x7f0a0819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a067fc640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a08108160 0x7f0a0819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 -- 172.21.15.37:0/3595564307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a08108ab0 msgr2=0x7f0a0819faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a08108ab0 0x7f0a0819faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 -- 172.21.15.37:0/3595564307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a08108160 msgr2=0x7f0a0819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a08108160 0x7f0a0819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 -- 172.21.15.37:0/3595564307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a081a0220 con 0x7f0a08102820 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a067fc640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a08108160 0x7f0a0819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f0a06ffd640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 0x7f0a0819a2b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009a20 tx=0x7f09f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.603+0000 7f09fffff640 1 -- 172.21.15.37:0/3595564307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f803f030 con 0x7f0a08102820 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.604+0000 7f0a0d606640 1 -- 172.21.15.37:0/3595564307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a081a04b0 con 0x7f0a08102820 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.604+0000 7f0a0d606640 1 -- 172.21.15.37:0/3595564307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a081a6c70 con 0x7f0a08102820 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.604+0000 7f09fffff640 1 -- 172.21.15.37:0/3595564307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09f80035f0 con 0x7f0a08102820 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.604+0000 7f09fffff640 1 -- 172.21.15.37:0/3595564307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8035070 con 0x7f0a08102820 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.606+0000 7f0a13b7b740 1 Processor -- start 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.606+0000 7f0a13b7b740 1 -- start start 2024-08-31T06:51:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb78c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb78c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f09fffff640 1 -- 172.21.15.37:0/3595564307 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f09f8003aa0 con 0x7f0a08102820 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb78cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598eb703680 con 0x5598eb3e7070 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5598eb6f2c10 con 0x5598eb3be1b0 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5598eb6f6bc0 con 0x5598eb3c6390 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb78c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb78c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54026/0 (socket says 172.21.15.37:54026) 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 -- 172.21.15.37:0/2624349108 learned_addr learned my addr 172.21.15.37:0/2624349108 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a06ffd640 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb78c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a067fc640 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb78cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 -- 172.21.15.37:0/2624349108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 msgr2=0x5598eb78cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb78cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 -- 172.21.15.37:0/2624349108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 msgr2=0x5598eb78c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb78c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 -- 172.21.15.37:0/2624349108 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598eb452650 con 0x5598eb3e7070 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.607+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb78c310 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000a430 tx=0x7f0a00009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6baa832b6092e4f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.608+0000 7f09fd7fa640 1 -- 172.21.15.37:0/2624349108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00013790 con 0x5598eb3e7070 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.608+0000 7f09fffff640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09f40b4ca0 0x7f09f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.608+0000 7f09fd7fa640 1 -- 172.21.15.37:0/2624349108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a00019070 con 0x5598eb3e7070 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.608+0000 7f09fd7fa640 1 -- 172.21.15.37:0/2624349108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00014c20 con 0x5598eb3e7070 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.608+0000 7f0a06ffd640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09f40b4ca0 0x7f09f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.608+0000 7f09fffff640 1 -- 172.21.15.37:0/3595564307 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f09f8105ed0 con 0x7f0a08102820 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2624349108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 msgr2=0x5598eb78c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a06ffd640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09f40b4ca0 0x7f09f40b71b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f09f8103710 tx=0x7f09f802a410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb78c310 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000a430 tx=0x7f0a00009650 comp rx=0 tx=0).stop 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2624349108 shutdown_connections 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb78cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb78c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2624349108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb78c310 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2624349108 >> 172.21.15.37:0/2624349108 conn(0x5598eb3db460 msgr2=0x5598eb78a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2624349108 shutdown_connections 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2624349108 wait complete. 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 -- start start 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.609+0000 7f0a13b7b740 1 Processor -- start 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb79be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3c6390 0x5598eb79c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3e7070 0x5598eb7a8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598eb555700 con 0x5598eb3c6390 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5598eb679750 con 0x5598eb3be1b0 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5598eb79ee50 con 0x5598eb3e7070 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a13b7b740 10 client.0 _ll_register_callbacks cb 0x5598eb6a8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3c6390 0x5598eb79c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3c6390 0x5598eb79c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54032/0 (socket says 172.21.15.37:54032) 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 -- 172.21.15.37:0/2079855571 learned_addr learned my addr 172.21.15.37:0/2079855571 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb79be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3e7070 0x5598eb7a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 -- 172.21.15.37:0/2079855571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3e7070 msgr2=0x5598eb7a8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3e7070 0x5598eb7a8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 -- 172.21.15.37:0/2079855571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 msgr2=0x5598eb79be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb79be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 -- 172.21.15.37:0/2079855571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598eb6b2900 con 0x5598eb3c6390 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3e7070 0x5598eb7a8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a067fc640 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3c6390 0x5598eb79c3a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f09f000e1f0 tx=0x7f09f000e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963687bdd33bdc8c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f09ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f09ee7fc640 1 -- 172.21.15.37:0/2079855571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f0017020 con 0x5598eb3c6390 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2079855571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a00019070 con 0x5598eb3c6390 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.610+0000 7f09ee7fc640 1 -- 172.21.15.37:0/2079855571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f09f0013610 con 0x5598eb3c6390 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f09ee7fc640 1 -- 172.21.15.37:0/2079855571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f09f0022050 con 0x5598eb3c6390 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a13b7b740 10 client.16794 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2079855571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5598eb7aacb0 con 0x5598eb3c6390 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f09ee7fc640 1 -- 172.21.15.37:0/2079855571 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a00019070 con 0x5598eb3c6390 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f09ee7fc640 1 -- 172.21.15.37:0/2079855571 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f09f0012050 con 0x5598eb3c6390 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a13b7b740 10 client.16794 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a13b7b740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a13b7b740 20 client.16794 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5598eb3a59f0 0x5598eb7ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a13b7b740 4 client.16794 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2079855571 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598eb7055d0 con 0x5598eb3a59f0 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.611+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5598eb3a59f0 0x5598eb7ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.612+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5598eb3a59f0 0x5598eb7ae140 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa2df259344e547a server_cookie=c91fdb75f08630e7 in_seq=0 out_seq=0 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.612+0000 7f09ee7fc640 10 client.16794 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f09ee7fc640 1 -- 172.21.15.37:0/2079855571 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5598eb7055d0 con 0x5598eb3a59f0 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f09ee7fc640 10 client.16794 handle_command_reply: tid=0 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 client.16794 shutdown 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2079855571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3c6390 msgr2=0x5598eb79c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3c6390 0x5598eb79c3a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f09f000e1f0 tx=0x7f09f000e6b0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2079855571 shutdown_connections 2024-08-31T06:51:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5598eb3a59f0 0x5598eb7ae140 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3c6390 0x5598eb79c3a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3e7070 0x5598eb7a8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2079855571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb79be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f09ee7fc640 0 client.16794 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2079855571 >> 172.21.15.37:0/2079855571 conn(0x5598eb3db460 msgr2=0x5598eb7887c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2079855571 shutdown_connections 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2079855571 wait complete. 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.613+0000 7f0a13b7b740 20 client.16794 trim_cache size 0 max 16384 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.626+0000 7f0a13b7b740 1 Processor -- start 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a13b7b740 1 -- start start 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb791bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb799050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb799590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a081afac0 con 0x5598eb3e7070 2024-08-31T06:51:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0a081ad390 con 0x5598eb3be1b0 2024-08-31T06:51:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0a081ab200 con 0x5598eb3c6390 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb799590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb799590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54034/0 (socket says 172.21.15.37:54034) 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 -- 172.21.15.37:0/2242277684 learned_addr learned my addr 172.21.15.37:0/2242277684 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb791bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a067fc640 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb799050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 -- 172.21.15.37:0/2242277684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 msgr2=0x5598eb799050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb799050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 -- 172.21.15.37:0/2242277684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 msgr2=0x5598eb791bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb791bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.627+0000 7f0a077fe640 1 -- 172.21.15.37:0/2242277684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598eb79cf00 con 0x5598eb3e7070 2024-08-31T06:51:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.628+0000 7f0a077fe640 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb799590 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000a400 tx=0x7f0a00014800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d41f989b7ce618 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.628+0000 7f09fcff9640 1 -- 172.21.15.37:0/2242277684 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00013790 con 0x5598eb3e7070 2024-08-31T06:51:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.628+0000 7f09fcff9640 1 -- 172.21.15.37:0/2242277684 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a00019070 con 0x5598eb3e7070 2024-08-31T06:51:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.628+0000 7f09fcff9640 1 -- 172.21.15.37:0/2242277684 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0001f8b0 con 0x5598eb3e7070 2024-08-31T06:51:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2242277684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 msgr2=0x5598eb799590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb799590 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000a400 tx=0x7f0a00014800 comp rx=0 tx=0).stop 2024-08-31T06:51:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2242277684 shutdown_connections 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb799590 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb799050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/2242277684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb791bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2242277684 >> 172.21.15.37:0/2242277684 conn(0x5598eb3db460 msgr2=0x5598eb7914b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2242277684 shutdown_connections 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 -- 172.21.15.37:0/2242277684 wait complete. 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 -- start start 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.629+0000 7f0a13b7b740 1 Processor -- start 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb7a0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb7a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a13b7b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb817b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a081ab850 con 0x5598eb3e7070 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0a081accc0 con 0x5598eb3be1b0 2024-08-31T06:51:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a13b7b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0a081abf20 con 0x5598eb3c6390 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a13b7b740 10 client.0 _ll_register_callbacks cb 0x7f09f0009180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb817b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb817b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54044/0 (socket says 172.21.15.37:54044) 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 -- 172.21.15.37:0/1149919666 learned_addr learned my addr 172.21.15.37:0/1149919666 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a067fc640 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb7a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb7a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 -- 172.21.15.37:0/1149919666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 msgr2=0x5598eb7a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb7a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 -- 172.21.15.37:0/1149919666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 msgr2=0x5598eb7a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb7a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.630+0000 7f0a077fe640 1 -- 172.21.15.37:0/1149919666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598eb818080 con 0x5598eb3e7070 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f09ee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:51:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f0a077fe640 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb817b40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0a000149f0 tx=0x7f0a00022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c403afc20c046da1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f09ee7fc640 1 -- 172.21.15.37:0/1149919666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0001f650 con 0x5598eb3e7070 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f09ee7fc640 1 -- 172.21.15.37:0/1149919666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0a0001f7f0 con 0x5598eb3e7070 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f0a13b7b740 1 -- 172.21.15.37:0/1149919666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a00019070 con 0x5598eb3e7070 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f09ee7fc640 1 -- 172.21.15.37:0/1149919666 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a0001f9f0 con 0x5598eb3e7070 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f0a13b7b740 10 client.16800 fetch_fsmap learned FSMap version 25 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f0a13b7b740 1 -- 172.21.15.37:0/1149919666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5598eb8192e0 con 0x5598eb3e7070 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.631+0000 7f09ee7fc640 1 -- 172.21.15.37:0/1149919666 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0a00019070 con 0x5598eb3e7070 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f09ee7fc640 1 -- 172.21.15.37:0/1149919666 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a00013a90 con 0x5598eb3e7070 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f0a13b7b740 10 client.16800 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f0a13b7b740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f0a13b7b740 20 client.16800 populate_metadata read hostname 'smithi037' 2024-08-31T06:51:57.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5598eb37ada0 0x5598eb81b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f0a13b7b740 4 client.16800 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f0a13b7b740 1 -- 172.21.15.37:0/1149919666 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598eb701070 con 0x5598eb37ada0 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f0a067fc640 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5598eb37ada0 0x5598eb81b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f09ee7fc640 10 client.16800 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.632+0000 7f0a067fc640 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5598eb37ada0 0x5598eb81b850 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a87bba9c8444c0c0 server_cookie=405d2f01c9fea38d in_seq=0 out_seq=0 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f09ee7fc640 1 -- 172.21.15.37:0/1149919666 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598eb701070 con 0x5598eb37ada0 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f09ee7fc640 10 client.16800 handle_command_reply: tid=0 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 client.16800 shutdown 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 -- 172.21.15.37:0/1149919666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 msgr2=0x5598eb817b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb817b40 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0a000149f0 tx=0x7f0a00022040 comp rx=0 tx=0).stop 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 -- 172.21.15.37:0/1149919666 shutdown_connections 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5598eb37ada0 0x5598eb81b850 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598eb3e7070 0x5598eb817b40 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5598eb3c6390 0x5598eb7a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 --2- 172.21.15.37:0/1149919666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5598eb3be1b0 0x5598eb7a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f09ee7fc640 0 client.16800 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:51:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 -- 172.21.15.37:0/1149919666 >> 172.21.15.37:0/1149919666 conn(0x5598eb3db460 msgr2=0x5598eb78d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 -- 172.21.15.37:0/1149919666 shutdown_connections 2024-08-31T06:51:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 1 -- 172.21.15.37:0/1149919666 wait complete. 2024-08-31T06:51:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.633+0000 7f0a13b7b740 20 client.16800 trim_cache size 0 max 16384 2024-08-31T06:51:57.648 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 -- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09f40b4ca0 msgr2=0x7f09f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09f40b4ca0 0x7f09f40b71b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f09f8103710 tx=0x7f09f802a410 comp rx=0 tx=0).stop 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 -- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 msgr2=0x7f0a0819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 0x7f0a0819a2b0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009a20 tx=0x7f09f8004270 comp rx=0 tx=0).stop 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 -- 172.21.15.37:0/3595564307 shutdown_connections 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f09f40b4ca0 0x7f09f40b71b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a08108ab0 0x7f0a0819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a08108160 0x7f0a0819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 --2- 172.21.15.37:0/3595564307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a08102820 0x7f0a0819a2b0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 -- 172.21.15.37:0/3595564307 >> 172.21.15.37:0/3595564307 conn(0x7f0a080794e0 msgr2=0x7f0a08101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:51:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 -- 172.21.15.37:0/3595564307 shutdown_connections 2024-08-31T06:51:57.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:51:57.634+0000 7f0a0d606640 1 -- 172.21.15.37:0/3595564307 wait complete. 2024-08-31T06:51:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:58 smithi066 ceph-mon[22244]: pgmap v473: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:58 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:51:58.398 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:58 smithi037 ceph-mon[18612]: pgmap v473: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:58.398 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:58 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:51:58.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:58 smithi106 ceph-mon[22134]: pgmap v473: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:51:58.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:58 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:51:59.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:51:59.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:51:59.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:51:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:51:59.426 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:51:59.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:51:59.453 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:51:59.453 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:51:59.453 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:51:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:51:59.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:51:59.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:51:59.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:51:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:51:59.691 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:00.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.162+0000 7f30169bb640 1 -- 172.21.15.37:0/391154863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3010075e20 msgr2=0x7f301010f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.162+0000 7f30169bb640 1 --2- 172.21.15.37:0/391154863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3010075e20 0x7f301010f9a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3004009900 tx=0x7f300402a410 comp rx=0 tx=0).stop 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.162+0000 7f30169bb640 1 -- 172.21.15.37:0/391154863 shutdown_connections 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.162+0000 7f30169bb640 1 --2- 172.21.15.37:0/391154863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3010075e20 0x7f301010f9a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.162+0000 7f30169bb640 1 --2- 172.21.15.37:0/391154863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301010fee0 0x7f3010112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.162+0000 7f30169bb640 1 --2- 172.21.15.37:0/391154863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30100754d0 0x7f30100758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.162+0000 7f30169bb640 1 -- 172.21.15.37:0/391154863 >> 172.21.15.37:0/391154863 conn(0x7f301007b5f0 msgr2=0x7f301007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.163+0000 7f30169bb640 1 -- 172.21.15.37:0/391154863 shutdown_connections 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.163+0000 7f30169bb640 1 -- 172.21.15.37:0/391154863 wait complete. 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.163+0000 7f30169bb640 1 Processor -- start 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.163+0000 7f30169bb640 1 -- start start 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f30169bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100754d0 0x7f301019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f30169bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3010075e20 0x7f301019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f30169bb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301010fee0 0x7f30101a1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f30169bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30101158d0 con 0x7f30100754d0 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f30169bb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3010115750 con 0x7f3010075e20 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f30169bb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3010115a50 con 0x7f301010fee0 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100754d0 0x7f301019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100754d0 0x7f301019c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54048/0 (socket says 172.21.15.37:54048) 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 -- 172.21.15.37:0/4238296366 learned_addr learned my addr 172.21.15.37:0/4238296366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300f7fe640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3010075e20 0x7f301019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f3014f58640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301010fee0 0x7f30101a1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 -- 172.21.15.37:0/4238296366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301010fee0 msgr2=0x7f30101a1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301010fee0 0x7f30101a1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 -- 172.21.15.37:0/4238296366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3010075e20 msgr2=0x7f301019c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3010075e20 0x7f301019c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 -- 172.21.15.37:0/4238296366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30101a2310 con 0x7f30100754d0 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f3014f58640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301010fee0 0x7f30101a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300ffff640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100754d0 0x7f301019c3a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f300000d950 tx=0x7f300000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.164+0000 7f300d7fa640 1 -- 172.21.15.37:0/4238296366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000017070 con 0x7f30100754d0 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.165+0000 7f300d7fa640 1 -- 172.21.15.37:0/4238296366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3000009c30 con 0x7f30100754d0 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.165+0000 7f300d7fa640 1 -- 172.21.15.37:0/4238296366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300000f620 con 0x7f30100754d0 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.165+0000 7f30169bb640 1 -- 172.21.15.37:0/4238296366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30101a2600 con 0x7f30100754d0 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.165+0000 7f30169bb640 1 -- 172.21.15.37:0/4238296366 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30101a8d60 con 0x7f30100754d0 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.167+0000 7f301cf30740 1 Processor -- start 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.167+0000 7f301cf30740 1 -- start start 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.167+0000 7f300d7fa640 1 -- 172.21.15.37:0/4238296366 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f3000010460 con 0x7f30100754d0 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.167+0000 7f301cf30740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b431a8350 0x557b4354e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.167+0000 7f301cf30740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4317f490 0x557b4354ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.167+0000 7f301cf30740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b43187670 0x557b4354f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f301cf30740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b434c45f0 con 0x557b4317f490 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f301cf30740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557b434b3b80 con 0x557b43187670 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f301cf30740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557b434b7b30 con 0x557b431a8350 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4317f490 0x557b4354ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4317f490 0x557b4354ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54050/0 (socket says 172.21.15.37:54050) 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 -- 172.21.15.37:0/2463031732 learned_addr learned my addr 172.21.15.37:0/2463031732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300f7fe640 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b43187670 0x557b4354f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f3014f58640 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b431a8350 0x557b4354e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300d7fa640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2ff80b4ca0 0x7f2ff80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 -- 172.21.15.37:0/2463031732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b431a8350 msgr2=0x557b4354e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b431a8350 0x557b4354e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 -- 172.21.15.37:0/2463031732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b43187670 msgr2=0x557b4354f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b43187670 0x557b4354f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 -- 172.21.15.37:0/2463031732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b43213930 con 0x557b4317f490 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f3014f58640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2ff80b4ca0 0x7f2ff80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300d7fa640 1 -- 172.21.15.37:0/4238296366 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f30000e5200 con 0x7f30100754d0 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.168+0000 7f300ffff640 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4317f490 0x557b4354ecc0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f30000e2900 tx=0x7f30000bd4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6173aea9ddd2e5b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.169+0000 7f2ff67fc640 1 -- 172.21.15.37:0/2463031732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000020020 con 0x557b4317f490 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.169+0000 7f2ff67fc640 1 -- 172.21.15.37:0/2463031732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30000ab440 con 0x557b4317f490 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.169+0000 7f2ff67fc640 1 -- 172.21.15.37:0/2463031732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30000ab280 con 0x557b4317f490 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.169+0000 7f301cf30740 1 -- 172.21.15.37:0/2463031732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4317f490 msgr2=0x557b4354ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.169+0000 7f3014f58640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2ff80b4ca0 0x7f2ff80b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3008005fd0 tx=0x7f3008004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.169+0000 7f301cf30740 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4317f490 0x557b4354ecc0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f30000e2900 tx=0x7f30000bd4a0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 -- 172.21.15.37:0/2463031732 shutdown_connections 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4317f490 0x557b4354ecc0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b43187670 0x557b4354f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 --2- 172.21.15.37:0/2463031732 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b431a8350 0x557b4354e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 -- 172.21.15.37:0/2463031732 >> 172.21.15.37:0/2463031732 conn(0x557b4319c740 msgr2=0x557b4354c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 -- 172.21.15.37:0/2463031732 shutdown_connections 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 -- 172.21.15.37:0/2463031732 wait complete. 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 -- start start 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.170+0000 7f301cf30740 1 Processor -- start 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f301cf30740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43559f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f301cf30740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b4355a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f301cf30740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43566250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f301cf30740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b43316890 con 0x557b431a8350 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f301cf30740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557b4343a790 con 0x557b4317f490 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f301cf30740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557b4355cf60 con 0x557b43187670 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f301cf30740 10 client.0 _ll_register_callbacks cb 0x557b431bfba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43566250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43566250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54062/0 (socket says 172.21.15.37:54062) 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 -- 172.21.15.37:0/311843574 learned_addr learned my addr 172.21.15.37:0/311843574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f300ffff640 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43559f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f300f7fe640 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b4355a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 -- 172.21.15.37:0/311843574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 msgr2=0x557b4355a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b4355a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 -- 172.21.15.37:0/311843574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 msgr2=0x557b43559f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43559f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 -- 172.21.15.37:0/311843574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b43471f30 con 0x557b431a8350 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f3014f58640 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43566250 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f30080119f0 tx=0x7f30080084a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c574c38153cee151 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f2fef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.171+0000 7f2fef7fe640 1 -- 172.21.15.37:0/311843574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300801cd80 con 0x557b431a8350 2024-08-31T06:52:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f2fef7fe640 1 -- 172.21.15.37:0/311843574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f300801a450 con 0x557b431a8350 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 1 -- 172.21.15.37:0/311843574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30000ab440 con 0x557b431a8350 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f2fef7fe640 1 -- 172.21.15.37:0/311843574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f300801a650 con 0x557b431a8350 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 10 client.16812 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 1 -- 172.21.15.37:0/311843574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557b43568e20 con 0x557b431a8350 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f2fef7fe640 1 -- 172.21.15.37:0/311843574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30000ab440 con 0x557b431a8350 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f2fef7fe640 1 -- 172.21.15.37:0/311843574 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3008023070 con 0x557b431a8350 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 10 client.16812 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 20 client.16812 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557b43166cd0 0x557b4356c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 4 client.16812 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f301cf30740 1 -- 172.21.15.37:0/311843574 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b434c6540 con 0x557b43166cd0 2024-08-31T06:52:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.172+0000 7f300ffff640 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557b43166cd0 0x557b4356c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.173+0000 7f300ffff640 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557b43166cd0 0x557b4356c390 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=227d74922aeb0ee1 server_cookie=6b5f35d8c217a10 in_seq=0 out_seq=0 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.173+0000 7f2fef7fe640 10 client.16812 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f2fef7fe640 1 -- 172.21.15.37:0/311843574 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b434c6540 con 0x557b43166cd0 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f2fef7fe640 10 client.16812 handle_command_reply: tid=0 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 client.16812 shutdown 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 -- 172.21.15.37:0/311843574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 msgr2=0x557b43566250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43566250 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f30080119f0 tx=0x7f30080084a0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 -- 172.21.15.37:0/311843574 shutdown_connections 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557b43166cd0 0x557b4356c390 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43566250 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b4355a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 --2- 172.21.15.37:0/311843574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43559f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f2fef7fe640 0 client.16812 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 -- 172.21.15.37:0/311843574 >> 172.21.15.37:0/311843574 conn(0x557b4319c740 msgr2=0x557b43551910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 -- 172.21.15.37:0/311843574 shutdown_connections 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 1 -- 172.21.15.37:0/311843574 wait complete. 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.174+0000 7f301cf30740 20 client.16812 trim_cache size 0 max 16384 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f301cf30740 1 Processor -- start 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f301cf30740 1 -- start start 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f301cf30740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43566150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f301cf30740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b43566690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f301cf30740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43557180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f301cf30740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30101b3f40 con 0x557b431a8350 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f301cf30740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f30101b1810 con 0x557b4317f490 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f301cf30740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f30101af660 con 0x557b43187670 2024-08-31T06:52:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f3014f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43557180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f3014f58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43557180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54064/0 (socket says 172.21.15.37:54064) 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f3014f58640 1 -- 172.21.15.37:0/3019947828 learned_addr learned my addr 172.21.15.37:0/3019947828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f300f7fe640 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b43566690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f3014f58640 1 -- 172.21.15.37:0/3019947828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 msgr2=0x557b43566690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f3014f58640 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b43566690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f3014f58640 1 -- 172.21.15.37:0/3019947828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 msgr2=0x557b43566150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f300ffff640 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43566150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f3014f58640 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43566150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f3014f58640 1 -- 172.21.15.37:0/3019947828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b43547b80 con 0x557b431a8350 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f300f7fe640 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b43566690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.192+0000 7f300ffff640 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43566150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f3014f58640 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43557180 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f30080258b0 tx=0x7f3008005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da18fa67535ec89f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f2ff5ffb640 1 -- 172.21.15.37:0/3019947828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3008032070 con 0x557b431a8350 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f2ff5ffb640 1 -- 172.21.15.37:0/3019947828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3008025d20 con 0x557b431a8350 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f2ff5ffb640 1 -- 172.21.15.37:0/3019947828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300801cde0 con 0x557b431a8350 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f301cf30740 1 -- 172.21.15.37:0/3019947828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 msgr2=0x557b43557180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f301cf30740 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43557180 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f30080258b0 tx=0x7f3008005ee0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f301cf30740 1 -- 172.21.15.37:0/3019947828 shutdown_connections 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f301cf30740 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b431a8350 0x557b43557180 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f301cf30740 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b43187670 0x557b43566690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f301cf30740 1 --2- 172.21.15.37:0/3019947828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b4317f490 0x557b43566150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.193+0000 7f301cf30740 1 -- 172.21.15.37:0/3019947828 >> 172.21.15.37:0/3019947828 conn(0x557b4319c740 msgr2=0x557b4354c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.194+0000 7f301cf30740 1 -- 172.21.15.37:0/3019947828 shutdown_connections 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.194+0000 7f301cf30740 1 -- 172.21.15.37:0/3019947828 wait complete. 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.194+0000 7f301cf30740 1 -- start start 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.194+0000 7f301cf30740 1 Processor -- start 2024-08-31T06:52:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.194+0000 7f301cf30740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b4317f490 0x557b4355e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.194+0000 7f301cf30740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b43187670 0x557b4355e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.194+0000 7f301cf30740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b431a8350 0x557b4355ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f301cf30740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30101afcd0 con 0x557b43187670 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f301cf30740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f30101b1140 con 0x557b431a8350 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f301cf30740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f30101b03a0 con 0x557b4317f490 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f301cf30740 10 client.0 _ll_register_callbacks cb 0x7f30080085f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b43187670 0x557b4355e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b43187670 0x557b4355e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54066/0 (socket says 172.21.15.37:54066) 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 -- 172.21.15.37:0/2693053927 learned_addr learned my addr 172.21.15.37:0/2693053927 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300ffff640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b4317f490 0x557b4355e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f3014f58640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b431a8350 0x557b4355ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 -- 172.21.15.37:0/2693053927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b4317f490 msgr2=0x557b4355e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b4317f490 0x557b4355e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 -- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b431a8350 msgr2=0x557b4355ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b431a8350 0x557b4355ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 -- 172.21.15.37:0/2693053927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b435d5eb0 con 0x557b43187670 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300ffff640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b4317f490 0x557b4355e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f3014f58640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b431a8350 0x557b4355ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f300f7fe640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b43187670 0x557b4355e850 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3004000c00 tx=0x7f3004032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a7f5f6d36e4f98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f2fef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f2fef7fe640 1 -- 172.21.15.37:0/2693053927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004035040 con 0x557b43187670 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f2fef7fe640 1 -- 172.21.15.37:0/2693053927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3004005030 con 0x557b43187670 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.195+0000 7f301cf30740 1 -- 172.21.15.37:0/2693053927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3008025d20 con 0x557b43187670 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f2fef7fe640 1 -- 172.21.15.37:0/2693053927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3004005230 con 0x557b43187670 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f301cf30740 10 client.16818 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f301cf30740 1 -- 172.21.15.37:0/2693053927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557b435d7050 con 0x557b43187670 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f2fef7fe640 1 -- 172.21.15.37:0/2693053927 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3008025d20 con 0x557b43187670 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f2fef7fe640 1 -- 172.21.15.37:0/2693053927 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f30040035f0 con 0x557b43187670 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f301cf30740 10 client.16818 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f301cf30740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f301cf30740 20 client.16818 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f301cf30740 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557b4313c080 0x557b435d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f301cf30740 4 client.16818 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f301cf30740 1 -- 172.21.15.37:0/2693053927 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557b434c1fe0 con 0x557b4313c080 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.196+0000 7f300ffff640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557b4313c080 0x557b435d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.197+0000 7f300ffff640 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557b4313c080 0x557b435d97f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15cf29f8505ca35b server_cookie=ad028a60cf8e61b2 in_seq=0 out_seq=0 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.197+0000 7f2fef7fe640 10 client.16818 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.198+0000 7f2fef7fe640 1 -- 172.21.15.37:0/2693053927 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557b434c1fe0 con 0x557b4313c080 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f2fef7fe640 10 client.16818 handle_command_reply: tid=0 2024-08-31T06:52:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 client.16818 shutdown 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "89dd192a-dd56-4a69-b909-ea46d1b786dd", 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 -- 172.21.15.37:0/2693053927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b43187670 msgr2=0x557b4355e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b43187670 0x557b4355e850 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3004000c00 tx=0x7f3004032df0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 -- 172.21.15.37:0/2693053927 shutdown_connections 2024-08-31T06:52:00.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557b4313c080 0x557b435d97f0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b43187670 0x557b4355e850 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557b431a8350 0x557b4355ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 --2- 172.21.15.37:0/2693053927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557b4317f490 0x557b4355e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 -- 172.21.15.37:0/2693053927 >> 172.21.15.37:0/2693053927 conn(0x557b4319c740 msgr2=0x557b43552010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f2fef7fe640 0 client.16818 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 -- 172.21.15.37:0/2693053927 shutdown_connections 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 1 -- 172.21.15.37:0/2693053927 wait complete. 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.199+0000 7f301cf30740 20 client.16818 trim_cache size 0 max 16384 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 -- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2ff80b4ca0 msgr2=0x7f2ff80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2ff80b4ca0 0x7f2ff80b71b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3008005fd0 tx=0x7f3008004a40 comp rx=0 tx=0).stop 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 -- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100754d0 msgr2=0x7f301019c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100754d0 0x7f301019c3a0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f300000d950 tx=0x7f300000de10 comp rx=0 tx=0).stop 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 -- 172.21.15.37:0/4238296366 shutdown_connections 2024-08-31T06:52:00.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2ff80b4ca0 0x7f2ff80b71b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f301010fee0 0x7f30101a1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3010075e20 0x7f301019c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 --2- 172.21.15.37:0/4238296366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100754d0 0x7f301019c3a0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:00.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 -- 172.21.15.37:0/4238296366 >> 172.21.15.37:0/4238296366 conn(0x7f301007b5f0 msgr2=0x7f30101006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:00.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 -- 172.21.15.37:0/4238296366 shutdown_connections 2024-08-31T06:52:00.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:00.200+0000 7f30169bb640 1 -- 172.21.15.37:0/4238296366 wait complete. 2024-08-31T06:52:00.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:00 smithi037 ceph-mon[18612]: pgmap v474: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:00 smithi066 ceph-mon[22244]: pgmap v474: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:00.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:00 smithi106 ceph-mon[22134]: pgmap v474: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:01.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:52:01.404 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:01.524 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:01 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:52:01.525 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:01 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:01.525 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:01 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:52:01.525 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:01 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:01.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:01 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:52:01.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:01 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:01.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:01 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:52:01.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:01 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:01.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:01 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:52:01.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:01 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:01.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:01 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:52:01.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:01 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1803742212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc103770 msgr2=0x7fbdbc103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1803742212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc103770 0x7fbdbc103b80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009900 tx=0x7fbdac02a410 comp rx=0 tx=0).stop 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1803742212 shutdown_connections 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1803742212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc109a00 0x7fbdbc110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1803742212 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdbc1090b0 0x7fbdbc1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1803742212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc103770 0x7fbdbc103b80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1803742212 >> 172.21.15.37:0/1803742212 conn(0x7fbdbc0ff1e0 msgr2=0x7fbdbc101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1803742212 shutdown_connections 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.862+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1803742212 wait complete. 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdc0b9f640 1 Processor -- start 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdc0b9f640 1 -- start start 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdc0b9f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdbc103770 0x7fbdbc19a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdc0b9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc1090b0 0x7fbdbc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdc0b9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc109a00 0x7fbdbc19f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdc0b9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc1135f0 con 0x7fbdbc109a00 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdc0b9f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc113470 con 0x7fbdbc1090b0 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdc0b9f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc113770 con 0x7fbdbc103770 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc109a00 0x7fbdbc19f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc109a00 0x7fbdbc19f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54076/0 (socket says 172.21.15.37:54076) 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.863+0000 7fbdbbfff640 1 -- 172.21.15.37:0/1452917473 learned_addr learned my addr 172.21.15.37:0/1452917473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdbc103770 0x7fbdbc19a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc1090b0 0x7fbdbc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdbbfff640 1 -- 172.21.15.37:0/1452917473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdbc103770 msgr2=0x7fbdbc19a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdbbfff640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdbc103770 0x7fbdbc19a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdbbfff640 1 -- 172.21.15.37:0/1452917473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc1090b0 msgr2=0x7fbdbc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdbbfff640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc1090b0 0x7fbdbc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdbbfff640 1 -- 172.21.15.37:0/1452917473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc19ffd0 con 0x7fbdbc109a00 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdbbfff640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc109a00 0x7fbdbc19f8a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400b970 tx=0x7fbdb400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdb8ff9640 1 -- 172.21.15.37:0/1452917473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4019070 con 0x7fbdbc109a00 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1452917473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc1a02c0 con 0x7fbdbc109a00 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdb8ff9640 1 -- 172.21.15.37:0/1452917473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb4014440 con 0x7fbdbc109a00 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdb8ff9640 1 -- 172.21.15.37:0/1452917473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40075d0 con 0x7fbdbc109a00 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.864+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1452917473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc1a6a20 con 0x7fbdbc109a00 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdb8ff9640 1 -- 172.21.15.37:0/1452917473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fbdb401c070 con 0x7fbdbc109a00 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdc8376740 1 Processor -- start 2024-08-31T06:52:01.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdc8376740 1 -- start start 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f806070 0x56064fbab460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 0x56064fbabee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdc8376740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56064fb22630 con 0x56064f806070 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdc8376740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56064fb11bc0 con 0x56064f7dd1b0 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdc8376740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56064fb15b70 con 0x56064f7e5390 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.867+0000 7fbdbaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f806070 0x56064fbab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f806070 0x56064fbab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54088/0 (socket says 172.21.15.37:54088) 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 -- 172.21.15.37:0/742171777 learned_addr learned my addr 172.21.15.37:0/742171777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 0x56064fbabee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdb8ff9640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbda40b4ca0 0x7fbda40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 -- 172.21.15.37:0/742171777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 msgr2=0x56064fbabee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 0x56064fbabee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 -- 172.21.15.37:0/742171777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 msgr2=0x56064fbab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 -- 172.21.15.37:0/742171777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56064f871650 con 0x56064f806070 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbbfff640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbda40b4ca0 0x7fbda40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdb8ff9640 1 -- 172.21.15.37:0/1452917473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbdb40e4a10 con 0x7fbdbc109a00 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f806070 0x56064fbab460 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000bb20 tx=0x7fbdb00041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de38429506739df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbda1ffb640 1 -- 172.21.15.37:0/742171777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0005020 con 0x56064f806070 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbda1ffb640 1 -- 172.21.15.37:0/742171777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb0005650 con 0x56064f806070 2024-08-31T06:52:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.868+0000 7fbda1ffb640 1 -- 172.21.15.37:0/742171777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0010460 con 0x56064f806070 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 -- 172.21.15.37:0/742171777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f806070 msgr2=0x56064fbab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdbbfff640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbda40b4ca0 0x7fbda40b71b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40e27a0 tx=0x7fbdb40773f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f806070 0x56064fbab460 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000bb20 tx=0x7fbdb00041d0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 -- 172.21.15.37:0/742171777 shutdown_connections 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 0x56064fbabee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 --2- 172.21.15.37:0/742171777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f806070 0x56064fbab460 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 -- 172.21.15.37:0/742171777 >> 172.21.15.37:0/742171777 conn(0x56064f7fa460 msgr2=0x56064fba9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 -- 172.21.15.37:0/742171777 shutdown_connections 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.869+0000 7fbdc8376740 1 -- 172.21.15.37:0/742171777 wait complete. 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.870+0000 7fbdc8376740 1 -- start start 2024-08-31T06:52:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.870+0000 7fbdc8376740 1 Processor -- start 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.870+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbb6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.870+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 0x56064fbb7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.870+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f806070 0x56064fbc2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.870+0000 7fbdc8376740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56064f974700 con 0x56064f7dd1b0 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.870+0000 7fbdc8376740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56064fa98700 con 0x56064f806070 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.870+0000 7fbdc8376740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56064fbb9be0 con 0x56064f7e5390 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdc8376740 10 client.0 _ll_register_callbacks cb 0x56064fac7dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbb6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbb6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54100/0 (socket says 172.21.15.37:54100) 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 -- 172.21.15.37:0/1994024533 learned_addr learned my addr 172.21.15.37:0/1994024533 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 0x56064fbb7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f806070 0x56064fbc2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 -- 172.21.15.37:0/1994024533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 msgr2=0x56064fbb7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 0x56064fbb7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 -- 172.21.15.37:0/1994024533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f806070 msgr2=0x56064fbc2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f806070 0x56064fbc2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 -- 172.21.15.37:0/1994024533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56064fad18b0 con 0x56064f7dd1b0 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbb6bf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000b5f0 tx=0x7fbdb0005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce53d1d288b28ea server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbd9affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbd9affd640 1 -- 172.21.15.37:0/1994024533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0005190 con 0x56064f7dd1b0 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbd9affd640 1 -- 172.21.15.37:0/1994024533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbdb0005330 con 0x56064f7dd1b0 2024-08-31T06:52:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.871+0000 7fbdc8376740 1 -- 172.21.15.37:0/1994024533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb0005650 con 0x56064f7dd1b0 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbd9affd640 1 -- 172.21.15.37:0/1994024533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbdb002f050 con 0x56064f7dd1b0 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdc8376740 10 client.16830 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdc8376740 1 -- 172.21.15.37:0/1994024533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56064fbc5990 con 0x56064f7dd1b0 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbd9affd640 1 -- 172.21.15.37:0/1994024533 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb0005650 con 0x56064f7dd1b0 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbd9affd640 1 -- 172.21.15.37:0/1994024533 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbdb001dc60 con 0x56064f7dd1b0 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdc8376740 10 client.16830 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdc8376740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdc8376740 20 client.16830 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdc8376740 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56064f7c49f0 0x56064fbc8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdc8376740 4 client.16830 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdc8376740 1 -- 172.21.15.37:0/1994024533 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56064fb24580 con 0x56064f7c49f0 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.872+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56064f7c49f0 0x56064fbc8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.873+0000 7fbd9affd640 10 client.16830 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.873+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56064f7c49f0 0x56064fbc8e00 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7d9fbfcd0f869f9 server_cookie=2d1056aae3133ff4 in_seq=0 out_seq=0 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.873+0000 7fbd9affd640 1 -- 172.21.15.37:0/1994024533 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56064fb24580 con 0x56064f7c49f0 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbd9affd640 10 client.16830 handle_command_reply: tid=0 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 client.16830 shutdown 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 -- 172.21.15.37:0/1994024533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 msgr2=0x56064fbb6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbb6bf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000b5f0 tx=0x7fbdb0005f30 comp rx=0 tx=0).stop 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 -- 172.21.15.37:0/1994024533 shutdown_connections 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56064f7c49f0 0x56064fbc8e00 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f806070 0x56064fbc2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f7e5390 0x56064fbb7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 --2- 172.21.15.37:0/1994024533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbb6bf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 -- 172.21.15.37:0/1994024533 >> 172.21.15.37:0/1994024533 conn(0x56064f7fa460 msgr2=0x56064fbae640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbd9affd640 0 client.16830 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 -- 172.21.15.37:0/1994024533 shutdown_connections 2024-08-31T06:52:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 1 -- 172.21.15.37:0/1994024533 wait complete. 2024-08-31T06:52:01.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.874+0000 7fbdc8376740 20 client.16830 trim_cache size 0 max 16384 2024-08-31T06:52:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdc8376740 1 Processor -- start 2024-08-31T06:52:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdc8376740 1 -- start start 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbacf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7e5390 0x56064fbb8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 0x56064fba90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdc8376740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc1b1b60 con 0x56064f7dd1b0 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdc8376740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc1af430 con 0x56064f7e5390 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdc8376740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc1ad280 con 0x56064f806070 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbacf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbacf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54102/0 (socket says 172.21.15.37:54102) 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 -- 172.21.15.37:0/2552571510 learned_addr learned my addr 172.21.15.37:0/2552571510 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/2552571510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7e5390 0x56064fbb8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 -- 172.21.15.37:0/2552571510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 msgr2=0x56064fba90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/2552571510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 0x56064fba90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 -- 172.21.15.37:0/2552571510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7e5390 msgr2=0x56064fbb8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/2552571510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7e5390 0x56064fbb8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 -- 172.21.15.37:0/2552571510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56064fba9c40 con 0x56064f7dd1b0 2024-08-31T06:52:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.892+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/2552571510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbacf70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbdb001f970 tx=0x7fbdb0004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e38b27dffbbdc23 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbda17fa640 1 -- 172.21.15.37:0/2552571510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb000b390 con 0x56064f7dd1b0 2024-08-31T06:52:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbda17fa640 1 -- 172.21.15.37:0/2552571510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb001fe80 con 0x56064f7dd1b0 2024-08-31T06:52:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbda17fa640 1 -- 172.21.15.37:0/2552571510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0004f40 con 0x56064f7dd1b0 2024-08-31T06:52:01.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbdc8376740 1 -- 172.21.15.37:0/2552571510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 msgr2=0x56064fbacf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbdc8376740 1 --2- 172.21.15.37:0/2552571510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbacf70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbdb001f970 tx=0x7fbdb0004120 comp rx=0 tx=0).stop 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbdc8376740 1 -- 172.21.15.37:0/2552571510 shutdown_connections 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbdc8376740 1 --2- 172.21.15.37:0/2552571510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 0x56064fba90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbdc8376740 1 --2- 172.21.15.37:0/2552571510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7e5390 0x56064fbb8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbdc8376740 1 --2- 172.21.15.37:0/2552571510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7dd1b0 0x56064fbacf70 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.893+0000 7fbdc8376740 1 -- 172.21.15.37:0/2552571510 >> 172.21.15.37:0/2552571510 conn(0x56064f7fa460 msgr2=0x56064fba89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 -- 172.21.15.37:0/2552571510 shutdown_connections 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 -- 172.21.15.37:0/2552571510 wait complete. 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 -- start start 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 Processor -- start 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbbf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7e5390 0x56064fbcdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 0x56064fbce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc1ad8f0 con 0x56064f7e5390 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc1aed60 con 0x56064f7dd1b0 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.894+0000 7fbdc8376740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc1adfc0 con 0x56064f806070 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdc8376740 10 client.0 _ll_register_callbacks cb 0x7fbdb000ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7e5390 0x56064fbcdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7e5390 0x56064fbcdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54118/0 (socket says 172.21.15.37:54118) 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 -- 172.21.15.37:0/4187969406 learned_addr learned my addr 172.21.15.37:0/4187969406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 0x56064fbce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbbf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 -- 172.21.15.37:0/4187969406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 msgr2=0x56064fbce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 0x56064fbce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 -- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 msgr2=0x56064fbbf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbbf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 -- 172.21.15.37:0/4187969406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56064fbcec80 con 0x56064f7e5390 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbbf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdbb7fe640 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7e5390 0x56064fbcdfb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0057c0 tx=0x7fbdac031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b18b178d818ad8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbd9affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbd9affd640 1 -- 172.21.15.37:0/4187969406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdac035040 con 0x56064f7e5390 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbd9affd640 1 -- 172.21.15.37:0/4187969406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fbdac004240 con 0x56064f7e5390 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.895+0000 7fbdc8376740 1 -- 172.21.15.37:0/4187969406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb001fe80 con 0x56064f7e5390 2024-08-31T06:52:01.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbd9affd640 1 -- 172.21.15.37:0/4187969406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbdac004440 con 0x56064f7e5390 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdc8376740 10 client.16836 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdc8376740 1 -- 172.21.15.37:0/4187969406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56064fc335a0 con 0x56064f7e5390 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbd9affd640 1 -- 172.21.15.37:0/4187969406 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb001fe80 con 0x56064f7e5390 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbd9affd640 1 -- 172.21.15.37:0/4187969406 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbdac03b5c0 con 0x56064f7e5390 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdc8376740 10 client.16836 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdc8376740 10 client.16836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdc8376740 20 client.16836 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdc8376740 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56064f799da0 0x56064fc35d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdc8376740 4 client.16836 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdc8376740 1 -- 172.21.15.37:0/4187969406 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56064fb20020 con 0x56064f799da0 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.896+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56064f799da0 0x56064fc35d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:01.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdbaffd640 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56064f799da0 0x56064fc35d10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5a4257860a1f3c8 server_cookie=8415f2ff69b30dbd in_seq=0 out_seq=0 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbd9affd640 10 client.16836 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbd9affd640 1 -- 172.21.15.37:0/4187969406 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x56064fb20020 con 0x56064f799da0 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbd9affd640 10 client.16836 handle_command_reply: tid=0 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 client.16836 shutdown 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 -- 172.21.15.37:0/4187969406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7e5390 msgr2=0x56064fbcdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7e5390 0x56064fbcdfb0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0057c0 tx=0x7fbdac031690 comp rx=0 tx=0).stop 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 -- 172.21.15.37:0/4187969406 shutdown_connections 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56064f799da0 0x56064fc35d10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56064f7e5390 0x56064fbcdfb0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56064f806070 0x56064fbce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 --2- 172.21.15.37:0/4187969406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56064f7dd1b0 0x56064fbbf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbd9affd640 0 client.16836 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:01.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.897+0000 7fbdc8376740 1 -- 172.21.15.37:0/4187969406 >> 172.21.15.37:0/4187969406 conn(0x56064f7fa460 msgr2=0x56064fbb8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:01.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc8376740 1 -- 172.21.15.37:0/4187969406 shutdown_connections 2024-08-31T06:52:01.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc8376740 1 -- 172.21.15.37:0/4187969406 wait complete. 2024-08-31T06:52:01.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc8376740 20 client.16836 trim_cache size 0 max 16384 2024-08-31T06:52:01.904 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:52:01.904 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:52:01.904 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:52:01.904 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:52:01.904 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "89dd192a-dd56-4a69-b909-ea46d1b786dd", 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.905 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.906 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:52:01.907 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.908 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.909 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:01.910 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:52:01.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbda40b4ca0 msgr2=0x7fbda40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbda40b4ca0 0x7fbda40b71b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40e27a0 tx=0x7fbdb40773f0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc109a00 msgr2=0x7fbdbc19f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:01.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc109a00 0x7fbdbc19f8a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400b970 tx=0x7fbdb400be30 comp rx=0 tx=0).stop 2024-08-31T06:52:01.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1452917473 shutdown_connections 2024-08-31T06:52:01.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbda40b4ca0 0x7fbda40b71b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdbc109a00 0x7fbdbc19f8a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc1090b0 0x7fbdbc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 --2- 172.21.15.37:0/1452917473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbdbc103770 0x7fbdbc19a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:01.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1452917473 >> 172.21.15.37:0/1452917473 conn(0x7fbdbc0ff1e0 msgr2=0x7fbdbc101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:01.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1452917473 shutdown_connections 2024-08-31T06:52:01.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:01.898+0000 7fbdc0b9f640 1 -- 172.21.15.37:0/1452917473 wait complete. 2024-08-31T06:52:02.466 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:02 smithi106 ceph-mon[22134]: pgmap v475: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:02.538 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:02 smithi066 ceph-mon[22244]: pgmap v475: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:02.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:02 smithi037 ceph-mon[18612]: pgmap v475: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:02.720 INFO:tasks.cephfs.filesystem:scrub status for tag:89dd192a-dd56-4a69-b909-ea46d1b786dd - {'path': '/', 'tag': '89dd192a-dd56-4a69-b909-ea46d1b786dd', 'options': 'recursive,force'} 2024-08-31T06:52:03.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:03 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:52:03.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:03 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:52:03.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:03 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:52:04.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:04 smithi106 ceph-mon[22134]: pgmap v476: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:52:04.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:04 smithi037 ceph-mon[18612]: pgmap v476: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:52:04.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:04 smithi066 ceph-mon[22244]: pgmap v476: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:52:06.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:06 smithi106 ceph-mon[22134]: pgmap v477: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:52:06.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:06 smithi037 ceph-mon[18612]: pgmap v477: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:52:06.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:06 smithi066 ceph-mon[22244]: pgmap v477: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-31T06:52:08.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:08 smithi106 ceph-mon[22134]: pgmap v478: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:52:08.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:08 smithi037 ceph-mon[18612]: pgmap v478: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:52:08.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:08 smithi066 ceph-mon[22244]: pgmap v478: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-31T06:52:10.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:10 smithi106 ceph-mon[22134]: pgmap v479: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:52:10.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:10 smithi037 ceph-mon[18612]: pgmap v479: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:52:10.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:10 smithi066 ceph-mon[22244]: pgmap v479: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:52:12.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:12 smithi106 ceph-mon[22134]: pgmap v480: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:52:12.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:12 smithi037 ceph-mon[18612]: pgmap v480: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:52:12.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:12 smithi066 ceph-mon[22244]: pgmap v480: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-31T06:52:14.421 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:14 smithi037 ceph-mon[18612]: pgmap v481: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:52:14.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:14 smithi106 ceph-mon[22134]: pgmap v481: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:52:14.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:14 smithi066 ceph-mon[22244]: pgmap v481: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-31T06:52:16.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:16 smithi106 ceph-mon[22134]: pgmap v482: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:52:16.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:16 smithi037 ceph-mon[18612]: pgmap v482: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:52:16.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:16 smithi066 ceph-mon[22244]: pgmap v482: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:52:18.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:18 smithi106 ceph-mon[22134]: pgmap v483: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T06:52:18.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:18 smithi037 ceph-mon[18612]: pgmap v483: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T06:52:18.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:18 smithi066 ceph-mon[22244]: pgmap v483: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2024-08-31T06:52:20.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:20 smithi106 ceph-mon[22134]: pgmap v484: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:52:20.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:20 smithi037 ceph-mon[18612]: pgmap v484: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:52:20.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:20 smithi066 ceph-mon[22244]: pgmap v484: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:52:22.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:22 smithi106 ceph-mon[22134]: pgmap v485: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:52:22.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:22 smithi037 ceph-mon[18612]: pgmap v485: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:52:22.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:22 smithi066 ceph-mon[22244]: pgmap v485: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-31T06:52:24.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:24 smithi106 ceph-mon[22134]: pgmap v486: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-31T06:52:24.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:24 smithi037 ceph-mon[18612]: pgmap v486: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-31T06:52:24.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:24 smithi066 ceph-mon[22244]: pgmap v486: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-31T06:52:26.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:26 smithi106 ceph-mon[22134]: pgmap v487: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:26.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:26 smithi037 ceph-mon[18612]: pgmap v487: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:26.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:26 smithi066 ceph-mon[22244]: pgmap v487: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:28.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:28 smithi106 ceph-mon[22134]: pgmap v488: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:28.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:28 smithi037 ceph-mon[18612]: pgmap v488: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:28.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:28 smithi066 ceph-mon[22244]: pgmap v488: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:30.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:30 smithi106 ceph-mon[22134]: pgmap v489: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:30.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:30 smithi037 ceph-mon[18612]: pgmap v489: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:30.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:30 smithi066 ceph-mon[22244]: pgmap v489: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:32.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:32 smithi106 ceph-mon[22134]: pgmap v490: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:32.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:32 smithi037 ceph-mon[18612]: pgmap v490: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:32.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:32 smithi066 ceph-mon[22244]: pgmap v490: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:32.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:52:32.991 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:33.386 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:33 smithi037 ceph-mon[18612]: pgmap v491: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:52:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 -- 172.21.15.37:0/2870092162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f410dbc0 msgr2=0x7fb2f41100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 --2- 172.21.15.37:0/2870092162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f410dbc0 0x7fb2f41100b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009ca0 tx=0x7fb2ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 -- 172.21.15.37:0/2870092162 shutdown_connections 2024-08-31T06:52:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 --2- 172.21.15.37:0/2870092162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f410dbc0 0x7fb2f41100b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 --2- 172.21.15.37:0/2870092162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2f41050b0 0x7fb2f410d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 --2- 172.21.15.37:0/2870092162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f4104760 0x7fb2f4104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 -- 172.21.15.37:0/2870092162 >> 172.21.15.37:0/2870092162 conn(0x7fb2f40794d0 msgr2=0x7fb2f40798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 -- 172.21.15.37:0/2870092162 shutdown_connections 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.481+0000 7fb2fb109640 1 -- 172.21.15.37:0/2870092162 wait complete. 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2fb109640 1 Processor -- start 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2fb109640 1 -- start start 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2fb109640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f4104760 0x7fb2f41024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2fb109640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f41050b0 0x7fb2f41029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2fb109640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2f410dbc0 0x7fb2f4102f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2fb109640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f4113740 con 0x7fb2f41050b0 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2fb109640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41135c0 con 0x7fb2f410dbc0 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2fb109640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41138c0 con 0x7fb2f4104760 2024-08-31T06:52:33.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f41050b0 0x7fb2f41029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f41050b0 0x7fb2f41029e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45962/0 (socket says 172.21.15.37:45962) 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2f3fff640 1 -- 172.21.15.37:0/995078787 learned_addr learned my addr 172.21.15.37:0/995078787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f4104760 0x7fb2f41024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.482+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2f410dbc0 0x7fb2f4102f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f3fff640 1 -- 172.21.15.37:0/995078787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f4104760 msgr2=0x7fb2f41024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f4104760 0x7fb2f41024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f3fff640 1 -- 172.21.15.37:0/995078787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2f410dbc0 msgr2=0x7fb2f4102f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2f410dbc0 0x7fb2f4102f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f3fff640 1 -- 172.21.15.37:0/995078787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f41a8450 con 0x7fb2f41050b0 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f41050b0 0x7fb2f41029e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000e9f0 tx=0x7fb2e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:33.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f1ffb640 1 -- 172.21.15.37:0/995078787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e000ccc0 con 0x7fb2f41050b0 2024-08-31T06:52:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2fb109640 1 -- 172.21.15.37:0/995078787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f41a8740 con 0x7fb2f41050b0 2024-08-31T06:52:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f1ffb640 1 -- 172.21.15.37:0/995078787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2e00108c0 con 0x7fb2f41050b0 2024-08-31T06:52:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2f1ffb640 1 -- 172.21.15.37:0/995078787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0018660 con 0x7fb2f41050b0 2024-08-31T06:52:33.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.483+0000 7fb2fb109640 1 -- 172.21.15.37:0/995078787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f41a8cd0 con 0x7fb2f41050b0 2024-08-31T06:52:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.486+0000 7fb30167e740 1 Processor -- start 2024-08-31T06:52:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.486+0000 7fb30167e740 1 -- start start 2024-08-31T06:52:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.486+0000 7fb30167e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd944070 0x5571ddce9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb30167e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddce9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb30167e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddce9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb30167e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5571ddc60630 con 0x5571dd923390 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb30167e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5571ddc4fbc0 con 0x5571dd944070 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb30167e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5571ddc53b70 con 0x5571dd91b1b0 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd944070 0x5571ddce9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd944070 0x5571ddce9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:57722/0 (socket says 172.21.15.37:57722) 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 -- 172.21.15.37:0/3707995475 learned_addr learned my addr 172.21.15.37:0/3707995475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/3707995475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddce9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 -- 172.21.15.37:0/3707995475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 msgr2=0x5571ddce9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/3707995475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddce9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 -- 172.21.15.37:0/3707995475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 msgr2=0x5571ddce9d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:52:33.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/3707995475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddce9d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 -- 172.21.15.37:0/3707995475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571dd9af650 con 0x5571dd944070 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.487+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/3707995475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd944070 0x5571ddce9300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009ca0 tx=0x7fb2ec009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c5f0720341fcac7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.488+0000 7fb2f1ffb640 1 -- 172.21.15.37:0/995078787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fb2e0010430 con 0x7fb2f41050b0 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.488+0000 7fb2deffd640 1 -- 172.21.15.37:0/3707995475 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec031790 con 0x5571dd944070 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.488+0000 7fb2deffd640 1 -- 172.21.15.37:0/3707995475 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2ec036030 con 0x5571dd944070 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.488+0000 7fb2deffd640 1 -- 172.21.15.37:0/3707995475 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0042a0 con 0x5571dd944070 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.488+0000 7fb2f1ffb640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb2e40b4ca0 0x7fb2e40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb2e40b4ca0 0x7fb2e40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb2f1ffb640 1 -- 172.21.15.37:0/995078787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb2e00e5820 con 0x7fb2f41050b0 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 -- 172.21.15.37:0/3707995475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd944070 msgr2=0x5571ddce9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 --2- 172.21.15.37:0/3707995475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd944070 0x5571ddce9300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec009ca0 tx=0x7fb2ec009a20 comp rx=0 tx=0).stop 2024-08-31T06:52:33.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb2e40b4ca0 0x7fb2e40b71b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5571ddce7f80 tx=0x7fb2e8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 -- 172.21.15.37:0/3707995475 shutdown_connections 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 --2- 172.21.15.37:0/3707995475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddce9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 --2- 172.21.15.37:0/3707995475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddce9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 --2- 172.21.15.37:0/3707995475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd944070 0x5571ddce9300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 -- 172.21.15.37:0/3707995475 >> 172.21.15.37:0/3707995475 conn(0x5571dd938460 msgr2=0x5571ddce71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 -- 172.21.15.37:0/3707995475 shutdown_connections 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.489+0000 7fb30167e740 1 -- 172.21.15.37:0/3707995475 wait complete. 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 1 -- start start 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 1 Processor -- start 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd91b1b0 0x5571ddcf4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd923390 0x5571ddcf5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd944070 0x5571ddd00c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5571ddab2700 con 0x5571dd944070 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5571ddbd6700 con 0x5571dd91b1b0 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5571ddcf7900 con 0x5571dd923390 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb30167e740 10 client.0 _ll_register_callbacks cb 0x5571ddc05dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.490+0000 7fb2f96a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd944070 0x5571ddd00c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f96a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd944070 0x5571ddd00c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45968/0 (socket says 172.21.15.37:45968) 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f96a6640 1 -- 172.21.15.37:0/158676774 learned_addr learned my addr 172.21.15.37:0/158676774 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:33.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd91b1b0 0x5571ddcf4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd923390 0x5571ddcf5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f96a6640 1 -- 172.21.15.37:0/158676774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd923390 msgr2=0x5571ddcf5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd923390 0x5571ddcf5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f96a6640 1 -- 172.21.15.37:0/158676774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd91b1b0 msgr2=0x5571ddcf4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd91b1b0 0x5571ddcf4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f96a6640 1 -- 172.21.15.37:0/158676774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ddc0f8b0 con 0x5571dd944070 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd923390 0x5571ddcf5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd944070 0x5571ddd00c20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec02aeb0 tx=0x7fb2ec02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e31cab4353149c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2d3fff640 1 -- 172.21.15.37:0/158676774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec04a040 con 0x5571dd944070 2024-08-31T06:52:33.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb2d3fff640 1 -- 172.21.15.37:0/158676774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb2ec031b80 con 0x5571dd944070 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.491+0000 7fb30167e740 1 -- 172.21.15.37:0/158676774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2ec036030 con 0x5571dd944070 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb2d3fff640 1 -- 172.21.15.37:0/158676774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2ec05e050 con 0x5571dd944070 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb30167e740 10 client.16845 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb30167e740 1 -- 172.21.15.37:0/158676774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5571ddd03790 con 0x5571dd944070 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb2d3fff640 1 -- 172.21.15.37:0/158676774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2ec036030 con 0x5571dd944070 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb2d3fff640 1 -- 172.21.15.37:0/158676774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2ec04d030 con 0x5571dd944070 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb30167e740 10 client.16845 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb30167e740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb30167e740 20 client.16845 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb30167e740 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5571dd9029f0 0x5571ddd06af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb30167e740 4 client.16845 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:33.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb30167e740 1 -- 172.21.15.37:0/158676774 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571ddc62580 con 0x5571dd9029f0 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.492+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5571dd9029f0 0x5571ddd06af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.493+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5571dd9029f0 0x5571ddd06af0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b45fd7c82f22bfab server_cookie=c0782b19a0cdd7c9 in_seq=0 out_seq=0 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.493+0000 7fb2d3fff640 10 client.16845 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb2d3fff640 1 -- 172.21.15.37:0/158676774 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5571ddc62580 con 0x5571dd9029f0 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb2d3fff640 10 client.16845 handle_command_reply: tid=0 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 client.16845 shutdown 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 -- 172.21.15.37:0/158676774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd944070 msgr2=0x5571ddd00c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd944070 0x5571ddd00c20 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec02aeb0 tx=0x7fb2ec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 -- 172.21.15.37:0/158676774 shutdown_connections 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5571dd9029f0 0x5571ddd06af0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb2d3fff640 0 client.16845 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:33.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd944070 0x5571ddd00c20 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd923390 0x5571ddcf5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 --2- 172.21.15.37:0/158676774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd91b1b0 0x5571ddcf4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 -- 172.21.15.37:0/158676774 >> 172.21.15.37:0/158676774 conn(0x5571dd938460 msgr2=0x5571ddcec490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 -- 172.21.15.37:0/158676774 shutdown_connections 2024-08-31T06:52:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 1 -- 172.21.15.37:0/158676774 wait complete. 2024-08-31T06:52:33.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.494+0000 7fb30167e740 20 client.16845 trim_cache size 0 max 16384 2024-08-31T06:52:33.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb30167e740 1 Processor -- start 2024-08-31T06:52:33.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb30167e740 1 -- start start 2024-08-31T06:52:33.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb30167e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd9029f0 0x5571ddceacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb30167e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcf6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb30167e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd923390 0x5571ddd00b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb30167e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41b3d50 con 0x5571dd9029f0 2024-08-31T06:52:33.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb30167e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41b1620 con 0x5571dd923390 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb30167e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41af470 con 0x5571dd91b1b0 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f8ea5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd9029f0 0x5571ddceacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f8ea5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd9029f0 0x5571ddceacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45982/0 (socket says 172.21.15.37:45982) 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f8ea5640 1 -- 172.21.15.37:0/4138530437 learned_addr learned my addr 172.21.15.37:0/4138530437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcf6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f8ea5640 1 -- 172.21.15.37:0/4138530437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 msgr2=0x5571ddcf6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcf6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f8ea5640 1 -- 172.21.15.37:0/4138530437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd923390 msgr2=0x5571ddd00b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd923390 0x5571ddd00b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.512+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd923390 0x5571ddd00b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.513+0000 7fb2f8ea5640 1 -- 172.21.15.37:0/4138530437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571ddcf2ff0 con 0x5571dd9029f0 2024-08-31T06:52:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.513+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd923390 0x5571ddd00b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.513+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd9029f0 0x5571ddceacf0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4103ef0 tx=0x7fb2e801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cee5cbf565f3a5f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.513+0000 7fb2de7fc640 1 -- 172.21.15.37:0/4138530437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8005020 con 0x5571dd9029f0 2024-08-31T06:52:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.513+0000 7fb2de7fc640 1 -- 172.21.15.37:0/4138530437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2e80047a0 con 0x5571dd9029f0 2024-08-31T06:52:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.513+0000 7fb2de7fc640 1 -- 172.21.15.37:0/4138530437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8005650 con 0x5571dd9029f0 2024-08-31T06:52:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 -- 172.21.15.37:0/4138530437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd9029f0 msgr2=0x5571ddceacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd9029f0 0x5571ddceacf0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb2f4103ef0 tx=0x7fb2e801b000 comp rx=0 tx=0).stop 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 -- 172.21.15.37:0/4138530437 shutdown_connections 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd923390 0x5571ddd00b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcf6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 --2- 172.21.15.37:0/4138530437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd9029f0 0x5571ddceacf0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 -- 172.21.15.37:0/4138530437 >> 172.21.15.37:0/4138530437 conn(0x5571dd938460 msgr2=0x5571ddcf6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 -- 172.21.15.37:0/4138530437 shutdown_connections 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.514+0000 7fb30167e740 1 -- 172.21.15.37:0/4138530437 wait complete. 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 1 -- start start 2024-08-31T06:52:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 1 Processor -- start 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd9029f0 0x5571ddcfb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcfba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddd6a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41afae0 con 0x5571dd923390 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41b0f50 con 0x5571dd9029f0 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f41b01b0 con 0x5571dd91b1b0 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.515+0000 7fb30167e740 10 client.0 _ll_register_callbacks cb 0x7fb2e8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddd6a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddd6a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45992/0 (socket says 172.21.15.37:45992) 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 -- 172.21.15.37:0/2616696120 learned_addr learned my addr 172.21.15.37:0/2616696120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcfba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd9029f0 0x5571ddcfb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 -- 172.21.15.37:0/2616696120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 msgr2=0x5571ddcfba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcfba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 -- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd9029f0 msgr2=0x5571ddcfb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd9029f0 0x5571ddcfb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 -- 172.21.15.37:0/2616696120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571ddd6a970 con 0x5571dd923390 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd9029f0 0x5571ddcfb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcfba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2f96a6640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddd6a300 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000f80 tx=0x7fb2ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8654eeaccab198b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2d3fff640 1 -- 172.21.15.37:0/2616696120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec031d90 con 0x5571dd923390 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb2d3fff640 1 -- 172.21.15.37:0/2616696120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fb2ec030800 con 0x5571dd923390 2024-08-31T06:52:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.516+0000 7fb30167e740 1 -- 172.21.15.37:0/2616696120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2e80047a0 con 0x5571dd923390 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb2d3fff640 1 -- 172.21.15.37:0/2616696120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2ec030a00 con 0x5571dd923390 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb30167e740 10 client.16851 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb30167e740 1 -- 172.21.15.37:0/2616696120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5571ddd71c10 con 0x5571dd923390 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb2d3fff640 1 -- 172.21.15.37:0/2616696120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2e80047a0 con 0x5571dd923390 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb2d3fff640 1 -- 172.21.15.37:0/2616696120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2ec04d040 con 0x5571dd923390 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb30167e740 10 client.16851 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb30167e740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb30167e740 20 client.16851 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb30167e740 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5571dd944070 0x5571ddd74340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb30167e740 4 client.16851 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb30167e740 1 -- 172.21.15.37:0/2616696120 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5571ddc5e020 con 0x5571dd944070 2024-08-31T06:52:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.517+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5571dd944070 0x5571ddd74340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb2f8ea5640 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5571dd944070 0x5571ddd74340 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52589b8ea5383dc1 server_cookie=1f0fcaa68f446aca in_seq=0 out_seq=0 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb2d3fff640 10 client.16851 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb2d3fff640 1 -- 172.21.15.37:0/2616696120 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x5571ddc5e020 con 0x5571dd944070 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb2d3fff640 10 client.16851 handle_command_reply: tid=0 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 client.16851 shutdown 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 -- 172.21.15.37:0/2616696120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 msgr2=0x5571ddd6a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddd6a300 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec000f80 tx=0x7fb2ec009bb0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 -- 172.21.15.37:0/2616696120 shutdown_connections 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5571dd944070 0x5571ddd74340 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571dd923390 0x5571ddd6a300 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5571dd91b1b0 0x5571ddcfba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 --2- 172.21.15.37:0/2616696120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5571dd9029f0 0x5571ddcfb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb30167e740 1 -- 172.21.15.37:0/2616696120 >> 172.21.15.37:0/2616696120 conn(0x5571dd938460 msgr2=0x5571ddceaac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.518+0000 7fb2d3fff640 0 client.16851 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.519+0000 7fb30167e740 1 -- 172.21.15.37:0/2616696120 shutdown_connections 2024-08-31T06:52:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.519+0000 7fb30167e740 1 -- 172.21.15.37:0/2616696120 wait complete. 2024-08-31T06:52:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.519+0000 7fb30167e740 20 client.16851 trim_cache size 0 max 16384 2024-08-31T06:52:33.527 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:52:33.527 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:52:33.527 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:52:33.528 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.529 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:52:33.530 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.532 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:33.533 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:33.534 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:33.534 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:52:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.519+0000 7fb2fb109640 1 -- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb2e40b4ca0 msgr2=0x7fb2e40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.519+0000 7fb2fb109640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb2e40b4ca0 0x7fb2e40b71b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5571ddce7f80 tx=0x7fb2e8005f90 comp rx=0 tx=0).stop 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.519+0000 7fb2fb109640 1 -- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f41050b0 msgr2=0x7fb2f41029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.519+0000 7fb2fb109640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f41050b0 0x7fb2f41029e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb2e000e9f0 tx=0x7fb2e000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.520+0000 7fb2fb109640 1 -- 172.21.15.37:0/995078787 shutdown_connections 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.520+0000 7fb2fb109640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb2e40b4ca0 0x7fb2e40b71b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.520+0000 7fb2fb109640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2f41050b0 0x7fb2f41029e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.520+0000 7fb2fb109640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2f410dbc0 0x7fb2f4102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.520+0000 7fb2fb109640 1 --2- 172.21.15.37:0/995078787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2f4104760 0x7fb2f41024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.520+0000 7fb2fb109640 1 -- 172.21.15.37:0/995078787 >> 172.21.15.37:0/995078787 conn(0x7fb2f40794d0 msgr2=0x7fb2f4100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.520+0000 7fb2fb109640 1 -- 172.21.15.37:0/995078787 shutdown_connections 2024-08-31T06:52:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:33.520+0000 7fb2fb109640 1 -- 172.21.15.37:0/995078787 wait complete. 2024-08-31T06:52:33.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:33 smithi106 ceph-mon[22134]: pgmap v491: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:52:33.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:33 smithi066 ceph-mon[22244]: pgmap v491: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-08-31T06:52:34.361 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:52:34.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:52:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 -- 172.21.15.37:0/3195368197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c102820 msgr2=0x7f9f0c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3195368197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c102820 0x7f9f0c102c30 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009900 tx=0x7f9efc02a410 comp rx=0 tx=0).stop 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 -- 172.21.15.37:0/3195368197 shutdown_connections 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3195368197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c108ab0 0x7f9f0c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3195368197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c108160 0x7f9f0c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3195368197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c102820 0x7f9f0c102c30 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 -- 172.21.15.37:0/3195368197 >> 172.21.15.37:0/3195368197 conn(0x7f9f0c0794e0 msgr2=0x7f9f0c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 -- 172.21.15.37:0/3195368197 shutdown_connections 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.092+0000 7f9f10da4640 1 -- 172.21.15.37:0/3195368197 wait complete. 2024-08-31T06:52:35.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.093+0000 7f9f10da4640 1 Processor -- start 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.093+0000 7f9f10da4640 1 -- start start 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.093+0000 7f9f10da4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102820 0x7f9f0c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f10da4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c108160 0x7f9f0c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f10da4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c108ab0 0x7f9f0c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f10da4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1125c0 con 0x7f9f0c108ab0 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f10da4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c112440 con 0x7f9f0c108160 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f10da4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c112740 con 0x7f9f0c102820 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c108ab0 0x7f9f0c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c108ab0 0x7f9f0c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53204/0 (socket says 172.21.15.37:53204) 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 -- 172.21.15.37:0/3367804579 learned_addr learned my addr 172.21.15.37:0/3367804579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0a59c640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102820 0x7f9f0c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f03fff640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c108160 0x7f9f0c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:35.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 -- 172.21.15.37:0/3367804579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102820 msgr2=0x7f9f0c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102820 0x7f9f0c198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 -- 172.21.15.37:0/3367804579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c108160 msgr2=0x7f9f0c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c108160 0x7f9f0c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 -- 172.21.15.37:0/3367804579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c1a8440 con 0x7f9f0c108ab0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f0ad9d640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c108ab0 0x7f9f0c199840 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400cce0 tx=0x7f9f0400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.094+0000 7f9f037fe640 1 -- 172.21.15.37:0/3367804579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400f450 con 0x7f9f0c108ab0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.095+0000 7f9f037fe640 1 -- 172.21.15.37:0/3367804579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f0400fa80 con 0x7f9f0c108ab0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.095+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c1a86d0 con 0x7f9f0c108ab0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.095+0000 7f9f037fe640 1 -- 172.21.15.37:0/3367804579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04018ad0 con 0x7f9f0c108ab0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.095+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c1a8bc0 con 0x7f9f0c108ab0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.096+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f0c103aa0 con 0x7f9f0c108ab0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.097+0000 7f9f037fe640 1 -- 172.21.15.37:0/3367804579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f9f0400f5f0 con 0x7f9f0c108ab0 2024-08-31T06:52:35.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.098+0000 7f9f037fe640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef80b4ca0 0x7f9ef80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.098+0000 7f9f0a59c640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef80b4ca0 0x7f9ef80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.098+0000 7f9f037fe640 1 -- 172.21.15.37:0/3367804579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9f040e5d90 con 0x7f9f0c108ab0 2024-08-31T06:52:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.098+0000 7f9f0a59c640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef80b4ca0 0x7f9ef80b71b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c107f40 tx=0x7f9efc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:35.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.101+0000 7f9f037fe640 1 -- 172.21.15.37:0/3367804579 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f9f04014030 con 0x7f9f0c108ab0 2024-08-31T06:52:35.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.322+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f0c102c30 con 0x7f9f0c108ab0 2024-08-31T06:52:35.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.323+0000 7f9f037fe640 1 -- 172.21.15.37:0/3367804579 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f9f0c102c30 con 0x7f9f0c108ab0 2024-08-31T06:52:35.325 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:52:35.326 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:52:35.326 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:52:35.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef80b4ca0 msgr2=0x7f9ef80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:35.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef80b4ca0 0x7f9ef80b71b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c107f40 tx=0x7f9efc0058d0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c108ab0 msgr2=0x7f9f0c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c108ab0 0x7f9f0c199840 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400cce0 tx=0x7f9f0400a620 comp rx=0 tx=0).stop 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 shutdown_connections 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef80b4ca0 0x7f9ef80b71b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c108ab0 0x7f9f0c199840 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c108160 0x7f9f0c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 --2- 172.21.15.37:0/3367804579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102820 0x7f9f0c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 >> 172.21.15.37:0/3367804579 conn(0x7f9f0c0794e0 msgr2=0x7f9f0c101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 shutdown_connections 2024-08-31T06:52:35.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:35.325+0000 7f9f10da4640 1 -- 172.21.15.37:0/3367804579 wait complete. 2024-08-31T06:52:35.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:35 smithi037 ceph-mon[18612]: pgmap v492: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:35.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:35 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3367804579' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:52:35.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:35 smithi106 ceph-mon[22134]: pgmap v492: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:35.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:35 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3367804579' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:52:35.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:35 smithi066 ceph-mon[22244]: pgmap v492: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:35.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:35 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3367804579' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:52:35.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:52:36.211 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 -- 172.21.15.37:0/3471866233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 msgr2=0x7fd80c104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 --2- 172.21.15.37:0/3471866233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 0x7fd80c104ab0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009900 tx=0x7fd7fc02a410 comp rx=0 tx=0).stop 2024-08-31T06:52:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 -- 172.21.15.37:0/3471866233 shutdown_connections 2024-08-31T06:52:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 --2- 172.21.15.37:0/3471866233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd80c10dc50 0x7fd80c1100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 --2- 172.21.15.37:0/3471866233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c104ff0 0x7fd80c10d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 --2- 172.21.15.37:0/3471866233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 0x7fd80c104ab0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 -- 172.21.15.37:0/3471866233 >> 172.21.15.37:0/3471866233 conn(0x7fd80c079500 msgr2=0x7fd80c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 -- 172.21.15.37:0/3471866233 shutdown_connections 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 -- 172.21.15.37:0/3471866233 wait complete. 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.694+0000 7fd81158b640 1 Processor -- start 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd81158b640 1 -- start start 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd81158b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 0x7fd80c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd81158b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c104ff0 0x7fd80c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd81158b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd80c10dc50 0x7fd80c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd81158b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c1137f0 con 0x7fd80c1046a0 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd81158b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c113670 con 0x7fd80c10dc50 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd81158b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c113970 con 0x7fd80c104ff0 2024-08-31T06:52:36.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 0x7fd80c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 0x7fd80c19a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53220/0 (socket says 172.21.15.37:53220) 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80affd640 1 -- 172.21.15.37:0/2298643675 learned_addr learned my addr 172.21.15.37:0/2298643675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd80c10dc50 0x7fd80c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c104ff0 0x7fd80c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80affd640 1 -- 172.21.15.37:0/2298643675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c104ff0 msgr2=0x7fd80c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80affd640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c104ff0 0x7fd80c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80affd640 1 -- 172.21.15.37:0/2298643675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd80c10dc50 msgr2=0x7fd80c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80affd640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd80c10dc50 0x7fd80c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80affd640 1 -- 172.21.15.37:0/2298643675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80c1a0330 con 0x7fd80c1046a0 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.695+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c104ff0 0x7fd80c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.696+0000 7fd80affd640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 0x7fd80c19a3c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc005940 tx=0x7fd7fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.696+0000 7fd7f3fff640 1 -- 172.21.15.37:0/2298643675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc03f030 con 0x7fd80c1046a0 2024-08-31T06:52:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.696+0000 7fd81158b640 1 -- 172.21.15.37:0/2298643675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80c1a05c0 con 0x7fd80c1046a0 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.696+0000 7fd7f3fff640 1 -- 172.21.15.37:0/2298643675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7fc003c90 con 0x7fd80c1046a0 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.696+0000 7fd7f3fff640 1 -- 172.21.15.37:0/2298643675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc035070 con 0x7fd80c1046a0 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.696+0000 7fd81158b640 1 -- 172.21.15.37:0/2298643675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80c1a6d80 con 0x7fd80c1046a0 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.698+0000 7fd817b00740 1 Processor -- start 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.698+0000 7fd817b00740 1 -- start start 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd817b00740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859e977310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd817b00740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 0x55859e977850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd817b00740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5b1390 0x55859e977d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd7f3fff640 1 -- 172.21.15.37:0/2298643675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fd7fc042030 con 0x7fd80c1046a0 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd817b00740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55859e8ee680 con 0x55859e5d2070 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd817b00740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55859e8ddc10 con 0x55859e5b1390 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd817b00740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55859e8e1bc0 con 0x55859e5a91b0 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859e977310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859e977310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53232/0 (socket says 172.21.15.37:53232) 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 -- 172.21.15.37:0/1932178446 learned_addr learned my addr 172.21.15.37:0/1932178446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5b1390 0x55859e977d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80affd640 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 0x55859e977850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 -- 172.21.15.37:0/1932178446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 msgr2=0x55859e977850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 0x55859e977850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 -- 172.21.15.37:0/1932178446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5b1390 msgr2=0x55859e977d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5b1390 0x55859e977d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 -- 172.21.15.37:0/1932178446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859e63d650 con 0x55859e5d2070 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.699+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859e977310 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd804009ef0 tx=0x7fd80400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdb60b92fec0212 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd7f17fa640 1 -- 172.21.15.37:0/1932178446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80401a070 con 0x55859e5d2070 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd7f17fa640 1 -- 172.21.15.37:0/1932178446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8040158a0 con 0x55859e5d2070 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd7f17fa640 1 -- 172.21.15.37:0/1932178446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80400a720 con 0x55859e5d2070 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd7f3fff640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd7f40b4ca0 0x7fd7f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd80affd640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd7f40b4ca0 0x7fd7f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd7f3fff640 1 -- 172.21.15.37:0/2298643675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd7fc105bf0 con 0x7fd80c1046a0 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd817b00740 1 -- 172.21.15.37:0/1932178446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 msgr2=0x55859e977310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd817b00740 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859e977310 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd804009ef0 tx=0x7fd80400c7f0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.700+0000 7fd80affd640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd7f40b4ca0 0x7fd7f40b71b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc103430 tx=0x7fd7fc032f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 -- 172.21.15.37:0/1932178446 shutdown_connections 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5b1390 0x55859e977d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 0x55859e977850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 --2- 172.21.15.37:0/1932178446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859e977310 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 -- 172.21.15.37:0/1932178446 >> 172.21.15.37:0/1932178446 conn(0x55859e5c6460 msgr2=0x55859e975200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 -- 172.21.15.37:0/1932178446 shutdown_connections 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 -- 172.21.15.37:0/1932178446 wait complete. 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 -- start start 2024-08-31T06:52:36.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 Processor -- start 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5a91b0 0x55859e986e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e987390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 0x55859e993180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55859e740700 con 0x55859e5a91b0 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55859e864750 con 0x55859e5d2070 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.701+0000 7fd817b00740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55859e989e50 con 0x55859e5b1390 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5a91b0 0x55859e986e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd817b00740 10 client.0 _ll_register_callbacks cb 0x55859e893e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5a91b0 0x55859e986e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53248/0 (socket says 172.21.15.37:53248) 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 -- 172.21.15.37:0/2433931176 learned_addr learned my addr 172.21.15.37:0/2433931176 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e987390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 0x55859e993180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 -- 172.21.15.37:0/2433931176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 msgr2=0x55859e987390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e987390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 -- 172.21.15.37:0/2433931176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 msgr2=0x55859e993180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 0x55859e993180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 -- 172.21.15.37:0/2433931176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55859e89d900 con 0x55859e5a91b0 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5a91b0 0x55859e986e50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd804009b00 tx=0x7fd80400a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626ad5e69e587553 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd7eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2433931176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80401a050 con 0x55859e5a91b0 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2433931176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd80400a710 con 0x55859e5a91b0 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd817b00740 1 -- 172.21.15.37:0/2433931176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8040158a0 con 0x55859e5a91b0 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2433931176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd804030050 con 0x55859e5a91b0 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd817b00740 10 client.16869 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:36.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.702+0000 7fd817b00740 1 -- 172.21.15.37:0/2433931176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55859e995c00 con 0x55859e5a91b0 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2433931176 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd8040158a0 con 0x55859e5a91b0 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2433931176 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd8040226d0 con 0x55859e5a91b0 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd817b00740 10 client.16869 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd817b00740 10 client.16869 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd817b00740 20 client.16869 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd817b00740 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55859e5909f0 0x55859e999070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd817b00740 4 client.16869 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd817b00740 1 -- 172.21.15.37:0/2433931176 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55859e8f05d0 con 0x55859e5909f0 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.703+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55859e5909f0 0x55859e999070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.704+0000 7fd7eeff5640 10 client.16869 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.704+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55859e5909f0 0x55859e999070 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9faaca0f0cc6c64e server_cookie=d772aabe7488440d in_seq=0 out_seq=0 2024-08-31T06:52:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.704+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2433931176 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55859e8f05d0 con 0x55859e5909f0 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.704+0000 7fd7eeff5640 10 client.16869 handle_command_reply: tid=0 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.704+0000 7fd817b00740 1 client.16869 shutdown 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 -- 172.21.15.37:0/2433931176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5a91b0 msgr2=0x55859e986e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5a91b0 0x55859e986e50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd804009b00 tx=0x7fd80400a400 comp rx=0 tx=0).stop 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 -- 172.21.15.37:0/2433931176 shutdown_connections 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55859e5909f0 0x55859e999070 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 0x55859e993180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e987390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd7eeff5640 0 client.16869 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 --2- 172.21.15.37:0/2433931176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5a91b0 0x55859e986e50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 -- 172.21.15.37:0/2433931176 >> 172.21.15.37:0/2433931176 conn(0x55859e5c6460 msgr2=0x55859e978d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 -- 172.21.15.37:0/2433931176 shutdown_connections 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 1 -- 172.21.15.37:0/2433931176 wait complete. 2024-08-31T06:52:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.705+0000 7fd817b00740 20 client.16869 trim_cache size 0 max 16384 2024-08-31T06:52:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd817b00740 1 Processor -- start 2024-08-31T06:52:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd817b00740 1 -- start start 2024-08-31T06:52:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd817b00740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 0x55859e988d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd817b00740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5b1390 0x55859e978a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd817b00740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 0x55859e9930f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd817b00740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c1afb80 con 0x55859e5b1390 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd817b00740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c1ad450 con 0x55859e5d2070 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd817b00740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c1ab2a0 con 0x55859e5a91b0 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd80a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5b1390 0x55859e978a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.718+0000 7fd80a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5b1390 0x55859e978a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53262/0 (socket says 172.21.15.37:53262) 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80a7fc640 1 -- 172.21.15.37:0/3486091293 learned_addr learned my addr 172.21.15.37:0/3486091293 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 0x55859e988d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 0x55859e9930f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80a7fc640 1 -- 172.21.15.37:0/3486091293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 msgr2=0x55859e988d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 0x55859e988d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80a7fc640 1 -- 172.21.15.37:0/3486091293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 msgr2=0x55859e9930f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 0x55859e9930f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80a7fc640 1 -- 172.21.15.37:0/3486091293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55859e97a0d0 con 0x55859e5b1390 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5b1390 0x55859e978a50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd80000aac0 tx=0x7fd800008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf29d9e0ecc7b59 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd7f0ff9640 1 -- 172.21.15.37:0/3486091293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd800020070 con 0x55859e5b1390 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd7f0ff9640 1 -- 172.21.15.37:0/3486091293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd800015e20 con 0x55859e5b1390 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.719+0000 7fd7f0ff9640 1 -- 172.21.15.37:0/3486091293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000235c0 con 0x55859e5b1390 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 -- 172.21.15.37:0/3486091293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5b1390 msgr2=0x55859e978a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5b1390 0x55859e978a50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd80000aac0 tx=0x7fd800008040 comp rx=0 tx=0).stop 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 -- 172.21.15.37:0/3486091293 shutdown_connections 2024-08-31T06:52:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5b1390 0x55859e978a50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5d2070 0x55859e9930f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 --2- 172.21.15.37:0/3486091293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5a91b0 0x55859e988d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 -- 172.21.15.37:0/3486091293 >> 172.21.15.37:0/3486091293 conn(0x55859e5c6460 msgr2=0x55859e978340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 -- 172.21.15.37:0/3486091293 shutdown_connections 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 -- 172.21.15.37:0/3486091293 wait complete. 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.720+0000 7fd817b00740 1 -- start start 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd817b00740 1 Processor -- start 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd817b00740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5a91b0 0x55859e9f7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd817b00740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e9f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd817b00740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859ea02800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd817b00740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c1ab910 con 0x55859e5d2070 2024-08-31T06:52:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd817b00740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c1acd80 con 0x55859e5a91b0 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd817b00740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c1abfe0 con 0x55859e5b1390 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd817b00740 10 client.0 _ll_register_callbacks cb 0x7fd804018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859ea02800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859ea02800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53278/0 (socket says 172.21.15.37:53278) 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 -- 172.21.15.37:0/2822835375 learned_addr learned my addr 172.21.15.37:0/2822835375 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5a91b0 0x55859e9f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e9f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 -- 172.21.15.37:0/2822835375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 msgr2=0x55859e9f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e9f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 -- 172.21.15.37:0/2822835375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5a91b0 msgr2=0x55859e9f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5a91b0 0x55859e9f7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80b7fe640 1 -- 172.21.15.37:0/2822835375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55859e978150 con 0x55859e5d2070 2024-08-31T06:52:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.721+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e9f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd80b7fe640 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859ea02800 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd804009bb0 tx=0x7fd80400a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a22c079f6b5517 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd7eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2822835375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80401a040 con 0x55859e5d2070 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2822835375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fd804022650 con 0x55859e5d2070 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 1 -- 172.21.15.37:0/2822835375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd800015e20 con 0x55859e5d2070 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2822835375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd804009840 con 0x55859e5d2070 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 10 client.16875 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 1 -- 172.21.15.37:0/2822835375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55859ea03cc0 con 0x55859e5d2070 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2822835375 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd800015e20 con 0x55859e5d2070 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2822835375 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd804034400 con 0x55859e5d2070 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 10 client.16875 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:36.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 10 client.16875 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 20 client.16875 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55859e565da0 0x55859ea062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 4 client.16875 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.722+0000 7fd817b00740 1 -- 172.21.15.37:0/2822835375 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55859e8ec070 con 0x55859e565da0 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.723+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55859e565da0 0x55859ea062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.723+0000 7fd80a7fc640 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55859e565da0 0x55859ea062e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7340d4537d65d91a server_cookie=af79c2a587cfb586 in_seq=0 out_seq=0 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.723+0000 7fd7eeff5640 10 client.16875 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd7eeff5640 1 -- 172.21.15.37:0/2822835375 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55859e8ec070 con 0x55859e565da0 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd7eeff5640 10 client.16875 handle_command_reply: tid=0 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 client.16875 shutdown 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 -- 172.21.15.37:0/2822835375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 msgr2=0x55859ea02800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859ea02800 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd804009bb0 tx=0x7fd80400a400 comp rx=0 tx=0).stop 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 -- 172.21.15.37:0/2822835375 shutdown_connections 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55859e5d2070 0x55859ea02800 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55859e565da0 0x55859ea062e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55859e5b1390 0x55859e9f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 --2- 172.21.15.37:0/2822835375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55859e5a91b0 0x55859e9f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd7eeff5640 0 client.16875 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 -- 172.21.15.37:0/2822835375 >> 172.21.15.37:0/2822835375 conn(0x55859e5c6460 msgr2=0x55859e988ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 -- 172.21.15.37:0/2822835375 shutdown_connections 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 1 -- 172.21.15.37:0/2822835375 wait complete. 2024-08-31T06:52:36.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd817b00740 20 client.16875 trim_cache size 0 max 16384 2024-08-31T06:52:36.744 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:52:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 -- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd7f40b4ca0 msgr2=0x7fd7f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd7f40b4ca0 0x7fd7f40b71b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc103430 tx=0x7fd7fc032f90 comp rx=0 tx=0).stop 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 -- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 msgr2=0x7fd80c19a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 0x7fd80c19a3c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc005940 tx=0x7fd7fc0042f0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 -- 172.21.15.37:0/2298643675 shutdown_connections 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fd7f40b4ca0 0x7fd7f40b71b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd80c10dc50 0x7fd80c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c104ff0 0x7fd80c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 --2- 172.21.15.37:0/2298643675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd80c1046a0 0x7fd80c19a3c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.724+0000 7fd81158b640 1 -- 172.21.15.37:0/2298643675 >> 172.21.15.37:0/2298643675 conn(0x7fd80c079500 msgr2=0x7fd80c1008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.725+0000 7fd81158b640 1 -- 172.21.15.37:0/2298643675 shutdown_connections 2024-08-31T06:52:36.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:36.725+0000 7fd81158b640 1 -- 172.21.15.37:0/2298643675 wait complete. 2024-08-31T06:52:37.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:52:37.645 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:37.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:37 smithi037 ceph-mon[18612]: pgmap v493: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:37.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:37 smithi106 ceph-mon[22134]: pgmap v493: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:37.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:37 smithi066 ceph-mon[22244]: pgmap v493: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 -- 172.21.15.37:0/4133352216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3194102d40 msgr2=0x7f319410fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 --2- 172.21.15.37:0/4133352216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3194102d40 0x7f319410fa60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f3184009900 tx=0x7f318402a480 comp rx=0 tx=0).stop 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 -- 172.21.15.37:0/4133352216 shutdown_connections 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 --2- 172.21.15.37:0/4133352216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3194102d40 0x7f319410fa60 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 --2- 172.21.15.37:0/4133352216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f319410ffa0 0x7f31941123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 --2- 172.21.15.37:0/4133352216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31941023f0 0x7f3194102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 -- 172.21.15.37:0/4133352216 >> 172.21.15.37:0/4133352216 conn(0x7f3194079510 msgr2=0x7f3194079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 -- 172.21.15.37:0/4133352216 shutdown_connections 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.102+0000 7f319c108640 1 -- 172.21.15.37:0/4133352216 wait complete. 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319c108640 1 Processor -- start 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319c108640 1 -- start start 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319c108640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31941023f0 0x7f319419c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319c108640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3194102d40 0x7f319419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319c108640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319410ffa0 0x7f31941a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319c108640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3194115940 con 0x7f31941023f0 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319c108640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31941157c0 con 0x7f319410ffa0 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319c108640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3194115ac0 con 0x7f3194102d40 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f3199ea4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31941023f0 0x7f319419c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f3199ea4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31941023f0 0x7f319419c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53294/0 (socket says 172.21.15.37:53294) 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f3199ea4640 1 -- 172.21.15.37:0/3970634365 learned_addr learned my addr 172.21.15.37:0/3970634365 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319a6a5640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319410ffa0 0x7f31941a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f31996a3640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3194102d40 0x7f319419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f3199ea4640 1 -- 172.21.15.37:0/3970634365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3194102d40 msgr2=0x7f319419ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f3199ea4640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3194102d40 0x7f319419ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f3199ea4640 1 -- 172.21.15.37:0/3970634365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319410ffa0 msgr2=0x7f31941a1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f3199ea4640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319410ffa0 0x7f31941a1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f3199ea4640 1 -- 172.21.15.37:0/3970634365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941a2400 con 0x7f31941023f0 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.103+0000 7f319a6a5640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319410ffa0 0x7f31941a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.104+0000 7f3199ea4640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31941023f0 0x7f319419c490 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f319000d950 tx=0x7f319000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.104+0000 7f318affd640 1 -- 172.21.15.37:0/3970634365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3190017030 con 0x7f31941023f0 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.104+0000 7f319c108640 1 -- 172.21.15.37:0/3970634365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941a26f0 con 0x7f31941023f0 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.104+0000 7f318affd640 1 -- 172.21.15.37:0/3970634365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3190004020 con 0x7f31941023f0 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.104+0000 7f318affd640 1 -- 172.21.15.37:0/3970634365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31900055d0 con 0x7f31941023f0 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.104+0000 7f319c108640 1 -- 172.21.15.37:0/3970634365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941a8e50 con 0x7f31941023f0 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.106+0000 7f31a267d740 1 Processor -- start 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f31a267d740 1 -- start start 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f31a267d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b4c070 0x560c90ef1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f31a267d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b231b0 0x560c90ef1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f31a267d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 0x560c90ef1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f31a267d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c90e68680 con 0x560c90b4c070 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f31a267d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560c90e57c10 con 0x560c90b231b0 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f31a267d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560c90e5bbc0 con 0x560c90b2b390 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f318affd640 1 -- 172.21.15.37:0/3970634365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f31900047a0 con 0x7f31941023f0 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f319a6a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b4c070 0x560c90ef1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f319a6a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b4c070 0x560c90ef1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53302/0 (socket says 172.21.15.37:53302) 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f319a6a5640 1 -- 172.21.15.37:0/4219732501 learned_addr learned my addr 172.21.15.37:0/4219732501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f3199ea4640 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b231b0 0x560c90ef1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f31996a3640 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 0x560c90ef1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f319a6a5640 1 -- 172.21.15.37:0/4219732501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 msgr2=0x560c90ef1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f319a6a5640 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 0x560c90ef1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f319a6a5640 1 -- 172.21.15.37:0/4219732501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b231b0 msgr2=0x560c90ef1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f319a6a5640 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b231b0 0x560c90ef1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f319a6a5640 1 -- 172.21.15.37:0/4219732501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c90bb7650 con 0x560c90b4c070 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.107+0000 7f3199ea4640 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b231b0 0x560c90ef1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.108+0000 7f319a6a5640 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b4c070 0x560c90ef1310 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f318c009f30 tx=0x7f318c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e11bf1965ebfc6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.108+0000 7f318affd640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f31800b4ca0 0x7f31800b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.108+0000 7f317ffff640 1 -- 172.21.15.37:0/4219732501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c016070 con 0x560c90b4c070 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.108+0000 7f317ffff640 1 -- 172.21.15.37:0/4219732501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f318c01baf0 con 0x560c90b4c070 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.108+0000 7f317ffff640 1 -- 172.21.15.37:0/4219732501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c012af0 con 0x560c90b4c070 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.108+0000 7f3199ea4640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f31800b4ca0 0x7f31800b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.108+0000 7f318affd640 1 -- 172.21.15.37:0/3970634365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f31900e5000 con 0x7f31941023f0 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 -- 172.21.15.37:0/4219732501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b4c070 msgr2=0x560c90ef1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b4c070 0x560c90ef1310 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f318c009f30 tx=0x7f318c010800 comp rx=0 tx=0).stop 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f3199ea4640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f31800b4ca0 0x7f31800b71b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f31900e2840 tx=0x7f31900ce040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 -- 172.21.15.37:0/4219732501 shutdown_connections 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 0x560c90ef1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b231b0 0x560c90ef1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 --2- 172.21.15.37:0/4219732501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b4c070 0x560c90ef1310 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 -- 172.21.15.37:0/4219732501 >> 172.21.15.37:0/4219732501 conn(0x560c90b40460 msgr2=0x560c90eef200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 -- 172.21.15.37:0/4219732501 shutdown_connections 2024-08-31T06:52:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.109+0000 7f31a267d740 1 -- 172.21.15.37:0/4219732501 wait complete. 2024-08-31T06:52:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 1 -- start start 2024-08-31T06:52:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 1 Processor -- start 2024-08-31T06:52:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90efca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 0x560c90efcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 0x560c90f08de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c90cba700 con 0x560c90b231b0 2024-08-31T06:52:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560c90dde750 con 0x560c90b4c070 2024-08-31T06:52:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560c90effaf0 con 0x560c90b2b390 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31a267d740 10 client.0 _ll_register_callbacks cb 0x560c90e0de10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f319a6a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90efca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f319a6a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90efca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53312/0 (socket says 172.21.15.37:53312) 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f319a6a5640 1 -- 172.21.15.37:0/1467375203 learned_addr learned my addr 172.21.15.37:0/1467375203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.110+0000 7f31996a3640 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 0x560c90efcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f319a6a5640 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 0x560c90f08de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f319a6a5640 1 -- 172.21.15.37:0/1467375203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 msgr2=0x560c90efcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f319a6a5640 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 0x560c90efcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f319a6a5640 1 -- 172.21.15.37:0/1467375203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 msgr2=0x560c90f08de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f319a6a5640 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 0x560c90f08de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f319a6a5640 1 -- 172.21.15.37:0/1467375203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c90e17900 con 0x560c90b231b0 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f319a6a5640 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90efca60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f318c006010 tx=0x7f318c012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f37149215b086 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f317d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f317d7fa640 1 -- 172.21.15.37:0/1467375203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c016030 con 0x560c90b231b0 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f317d7fa640 1 -- 172.21.15.37:0/1467375203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f318c01b460 con 0x560c90b231b0 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f31a267d740 1 -- 172.21.15.37:0/1467375203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f318c01baf0 con 0x560c90b231b0 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f317d7fa640 1 -- 172.21.15.37:0/1467375203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f318c004e10 con 0x560c90b231b0 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f31a267d740 10 client.16887 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.111+0000 7f31a267d740 1 -- 172.21.15.37:0/1467375203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c90f0b860 con 0x560c90b231b0 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f317d7fa640 1 -- 172.21.15.37:0/1467375203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f318c01baf0 con 0x560c90b231b0 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f317d7fa640 1 -- 172.21.15.37:0/1467375203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f318c00f040 con 0x560c90b231b0 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f31a267d740 10 client.16887 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f31a267d740 10 client.16887 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f31a267d740 20 client.16887 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f31a267d740 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x560c90b0a9f0 0x560c90f0ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f31a267d740 4 client.16887 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f31a267d740 1 -- 172.21.15.37:0/1467375203 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c90e6a5d0 con 0x560c90b0a9f0 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.112+0000 7f31996a3640 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x560c90b0a9f0 0x560c90f0ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.113+0000 7f317d7fa640 10 client.16887 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.113+0000 7f31996a3640 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x560c90b0a9f0 0x560c90f0ecd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a83bace72ae04d1 server_cookie=1de8eba1d5e86329 in_seq=0 out_seq=0 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f317d7fa640 1 -- 172.21.15.37:0/1467375203 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c90e6a5d0 con 0x560c90b0a9f0 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f317d7fa640 10 client.16887 handle_command_reply: tid=0 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 client.16887 shutdown 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 -- 172.21.15.37:0/1467375203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 msgr2=0x560c90efca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90efca60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f318c006010 tx=0x7f318c012520 comp rx=0 tx=0).stop 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 -- 172.21.15.37:0/1467375203 shutdown_connections 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x560c90b0a9f0 0x560c90f0ecd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 0x560c90f08de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b2b390 0x560c90efcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 --2- 172.21.15.37:0/1467375203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90efca60 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f317d7fa640 0 client.16887 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:52:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 -- 172.21.15.37:0/1467375203 >> 172.21.15.37:0/1467375203 conn(0x560c90b40460 msgr2=0x560c90ef44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 -- 172.21.15.37:0/1467375203 shutdown_connections 2024-08-31T06:52:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 1 -- 172.21.15.37:0/1467375203 wait complete. 2024-08-31T06:52:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.114+0000 7f31a267d740 20 client.16887 trim_cache size 0 max 16384 2024-08-31T06:52:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.127+0000 7f31a267d740 1 Processor -- start 2024-08-31T06:52:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31a267d740 1 -- start start 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31a267d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b231b0 0x560c90ef4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31a267d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b2b390 0x560c90f08d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31a267d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 0x560c90ef9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31a267d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f31941b3ed0 con 0x560c90b2b390 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31a267d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31941b17a0 con 0x560c90b4c070 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31a267d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f31941af5f0 con 0x560c90b231b0 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b2b390 0x560c90f08d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b2b390 0x560c90f08d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53324/0 (socket says 172.21.15.37:53324) 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 -- 172.21.15.37:0/1143764070 learned_addr learned my addr 172.21.15.37:0/1143764070 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f319a6a5640 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b231b0 0x560c90ef4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 -- 172.21.15.37:0/1143764070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b231b0 msgr2=0x560c90ef4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b231b0 0x560c90ef4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f319a6a5640 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 0x560c90ef9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 -- 172.21.15.37:0/1143764070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 msgr2=0x560c90ef9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 0x560c90ef9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 -- 172.21.15.37:0/1143764070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c90ef5060 con 0x560c90b2b390 2024-08-31T06:52:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.128+0000 7f31996a3640 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b2b390 0x560c90f08d50 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3184005ab0 tx=0x7f3184005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4103d8a5c48bee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.129+0000 7f317f7fe640 1 -- 172.21.15.37:0/1143764070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184048070 con 0x560c90b2b390 2024-08-31T06:52:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.129+0000 7f317f7fe640 1 -- 172.21.15.37:0/1143764070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31840044d0 con 0x560c90b2b390 2024-08-31T06:52:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.129+0000 7f317f7fe640 1 -- 172.21.15.37:0/1143764070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184035040 con 0x560c90b2b390 2024-08-31T06:52:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.129+0000 7f31a267d740 1 -- 172.21.15.37:0/1143764070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b2b390 msgr2=0x560c90f08d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.129+0000 7f31a267d740 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b2b390 0x560c90f08d50 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3184005ab0 tx=0x7f3184005a40 comp rx=0 tx=0).stop 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.129+0000 7f31a267d740 1 -- 172.21.15.37:0/1143764070 shutdown_connections 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.129+0000 7f31a267d740 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b2b390 0x560c90f08d50 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b4c070 0x560c90ef9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 --2- 172.21.15.37:0/1143764070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b231b0 0x560c90ef4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 -- 172.21.15.37:0/1143764070 >> 172.21.15.37:0/1143764070 conn(0x560c90b40460 msgr2=0x560c90ef4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 -- 172.21.15.37:0/1143764070 shutdown_connections 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 -- 172.21.15.37:0/1143764070 wait complete. 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 -- start start 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 Processor -- start 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90f106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b2b390 0x560c90f10c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.130+0000 7f31a267d740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b4c070 0x560c90f72420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f31a267d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f31941afc60 con 0x560c90b231b0 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f31a267d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f31941b10d0 con 0x560c90b2b390 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f31a267d740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f31941b0330 con 0x560c90b4c070 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f31a267d740 10 client.0 _ll_register_callbacks cb 0x7f318c009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90f106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90f106a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53338/0 (socket says 172.21.15.37:53338) 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 -- 172.21.15.37:0/2252663174 learned_addr learned my addr 172.21.15.37:0/2252663174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f31996a3640 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b2b390 0x560c90f10c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 -- 172.21.15.37:0/2252663174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b4c070 msgr2=0x560c90f72420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b4c070 0x560c90f72420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 -- 172.21.15.37:0/2252663174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b2b390 msgr2=0x560c90f10c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b2b390 0x560c90f10c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 -- 172.21.15.37:0/2252663174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c90f72a90 con 0x560c90b231b0 2024-08-31T06:52:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f319a6a5640 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90f106a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x560c90eff2b0 tx=0x7f318c010ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271a5831c8bf7e37 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f317d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f317d7fa640 1 -- 172.21.15.37:0/2252663174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c016050 con 0x560c90b231b0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f317d7fa640 1 -- 172.21.15.37:0/2252663174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f318c02d070 con 0x560c90b231b0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.131+0000 7f31a267d740 1 -- 172.21.15.37:0/2252663174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31840044d0 con 0x560c90b231b0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f317d7fa640 1 -- 172.21.15.37:0/2252663174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f318c005810 con 0x560c90b231b0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31a267d740 10 client.16893 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31a267d740 1 -- 172.21.15.37:0/2252663174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c90f79e60 con 0x560c90b231b0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f317d7fa640 1 -- 172.21.15.37:0/2252663174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31840044d0 con 0x560c90b231b0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f317d7fa640 1 -- 172.21.15.37:0/2252663174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f318c01b480 con 0x560c90b231b0 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31a267d740 10 client.16893 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31a267d740 10 client.16893 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31a267d740 20 client.16893 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31a267d740 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x560c90adfda0 0x560c90f7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31a267d740 4 client.16893 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:52:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31a267d740 1 -- 172.21.15.37:0/2252663174 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c90e66070 con 0x560c90adfda0 2024-08-31T06:52:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.132+0000 7f31996a3640 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x560c90adfda0 0x560c90f7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f317d7fa640 10 client.16893 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:52:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31996a3640 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x560c90adfda0 0x560c90f7c4d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7309ceef45f06e5 server_cookie=508406da55ad23d9 in_seq=0 out_seq=0 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f317d7fa640 1 -- 172.21.15.37:0/2252663174 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c90e66070 con 0x560c90adfda0 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f317d7fa640 10 client.16893 handle_command_reply: tid=0 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 client.16893 shutdown 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 -- 172.21.15.37:0/2252663174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 msgr2=0x560c90f106a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90f106a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x560c90eff2b0 tx=0x7f318c010ea0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 -- 172.21.15.37:0/2252663174 shutdown_connections 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x560c90adfda0 0x560c90f7c4d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c90b4c070 0x560c90f72420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c90b2b390 0x560c90f10c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 --2- 172.21.15.37:0/2252663174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c90b231b0 0x560c90f106a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f317d7fa640 0 client.16893 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 -- 172.21.15.37:0/2252663174 >> 172.21.15.37:0/2252663174 conn(0x560c90b40460 msgr2=0x560c90efdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 -- 172.21.15.37:0/2252663174 shutdown_connections 2024-08-31T06:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 1 -- 172.21.15.37:0/2252663174 wait complete. 2024-08-31T06:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.133+0000 7f31a267d740 20 client.16893 trim_cache size 0 max 16384 2024-08-31T06:52:38.139 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 -- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f31800b4ca0 msgr2=0x7f31800b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f31800b4ca0 0x7f31800b71b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f31900e2840 tx=0x7f31900ce040 comp rx=0 tx=0).stop 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 -- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31941023f0 msgr2=0x7f319419c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31941023f0 0x7f319419c490 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f319000d950 tx=0x7f319000de10 comp rx=0 tx=0).stop 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 -- 172.21.15.37:0/3970634365 shutdown_connections 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f31800b4ca0 0x7f31800b71b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f319410ffa0 0x7f31941a1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3194102d40 0x7f319419ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 --2- 172.21.15.37:0/3970634365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31941023f0 0x7f319419c490 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 -- 172.21.15.37:0/3970634365 >> 172.21.15.37:0/3970634365 conn(0x7f3194079510 msgr2=0x7f3194111540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 -- 172.21.15.37:0/3970634365 shutdown_connections 2024-08-31T06:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:38.134+0000 7f319c108640 1 -- 172.21.15.37:0/3970634365 wait complete. 2024-08-31T06:52:38.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:52:39.082 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:39.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:39 smithi037 ceph-mon[18612]: pgmap v494: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 -- 172.21.15.37:0/2999241412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c103900 msgr2=0x7f3c9c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/2999241412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c103900 0x7f3c9c103d10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009900 tx=0x7f3c8c02a410 comp rx=0 tx=0).stop 2024-08-31T06:52:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 -- 172.21.15.37:0/2999241412 shutdown_connections 2024-08-31T06:52:39.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/2999241412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c9c109b90 0x7f3c9c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/2999241412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c9c109240 0x7f3c9c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/2999241412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c103900 0x7f3c9c103d10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 -- 172.21.15.37:0/2999241412 >> 172.21.15.37:0/2999241412 conn(0x7f3c9c07b5f0 msgr2=0x7f3c9c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 -- 172.21.15.37:0/2999241412 shutdown_connections 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.568+0000 7f3ca1f15640 1 -- 172.21.15.37:0/2999241412 wait complete. 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3ca1f15640 1 Processor -- start 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3ca1f15640 1 -- start start 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3ca1f15640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c9c103900 0x7f3c9c1a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3ca1f15640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c109240 0x7f3c9c1a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3ca1f15640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c9c109b90 0x7f3c9c1ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3ca1f15640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c113700 con 0x7f3c9c109240 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3ca1f15640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c113580 con 0x7f3c9c103900 2024-08-31T06:52:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3ca1f15640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c113880 con 0x7f3c9c109b90 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.569+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c109240 0x7f3c9c1a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c109240 0x7f3c9c1a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53362/0 (socket says 172.21.15.37:53362) 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9affd640 1 -- 172.21.15.37:0/1930358393 learned_addr learned my addr 172.21.15.37:0/1930358393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c9c103900 0x7f3c9c1a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c9c109b90 0x7f3c9c1ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9affd640 1 -- 172.21.15.37:0/1930358393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c9c109b90 msgr2=0x7f3c9c1ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9affd640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c9c109b90 0x7f3c9c1ac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9affd640 1 -- 172.21.15.37:0/1930358393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c9c103900 msgr2=0x7f3c9c1a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9affd640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c9c103900 0x7f3c9c1a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9affd640 1 -- 172.21.15.37:0/1930358393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c1ac9a0 con 0x7f3c9c109240 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c9affd640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c109240 0x7f3c9c1a1920 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000e9f0 tx=0x7f3c9000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c98ff9640 1 -- 172.21.15.37:0/1930358393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9000ccc0 con 0x7f3c9c109240 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c98ff9640 1 -- 172.21.15.37:0/1930358393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c900108c0 con 0x7f3c9c109240 2024-08-31T06:52:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3ca1f15640 1 -- 172.21.15.37:0/1930358393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9c1acb70 con 0x7f3c9c109240 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3c98ff9640 1 -- 172.21.15.37:0/1930358393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90018750 con 0x7f3c9c109240 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.570+0000 7f3ca1f15640 1 -- 172.21.15.37:0/1930358393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c9c1ad020 con 0x7f3c9c109240 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.573+0000 7f3ca848a740 1 Processor -- start 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.573+0000 7f3ca848a740 1 -- start start 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c100070 0x55962c4a5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0d71b0 0x55962c4a5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3ca848a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55962c41c680 con 0x55962c0df390 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3ca848a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55962c40bc10 con 0x55962c0d71b0 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3ca848a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55962c40fbc0 con 0x55962c100070 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c98ff9640 1 -- 172.21.15.37:0/1930358393 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f3c90010430 con 0x7f3c9c109240 2024-08-31T06:52:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0d71b0 0x55962c4a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4a5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53364/0 (socket says 172.21.15.37:53364) 2024-08-31T06:52:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9affd640 1 -- 172.21.15.37:0/2426140487 learned_addr learned my addr 172.21.15.37:0/2426140487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0d71b0 0x55962c4a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.37:39564/0 (socket says 172.21.15.37:39564) 2024-08-31T06:52:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c100070 0x55962c4a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9affd640 1 -- 172.21.15.37:0/2426140487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c100070 msgr2=0x55962c4a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9affd640 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c100070 0x55962c4a5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9affd640 1 -- 172.21.15.37:0/2426140487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0d71b0 msgr2=0x55962c4a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9affd640 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0d71b0 0x55962c4a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.574+0000 7f3c9affd640 1 -- 172.21.15.37:0/2426140487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55962c16b650 con 0x55962c0df390 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.575+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0d71b0 0x55962c4a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.575+0000 7f3c9affd640 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4a5d90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e2f30 tx=0x7f3c900ed690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1abd06f6756643b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.575+0000 7f3c98ff9640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c840b4ca0 0x7f3c840b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.575+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c840b4ca0 0x7f3c840b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.575+0000 7f3c81ffb640 1 -- 172.21.15.37:0/2426140487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c900f4070 con 0x55962c0df390 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.575+0000 7f3c98ff9640 1 -- 172.21.15.37:0/1930358393 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3c900e5830 con 0x7f3c9c109240 2024-08-31T06:52:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.575+0000 7f3c81ffb640 1 -- 172.21.15.37:0/2426140487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c900abb20 con 0x55962c0df390 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.575+0000 7f3c81ffb640 1 -- 172.21.15.37:0/2426140487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c900ab960 con 0x55962c0df390 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 -- 172.21.15.37:0/2426140487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 msgr2=0x55962c4a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4a5d90 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e2f30 tx=0x7f3c900ed690 comp rx=0 tx=0).stop 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c840b4ca0 0x7f3c840b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005fd0 tx=0x7f3c94009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 -- 172.21.15.37:0/2426140487 shutdown_connections 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4a5d90 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0d71b0 0x55962c4a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 --2- 172.21.15.37:0/2426140487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c100070 0x55962c4a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 -- 172.21.15.37:0/2426140487 >> 172.21.15.37:0/2426140487 conn(0x55962c0f4460 msgr2=0x55962c4a3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 -- 172.21.15.37:0/2426140487 shutdown_connections 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.576+0000 7f3ca848a740 1 -- 172.21.15.37:0/2426140487 wait complete. 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 1 -- start start 2024-08-31T06:52:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 1 Processor -- start 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 0x55962c4b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4b1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c100070 0x55962c4bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55962c26e700 con 0x55962c0df390 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55962c392750 con 0x55962c100070 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55962c4b3af0 con 0x55962c0d71b0 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3ca848a740 10 client.0 _ll_register_callbacks cb 0x55962c3c1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4b1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53372/0 (socket says 172.21.15.37:53372) 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3c9affd640 1 -- 172.21.15.37:0/3991826753 learned_addr learned my addr 172.21.15.37:0/3991826753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c100070 0x55962c4bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.577+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 0x55962c4b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c9affd640 1 -- 172.21.15.37:0/3991826753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 msgr2=0x55962c4b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c9affd640 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 0x55962c4b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c9affd640 1 -- 172.21.15.37:0/3991826753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c100070 msgr2=0x55962c4bcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c9affd640 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c100070 0x55962c4bcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c9affd640 1 -- 172.21.15.37:0/3991826753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55962c3cb900 con 0x55962c0df390 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c9affd640 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4b1010 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e3070 tx=0x7f3c9000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1add974da87b03c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c7affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c7affd640 1 -- 172.21.15.37:0/3991826753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c900f4030 con 0x55962c0df390 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c7affd640 1 -- 172.21.15.37:0/3991826753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3c90010d50 con 0x55962c0df390 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3ca848a740 1 -- 172.21.15.37:0/3991826753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c900abb20 con 0x55962c0df390 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c7affd640 1 -- 172.21.15.37:0/3991826753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c90010720 con 0x55962c0df390 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3ca848a740 10 client.16905 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3ca848a740 1 -- 172.21.15.37:0/3991826753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55962c4bf920 con 0x55962c0df390 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.578+0000 7f3c7affd640 1 -- 172.21.15.37:0/3991826753 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c900abb20 con 0x55962c0df390 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.579+0000 7f3c7affd640 1 -- 172.21.15.37:0/3991826753 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3c900e5ce0 con 0x55962c0df390 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.579+0000 7f3ca848a740 10 client.16905 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.579+0000 7f3ca848a740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.579+0000 7f3ca848a740 20 client.16905 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.579+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55962c0be9f0 0x55962c4c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.579+0000 7f3ca848a740 4 client.16905 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.579+0000 7f3ca848a740 1 -- 172.21.15.37:0/3991826753 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55962c41e5d0 con 0x55962c0be9f0 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.579+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55962c0be9f0 0x55962c4c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.580+0000 7f3c7affd640 10 client.16905 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.580+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55962c0be9f0 0x55962c4c2c80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e599dd289aa964db server_cookie=a87e99c67d4bc0e7 in_seq=0 out_seq=0 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.580+0000 7f3c7affd640 1 -- 172.21.15.37:0/3991826753 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55962c41e5d0 con 0x55962c0be9f0 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.580+0000 7f3c7affd640 10 client.16905 handle_command_reply: tid=0 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.580+0000 7f3ca848a740 1 client.16905 shutdown 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.580+0000 7f3ca848a740 1 -- 172.21.15.37:0/3991826753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 msgr2=0x55962c4b1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.580+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4b1010 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e3070 tx=0x7f3c9000c840 comp rx=0 tx=0).stop 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 1 -- 172.21.15.37:0/3991826753 shutdown_connections 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55962c0be9f0 0x55962c4c2c80 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3c7affd640 0 client.16905 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4b1010 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c100070 0x55962c4bcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3991826753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 0x55962c4b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 1 -- 172.21.15.37:0/3991826753 >> 172.21.15.37:0/3991826753 conn(0x55962c0f4460 msgr2=0x55962c4a84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 1 -- 172.21.15.37:0/3991826753 shutdown_connections 2024-08-31T06:52:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 1 -- 172.21.15.37:0/3991826753 wait complete. 2024-08-31T06:52:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.581+0000 7f3ca848a740 20 client.16905 trim_cache size 0 max 16384 2024-08-31T06:52:39.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3ca848a740 1 Processor -- start 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3ca848a740 1 -- start start 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0be9f0 0x55962c4a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0d71b0 0x55962c4b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0df390 0x55962c4bcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3ca848a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1b8270 con 0x55962c0d71b0 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3ca848a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1b5b40 con 0x55962c0df390 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3ca848a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1b3990 con 0x55962c0be9f0 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0d71b0 0x55962c4b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3c9affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0d71b0 0x55962c4b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53388/0 (socket says 172.21.15.37:53388) 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3c9affd640 1 -- 172.21.15.37:0/1102171264 learned_addr learned my addr 172.21.15.37:0/1102171264 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.594+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0be9f0 0x55962c4a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c9affd640 1 -- 172.21.15.37:0/1102171264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0be9f0 msgr2=0x55962c4a33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c9affd640 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0be9f0 0x55962c4a33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0df390 0x55962c4bcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c9affd640 1 -- 172.21.15.37:0/1102171264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0df390 msgr2=0x55962c4bcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c9affd640 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0df390 0x55962c4bcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c9affd640 1 -- 172.21.15.37:0/1102171264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55962c4b1d90 con 0x55962c0d71b0 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0be9f0 0x55962c4a33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c9affd640 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0d71b0 0x55962c4b2700 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e35c0 tx=0x7f3c900abf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7aff7b4e4a2a70d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c817fa640 1 -- 172.21.15.37:0/1102171264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c900f4070 con 0x55962c0d71b0 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c817fa640 1 -- 172.21.15.37:0/1102171264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c900ede90 con 0x55962c0d71b0 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.595+0000 7f3c817fa640 1 -- 172.21.15.37:0/1102171264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c900ab780 con 0x55962c0d71b0 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 -- 172.21.15.37:0/1102171264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0d71b0 msgr2=0x55962c4b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0d71b0 0x55962c4b2700 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3c900e35c0 tx=0x7f3c900abf10 comp rx=0 tx=0).stop 2024-08-31T06:52:39.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 -- 172.21.15.37:0/1102171264 shutdown_connections 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0d71b0 0x55962c4b2700 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0df390 0x55962c4bcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 --2- 172.21.15.37:0/1102171264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0be9f0 0x55962c4a33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 -- 172.21.15.37:0/1102171264 >> 172.21.15.37:0/1102171264 conn(0x55962c0f4460 msgr2=0x55962c4b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 -- 172.21.15.37:0/1102171264 shutdown_connections 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 -- 172.21.15.37:0/1102171264 wait complete. 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 -- start start 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.596+0000 7f3ca848a740 1 Processor -- start 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0be9f0 0x55962c4c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 0x55962c4c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3ca848a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3ca848a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1b4000 con 0x55962c0df390 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3ca848a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1b5470 con 0x55962c0be9f0 2024-08-31T06:52:39.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3ca848a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1b46d0 con 0x55962c0d71b0 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3ca848a740 10 client.0 _ll_register_callbacks cb 0x7f3c940093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4c46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53404/0 (socket says 172.21.15.37:53404) 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9bfff640 1 -- 172.21.15.37:0/3253856688 learned_addr learned my addr 172.21.15.37:0/3253856688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9affd640 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 0x55962c4c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0be9f0 0x55962c4c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9bfff640 1 -- 172.21.15.37:0/3253856688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 msgr2=0x55962c4c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 0x55962c4c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9bfff640 1 -- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0be9f0 msgr2=0x55962c4c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0be9f0 0x55962c4c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9bfff640 1 -- 172.21.15.37:0/3253856688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55962c52c400 con 0x55962c0df390 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.597+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0be9f0 0x55962c4c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3c9bfff640 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4c46f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3c940041a0 tx=0x7f3c94004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dbbd551768fcc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:39.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3c7affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3c7affd640 1 -- 172.21.15.37:0/3253856688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94004b20 con 0x55962c0df390 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3c7affd640 1 -- 172.21.15.37:0/3253856688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f3c94004cc0 con 0x55962c0df390 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3ca848a740 1 -- 172.21.15.37:0/3253856688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c900ede90 con 0x55962c0df390 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3c7affd640 1 -- 172.21.15.37:0/3253856688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3c9400f9e0 con 0x55962c0df390 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3ca848a740 10 client.16911 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3ca848a740 1 -- 172.21.15.37:0/3253856688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55962c52d6b0 con 0x55962c0df390 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3c7affd640 1 -- 172.21.15.37:0/3253856688 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c900ede90 con 0x55962c0df390 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3c7affd640 1 -- 172.21.15.37:0/3253856688 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3c94027070 con 0x55962c0df390 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3ca848a740 10 client.16911 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3ca848a740 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.598+0000 7f3ca848a740 20 client.16911 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55962c100070 0x55962c52ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3ca848a740 4 client.16911 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:52:39.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3ca848a740 1 -- 172.21.15.37:0/3253856688 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55962c41a070 con 0x55962c100070 2024-08-31T06:52:39.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55962c100070 0x55962c52ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3c9b7fe640 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55962c100070 0x55962c52ff20 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=896641e38b48cebe server_cookie=81b6a682f60339d1 in_seq=0 out_seq=0 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3c7affd640 10 client.16911 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3c7affd640 1 -- 172.21.15.37:0/3253856688 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55962c41a070 con 0x55962c100070 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3c7affd640 10 client.16911 handle_command_reply: tid=0 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.599+0000 7f3ca848a740 1 client.16911 shutdown 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 -- 172.21.15.37:0/3253856688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 msgr2=0x55962c4c46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4c46f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3c940041a0 tx=0x7f3c94004ab0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 -- 172.21.15.37:0/3253856688 shutdown_connections 2024-08-31T06:52:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55962c100070 0x55962c52ff20 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55962c0df390 0x55962c4c46f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55962c0d71b0 0x55962c4c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3c7affd640 0 client.16911 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 --2- 172.21.15.37:0/3253856688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55962c0be9f0 0x55962c4c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 -- 172.21.15.37:0/3253856688 >> 172.21.15.37:0/3253856688 conn(0x55962c0f4460 msgr2=0x55962c4a8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 -- 172.21.15.37:0/3253856688 shutdown_connections 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 1 -- 172.21.15.37:0/3253856688 wait complete. 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca848a740 20 client.16911 trim_cache size 0 max 16384 2024-08-31T06:52:39.607 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 -- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c840b4ca0 msgr2=0x7f3c840b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c840b4ca0 0x7f3c840b71b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3c94005fd0 tx=0x7f3c94009500 comp rx=0 tx=0).stop 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 -- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c109240 msgr2=0x7f3c9c1a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c109240 0x7f3c9c1a1920 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f3c9000e9f0 tx=0x7f3c9000eeb0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 -- 172.21.15.37:0/1930358393 shutdown_connections 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3c840b4ca0 0x7f3c840b71b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c109240 0x7f3c9c1a1920 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c9c109b90 0x7f3c9c1ac460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 --2- 172.21.15.37:0/1930358393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c9c103900 0x7f3c9c1a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:39.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.600+0000 7f3ca1f15640 1 -- 172.21.15.37:0/1930358393 >> 172.21.15.37:0/1930358393 conn(0x7f3c9c07b5f0 msgr2=0x7f3c9c107150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:39.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.601+0000 7f3ca1f15640 1 -- 172.21.15.37:0/1930358393 shutdown_connections 2024-08-31T06:52:39.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:39.601+0000 7f3ca1f15640 1 -- 172.21.15.37:0/1930358393 wait complete. 2024-08-31T06:52:39.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:39 smithi106 ceph-mon[22134]: pgmap v494: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:39.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:39 smithi066 ceph-mon[22244]: pgmap v494: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:52:41.335 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:52:41.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:52:41.601 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:41.721 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:41 smithi037 ceph-mon[18612]: pgmap v495: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:41.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:41 smithi106 ceph-mon[22134]: pgmap v495: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:41.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:41 smithi066 ceph-mon[22244]: pgmap v495: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 -- 172.21.15.37:0/221466996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c102d30 msgr2=0x7f9f0c103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 --2- 172.21.15.37:0/221466996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c102d30 0x7f9f0c103140 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009900 tx=0x7f9f0002a410 comp rx=0 tx=0).stop 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 -- 172.21.15.37:0/221466996 shutdown_connections 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 --2- 172.21.15.37:0/221466996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c102d30 0x7f9f0c103140 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 --2- 172.21.15.37:0/221466996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c103680 0x7f9f0c10f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 --2- 172.21.15.37:0/221466996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c1073c0 0x7f9f0c1077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 -- 172.21.15.37:0/221466996 >> 172.21.15.37:0/221466996 conn(0x7f9f0c079bd0 msgr2=0x7f9f0c079fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 -- 172.21.15.37:0/221466996 shutdown_connections 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.077+0000 7f9f122a5640 1 -- 172.21.15.37:0/221466996 wait complete. 2024-08-31T06:52:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.078+0000 7f9f122a5640 1 Processor -- start 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.078+0000 7f9f122a5640 1 -- start start 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.078+0000 7f9f122a5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102d30 0x7f9f0c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f122a5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c103680 0x7f9f0c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f122a5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c1073c0 0x7f9f0c19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f122a5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c113740 con 0x7f9f0c1073c0 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f122a5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1135c0 con 0x7f9f0c103680 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f122a5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1138c0 con 0x7f9f0c102d30 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c1073c0 0x7f9f0c19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c1073c0 0x7f9f0c19fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53420/0 (socket says 172.21.15.37:53420) 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 -- 172.21.15.37:0/223606082 learned_addr learned my addr 172.21.15.37:0/223606082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102d30 0x7f9f0c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c103680 0x7f9f0c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 -- 172.21.15.37:0/223606082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102d30 msgr2=0x7f9f0c19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102d30 0x7f9f0c19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 -- 172.21.15.37:0/223606082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c103680 msgr2=0x7f9f0c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c103680 0x7f9f0c19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 -- 172.21.15.37:0/223606082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c1a0160 con 0x7f9f0c1073c0 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f10842640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c1073c0 0x7f9f0c19fa30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400cad0 tx=0x7f9f0400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f097fa640 1 -- 172.21.15.37:0/223606082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400ae20 con 0x7f9f0c1073c0 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f097fa640 1 -- 172.21.15.37:0/223606082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f04005020 con 0x7f9f0c1073c0 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f122a5640 1 -- 172.21.15.37:0/223606082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c1a0450 con 0x7f9f0c1073c0 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.079+0000 7f9f097fa640 1 -- 172.21.15.37:0/223606082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400f6b0 con 0x7f9f0c1073c0 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.080+0000 7f9f122a5640 1 -- 172.21.15.37:0/223606082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c1a6bb0 con 0x7f9f0c1073c0 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.082+0000 7f9f097fa640 1 -- 172.21.15.37:0/223606082 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f9f040051d0 con 0x7f9f0c1073c0 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.082+0000 7f9f1881a740 1 Processor -- start 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.082+0000 7f9f1881a740 1 -- start start 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dc1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 0x559a17dc20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 0x559a17dc2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f1881a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a17d335f0 con 0x559a17a17350 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f1881a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559a17d22b80 con 0x559a179f6670 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f1881a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559a17d26b30 con 0x559a179ee490 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dc1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dc1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53428/0 (socket says 172.21.15.37:53428) 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/2785670673 learned_addr learned my addr 172.21.15.37:0/2785670673 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 0x559a17dc20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f097fa640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef40b4ca0 0x7f9ef40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 0x559a17dc2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f10842640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef40b4ca0 0x7f9ef40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/2785670673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 msgr2=0x559a17dc20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 0x559a17dc20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/2785670673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 msgr2=0x559a17dc2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 0x559a17dc2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/2785670673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a17a82930 con 0x559a17a17350 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f097fa640 1 -- 172.21.15.37:0/223606082 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9f040e57f0 con 0x7f9f0c1073c0 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.083+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dc1b90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9f000057c0 tx=0x7f9f00005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37be5cfe86cf57c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.084+0000 7f9ef27fc640 1 -- 172.21.15.37:0/2785670673 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00044020 con 0x559a17a17350 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.084+0000 7f9f10842640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef40b4ca0 0x7f9ef40b71b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9f040e3030 tx=0x7f9f04079470 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.084+0000 7f9ef27fc640 1 -- 172.21.15.37:0/2785670673 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f000044c0 con 0x559a17a17350 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.084+0000 7f9ef27fc640 1 -- 172.21.15.37:0/2785670673 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00035040 con 0x559a17a17350 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.084+0000 7f9f1881a740 1 -- 172.21.15.37:0/2785670673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 msgr2=0x559a17dc1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.084+0000 7f9f1881a740 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dc1b90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f9f000057c0 tx=0x7f9f00005fd0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 -- 172.21.15.37:0/2785670673 shutdown_connections 2024-08-31T06:52:42.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 0x559a17dc2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 0x559a17dc20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 --2- 172.21.15.37:0/2785670673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dc1b90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 -- 172.21.15.37:0/2785670673 >> 172.21.15.37:0/2785670673 conn(0x559a17a0b740 msgr2=0x559a17dbfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 -- 172.21.15.37:0/2785670673 shutdown_connections 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 -- 172.21.15.37:0/2785670673 wait complete. 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 -- start start 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.085+0000 7f9f1881a740 1 Processor -- start 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dcd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179f6670 0x559a17dcd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dd9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f1881a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a17b85890 con 0x559a17a17350 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f1881a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559a17ca9790 con 0x559a179ee490 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f1881a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559a17dd0310 con 0x559a179f6670 2024-08-31T06:52:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f1881a740 10 client.0 _ll_register_callbacks cb 0x559a17a2eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dd9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dd9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53432/0 (socket says 172.21.15.37:53432) 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/1767262088 learned_addr learned my addr 172.21.15.37:0/1767262088 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179f6670 0x559a17dcd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dcd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/1767262088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179f6670 msgr2=0x559a17dcd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179f6670 0x559a17dcd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/1767262088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 msgr2=0x559a17dcd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dcd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/1767262088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a17ce0f30 con 0x559a17a17350 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179f6670 0x559a17dcd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dd9630 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9f0002a930 tx=0x7f9f00003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64b1533bd90d746 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9eeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/1767262088 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00035070 con 0x559a17a17350 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/1767262088 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9f00003c30 con 0x559a17a17350 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.086+0000 7f9f1881a740 1 -- 172.21.15.37:0/1767262088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559a17d35540 con 0x559a17a17350 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/1767262088 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f00044070 con 0x559a17a17350 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f1881a740 10 client.16923 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f1881a740 1 -- 172.21.15.37:0/1767262088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a17ddc0d0 con 0x559a17a17350 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/1767262088 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559a17d35540 con 0x559a17a17350 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/1767262088 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f0004c880 con 0x559a17a17350 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f1881a740 10 client.16923 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f1881a740 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f1881a740 20 client.16923 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f1881a740 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559a179d5cd0 0x559a17ddf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f1881a740 4 client.16923 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f1881a740 1 -- 172.21.15.37:0/1767262088 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a17d30fe0 con 0x559a179d5cd0 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.087+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559a179d5cd0 0x559a17ddf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.088+0000 7f9eeb7fe640 10 client.16923 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.088+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559a179d5cd0 0x559a17ddf430 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43faac89ecc18892 server_cookie=97824ec1f9fa7108 in_seq=0 out_seq=0 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.088+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/1767262088 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a17d30fe0 con 0x559a179d5cd0 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9eeb7fe640 10 client.16923 handle_command_reply: tid=0 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 client.16923 shutdown 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 -- 172.21.15.37:0/1767262088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 msgr2=0x559a17dd9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dd9630 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9f0002a930 tx=0x7f9f00003930 comp rx=0 tx=0).stop 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 -- 172.21.15.37:0/1767262088 shutdown_connections 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559a179d5cd0 0x559a17ddf430 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dd9630 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179f6670 0x559a17dcd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 --2- 172.21.15.37:0/1767262088 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dcd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 -- 172.21.15.37:0/1767262088 >> 172.21.15.37:0/1767262088 conn(0x559a17a0b740 msgr2=0x559a17dc4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:42.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9eeb7fe640 0 client.16923 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:42.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 -- 172.21.15.37:0/1767262088 shutdown_connections 2024-08-31T06:52:42.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 1 -- 172.21.15.37:0/1767262088 wait complete. 2024-08-31T06:52:42.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.089+0000 7f9f1881a740 20 client.16923 trim_cache size 0 max 16384 2024-08-31T06:52:42.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.107+0000 7f9f1881a740 1 Processor -- start 2024-08-31T06:52:42.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.107+0000 7f9f1881a740 1 -- start start 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 0x559a17dd95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 0x559a17dca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dcaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f1881a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1af990 con 0x559a17a17350 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f1881a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1ad260 con 0x559a179f6670 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f1881a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1ab0b0 con 0x559a179ee490 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dcaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dcaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53436/0 (socket says 172.21.15.37:53436) 2024-08-31T06:52:42.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/4021539451 learned_addr learned my addr 172.21.15.37:0/4021539451 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:42.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 0x559a17dd95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 0x559a17dca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/4021539451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 msgr2=0x559a17dd95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 0x559a17dd95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/4021539451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 msgr2=0x559a17dca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 0x559a17dca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 -- 172.21.15.37:0/4021539451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a17dcfa30 con 0x559a17a17350 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dcaa20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9f00001eb0 tx=0x7f9f00040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b378bc362938cee4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9ef1ffb640 1 -- 172.21.15.37:0/4021539451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00035070 con 0x559a17a17350 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.108+0000 7f9ef1ffb640 1 -- 172.21.15.37:0/4021539451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f000575e0 con 0x559a17a17350 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9ef1ffb640 1 -- 172.21.15.37:0/4021539451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00003c00 con 0x559a17a17350 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 -- 172.21.15.37:0/4021539451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 msgr2=0x559a17dcaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dcaa20 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9f00001eb0 tx=0x7f9f00040040 comp rx=0 tx=0).stop 2024-08-31T06:52:42.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 -- 172.21.15.37:0/4021539451 shutdown_connections 2024-08-31T06:52:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a17a17350 0x559a17dcaa20 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179f6670 0x559a17dca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 --2- 172.21.15.37:0/4021539451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a179ee490 0x559a17dd95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 -- 172.21.15.37:0/4021539451 >> 172.21.15.37:0/4021539451 conn(0x559a17a0b740 msgr2=0x559a17dcbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 -- 172.21.15.37:0/4021539451 shutdown_connections 2024-08-31T06:52:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.109+0000 7f9f1881a740 1 -- 172.21.15.37:0/4021539451 wait complete. 2024-08-31T06:52:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 1 -- start start 2024-08-31T06:52:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 1 Processor -- start 2024-08-31T06:52:42.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dde830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a179f6670 0x559a17ddedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a17a17350 0x559a17e48ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1ab720 con 0x559a179f6670 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1acb90 con 0x559a179ee490 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c1abdf0 con 0x559a17a17350 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.110+0000 7f9f1881a740 10 client.0 _ll_register_callbacks cb 0x7f9efc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a179f6670 0x559a17ddedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a179f6670 0x559a17ddedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53440/0 (socket says 172.21.15.37:53440) 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 -- 172.21.15.37:0/3228112205 learned_addr learned my addr 172.21.15.37:0/3228112205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a17a17350 0x559a17e48ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dde830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 -- 172.21.15.37:0/3228112205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a17a17350 msgr2=0x559a17e48ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a17a17350 0x559a17e48ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 -- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 msgr2=0x559a17dde830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dde830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 -- 172.21.15.37:0/3228112205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a17e490e0 con 0x559a179f6670 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dde830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f0bfff640 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a179f6670 0x559a17ddedb0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x559a17d33700 tx=0x7f9efc00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeed11a460920e44 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9eeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/3228112205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9efc011640 con 0x559a179f6670 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/3228112205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f9efc0117e0 con 0x559a179f6670 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9f1881a740 1 -- 172.21.15.37:0/3228112205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f000575e0 con 0x559a179f6670 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.111+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/3228112205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9efc031050 con 0x559a179f6670 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f1881a740 10 client.16929 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f1881a740 1 -- 172.21.15.37:0/3228112205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a17e4a2d0 con 0x559a179f6670 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/3228112205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f000575e0 con 0x559a179f6670 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/3228112205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9efc0239b0 con 0x559a179f6670 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f1881a740 10 client.16929 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f1881a740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f1881a740 20 client.16929 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f1881a740 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559a179ab080 0x559a17e4cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f1881a740 4 client.16929 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:52:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f1881a740 1 -- 172.21.15.37:0/3228112205 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559a17d2e720 con 0x559a179ab080 2024-08-31T06:52:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.112+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559a179ab080 0x559a17e4cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.113+0000 7f9f0b7fe640 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559a179ab080 0x559a17e4cac0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f4476e6b2a305e9 server_cookie=cc0b1b5caa39a006 in_seq=0 out_seq=0 2024-08-31T06:52:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.113+0000 7f9eeb7fe640 10 client.16929 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.114+0000 7f9eeb7fe640 1 -- 172.21.15.37:0/3228112205 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559a17d2e720 con 0x559a179ab080 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.114+0000 7f9eeb7fe640 10 client.16929 handle_command_reply: tid=0 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.114+0000 7f9f1881a740 1 client.16929 shutdown 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 -- 172.21.15.37:0/3228112205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a179f6670 msgr2=0x559a17ddedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a179f6670 0x559a17ddedb0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x559a17d33700 tx=0x7f9efc00beb0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 -- 172.21.15.37:0/3228112205 shutdown_connections 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559a179ab080 0x559a17e4cac0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a179f6670 0x559a17ddedb0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9eeb7fe640 0 client.16929 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559a17a17350 0x559a17e48ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 --2- 172.21.15.37:0/3228112205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559a179ee490 0x559a17dde830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 -- 172.21.15.37:0/3228112205 >> 172.21.15.37:0/3228112205 conn(0x559a17a0b740 msgr2=0x559a17dc2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 -- 172.21.15.37:0/3228112205 shutdown_connections 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 1 -- 172.21.15.37:0/3228112205 wait complete. 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f1881a740 20 client.16929 trim_cache size 0 max 16384 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "deffd930-526d-4ef6-92aa-59df677c2e84", 2024-08-31T06:52:42.119 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:52:42.120 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:52:42.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f122a5640 1 -- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef40b4ca0 msgr2=0x7f9ef40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.115+0000 7f9f122a5640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef40b4ca0 0x7f9ef40b71b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9f040e3030 tx=0x7f9f04079470 comp rx=0 tx=0).stop 2024-08-31T06:52:42.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 -- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c1073c0 msgr2=0x7f9f0c19fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:42.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c1073c0 0x7f9f0c19fa30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400cad0 tx=0x7f9f0400cf90 comp rx=0 tx=0).stop 2024-08-31T06:52:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 -- 172.21.15.37:0/223606082 shutdown_connections 2024-08-31T06:52:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f9ef40b4ca0 0x7f9ef40b71b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f0c1073c0 0x7f9f0c19fa30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f0c103680 0x7f9f0c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 --2- 172.21.15.37:0/223606082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f0c102d30 0x7f9f0c19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 -- 172.21.15.37:0/223606082 >> 172.21.15.37:0/223606082 conn(0x7f9f0c079bd0 msgr2=0x7f9f0c104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 -- 172.21.15.37:0/223606082 shutdown_connections 2024-08-31T06:52:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:42.116+0000 7f9f122a5640 1 -- 172.21.15.37:0/223606082 wait complete. 2024-08-31T06:52:42.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:52:43.058 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:43.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.554+0000 7ffa2502a640 1 -- 172.21.15.37:0/1667984839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20101df0 msgr2=0x7ffa20102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.554+0000 7ffa2502a640 1 --2- 172.21.15.37:0/1667984839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20101df0 0x7ffa20102200 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009900 tx=0x7ffa1002a410 comp rx=0 tx=0).stop 2024-08-31T06:52:43.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.555+0000 7ffa2502a640 1 -- 172.21.15.37:0/1667984839 shutdown_connections 2024-08-31T06:52:43.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.555+0000 7ffa2502a640 1 --2- 172.21.15.37:0/1667984839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa20106990 0x7ffa20110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.555+0000 7ffa2502a640 1 --2- 172.21.15.37:0/1667984839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa20106040 0x7ffa20106450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.555+0000 7ffa2502a640 1 --2- 172.21.15.37:0/1667984839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20101df0 0x7ffa20102200 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.555+0000 7ffa2502a640 1 -- 172.21.15.37:0/1667984839 >> 172.21.15.37:0/1667984839 conn(0x7ffa20077a00 msgr2=0x7ffa20077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.555+0000 7ffa2502a640 1 -- 172.21.15.37:0/1667984839 shutdown_connections 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.555+0000 7ffa2502a640 1 -- 172.21.15.37:0/1667984839 wait complete. 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.555+0000 7ffa2502a640 1 Processor -- start 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa2502a640 1 -- start start 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa2502a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa20101df0 0x7ffa20102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa2502a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa20106040 0x7ffa201032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa2502a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20106990 0x7ffa20103810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa2502a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa20113750 con 0x7ffa20106990 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa2502a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201135d0 con 0x7ffa20106040 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa2502a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201138d0 con 0x7ffa20101df0 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20106990 0x7ffa20103810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20106990 0x7ffa20103810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53456/0 (socket says 172.21.15.37:53456) 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1f59e640 1 -- 172.21.15.37:0/2529338415 learned_addr learned my addr 172.21.15.37:0/2529338415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:43.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa20106040 0x7ffa201032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa20101df0 0x7ffa20102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1f59e640 1 -- 172.21.15.37:0/2529338415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa20101df0 msgr2=0x7ffa20102d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1f59e640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa20101df0 0x7ffa20102d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1f59e640 1 -- 172.21.15.37:0/2529338415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa20106040 msgr2=0x7ffa201032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1f59e640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa20106040 0x7ffa201032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.556+0000 7ffa1f59e640 1 -- 172.21.15.37:0/2529338415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa201a8540 con 0x7ffa20106990 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.557+0000 7ffa1f59e640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20106990 0x7ffa20103810 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800eaa0 tx=0x7ffa1800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.557+0000 7ffa07fff640 1 -- 172.21.15.37:0/2529338415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18004d20 con 0x7ffa20106990 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.557+0000 7ffa2502a640 1 -- 172.21.15.37:0/2529338415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa201a8830 con 0x7ffa20106990 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.557+0000 7ffa07fff640 1 -- 172.21.15.37:0/2529338415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa18005020 con 0x7ffa20106990 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.557+0000 7ffa07fff640 1 -- 172.21.15.37:0/2529338415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa180116d0 con 0x7ffa20106990 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.557+0000 7ffa2502a640 1 -- 172.21.15.37:0/2529338415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa201a8d70 con 0x7ffa20106990 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa2b59f740 1 Processor -- start 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa07fff640 1 -- 172.21.15.37:0/2529338415 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7ffa180051d0 con 0x7ffa20106990 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa2b59f740 1 -- start start 2024-08-31T06:52:43.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 0x55e8aa3ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e8aa341630 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e8aa330bc0 con 0x55e8aa004390 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e8aa334b70 con 0x55e8aa025070 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa1ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa1ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53472/0 (socket says 172.21.15.37:53472) 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa1ed9d640 1 -- 172.21.15.37:0/4193221270 learned_addr learned my addr 172.21.15.37:0/4193221270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.560+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 0x55e8aa3ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1ed9d640 1 -- 172.21.15.37:0/4193221270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 msgr2=0x55e8aa3ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 0x55e8aa3ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1ed9d640 1 -- 172.21.15.37:0/4193221270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 msgr2=0x55e8aa3cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1ed9d640 1 -- 172.21.15.37:0/4193221270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8aa090650 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3ca800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009900 tx=0x7ffa10031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b6867c4d970c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa07fff640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa080b4ca0 0x7ffa080b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa080b4ca0 0x7ffa080b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa057fa640 1 -- 172.21.15.37:0/4193221270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10035030 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa057fa640 1 -- 172.21.15.37:0/4193221270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa100044c0 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa057fa640 1 -- 172.21.15.37:0/4193221270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10005590 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.561+0000 7ffa07fff640 1 -- 172.21.15.37:0/2529338415 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ffa180e5700 con 0x7ffa20106990 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 -- 172.21.15.37:0/4193221270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 msgr2=0x55e8aa3ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa080b4ca0 0x7ffa080b71b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffa20108f60 tx=0x7ffa14008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3ca800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009900 tx=0x7ffa10031740 comp rx=0 tx=0).stop 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 -- 172.21.15.37:0/4193221270 shutdown_connections 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3ca800 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/4193221270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 0x55e8aa3ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 -- 172.21.15.37:0/4193221270 >> 172.21.15.37:0/4193221270 conn(0x55e8aa019460 msgr2=0x55e8aa3c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 -- 172.21.15.37:0/4193221270 shutdown_connections 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 -- 172.21.15.37:0/4193221270 wait complete. 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.562+0000 7ffa2b59f740 1 -- start start 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa2b59f740 1 Processor -- start 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3d5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3d5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 0x55e8aa3e1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e8aa193700 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e8aa2b7700 con 0x55e8aa004390 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e8aa3d8a40 con 0x55e8aa025070 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa2b59f740 10 client.0 _ll_register_callbacks cb 0x55e8aa2e6dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3d5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3d5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53482/0 (socket says 172.21.15.37:53482) 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1ed9d640 1 -- 172.21.15.37:0/1425352044 learned_addr learned my addr 172.21.15.37:0/1425352044 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3d5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1f59e640 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 0x55e8aa3e1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1ed9d640 1 -- 172.21.15.37:0/1425352044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 msgr2=0x55e8aa3e1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 0x55e8aa3e1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1ed9d640 1 -- 172.21.15.37:0/1425352044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 msgr2=0x55e8aa3d5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3d5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.563+0000 7ffa1ed9d640 1 -- 172.21.15.37:0/1425352044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8aa2f08b0 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3d5a10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002a450 tx=0x7ffa10031c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed96d3135b9fc3fb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa02ff5640 1 -- 172.21.15.37:0/1425352044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10051060 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa02ff5640 1 -- 172.21.15.37:0/1425352044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ffa10031d80 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1425352044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e8aa343580 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa02ff5640 1 -- 172.21.15.37:0/1425352044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa10035050 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 10 client.16941 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1425352044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e8aa3e47e0 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa02ff5640 1 -- 172.21.15.37:0/1425352044 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e8aa343580 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa02ff5640 1 -- 172.21.15.37:0/1425352044 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa10056590 con 0x55e8a9ffc1b0 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 10 client.16941 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 20 client.16941 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e8a9fe39f0 0x55e8aa3e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 4 client.16941 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.564+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1425352044 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8aa33f020 con 0x55e8a9fe39f0 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.565+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e8a9fe39f0 0x55e8aa3e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.565+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e8a9fe39f0 0x55e8aa3e7b40 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eafeb22642f0dca server_cookie=e8af57927c8308a9 in_seq=0 out_seq=0 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.565+0000 7ffa02ff5640 10 client.16941 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa02ff5640 1 -- 172.21.15.37:0/1425352044 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8aa33f020 con 0x55e8a9fe39f0 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa02ff5640 10 client.16941 handle_command_reply: tid=0 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa2b59f740 1 client.16941 shutdown 2024-08-31T06:52:43.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1425352044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 msgr2=0x55e8aa3d5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3d5a10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002a450 tx=0x7ffa10031c10 comp rx=0 tx=0).stop 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1425352044 shutdown_connections 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e8a9fe39f0 0x55e8aa3e7b40 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8aa025070 0x55e8aa3e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.566+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3d5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.567+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1425352044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8a9ffc1b0 0x55e8aa3d5a10 secure :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002a450 tx=0x7ffa10031c10 comp rx=0 tx=0).stop 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.567+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1425352044 >> 172.21.15.37:0/1425352044 conn(0x55e8aa019460 msgr2=0x55e8aa3cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.567+0000 7ffa02ff5640 0 client.16941 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.567+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1425352044 shutdown_connections 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.567+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1425352044 wait complete. 2024-08-31T06:52:43.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.567+0000 7ffa2b59f740 20 client.16941 trim_cache size 0 max 16384 2024-08-31T06:52:43.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa2b59f740 1 Processor -- start 2024-08-31T06:52:43.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa2b59f740 1 -- start start 2024-08-31T06:52:43.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3d5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa025070 0x55e8aa3cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 0x55e8aa3cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201b3e40 con 0x55e8aa025070 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201b1710 con 0x55e8aa004390 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201af560 con 0x55e8a9fb8da0 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa025070 0x55e8aa3cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa025070 0x55e8aa3cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53488/0 (socket says 172.21.15.37:53488) 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1e59c640 1 -- 172.21.15.37:0/1867225587 learned_addr learned my addr 172.21.15.37:0/1867225587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3d5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1f59e640 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 0x55e8aa3cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1e59c640 1 -- 172.21.15.37:0/1867225587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 msgr2=0x55e8aa3cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 0x55e8aa3cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1e59c640 1 -- 172.21.15.37:0/1867225587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 msgr2=0x55e8aa3d5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.585+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3d5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.586+0000 7ffa1e59c640 1 -- 172.21.15.37:0/1867225587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8aa3cc5b0 con 0x55e8aa025070 2024-08-31T06:52:43.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.586+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa025070 0x55e8aa3cd3c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ffa14018040 tx=0x7ffa14016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15510c9aa2e10bad server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:43.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.586+0000 7ffa04ff9640 1 -- 172.21.15.37:0/1867225587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa140243f0 con 0x55e8aa025070 2024-08-31T06:52:43.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.586+0000 7ffa04ff9640 1 -- 172.21.15.37:0/1867225587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa14031070 con 0x55e8aa025070 2024-08-31T06:52:43.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.586+0000 7ffa04ff9640 1 -- 172.21.15.37:0/1867225587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14015620 con 0x55e8aa025070 2024-08-31T06:52:43.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1867225587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa025070 msgr2=0x55e8aa3cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa025070 0x55e8aa3cd3c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ffa14018040 tx=0x7ffa14016000 comp rx=0 tx=0).stop 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1867225587 shutdown_connections 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa025070 0x55e8aa3cd3c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 0x55e8aa3cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/1867225587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa004390 0x55e8aa3d5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1867225587 >> 172.21.15.37:0/1867225587 conn(0x55e8aa019460 msgr2=0x55e8aa3d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1867225587 shutdown_connections 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 -- 172.21.15.37:0/1867225587 wait complete. 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 -- start start 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.587+0000 7ffa2b59f740 1 Processor -- start 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 0x55e8aa3eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa004390 0x55e8aa3e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa2b59f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa025070 0x55e8aa3e8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201afbd0 con 0x55e8aa004390 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201b1040 con 0x55e8aa025070 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa2b59f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ffa201b02a0 con 0x55e8a9fb8da0 2024-08-31T06:52:43.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa2b59f740 10 client.0 _ll_register_callbacks cb 0x7ffa10031690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa004390 0x55e8aa3e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa004390 0x55e8aa3e85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53496/0 (socket says 172.21.15.37:53496) 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 -- 172.21.15.37:0/3693439583 learned_addr learned my addr 172.21.15.37:0/3693439583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 0x55e8aa3eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1f59e640 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa025070 0x55e8aa3e8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 -- 172.21.15.37:0/3693439583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 msgr2=0x55e8aa3eb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 0x55e8aa3eb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 -- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa025070 msgr2=0x55e8aa3e8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa025070 0x55e8aa3e8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 -- 172.21.15.37:0/3693439583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8aa3e9020 con 0x55e8aa004390 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1f59e640 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa025070 0x55e8aa3e8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa1e59c640 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa004390 0x55e8aa3e85a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ffa14008010 tx=0x7ffa14024620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05ab6106565d45b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa02ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:43.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.588+0000 7ffa02ff5640 1 -- 172.21.15.37:0/3693439583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1403b070 con 0x55e8aa004390 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa02ff5640 1 -- 172.21.15.37:0/3693439583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7ffa140249d0 con 0x55e8aa004390 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 1 -- 172.21.15.37:0/3693439583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa14031070 con 0x55e8aa004390 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa02ff5640 1 -- 172.21.15.37:0/3693439583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa14047050 con 0x55e8aa004390 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 10 client.16947 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 1 -- 172.21.15.37:0/3693439583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e8aa451f80 con 0x55e8aa004390 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa02ff5640 1 -- 172.21.15.37:0/3693439583 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa14031070 con 0x55e8aa004390 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa02ff5640 1 -- 172.21.15.37:0/3693439583 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa140153c0 con 0x55e8aa004390 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 10 client.16947 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 20 client.16947 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e8aa452640 0x55e8aa454a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 4 client.16947 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa2b59f740 1 -- 172.21.15.37:0/3693439583 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e8aa33c760 con 0x55e8aa452640 2024-08-31T06:52:43.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.589+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e8aa452640 0x55e8aa454a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa02ff5640 10 client.16947 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa1ed9d640 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e8aa452640 0x55e8aa454a60 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81db7a2fd8f9f0f9 server_cookie=98f4c66bf84d07a8 in_seq=0 out_seq=0 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa02ff5640 1 -- 172.21.15.37:0/3693439583 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55e8aa33c760 con 0x55e8aa452640 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa02ff5640 10 client.16947 handle_command_reply: tid=0 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 client.16947 shutdown 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 -- 172.21.15.37:0/3693439583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa004390 msgr2=0x55e8aa3e85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa004390 0x55e8aa3e85a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ffa14008010 tx=0x7ffa14024620 comp rx=0 tx=0).stop 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 -- 172.21.15.37:0/3693439583 shutdown_connections 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e8aa452640 0x55e8aa454a60 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8aa004390 0x55e8aa3e85a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e8aa025070 0x55e8aa3e8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 --2- 172.21.15.37:0/3693439583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e8a9fb8da0 0x55e8aa3eb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.590+0000 7ffa2b59f740 1 -- 172.21.15.37:0/3693439583 >> 172.21.15.37:0/3693439583 conn(0x55e8aa019460 msgr2=0x55e8aa3d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa02ff5640 0 client.16947 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2b59f740 1 -- 172.21.15.37:0/3693439583 shutdown_connections 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2b59f740 1 -- 172.21.15.37:0/3693439583 wait complete. 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2b59f740 20 client.16947 trim_cache size 0 max 16384 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:52:43.596 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.598 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.600 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:52:43.601 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:52:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:43.602 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:43.602 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 -- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa080b4ca0 msgr2=0x7ffa080b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa080b4ca0 0x7ffa080b71b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffa20108f60 tx=0x7ffa14008040 comp rx=0 tx=0).stop 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 -- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20106990 msgr2=0x7ffa20103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20106990 0x7ffa20103810 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800eaa0 tx=0x7ffa1800eea0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 -- 172.21.15.37:0/2529338415 shutdown_connections 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ffa080b4ca0 0x7ffa080b71b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa20106990 0x7ffa20103810 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa20106040 0x7ffa201032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 --2- 172.21.15.37:0/2529338415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa20101df0 0x7ffa20102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:43.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 -- 172.21.15.37:0/2529338415 >> 172.21.15.37:0/2529338415 conn(0x7ffa20077a00 msgr2=0x7ffa20107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:43.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.591+0000 7ffa2502a640 1 -- 172.21.15.37:0/2529338415 shutdown_connections 2024-08-31T06:52:43.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:43.592+0000 7ffa2502a640 1 -- 172.21.15.37:0/2529338415 wait complete. 2024-08-31T06:52:43.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:43 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:52:43.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:43 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:43.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:43 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:52:43.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:43 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:43.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:43 smithi106 ceph-mon[22134]: pgmap v496: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-31T06:52:43.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:43 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:52:43.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:43 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:52:43.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:43 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:43.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:43 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:52:43.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:43 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:43.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:43 smithi037 ceph-mon[18612]: pgmap v496: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-31T06:52:43.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:43 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:52:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:43 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:52:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:43 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:43 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:52:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:43 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:43 smithi066 ceph-mon[22244]: pgmap v496: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-08-31T06:52:43.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:43 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:52:44.509 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:52:44.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:52:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 -- 172.21.15.37:0/35106816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8102800 msgr2=0x7f0bd8102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/35106816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8102800 0x7f0bd8102c10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009900 tx=0x7f0bc802a410 comp rx=0 tx=0).stop 2024-08-31T06:52:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 -- 172.21.15.37:0/35106816 shutdown_connections 2024-08-31T06:52:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/35106816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8108a90 0x7f0bd810f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/35106816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108140 0x7f0bd8108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/35106816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8102800 0x7f0bd8102c10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 -- 172.21.15.37:0/35106816 >> 172.21.15.37:0/35106816 conn(0x7f0bd80794d0 msgr2=0x7f0bd80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 -- 172.21.15.37:0/35106816 shutdown_connections 2024-08-31T06:52:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.260+0000 7f0bde7e3640 1 -- 172.21.15.37:0/35106816 wait complete. 2024-08-31T06:52:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.261+0000 7f0bde7e3640 1 Processor -- start 2024-08-31T06:52:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.261+0000 7f0bde7e3640 1 -- start start 2024-08-31T06:52:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bde7e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102800 0x7f0bd819afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bde7e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8108140 0x7f0bd819b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bde7e3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108a90 0x7f0bd819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bde7e3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd81125c0 con 0x7f0bd8108140 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bde7e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8112440 con 0x7f0bd8102800 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bde7e3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8112740 con 0x7f0bd8108a90 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8108140 0x7f0bd819b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8108140 0x7f0bd819b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51696/0 (socket says 172.21.15.37:51696) 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd77fe640 1 -- 172.21.15.37:0/2529851528 learned_addr learned my addr 172.21.15.37:0/2529851528 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102800 0x7f0bd819afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bdcd80640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108a90 0x7f0bd819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd77fe640 1 -- 172.21.15.37:0/2529851528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108a90 msgr2=0x7f0bd819ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108a90 0x7f0bd819ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd77fe640 1 -- 172.21.15.37:0/2529851528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102800 msgr2=0x7f0bd819afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102800 0x7f0bd819afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.262+0000 7f0bd77fe640 1 -- 172.21.15.37:0/2529851528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd81a6260 con 0x7f0bd8108140 2024-08-31T06:52:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.263+0000 7f0bd77fe640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8108140 0x7f0bd819b510 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c970 tx=0x7f0bcc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:45.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.263+0000 7f0bd57fa640 1 -- 172.21.15.37:0/2529851528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc007bb0 con 0x7f0bd8108140 2024-08-31T06:52:45.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.263+0000 7f0bd57fa640 1 -- 172.21.15.37:0/2529851528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0bcc007d50 con 0x7f0bd8108140 2024-08-31T06:52:45.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.263+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd81a6550 con 0x7f0bd8108140 2024-08-31T06:52:45.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.263+0000 7f0bd57fa640 1 -- 172.21.15.37:0/2529851528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc018660 con 0x7f0bd8108140 2024-08-31T06:52:45.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.263+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd81a6a40 con 0x7f0bd8108140 2024-08-31T06:52:45.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.264+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd8102c10 con 0x7f0bd8108140 2024-08-31T06:52:45.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.266+0000 7f0bd57fa640 1 -- 172.21.15.37:0/2529851528 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f0bcc00f970 con 0x7f0bd8108140 2024-08-31T06:52:45.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.266+0000 7f0bd57fa640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4cd0 0x7f0bc00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:45.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.267+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4cd0 0x7f0bc00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:45.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.267+0000 7f0bd57fa640 1 -- 172.21.15.37:0/2529851528 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f0bcc0e5950 con 0x7f0bd8108140 2024-08-31T06:52:45.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.267+0000 7f0bd7fff640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4cd0 0x7f0bc00b71e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0bd806b760 tx=0x7f0bc80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:45.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.272+0000 7f0bd57fa640 1 -- 172.21.15.37:0/2529851528 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f0bcc014030 con 0x7f0bd8108140 2024-08-31T06:52:45.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.497+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bd806b010 con 0x7f0bd8108140 2024-08-31T06:52:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.498+0000 7f0bd57fa640 1 -- 172.21.15.37:0/2529851528 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f0bcc0ac780 con 0x7f0bd8108140 2024-08-31T06:52:45.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:52:45.499 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:52:45.499 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:52:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4cd0 msgr2=0x7f0bc00b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4cd0 0x7f0bc00b71e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0bd806b760 tx=0x7f0bc80058d0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8108140 msgr2=0x7f0bd819b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8108140 0x7f0bd819b510 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc00c970 tx=0x7f0bcc00ce30 comp rx=0 tx=0).stop 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 shutdown_connections 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f0bc00b4cd0 0x7f0bc00b71e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd8108140 0x7f0bd819b510 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bd8108a90 0x7f0bd819ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 --2- 172.21.15.37:0/2529851528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0bd8102800 0x7f0bd819afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.500+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 >> 172.21.15.37:0/2529851528 conn(0x7f0bd80794d0 msgr2=0x7f0bd8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.501+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 shutdown_connections 2024-08-31T06:52:45.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:45.501+0000 7f0bde7e3640 1 -- 172.21.15.37:0/2529851528 wait complete. 2024-08-31T06:52:45.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:45 smithi037 ceph-mon[18612]: pgmap v497: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:52:45.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:45 smithi106 ceph-mon[22134]: pgmap v497: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:52:45.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:45 smithi066 ceph-mon[22244]: pgmap v497: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:52:46.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:52:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:46.707 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:46 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2529851528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:52:46.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:46 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2529851528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:52:46.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:46 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2529851528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 -- 172.21.15.37:0/4219981083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608109240 msgr2=0x7f7608109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 --2- 172.21.15.37:0/4219981083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608109240 0x7f7608109650 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009900 tx=0x7f75f802a410 comp rx=0 tx=0).stop 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 -- 172.21.15.37:0/4219981083 shutdown_connections 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 --2- 172.21.15.37:0/4219981083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608109240 0x7f7608109650 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 --2- 172.21.15.37:0/4219981083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7608109b90 0x7f76081103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 --2- 172.21.15.37:0/4219981083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7608103900 0x7f7608103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 -- 172.21.15.37:0/4219981083 >> 172.21.15.37:0/4219981083 conn(0x7f760807b5f0 msgr2=0x7f760807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 -- 172.21.15.37:0/4219981083 shutdown_connections 2024-08-31T06:52:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.960+0000 7f760fbb1640 1 -- 172.21.15.37:0/4219981083 wait complete. 2024-08-31T06:52:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.961+0000 7f760fbb1640 1 Processor -- start 2024-08-31T06:52:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.961+0000 7f760fbb1640 1 -- start start 2024-08-31T06:52:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760fbb1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608103900 0x7f76081a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760fbb1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7608109240 0x7f76081a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760fbb1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7608109b90 0x7f76081ac400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760fbb1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7608113700 con 0x7f7608103900 2024-08-31T06:52:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760fbb1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7608113580 con 0x7f7608109b90 2024-08-31T06:52:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760fbb1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7608113880 con 0x7f7608109240 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608103900 0x7f76081a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608103900 0x7f76081a1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51720/0 (socket says 172.21.15.37:51720) 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 -- 172.21.15.37:0/3410038682 learned_addr learned my addr 172.21.15.37:0/3410038682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d14c640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7608109240 0x7f76081a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760e14e640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7608109b90 0x7f76081ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 -- 172.21.15.37:0/3410038682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7608109240 msgr2=0x7f76081a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7608109240 0x7f76081a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 -- 172.21.15.37:0/3410038682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7608109b90 msgr2=0x7f76081ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7608109b90 0x7f76081ac400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 -- 172.21.15.37:0/3410038682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76081ac940 con 0x7f7608103900 2024-08-31T06:52:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.962+0000 7f760d94d640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608103900 0x7f76081a1380 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f760400c920 tx=0x7f760400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.963+0000 7f75feffd640 1 -- 172.21.15.37:0/3410038682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7604007c70 con 0x7f7608103900 2024-08-31T06:52:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.963+0000 7f760fbb1640 1 -- 172.21.15.37:0/3410038682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76081acb10 con 0x7f7608103900 2024-08-31T06:52:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.963+0000 7f75feffd640 1 -- 172.21.15.37:0/3410038682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7604007e10 con 0x7f7608103900 2024-08-31T06:52:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.963+0000 7f75feffd640 1 -- 172.21.15.37:0/3410038682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040186f0 con 0x7f7608103900 2024-08-31T06:52:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.963+0000 7f760fbb1640 1 -- 172.21.15.37:0/3410038682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76081ad070 con 0x7f7608103900 2024-08-31T06:52:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.965+0000 7f7616126740 1 Processor -- start 2024-08-31T06:52:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f7616126740 1 -- start start 2024-08-31T06:52:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f7616126740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e89f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f7616126740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 0x560c6e89f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f7616126740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e89fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f7616126740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c6e816680 con 0x560c6e4d9390 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f7616126740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560c6e805c10 con 0x560c6e4d11b0 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f7616126740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560c6e809bc0 con 0x560c6e4fa070 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f75feffd640 1 -- 172.21.15.37:0/3410038682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f760400f450 con 0x7f7608103900 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760d14c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e89fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760d14c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e89fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51726/0 (socket says 172.21.15.37:51726) 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760d14c640 1 -- 172.21.15.37:0/2505418641 learned_addr learned my addr 172.21.15.37:0/2505418641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760e14e640 1 --2- 172.21.15.37:0/2505418641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e89f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760d14c640 1 -- 172.21.15.37:0/2505418641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 msgr2=0x560c6e89f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760d14c640 1 --2- 172.21.15.37:0/2505418641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e89f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760d14c640 1 -- 172.21.15.37:0/2505418641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 msgr2=0x560c6e89f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760d14c640 1 --2- 172.21.15.37:0/2505418641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 0x560c6e89f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.966+0000 7f760d14c640 1 -- 172.21.15.37:0/2505418641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6e565650 con 0x560c6e4d9390 2024-08-31T06:52:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.967+0000 7f760d14c640 1 --2- 172.21.15.37:0/2505418641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e89fd90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f75f80057c0 tx=0x7f75f8031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48d3eee980b968b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.967+0000 7f75f3fff640 1 -- 172.21.15.37:0/2505418641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8040070 con 0x560c6e4d9390 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.967+0000 7f75f3fff640 1 -- 172.21.15.37:0/2505418641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75f80044c0 con 0x560c6e4d9390 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.967+0000 7f75f3fff640 1 -- 172.21.15.37:0/2505418641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f8035040 con 0x560c6e4d9390 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.967+0000 7f75feffd640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f75f40b4ca0 0x7f75f40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.967+0000 7f760e14e640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f75f40b4ca0 0x7f75f40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.967+0000 7f75feffd640 1 -- 172.21.15.37:0/3410038682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f76040e5710 con 0x7f7608103900 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 -- 172.21.15.37:0/2505418641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 msgr2=0x560c6e89fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f760e14e640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f75f40b4ca0 0x7f75f40b71b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7600005fd0 tx=0x7f76000095a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 --2- 172.21.15.37:0/2505418641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e89fd90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f75f80057c0 tx=0x7f75f8031dc0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 -- 172.21.15.37:0/2505418641 shutdown_connections 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 --2- 172.21.15.37:0/2505418641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e89fd90 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 --2- 172.21.15.37:0/2505418641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 0x560c6e89f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 --2- 172.21.15.37:0/2505418641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e89f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 -- 172.21.15.37:0/2505418641 >> 172.21.15.37:0/2505418641 conn(0x560c6e4ee460 msgr2=0x560c6e89d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 -- 172.21.15.37:0/2505418641 shutdown_connections 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 -- 172.21.15.37:0/2505418641 wait complete. 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.968+0000 7f7616126740 1 -- start start 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f7616126740 1 Processor -- start 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f7616126740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 0x560c6e8aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f7616126740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f7616126740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e8b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f7616126740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c6e668700 con 0x560c6e4d9390 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f7616126740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560c6e78c750 con 0x560c6e4d11b0 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f7616126740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560c6e8ada90 con 0x560c6e4fa070 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f7616126740 10 client.0 _ll_register_callbacks cb 0x560c6e7bbe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:46.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f760d14c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f760d14c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8aafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51742/0 (socket says 172.21.15.37:51742) 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f760d14c640 1 -- 172.21.15.37:0/2527609794 learned_addr learned my addr 172.21.15.37:0/2527609794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f760d94d640 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 0x560c6e8aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.969+0000 7f760e14e640 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e8b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f760d14c640 1 -- 172.21.15.37:0/2527609794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 msgr2=0x560c6e8b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f760d14c640 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e8b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f760d14c640 1 -- 172.21.15.37:0/2527609794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 msgr2=0x560c6e8aaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f760d14c640 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 0x560c6e8aaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f760d14c640 1 -- 172.21.15.37:0/2527609794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6e7c5900 con 0x560c6e4d9390 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f760d14c640 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8aafb0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f75f802a930 tx=0x7f75f8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9b1f696fed84cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f75f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f75f17fa640 1 -- 172.21.15.37:0/2527609794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f804b020 con 0x560c6e4d9390 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f7616126740 1 -- 172.21.15.37:0/2527609794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c6e8185d0 con 0x560c6e4d9390 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f75f17fa640 1 -- 172.21.15.37:0/2527609794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f75f8003b50 con 0x560c6e4d9390 2024-08-31T06:52:46.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f75f17fa640 1 -- 172.21.15.37:0/2527609794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75f8056050 con 0x560c6e4d9390 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f7616126740 10 client.16965 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f7616126740 1 -- 172.21.15.37:0/2527609794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c6e8b9870 con 0x560c6e4d9390 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.970+0000 7f75f17fa640 1 -- 172.21.15.37:0/2527609794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560c6e8185d0 con 0x560c6e4d9390 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f75f17fa640 1 -- 172.21.15.37:0/2527609794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f75f803c940 con 0x560c6e4d9390 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f7616126740 10 client.16965 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f7616126740 10 client.16965 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f7616126740 20 client.16965 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f7616126740 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560c6e4b89f0 0x560c6e8bcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f7616126740 4 client.16965 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f7616126740 1 -- 172.21.15.37:0/2527609794 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c6e814070 con 0x560c6e4b89f0 2024-08-31T06:52:46.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f760d94d640 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560c6e4b89f0 0x560c6e8bcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f760d94d640 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560c6e4b89f0 0x560c6e8bcbd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0369f22233bcbe4 server_cookie=c8c182b08dd376ef in_seq=0 out_seq=0 2024-08-31T06:52:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.971+0000 7f75f17fa640 10 client.16965 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:52:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.972+0000 7f75f17fa640 1 -- 172.21.15.37:0/2527609794 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c6e814070 con 0x560c6e4b89f0 2024-08-31T06:52:46.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.972+0000 7f75f17fa640 10 client.16965 handle_command_reply: tid=0 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.972+0000 7f7616126740 1 client.16965 shutdown 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.972+0000 7f7616126740 1 -- 172.21.15.37:0/2527609794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 msgr2=0x560c6e8aafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.972+0000 7f7616126740 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8aafb0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f75f802a930 tx=0x7f75f8031400 comp rx=0 tx=0).stop 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 1 -- 172.21.15.37:0/2527609794 shutdown_connections 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8aafb0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560c6e4b89f0 0x560c6e8bcbd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e8b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 1 --2- 172.21.15.37:0/2527609794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d11b0 0x560c6e8aaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 1 -- 172.21.15.37:0/2527609794 >> 172.21.15.37:0/2527609794 conn(0x560c6e4ee460 msgr2=0x560c6e8a24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f75f17fa640 0 client.16965 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 1 -- 172.21.15.37:0/2527609794 shutdown_connections 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 1 -- 172.21.15.37:0/2527609794 wait complete. 2024-08-31T06:52:46.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.973+0000 7f7616126740 20 client.16965 trim_cache size 0 max 16384 2024-08-31T06:52:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f7616126740 1 Processor -- start 2024-08-31T06:52:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f7616126740 1 -- start start 2024-08-31T06:52:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f7616126740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d11b0 0x560c6e8b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f7616126740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d9390 0x560c6e89c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f7616126740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e89cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f7616126740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f76081b80f0 con 0x560c6e4d11b0 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f7616126740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76081b59c0 con 0x560c6e4d9390 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f7616126740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f76081b3810 con 0x560c6e4fa070 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f760d94d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d11b0 0x560c6e8b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f760d94d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d11b0 0x560c6e8b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51754/0 (socket says 172.21.15.37:51754) 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.986+0000 7f760d94d640 1 -- 172.21.15.37:0/1099244482 learned_addr learned my addr 172.21.15.37:0/1099244482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760e14e640 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e89cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760d14c640 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d9390 0x560c6e89c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760d94d640 1 -- 172.21.15.37:0/1099244482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 msgr2=0x560c6e89cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760d94d640 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e89cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760d94d640 1 -- 172.21.15.37:0/1099244482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d9390 msgr2=0x560c6e89c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760d94d640 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d9390 0x560c6e89c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760d94d640 1 -- 172.21.15.37:0/1099244482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c6e8ad1b0 con 0x560c6e4d11b0 2024-08-31T06:52:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760d14c640 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d9390 0x560c6e89c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f760d94d640 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d11b0 0x560c6e8b6d20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f76040abb40 tx=0x7f76040a7e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3d11b095ddb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f75f37fe640 1 -- 172.21.15.37:0/1099244482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040ae040 con 0x560c6e4d11b0 2024-08-31T06:52:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f75f37fe640 1 -- 172.21.15.37:0/1099244482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f76040971d0 con 0x560c6e4d11b0 2024-08-31T06:52:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.987+0000 7f75f37fe640 1 -- 172.21.15.37:0/1099244482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76040a80d0 con 0x560c6e4d11b0 2024-08-31T06:52:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 -- 172.21.15.37:0/1099244482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d11b0 msgr2=0x560c6e8b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d11b0 0x560c6e8b6d20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f76040abb40 tx=0x7f76040a7e30 comp rx=0 tx=0).stop 2024-08-31T06:52:46.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 -- 172.21.15.37:0/1099244482 shutdown_connections 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4fa070 0x560c6e89cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4d9390 0x560c6e89c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 --2- 172.21.15.37:0/1099244482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d11b0 0x560c6e8b6d20 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 -- 172.21.15.37:0/1099244482 >> 172.21.15.37:0/1099244482 conn(0x560c6e4ee460 msgr2=0x560c6e8a92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 -- 172.21.15.37:0/1099244482 shutdown_connections 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.988+0000 7f7616126740 1 -- 172.21.15.37:0/1099244482 wait complete. 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 1 -- start start 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 1 Processor -- start 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4d11b0 0x560c6e8bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8be220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4fa070 0x560c6e8be760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f76081b3e80 con 0x560c6e4d9390 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f76081b52f0 con 0x560c6e4fa070 2024-08-31T06:52:46.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f76081b4550 con 0x560c6e4d11b0 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f7616126740 10 client.0 _ll_register_callbacks cb 0x7f7600009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f760d14c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f760d14c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8be220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51770/0 (socket says 172.21.15.37:51770) 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f760d14c640 1 -- 172.21.15.37:0/2560390001 learned_addr learned my addr 172.21.15.37:0/2560390001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f760e14e640 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4fa070 0x560c6e8be760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.989+0000 7f760d94d640 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4d11b0 0x560c6e8bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f760d14c640 1 -- 172.21.15.37:0/2560390001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4d11b0 msgr2=0x560c6e8bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f760d14c640 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4d11b0 0x560c6e8bdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f760d14c640 1 -- 172.21.15.37:0/2560390001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4fa070 msgr2=0x560c6e8be760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f760d14c640 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4fa070 0x560c6e8be760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f760d14c640 1 -- 172.21.15.37:0/2560390001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c6e926450 con 0x560c6e4d9390 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f760d14c640 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8be220 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f75f803cce0 tx=0x7f75f80058c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d11743e95889927 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f75f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f75f17fa640 1 -- 172.21.15.37:0/2560390001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f804b040 con 0x560c6e4d9390 2024-08-31T06:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f75f17fa640 1 -- 172.21.15.37:0/2560390001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f75f803c850 con 0x560c6e4d9390 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f7616126740 1 -- 172.21.15.37:0/2560390001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c6e8117b0 con 0x560c6e4d9390 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f75f17fa640 1 -- 172.21.15.37:0/2560390001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f75f8035070 con 0x560c6e4d9390 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f7616126740 10 client.16971 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f7616126740 1 -- 172.21.15.37:0/2560390001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c6e9276b0 con 0x560c6e4d9390 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.990+0000 7f75f17fa640 1 -- 172.21.15.37:0/2560390001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x560c6e8117b0 con 0x560c6e4d9390 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f75f17fa640 1 -- 172.21.15.37:0/2560390001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f75f8063ab0 con 0x560c6e4d9390 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f7616126740 10 client.16971 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f7616126740 10 client.16971 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f7616126740 20 client.16971 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f7616126740 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560c6e48dda0 0x560c6e929e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f7616126740 4 client.16971 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f7616126740 1 -- 172.21.15.37:0/2560390001 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560c6e788aa0 con 0x560c6e48dda0 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f760d94d640 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560c6e48dda0 0x560c6e929e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f75f17fa640 10 client.16971 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.991+0000 7f760d94d640 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560c6e48dda0 0x560c6e929e10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5e07cdf4aca74edf server_cookie=74973a3b16860e3 in_seq=0 out_seq=0 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f75f17fa640 1 -- 172.21.15.37:0/2560390001 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560c6e788aa0 con 0x560c6e48dda0 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f75f17fa640 10 client.16971 handle_command_reply: tid=0 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 client.16971 shutdown 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 -- 172.21.15.37:0/2560390001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 msgr2=0x560c6e8be220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8be220 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f75f803cce0 tx=0x7f75f80058c0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 -- 172.21.15.37:0/2560390001 shutdown_connections 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c6e4d9390 0x560c6e8be220 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x560c6e48dda0 0x560c6e929e10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560c6e4fa070 0x560c6e8be760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 --2- 172.21.15.37:0/2560390001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560c6e4d11b0 0x560c6e8bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f75f17fa640 0 client.16971 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 -- 172.21.15.37:0/2560390001 >> 172.21.15.37:0/2560390001 conn(0x560c6e4ee460 msgr2=0x560c6e8a0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:46.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 -- 172.21.15.37:0/2560390001 shutdown_connections 2024-08-31T06:52:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 1 -- 172.21.15.37:0/2560390001 wait complete. 2024-08-31T06:52:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.992+0000 7f7616126740 20 client.16971 trim_cache size 0 max 16384 2024-08-31T06:52:46.998 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:52:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 -- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f75f40b4ca0 msgr2=0x7f75f40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f75f40b4ca0 0x7f75f40b71b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7600005fd0 tx=0x7f76000095a0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 -- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608103900 msgr2=0x7f76081a1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608103900 0x7f76081a1380 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f760400c920 tx=0x7f760400cde0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 -- 172.21.15.37:0/3410038682 shutdown_connections 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f75f40b4ca0 0x7f75f40b71b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7608109b90 0x7f76081ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7608109240 0x7f76081a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 --2- 172.21.15.37:0/3410038682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7608103900 0x7f76081a1380 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 -- 172.21.15.37:0/3410038682 >> 172.21.15.37:0/3410038682 conn(0x7f760807b5f0 msgr2=0x7f7608107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 -- 172.21.15.37:0/3410038682 shutdown_connections 2024-08-31T06:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:46.993+0000 7f760fbb1640 1 -- 172.21.15.37:0/3410038682 wait complete. 2024-08-31T06:52:47.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:47 smithi037 ceph-mon[18612]: pgmap v498: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7 op/s 2024-08-31T06:52:47.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:47 smithi106 ceph-mon[22134]: pgmap v498: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7 op/s 2024-08-31T06:52:47.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:52:47.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:47 smithi066 ceph-mon[22244]: pgmap v498: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 7 op/s 2024-08-31T06:52:48.089 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.569+0000 7f83fe2b3640 1 -- 172.21.15.37:0/875403654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8103900 msgr2=0x7f83f8103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.569+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/875403654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8103900 0x7f83f8103d10 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009900 tx=0x7f83e802a410 comp rx=0 tx=0).stop 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 -- 172.21.15.37:0/875403654 shutdown_connections 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/875403654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8109b90 0x7f83f81103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/875403654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8109240 0x7f83f8109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/875403654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8103900 0x7f83f8103d10 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 -- 172.21.15.37:0/875403654 >> 172.21.15.37:0/875403654 conn(0x7f83f807b5f0 msgr2=0x7f83f807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 -- 172.21.15.37:0/875403654 shutdown_connections 2024-08-31T06:52:48.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 -- 172.21.15.37:0/875403654 wait complete. 2024-08-31T06:52:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 Processor -- start 2024-08-31T06:52:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.570+0000 7f83fe2b3640 1 -- start start 2024-08-31T06:52:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fe2b3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8103900 0x7f83f819a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fe2b3640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8109240 0x7f83f819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fe2b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109b90 0x7f83f819f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fe2b3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83f8113760 con 0x7f83f8109b90 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fe2b3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81135e0 con 0x7f83f8103900 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fe2b3640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81138e0 con 0x7f83f8109240 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fc850640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109b90 0x7f83f819f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fc850640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109b90 0x7f83f819f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51782/0 (socket says 172.21.15.37:51782) 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fc850640 1 -- 172.21.15.37:0/3644923054 learned_addr learned my addr 172.21.15.37:0/3644923054 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83f77fe640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8109240 0x7f83f819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83f7fff640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8103900 0x7f83f819a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fc850640 1 -- 172.21.15.37:0/3644923054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8109240 msgr2=0x7f83f819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fc850640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8109240 0x7f83f819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fc850640 1 -- 172.21.15.37:0/3644923054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8103900 msgr2=0x7f83f819a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fc850640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8103900 0x7f83f819a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83fc850640 1 -- 172.21.15.37:0/3644923054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f81a00e0 con 0x7f83f8109b90 2024-08-31T06:52:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.571+0000 7f83f7fff640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8103900 0x7f83f819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.572+0000 7f83fc850640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109b90 0x7f83f819f9b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f83f000b970 tx=0x7f83f000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.572+0000 7f83f57fa640 1 -- 172.21.15.37:0/3644923054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0019070 con 0x7f83f8109b90 2024-08-31T06:52:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.572+0000 7f83f57fa640 1 -- 172.21.15.37:0/3644923054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83f0014440 con 0x7f83f8109b90 2024-08-31T06:52:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.572+0000 7f83fe2b3640 1 -- 172.21.15.37:0/3644923054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f81a03d0 con 0x7f83f8109b90 2024-08-31T06:52:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.572+0000 7f83f57fa640 1 -- 172.21.15.37:0/3644923054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f00075d0 con 0x7f83f8109b90 2024-08-31T06:52:48.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.572+0000 7f83fe2b3640 1 -- 172.21.15.37:0/3644923054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f81a6b30 con 0x7f83f8109b90 2024-08-31T06:52:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f83f57fa640 1 -- 172.21.15.37:0/3644923054 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f83f001c070 con 0x7f83f8109b90 2024-08-31T06:52:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f8404828740 1 Processor -- start 2024-08-31T06:52:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f8404828740 1 -- start start 2024-08-31T06:52:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f8404828740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c029070 0x559b0c3ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f8404828740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c0001b0 0x559b0c3ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f8404828740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c008390 0x559b0c3ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f8404828740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559b0c345680 con 0x559b0c008390 2024-08-31T06:52:48.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f8404828740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559b0c334c10 con 0x559b0c0001b0 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f8404828740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559b0c338bc0 con 0x559b0c029070 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f83f77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c008390 0x559b0c3ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f83f77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c008390 0x559b0c3ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51784/0 (socket says 172.21.15.37:51784) 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f83f77fe640 1 -- 172.21.15.37:0/811629810 learned_addr learned my addr 172.21.15.37:0/811629810 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f83f77fe640 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c029070 0x559b0c3ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.575+0000 7f83f7fff640 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c0001b0 0x559b0c3ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83f57fa640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e00b4ca0 0x7f83e00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83fc850640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e00b4ca0 0x7f83e00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83f77fe640 1 -- 172.21.15.37:0/811629810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c0001b0 msgr2=0x559b0c3ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83f77fe640 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c0001b0 0x559b0c3ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83f77fe640 1 -- 172.21.15.37:0/811629810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c008390 msgr2=0x559b0c3ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83f77fe640 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c008390 0x559b0c3ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83f77fe640 1 -- 172.21.15.37:0/811629810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0c094650 con 0x559b0c029070 2024-08-31T06:52:48.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83f57fa640 1 -- 172.21.15.37:0/3644923054 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f83f00e49b0 con 0x7f83f8109b90 2024-08-31T06:52:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83f77fe640 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c029070 0x559b0c3ce310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0116b0 tx=0x7f83ec00a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ca6586527523f5a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83de7fc640 1 -- 172.21.15.37:0/811629810 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec004020 con 0x559b0c029070 2024-08-31T06:52:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83fc850640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e00b4ca0 0x7f83e00b71b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f83f00e21f0 tx=0x7f83f0077390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83de7fc640 1 -- 172.21.15.37:0/811629810 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83ec0054b0 con 0x559b0c029070 2024-08-31T06:52:48.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.576+0000 7f83de7fc640 1 -- 172.21.15.37:0/811629810 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83ec004b90 con 0x559b0c029070 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 -- 172.21.15.37:0/811629810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c029070 msgr2=0x559b0c3ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c029070 0x559b0c3ce310 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83ec0116b0 tx=0x7f83ec00a2d0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 -- 172.21.15.37:0/811629810 shutdown_connections 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c008390 0x559b0c3ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c0001b0 0x559b0c3ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 --2- 172.21.15.37:0/811629810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c029070 0x559b0c3ce310 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 -- 172.21.15.37:0/811629810 >> 172.21.15.37:0/811629810 conn(0x559b0c01d460 msgr2=0x559b0c3cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 -- 172.21.15.37:0/811629810 shutdown_connections 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.577+0000 7f8404828740 1 -- 172.21.15.37:0/811629810 wait complete. 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 1 -- start start 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 1 Processor -- start 2024-08-31T06:52:48.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3d99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3d9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c029070 0x559b0c3e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559b0c197700 con 0x559b0c0001b0 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559b0c2bb750 con 0x559b0c029070 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559b0c3dcaf0 con 0x559b0c008390 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f8404828740 10 client.0 _ll_register_callbacks cb 0x559b0c2eae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f83f77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3d99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f83f77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3d99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51786/0 (socket says 172.21.15.37:51786) 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f83f77fe640 1 -- 172.21.15.37:0/1238954100 learned_addr learned my addr 172.21.15.37:0/1238954100 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.578+0000 7f83f7fff640 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3d9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83f77fe640 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c029070 0x559b0c3e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83f7fff640 1 -- 172.21.15.37:0/1238954100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c029070 msgr2=0x559b0c3e5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83f7fff640 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c029070 0x559b0c3e5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83f7fff640 1 -- 172.21.15.37:0/1238954100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 msgr2=0x559b0c3d99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83f7fff640 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3d99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83f7fff640 1 -- 172.21.15.37:0/1238954100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0c2f4900 con 0x559b0c008390 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83f77fe640 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3d99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83f7fff640 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3d9f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83e80057c0 tx=0x7f83e8031750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3933bd9f02fdeaef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83d77fe640 1 -- 172.21.15.37:0/1238954100 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e804b060 con 0x559b0c008390 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83d77fe640 1 -- 172.21.15.37:0/1238954100 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f83e8004450 con 0x559b0c008390 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f8404828740 1 -- 172.21.15.37:0/1238954100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83ec0054b0 con 0x559b0c008390 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f83d77fe640 1 -- 172.21.15.37:0/1238954100 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f83e8035070 con 0x559b0c008390 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f8404828740 10 client.26299 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.579+0000 7f8404828740 1 -- 172.21.15.37:0/1238954100 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b0c3e8860 con 0x559b0c008390 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f83d77fe640 1 -- 172.21.15.37:0/1238954100 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83ec0054b0 con 0x559b0c008390 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f83d77fe640 1 -- 172.21.15.37:0/1238954100 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f83e8003810 con 0x559b0c008390 2024-08-31T06:52:48.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f8404828740 10 client.26299 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f8404828740 10 client.26299 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f8404828740 20 client.26299 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f8404828740 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559b0bfe79f0 0x559b0c3ebd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f8404828740 4 client.26299 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f8404828740 1 -- 172.21.15.37:0/1238954100 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b0c3475d0 con 0x559b0bfe79f0 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.580+0000 7f83f77fe640 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559b0bfe79f0 0x559b0c3ebd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.581+0000 7f83d77fe640 10 client.26299 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.581+0000 7f83f77fe640 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559b0bfe79f0 0x559b0c3ebd50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=720419eb0e747c20 server_cookie=8fc05898faf411d in_seq=0 out_seq=0 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.581+0000 7f83d77fe640 1 -- 172.21.15.37:0/1238954100 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b0c3475d0 con 0x559b0bfe79f0 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.581+0000 7f83d77fe640 10 client.26299 handle_command_reply: tid=0 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.581+0000 7f8404828740 1 client.26299 shutdown 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 -- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 msgr2=0x559b0c3d9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3d9f30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f83e80057c0 tx=0x7f83e8031750 comp rx=0 tx=0).stop 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 -- 172.21.15.37:0/1238954100 shutdown_connections 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559b0bfe79f0 0x559b0c3ebd50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0c029070 0x559b0c3e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f83d77fe640 0 client.26299 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3d9f30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 --2- 172.21.15.37:0/1238954100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3d99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 -- 172.21.15.37:0/1238954100 >> 172.21.15.37:0/1238954100 conn(0x559b0c01d460 msgr2=0x559b0c3d14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 -- 172.21.15.37:0/1238954100 shutdown_connections 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 1 -- 172.21.15.37:0/1238954100 wait complete. 2024-08-31T06:52:48.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.582+0000 7f8404828740 20 client.26299 trim_cache size 0 max 16384 2024-08-31T06:52:48.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.595+0000 7f8404828740 1 Processor -- start 2024-08-31T06:52:48.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.595+0000 7f8404828740 1 -- start start 2024-08-31T06:52:48.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f8404828740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3db620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f8404828740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f8404828740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f8404828740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81af980 con 0x559b0c0001b0 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f8404828740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81ad250 con 0x559b0bfe79f0 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f8404828740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81ab0a0 con 0x559b0c008390 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51794/0 (socket says 172.21.15.37:51794) 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 -- 172.21.15.37:0/771599887 learned_addr learned my addr 172.21.15.37:0/771599887 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f77fe640 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3db620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f77fe640 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 -- 172.21.15.37:0/771599887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 msgr2=0x559b0c3cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 -- 172.21.15.37:0/771599887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 msgr2=0x559b0c3db620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3db620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 -- 172.21.15.37:0/771599887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b0c3d0600 con 0x559b0c0001b0 2024-08-31T06:52:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f77fe640 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83f7fff640 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3cb7d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f83e802a930 tx=0x7f83e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2cc6a5e29c34d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.596+0000 7f83ddffb640 1 -- 172.21.15.37:0/771599887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e804b040 con 0x559b0c0001b0 2024-08-31T06:52:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f83ddffb640 1 -- 172.21.15.37:0/771599887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83e8004250 con 0x559b0c0001b0 2024-08-31T06:52:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f83ddffb640 1 -- 172.21.15.37:0/771599887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e803bc00 con 0x559b0c0001b0 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 -- 172.21.15.37:0/771599887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 msgr2=0x559b0c3cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3cb7d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f83e802a930 tx=0x7f83e8009250 comp rx=0 tx=0).stop 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 -- 172.21.15.37:0/771599887 shutdown_connections 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3cb7d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 --2- 172.21.15.37:0/771599887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 -- 172.21.15.37:0/771599887 >> 172.21.15.37:0/771599887 conn(0x559b0c01d460 msgr2=0x559b0c3daf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 -- 172.21.15.37:0/771599887 shutdown_connections 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.597+0000 7f8404828740 1 -- 172.21.15.37:0/771599887 wait complete. 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.598+0000 7f8404828740 1 -- start start 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.598+0000 7f8404828740 1 Processor -- start 2024-08-31T06:52:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.598+0000 7f8404828740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.598+0000 7f8404828740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3de6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.598+0000 7f8404828740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3dec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.598+0000 7f8404828740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81ab710 con 0x559b0c0001b0 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.598+0000 7f8404828740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81acb80 con 0x559b0bfe79f0 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.598+0000 7f8404828740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f83f81abde0 con 0x559b0c008390 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3de6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f8404828740 10 client.0 _ll_register_callbacks cb 0x7f83e8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3de6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51798/0 (socket says 172.21.15.37:51798) 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 -- 172.21.15.37:0/954040280 learned_addr learned my addr 172.21.15.37:0/954040280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f77fe640 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3dec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f77fe640 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 -- 172.21.15.37:0/954040280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 msgr2=0x559b0c3dec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3dec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 -- 172.21.15.37:0/954040280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 msgr2=0x559b0c3e2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3e2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 -- 172.21.15.37:0/954040280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b0c3df170 con 0x559b0c0001b0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83f7fff640 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3de6f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f83e8003c10 tx=0x7f83e803b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d5a8f6253c24f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83d77fe640 1 -- 172.21.15.37:0/954040280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e805d070 con 0x559b0c0001b0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83d77fe640 1 -- 172.21.15.37:0/954040280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f83e803b980 con 0x559b0c0001b0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f8404828740 1 -- 172.21.15.37:0/954040280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e8004250 con 0x559b0c0001b0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f83d77fe640 1 -- 172.21.15.37:0/954040280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f83e8069050 con 0x559b0c0001b0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f8404828740 10 client.16989 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.599+0000 7f8404828740 1 -- 172.21.15.37:0/954040280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b0c457340 con 0x559b0c0001b0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f83d77fe640 1 -- 172.21.15.37:0/954040280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83e8004250 con 0x559b0c0001b0 2024-08-31T06:52:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f83d77fe640 1 -- 172.21.15.37:0/954040280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f83e8046b10 con 0x559b0c0001b0 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f8404828740 10 client.16989 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f8404828740 10 client.16989 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f8404828740 20 client.16989 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f8404828740 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559b0c029070 0x559b0c459a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f8404828740 4 client.16989 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f8404828740 1 -- 172.21.15.37:0/954040280 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b0c343070 con 0x559b0c029070 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.600+0000 7f83f77fe640 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559b0c029070 0x559b0c459a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f83f77fe640 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559b0c029070 0x559b0c459a60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55d2bb95a4e91858 server_cookie=6dc952904173467b in_seq=0 out_seq=0 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f83d77fe640 10 client.16989 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f83d77fe640 1 -- 172.21.15.37:0/954040280 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b0c343070 con 0x559b0c029070 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f83d77fe640 10 client.16989 handle_command_reply: tid=0 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 client.16989 shutdown 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 -- 172.21.15.37:0/954040280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 msgr2=0x559b0c3de6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3de6f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f83e8003c10 tx=0x7f83e803b750 comp rx=0 tx=0).stop 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 -- 172.21.15.37:0/954040280 shutdown_connections 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559b0c029070 0x559b0c459a60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559b0c0001b0 0x559b0c3de6f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559b0c008390 0x559b0c3dec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 --2- 172.21.15.37:0/954040280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559b0bfe79f0 0x559b0c3e2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 -- 172.21.15.37:0/954040280 >> 172.21.15.37:0/954040280 conn(0x559b0c01d460 msgr2=0x559b0c3cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f83d77fe640 0 client.16989 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 -- 172.21.15.37:0/954040280 shutdown_connections 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.601+0000 7f8404828740 1 -- 172.21.15.37:0/954040280 wait complete. 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f8404828740 20 client.16989 trim_cache size 0 max 16384 2024-08-31T06:52:48.607 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:52:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 -- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e00b4ca0 msgr2=0x7f83e00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e00b4ca0 0x7f83e00b71b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f83f00e21f0 tx=0x7f83f0077390 comp rx=0 tx=0).stop 2024-08-31T06:52:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 -- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109b90 msgr2=0x7f83f819f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109b90 0x7f83f819f9b0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f83f000b970 tx=0x7f83f000be30 comp rx=0 tx=0).stop 2024-08-31T06:52:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 -- 172.21.15.37:0/3644923054 shutdown_connections 2024-08-31T06:52:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f83e00b4ca0 0x7f83e00b71b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f8109b90 0x7f83f819f9b0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83f8109240 0x7f83f819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 --2- 172.21.15.37:0/3644923054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83f8103900 0x7f83f819a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 -- 172.21.15.37:0/3644923054 >> 172.21.15.37:0/3644923054 conn(0x7f83f807b5f0 msgr2=0x7f83f8107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 -- 172.21.15.37:0/3644923054 shutdown_connections 2024-08-31T06:52:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:48.602+0000 7f83fe2b3640 1 -- 172.21.15.37:0/3644923054 wait complete. 2024-08-31T06:52:49.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:52:49.717 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:49.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:49 smithi106 ceph-mon[22134]: pgmap v499: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:49.833 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:49 smithi037 ceph-mon[18612]: pgmap v499: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:49.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:49 smithi066 ceph-mon[22244]: pgmap v499: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:50.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.185+0000 7fe1ff913640 1 -- 172.21.15.37:0/733222872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 msgr2=0x7fe1f810d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.185+0000 7fe1ff913640 1 --2- 172.21.15.37:0/733222872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 0x7fe1f810d670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8009900 tx=0x7fe1e802a410 comp rx=0 tx=0).stop 2024-08-31T06:52:50.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.185+0000 7fe1ff913640 1 -- 172.21.15.37:0/733222872 shutdown_connections 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.185+0000 7fe1ff913640 1 --2- 172.21.15.37:0/733222872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 0x7fe1f810d670 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.185+0000 7fe1ff913640 1 --2- 172.21.15.37:0/733222872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f810dc30 0x7fe1f8110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.185+0000 7fe1ff913640 1 --2- 172.21.15.37:0/733222872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f81047d0 0x7fe1f8104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.186+0000 7fe1ff913640 1 -- 172.21.15.37:0/733222872 >> 172.21.15.37:0/733222872 conn(0x7fe1f8079510 msgr2=0x7fe1f8079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.186+0000 7fe1ff913640 1 -- 172.21.15.37:0/733222872 shutdown_connections 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.186+0000 7fe1ff913640 1 -- 172.21.15.37:0/733222872 wait complete. 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.186+0000 7fe1ff913640 1 Processor -- start 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.186+0000 7fe1ff913640 1 -- start start 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1ff913640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f81047d0 0x7fe1f819a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1ff913640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 0x7fe1f819a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1ff913640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f810dc30 0x7fe1f819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1ff913640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f8113740 con 0x7fe1f8105120 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1ff913640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f81135c0 con 0x7fe1f810dc30 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1ff913640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f81138c0 con 0x7fe1f81047d0 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 0x7fe1f819a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 0x7fe1f819a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51814/0 (socket says 172.21.15.37:51814) 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 -- 172.21.15.37:0/3517319891 learned_addr learned my addr 172.21.15.37:0/3517319891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f81047d0 0x7fe1f819a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f810dc30 0x7fe1f819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 -- 172.21.15.37:0/3517319891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f81047d0 msgr2=0x7fe1f819a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f81047d0 0x7fe1f819a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 -- 172.21.15.37:0/3517319891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f810dc30 msgr2=0x7fe1f819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f810dc30 0x7fe1f819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 -- 172.21.15.37:0/3517319891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f81a01a0 con 0x7fe1f8105120 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f81047d0 0x7fe1f819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1fceae640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 0x7fe1f819a7d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8004770 tx=0x7fe1e8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.187+0000 7fe1ee7fc640 1 -- 172.21.15.37:0/3517319891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e803f030 con 0x7fe1f8105120 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.188+0000 7fe1ff913640 1 -- 172.21.15.37:0/3517319891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f81a0430 con 0x7fe1f8105120 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.188+0000 7fe1ee7fc640 1 -- 172.21.15.37:0/3517319891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1e8004440 con 0x7fe1f8105120 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.188+0000 7fe1ee7fc640 1 -- 172.21.15.37:0/3517319891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8035070 con 0x7fe1f8105120 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.188+0000 7fe1ff913640 1 -- 172.21.15.37:0/3517319891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f81a6bf0 con 0x7fe1f8105120 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.190+0000 7fe1ee7fc640 1 -- 172.21.15.37:0/3517319891 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fe1e8042030 con 0x7fe1f8105120 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.190+0000 7fe205e88740 1 Processor -- start 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.190+0000 7fe205e88740 1 -- start start 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe205e88740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f5085310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe205e88740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cb71b0 0x5560f5085850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe205e88740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cbf390 0x5560f5085d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe205e88740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5560f4ffc680 con 0x5560f4cb71b0 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe205e88740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5560f4febc10 con 0x5560f4cbf390 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe205e88740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5560f4fefbc0 con 0x5560f4ce0070 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fd6af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cb71b0 0x5560f5085850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fd6af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cb71b0 0x5560f5085850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51828/0 (socket says 172.21.15.37:51828) 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fd6af640 1 -- 172.21.15.37:0/1508683780 learned_addr learned my addr 172.21.15.37:0/1508683780 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1ee7fc640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe1e40b4ca0 0x7fe1e40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f5085310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fceae640 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cbf390 0x5560f5085d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fd6af640 1 -- 172.21.15.37:0/1508683780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 msgr2=0x5560f5085310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f5085310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fd6af640 1 -- 172.21.15.37:0/1508683780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cbf390 msgr2=0x5560f5085d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cbf390 0x5560f5085d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe1e40b4ca0 0x7fe1e40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fd6af640 1 -- 172.21.15.37:0/1508683780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f4d4b650 con 0x5560f4cb71b0 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1ee7fc640 1 -- 172.21.15.37:0/3517319891 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe1e8105a10 con 0x7fe1f8105120 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.191+0000 7fe1fceae640 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cbf390 0x5560f5085d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.192+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cb71b0 0x5560f5085850 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400bcc0 tx=0x7fe1f400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302c023371d9b219 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.192+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe1e40b4ca0 0x7fe1e40b71b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009810 tx=0x7fe1f0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.192+0000 7fe1e37fe640 1 -- 172.21.15.37:0/1508683780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4005020 con 0x5560f4cb71b0 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.192+0000 7fe1e37fe640 1 -- 172.21.15.37:0/1508683780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1f40047a0 con 0x5560f4cb71b0 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.192+0000 7fe1e37fe640 1 -- 172.21.15.37:0/1508683780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f40116a0 con 0x5560f4cb71b0 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 -- 172.21.15.37:0/1508683780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cb71b0 msgr2=0x5560f5085850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cb71b0 0x5560f5085850 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400bcc0 tx=0x7fe1f400f730 comp rx=0 tx=0).stop 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 -- 172.21.15.37:0/1508683780 shutdown_connections 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cb71b0 0x5560f5085850 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cbf390 0x5560f5085d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 --2- 172.21.15.37:0/1508683780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f5085310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 -- 172.21.15.37:0/1508683780 >> 172.21.15.37:0/1508683780 conn(0x5560f4cd4460 msgr2=0x5560f5083200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:50.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 -- 172.21.15.37:0/1508683780 shutdown_connections 2024-08-31T06:52:50.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 -- 172.21.15.37:0/1508683780 wait complete. 2024-08-31T06:52:50.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 -- start start 2024-08-31T06:52:50.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.193+0000 7fe205e88740 1 Processor -- start 2024-08-31T06:52:50.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe205e88740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5090a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe205e88740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f5090fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe205e88740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f509ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe205e88740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5560f4e4e700 con 0x5560f4cbf390 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe205e88740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5560f4f72750 con 0x5560f4cb71b0 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe205e88740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5560f5093af0 con 0x5560f4ce0070 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe205e88740 10 client.0 _ll_register_callbacks cb 0x5560f4fa1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fceae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f5090fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fceae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f5090fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51834/0 (socket says 172.21.15.37:51834) 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fceae640 1 -- 172.21.15.37:0/1936234482 learned_addr learned my addr 172.21.15.37:0/1936234482 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5090a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f509ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fceae640 1 -- 172.21.15.37:0/1936234482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 msgr2=0x5560f509ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:50.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fceae640 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f509ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fceae640 1 -- 172.21.15.37:0/1936234482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 msgr2=0x5560f5090a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fceae640 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5090a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fceae640 1 -- 172.21.15.37:0/1936234482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f4fab900 con 0x5560f4cbf390 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.194+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f509ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe1fceae640 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f5090fb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80cbde0 tx=0x7fe1e80416b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c69c5d9b70c43a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe1e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/1936234482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80cbbf0 con 0x5560f4cbf390 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/1936234482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe1e80c86d0 con 0x5560f4cbf390 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 1 -- 172.21.15.37:0/1936234482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1f40047a0 con 0x5560f4cbf390 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/1936234482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1e80cc7e0 con 0x5560f4cbf390 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 10 client.17001 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 1 -- 172.21.15.37:0/1936234482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5560f509f820 con 0x5560f4cbf390 2024-08-31T06:52:50.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/1936234482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1f40047a0 con 0x5560f4cbf390 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/1936234482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe1e81033c0 con 0x5560f4cbf390 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 10 client.17001 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 20 client.17001 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5560f4c9e9f0 0x5560f50a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 4 client.17001 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.195+0000 7fe205e88740 1 -- 172.21.15.37:0/1936234482 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560f4ffe5d0 con 0x5560f4c9e9f0 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.196+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5560f4c9e9f0 0x5560f50a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.196+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5560f4c9e9f0 0x5560f50a2c70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54684c8e455469df server_cookie=ba16afd2668a566b in_seq=0 out_seq=0 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.196+0000 7fe1e0ff9640 10 client.17001 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/1936234482 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5560f4ffe5d0 con 0x5560f4c9e9f0 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe1e0ff9640 10 client.17001 handle_command_reply: tid=0 2024-08-31T06:52:50.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 client.17001 shutdown 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 -- 172.21.15.37:0/1936234482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 msgr2=0x5560f5090fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f5090fb0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fe1e80cbde0 tx=0x7fe1e80416b0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 -- 172.21.15.37:0/1936234482 shutdown_connections 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5560f4c9e9f0 0x5560f50a2c70 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f5090fb0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f509ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe1e0ff9640 0 client.17001 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 --2- 172.21.15.37:0/1936234482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5090a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.197+0000 7fe205e88740 1 -- 172.21.15.37:0/1936234482 >> 172.21.15.37:0/1936234482 conn(0x5560f4cd4460 msgr2=0x5560f50884a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.198+0000 7fe205e88740 1 -- 172.21.15.37:0/1936234482 shutdown_connections 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.198+0000 7fe205e88740 1 -- 172.21.15.37:0/1936234482 wait complete. 2024-08-31T06:52:50.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.198+0000 7fe205e88740 20 client.17001 trim_cache size 0 max 16384 2024-08-31T06:52:50.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe205e88740 1 Processor -- start 2024-08-31T06:52:50.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe205e88740 1 -- start start 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe205e88740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5083230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe205e88740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f509cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe205e88740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f508dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe205e88740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f81b1c80 con 0x5560f4cbf390 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe205e88740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f81af550 con 0x5560f4cb71b0 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe205e88740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f81ad3a0 con 0x5560f4ce0070 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.211+0000 7fe1fceae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f509cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fceae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f509cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51844/0 (socket says 172.21.15.37:51844) 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fceae640 1 -- 172.21.15.37:0/2374113235 learned_addr learned my addr 172.21.15.37:0/2374113235 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:50.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5083230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f508dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fceae640 1 -- 172.21.15.37:0/2374113235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 msgr2=0x5560f508dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fceae640 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f508dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fceae640 1 -- 172.21.15.37:0/2374113235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 msgr2=0x5560f5083230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fceae640 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5083230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fceae640 1 -- 172.21.15.37:0/2374113235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f5087600 con 0x5560f4cbf390 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1fceae640 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f509cd10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe1e803d040 tx=0x7fe1e802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdff70bca2a02b8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1e2ffd640 1 -- 172.21.15.37:0/2374113235 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e80cba30 con 0x5560f4cbf390 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1e2ffd640 1 -- 172.21.15.37:0/2374113235 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1e80cbbf0 con 0x5560f4cbf390 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.212+0000 7fe1e2ffd640 1 -- 172.21.15.37:0/2374113235 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e81033c0 con 0x5560f4cbf390 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 -- 172.21.15.37:0/2374113235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 msgr2=0x5560f509cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f509cd10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe1e803d040 tx=0x7fe1e802a410 comp rx=0 tx=0).stop 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 -- 172.21.15.37:0/2374113235 shutdown_connections 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4cbf390 0x5560f509cd10 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4ce0070 0x5560f508dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 --2- 172.21.15.37:0/2374113235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5083230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 -- 172.21.15.37:0/2374113235 >> 172.21.15.37:0/2374113235 conn(0x5560f4cd4460 msgr2=0x5560f5082b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:50.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 -- 172.21.15.37:0/2374113235 shutdown_connections 2024-08-31T06:52:50.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 -- 172.21.15.37:0/2374113235 wait complete. 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.213+0000 7fe205e88740 1 -- start start 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe205e88740 1 Processor -- start 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe205e88740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5099310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe205e88740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4cbf390 0x5560f50957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe205e88740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4ce0070 0x5560f5095d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe205e88740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f81ada10 con 0x5560f4ce0070 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe205e88740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f81aee80 con 0x5560f4cb71b0 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe205e88740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f81ae0e0 con 0x5560f4cbf390 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe205e88740 10 client.0 _ll_register_callbacks cb 0x7fe1e8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe1fdeb0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4ce0070 0x5560f5095d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe1fdeb0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4ce0070 0x5560f5095d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51856/0 (socket says 172.21.15.37:51856) 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe1fdeb0640 1 -- 172.21.15.37:0/603857643 learned_addr learned my addr 172.21.15.37:0/603857643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5099310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.214+0000 7fe1fceae640 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4cbf390 0x5560f50957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1fdeb0640 1 -- 172.21.15.37:0/603857643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4cbf390 msgr2=0x5560f50957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4cbf390 0x5560f50957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1fdeb0640 1 -- 172.21.15.37:0/603857643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 msgr2=0x5560f5099310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5099310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1fdeb0640 1 -- 172.21.15.37:0/603857643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f5096250 con 0x5560f4ce0070 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1fdeb0640 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4ce0070 0x5560f5095d10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00042b0 tx=0x7fe1f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d8b44f52ec9edf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/603857643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0020b10 con 0x5560f4ce0070 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/603857643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7fe1f0020cb0 con 0x5560f4ce0070 2024-08-31T06:52:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe205e88740 1 -- 172.21.15.37:0/603857643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1e80cbbf0 con 0x5560f4ce0070 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/603857643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1f0011450 con 0x5560f4ce0070 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe205e88740 10 client.17007 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe205e88740 1 -- 172.21.15.37:0/603857643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5560f510e390 con 0x5560f4ce0070 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.215+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/603857643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1e80cbbf0 con 0x5560f4ce0070 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/603857643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe1f001b070 con 0x5560f4ce0070 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe205e88740 10 client.17007 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe205e88740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe205e88740 20 client.17007 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe205e88740 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5560f4c73da0 0x5560f5110b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe205e88740 4 client.17007 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe205e88740 1 -- 172.21.15.37:0/603857643 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5560f4ffa070 con 0x5560f4c73da0 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5560f4c73da0 0x5560f5110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:50.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe1fd6af640 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5560f4c73da0 0x5560f5110b20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeda81e75ba6ca8f server_cookie=6a50b66a88aeef95 in_seq=0 out_seq=0 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe1e0ff9640 10 client.17007 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe1e0ff9640 1 -- 172.21.15.37:0/603857643 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5560f4ffa070 con 0x5560f4c73da0 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe1e0ff9640 10 client.17007 handle_command_reply: tid=0 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.216+0000 7fe205e88740 1 client.17007 shutdown 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 -- 172.21.15.37:0/603857643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4ce0070 msgr2=0x5560f5095d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4ce0070 0x5560f5095d10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00042b0 tx=0x7fe1f0004a40 comp rx=0 tx=0).stop 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 -- 172.21.15.37:0/603857643 shutdown_connections 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5560f4c73da0 0x5560f5110b20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560f4ce0070 0x5560f5095d10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5560f4cbf390 0x5560f50957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe1e0ff9640 0 client.17007 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 --2- 172.21.15.37:0/603857643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5560f4cb71b0 0x5560f5099310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 -- 172.21.15.37:0/603857643 >> 172.21.15.37:0/603857643 conn(0x5560f4cd4460 msgr2=0x5560f5086340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 -- 172.21.15.37:0/603857643 shutdown_connections 2024-08-31T06:52:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 1 -- 172.21.15.37:0/603857643 wait complete. 2024-08-31T06:52:50.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe205e88740 20 client.17007 trim_cache size 0 max 16384 2024-08-31T06:52:50.223 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:52:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe1ff913640 1 -- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe1e40b4ca0 msgr2=0x7fe1e40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe1ff913640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe1e40b4ca0 0x7fe1e40b71b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009810 tx=0x7fe1f0009500 comp rx=0 tx=0).stop 2024-08-31T06:52:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe1ff913640 1 -- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 msgr2=0x7fe1f819a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.217+0000 7fe1ff913640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 0x7fe1f819a7d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8004770 tx=0x7fe1e8004040 comp rx=0 tx=0).stop 2024-08-31T06:52:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.218+0000 7fe1ff913640 1 -- 172.21.15.37:0/3517319891 shutdown_connections 2024-08-31T06:52:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.218+0000 7fe1ff913640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fe1e40b4ca0 0x7fe1e40b71b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.218+0000 7fe1ff913640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1f8105120 0x7fe1f819a7d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.218+0000 7fe1ff913640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1f810dc30 0x7fe1f819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.218+0000 7fe1ff913640 1 --2- 172.21.15.37:0/3517319891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1f81047d0 0x7fe1f819a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:50.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.218+0000 7fe1ff913640 1 -- 172.21.15.37:0/3517319891 >> 172.21.15.37:0/3517319891 conn(0x7fe1f8079510 msgr2=0x7fe1f81006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:50.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.218+0000 7fe1ff913640 1 -- 172.21.15.37:0/3517319891 shutdown_connections 2024-08-31T06:52:50.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:50.218+0000 7fe1ff913640 1 -- 172.21.15.37:0/3517319891 wait complete. 2024-08-31T06:52:51.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:51 smithi106 ceph-mon[22134]: pgmap v500: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:52:51.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:51 smithi037 ceph-mon[18612]: pgmap v500: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:52:51.878 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:52:51.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:52:51.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:51 smithi066 ceph-mon[22244]: pgmap v500: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:52:52.143 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 -- 172.21.15.37:0/2146963573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac104600 msgr2=0x7f70ac104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 --2- 172.21.15.37:0/2146963573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac104600 0x7f70ac104a10 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f709c009900 tx=0x7f709c02a410 comp rx=0 tx=0).stop 2024-08-31T06:52:52.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 -- 172.21.15.37:0/2146963573 shutdown_connections 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 --2- 172.21.15.37:0/2146963573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70ac10dbb0 0x7f70ac110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 --2- 172.21.15.37:0/2146963573 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70ac105030 0x7f70ac10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 --2- 172.21.15.37:0/2146963573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac104600 0x7f70ac104a10 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 -- 172.21.15.37:0/2146963573 >> 172.21.15.37:0/2146963573 conn(0x7f70ac0794d0 msgr2=0x7f70ac0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 -- 172.21.15.37:0/2146963573 shutdown_connections 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.630+0000 7f70b2360640 1 -- 172.21.15.37:0/2146963573 wait complete. 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70b2360640 1 Processor -- start 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70b2360640 1 -- start start 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70b2360640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70ac104600 0x7f70ac19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70b2360640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac105030 0x7f70ac19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70b2360640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70ac10dbb0 0x7f70ac19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70b2360640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1136c0 con 0x7f70ac105030 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70b2360640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac113540 con 0x7f70ac104600 2024-08-31T06:52:52.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70b2360640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac113840 con 0x7f70ac10dbb0 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.631+0000 7f70a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac105030 0x7f70ac19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac105030 0x7f70ac19a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51876/0 (socket says 172.21.15.37:51876) 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a3fff640 1 -- 172.21.15.37:0/109196911 learned_addr learned my addr 172.21.15.37:0/109196911 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70b08fd640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70ac10dbb0 0x7f70ac19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70abfff640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70ac104600 0x7f70ac19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a3fff640 1 -- 172.21.15.37:0/109196911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70ac10dbb0 msgr2=0x7f70ac19fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a3fff640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70ac10dbb0 0x7f70ac19fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a3fff640 1 -- 172.21.15.37:0/109196911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70ac104600 msgr2=0x7f70ac19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a3fff640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70ac104600 0x7f70ac19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a3fff640 1 -- 172.21.15.37:0/109196911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac1a00a0 con 0x7f70ac105030 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a3fff640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac105030 0x7f70ac19a790 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f709400c8c0 tx=0x7f709400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a9ffb640 1 -- 172.21.15.37:0/109196911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7094007bb0 con 0x7f70ac105030 2024-08-31T06:52:52.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a9ffb640 1 -- 172.21.15.37:0/109196911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7094007d50 con 0x7f70ac105030 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70b2360640 1 -- 172.21.15.37:0/109196911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac1a0390 con 0x7f70ac105030 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70a9ffb640 1 -- 172.21.15.37:0/109196911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70940186a0 con 0x7f70ac105030 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.632+0000 7f70b2360640 1 -- 172.21.15.37:0/109196911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac1a6bb0 con 0x7f70ac105030 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70a9ffb640 1 -- 172.21.15.37:0/109196911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f709400fa00 con 0x7f70ac105030 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70b88d5740 1 Processor -- start 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70b88d5740 1 -- start start 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520e1c350 0x55a5211c2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520df3490 0x55a5211c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520dfb670 0x55a5211c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70b88d5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a5211385f0 con 0x55a520df3490 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70b88d5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a521127b80 con 0x55a520e1c350 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70b88d5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a52112bb30 con 0x55a520dfb670 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.635+0000 7f70abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520df3490 0x55a5211c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520df3490 0x55a5211c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51882/0 (socket says 172.21.15.37:51882) 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70abfff640 1 -- 172.21.15.37:0/1911998135 learned_addr learned my addr 172.21.15.37:0/1911998135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70b08fd640 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520e1c350 0x55a5211c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70a3fff640 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520dfb670 0x55a5211c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70abfff640 1 -- 172.21.15.37:0/1911998135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520dfb670 msgr2=0x55a5211c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70abfff640 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520dfb670 0x55a5211c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70abfff640 1 -- 172.21.15.37:0/1911998135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520e1c350 msgr2=0x55a5211c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70abfff640 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520e1c350 0x55a5211c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70abfff640 1 -- 172.21.15.37:0/1911998135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a520e87930 con 0x55a520df3490 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70a9ffb640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70980b4d50 0x7f70980b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70a3fff640 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520dfb670 0x55a5211c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70a3fff640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70980b4d50 0x7f70980b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70abfff640 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520df3490 0x55a5211c2cc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f709c02a930 tx=0x7f709c032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664da83fcf8cd209 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70a9ffb640 1 -- 172.21.15.37:0/109196911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f70940e5540 con 0x7f70ac105030 2024-08-31T06:52:52.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70a27fc640 1 -- 172.21.15.37:0/1911998135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c03f070 con 0x55a520df3490 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70a27fc640 1 -- 172.21.15.37:0/1911998135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f709c0044c0 con 0x55a520df3490 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.636+0000 7f70a27fc640 1 -- 172.21.15.37:0/1911998135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c035070 con 0x55a520df3490 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 -- 172.21.15.37:0/1911998135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520df3490 msgr2=0x55a5211c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70a3fff640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70980b4d50 0x7f70980b7260 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f70940e2d80 tx=0x7f7094093040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520df3490 0x55a5211c2cc0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f709c02a930 tx=0x7f709c032dd0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 -- 172.21.15.37:0/1911998135 shutdown_connections 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520df3490 0x55a5211c2cc0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520dfb670 0x55a5211c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1911998135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520e1c350 0x55a5211c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 -- 172.21.15.37:0/1911998135 >> 172.21.15.37:0/1911998135 conn(0x55a520e10740 msgr2=0x55a5211c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 -- 172.21.15.37:0/1911998135 shutdown_connections 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.637+0000 7f70b88d5740 1 -- 172.21.15.37:0/1911998135 wait complete. 2024-08-31T06:52:52.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 1 -- start start 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 1 Processor -- start 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 0x55a5211d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520e1c350 0x55a5211de590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a520f8a890 con 0x55a520e1c350 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a5210ae790 con 0x55a520dfb670 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a5211d5260 con 0x55a520df3490 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b88d5740 10 client.0 _ll_register_callbacks cb 0x55a520e33ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b08fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520e1c350 0x55a5211de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b08fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520e1c350 0x55a5211de590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51888/0 (socket says 172.21.15.37:51888) 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.638+0000 7f70b08fd640 1 -- 172.21.15.37:0/1167673578 learned_addr learned my addr 172.21.15.37:0/1167673578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70abfff640 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 0x55a5211d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b08fd640 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b08fd640 1 -- 172.21.15.37:0/1167673578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 msgr2=0x55a5211d2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b08fd640 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211d2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b08fd640 1 -- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 msgr2=0x55a5211d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b08fd640 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 0x55a5211d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b08fd640 1 -- 172.21.15.37:0/1167673578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5210e5f30 con 0x55a520e1c350 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70abfff640 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 0x55a5211d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b08fd640 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520e1c350 0x55a5211de590 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009fd0 tx=0x7f70a4009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412e55920d2fbba9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f708b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f708b7fe640 1 -- 172.21.15.37:0/1167673578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4013110 con 0x55a520e1c350 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b88d5740 1 -- 172.21.15.37:0/1167673578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a52113a540 con 0x55a520e1c350 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f708b7fe640 1 -- 172.21.15.37:0/1167673578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f70a4003970 con 0x55a520e1c350 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f708b7fe640 1 -- 172.21.15.37:0/1167673578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f70a4026050 con 0x55a520e1c350 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b88d5740 10 client.17019 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.639+0000 7f70b88d5740 1 -- 172.21.15.37:0/1167673578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a5211e1130 con 0x55a520e1c350 2024-08-31T06:52:52.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f708b7fe640 1 -- 172.21.15.37:0/1167673578 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a52113a540 con 0x55a520e1c350 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f708b7fe640 1 -- 172.21.15.37:0/1167673578 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f70a4004560 con 0x55a520e1c350 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f70b88d5740 10 client.17019 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f70b88d5740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f70b88d5740 20 client.17019 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a520ddacd0 0x55a5211e4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f70b88d5740 4 client.17019 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f70b88d5740 1 -- 172.21.15.37:0/1167673578 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a521135fe0 con 0x55a520ddacd0 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.640+0000 7f70abfff640 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a520ddacd0 0x55a5211e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.641+0000 7f70abfff640 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a520ddacd0 0x55a5211e4630 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3e3ed30e2460d00 server_cookie=46e5ba930ce276d0 in_seq=0 out_seq=0 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.641+0000 7f708b7fe640 10 client.17019 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.641+0000 7f708b7fe640 1 -- 172.21.15.37:0/1167673578 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a521135fe0 con 0x55a520ddacd0 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.641+0000 7f708b7fe640 10 client.17019 handle_command_reply: tid=0 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.641+0000 7f70b88d5740 1 client.17019 shutdown 2024-08-31T06:52:52.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 -- 172.21.15.37:0/1167673578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520e1c350 msgr2=0x55a5211de590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520e1c350 0x55a5211de590 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009fd0 tx=0x7f70a4009e50 comp rx=0 tx=0).stop 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 -- 172.21.15.37:0/1167673578 shutdown_connections 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a520ddacd0 0x55a5211e4630 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520e1c350 0x55a5211de590 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 0x55a5211d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f708b7fe640 0 client.17019 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 --2- 172.21.15.37:0/1167673578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211d2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 -- 172.21.15.37:0/1167673578 >> 172.21.15.37:0/1167673578 conn(0x55a520e10740 msgr2=0x55a5211c4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 -- 172.21.15.37:0/1167673578 shutdown_connections 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 1 -- 172.21.15.37:0/1167673578 wait complete. 2024-08-31T06:52:52.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.642+0000 7f70b88d5740 20 client.17019 trim_cache size 0 max 16384 2024-08-31T06:52:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b88d5740 1 Processor -- start 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b88d5740 1 -- start start 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520ddacd0 0x55a5211d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 0x55a5211bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b88d5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1af970 con 0x55a520ddacd0 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b88d5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1ad240 con 0x55a520dfb670 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b88d5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1ab090 con 0x55a520df3490 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b08fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520ddacd0 0x55a5211d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b08fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520ddacd0 0x55a5211d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51892/0 (socket says 172.21.15.37:51892) 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.660+0000 7f70b08fd640 1 -- 172.21.15.37:0/3902999694 learned_addr learned my addr 172.21.15.37:0/3902999694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70abfff640 1 --2- 172.21.15.37:0/3902999694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70b08fd640 1 -- 172.21.15.37:0/3902999694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 msgr2=0x55a5211d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70b08fd640 1 --2- 172.21.15.37:0/3902999694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70b08fd640 1 -- 172.21.15.37:0/3902999694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 msgr2=0x55a5211bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70b08fd640 1 --2- 172.21.15.37:0/3902999694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 0x55a5211bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70b08fd640 1 -- 172.21.15.37:0/3902999694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5211d0850 con 0x55a520ddacd0 2024-08-31T06:52:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70b08fd640 1 --2- 172.21.15.37:0/3902999694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520ddacd0 0x55a5211d22c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009b30 tx=0x7f70a400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d083ec2fc88b2d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70a1ffb640 1 -- 172.21.15.37:0/3902999694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a40097d0 con 0x55a520ddacd0 2024-08-31T06:52:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70a1ffb640 1 -- 172.21.15.37:0/3902999694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70a402f070 con 0x55a520ddacd0 2024-08-31T06:52:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.661+0000 7f70a1ffb640 1 -- 172.21.15.37:0/3902999694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4011980 con 0x55a520ddacd0 2024-08-31T06:52:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 -- 172.21.15.37:0/3902999694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520ddacd0 msgr2=0x55a5211d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 --2- 172.21.15.37:0/3902999694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520ddacd0 0x55a5211d22c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009b30 tx=0x7f70a400eef0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 -- 172.21.15.37:0/3902999694 shutdown_connections 2024-08-31T06:52:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 --2- 172.21.15.37:0/3902999694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520dfb670 0x55a5211bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 --2- 172.21.15.37:0/3902999694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 --2- 172.21.15.37:0/3902999694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520ddacd0 0x55a5211d22c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 -- 172.21.15.37:0/3902999694 >> 172.21.15.37:0/3902999694 conn(0x55a520e10740 msgr2=0x55a5211d0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 -- 172.21.15.37:0/3902999694 shutdown_connections 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 -- 172.21.15.37:0/3902999694 wait complete. 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.662+0000 7f70b88d5740 1 -- start start 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b88d5740 1 Processor -- start 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520ddacd0 0x55a5211da500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211daa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b88d5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520dfb670 0x55a5211d54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b88d5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1ab700 con 0x55a520dfb670 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b88d5740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1acb70 con 0x55a520ddacd0 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b88d5740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1abdd0 con 0x55a520df3490 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b88d5740 10 client.0 _ll_register_callbacks cb 0x7f70a4009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b08fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520dfb670 0x55a5211d54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b08fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520dfb670 0x55a5211d54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51904/0 (socket says 172.21.15.37:51904) 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b08fd640 1 -- 172.21.15.37:0/428884635 learned_addr learned my addr 172.21.15.37:0/428884635 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b08fd640 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520ddacd0 0x55a5211da500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70abfff640 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211daa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b08fd640 1 -- 172.21.15.37:0/428884635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 msgr2=0x55a5211daa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b08fd640 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211daa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b08fd640 1 -- 172.21.15.37:0/428884635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520ddacd0 msgr2=0x55a5211da500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.663+0000 7f70b08fd640 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520ddacd0 0x55a5211da500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f70b08fd640 1 -- 172.21.15.37:0/428884635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5211db000 con 0x55a520dfb670 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f70b08fd640 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520dfb670 0x55a5211d54b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f70a4002210 tx=0x7f70a4005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e47492f5b102f98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f708b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f708b7fe640 1 -- 172.21.15.37:0/428884635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4039030 con 0x55a520dfb670 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f708b7fe640 1 -- 172.21.15.37:0/428884635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f70a4011db0 con 0x55a520dfb670 2024-08-31T06:52:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f70b88d5740 1 -- 172.21.15.37:0/428884635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a402f070 con 0x55a520dfb670 2024-08-31T06:52:52.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f708b7fe640 1 -- 172.21.15.37:0/428884635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f70a4011700 con 0x55a520dfb670 2024-08-31T06:52:52.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f70b88d5740 10 client.17025 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:52.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f70b88d5740 1 -- 172.21.15.37:0/428884635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a52124f370 con 0x55a520dfb670 2024-08-31T06:52:52.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.664+0000 7f708b7fe640 1 -- 172.21.15.37:0/428884635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70a402f070 con 0x55a520dfb670 2024-08-31T06:52:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f708b7fe640 1 -- 172.21.15.37:0/428884635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f70a4005140 con 0x55a520dfb670 2024-08-31T06:52:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f70b88d5740 10 client.17025 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f70b88d5740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:52.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f70b88d5740 20 client.17025 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f70b88d5740 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a520e1c350 0x55a521251ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f70b88d5740 4 client.17025 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f70b88d5740 1 -- 172.21.15.37:0/428884635 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a521133720 con 0x55a520e1c350 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f70abfff640 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a520e1c350 0x55a521251ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f70abfff640 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a520e1c350 0x55a521251ac0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1495aa8c89b72e5 server_cookie=a82c4c65c7e8bf88 in_seq=0 out_seq=0 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.665+0000 7f708b7fe640 10 client.17025 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f708b7fe640 1 -- 172.21.15.37:0/428884635 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a521133720 con 0x55a520e1c350 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f708b7fe640 10 client.17025 handle_command_reply: tid=0 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 client.17025 shutdown 2024-08-31T06:52:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 -- 172.21.15.37:0/428884635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520dfb670 msgr2=0x55a5211d54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520dfb670 0x55a5211d54b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f70a4002210 tx=0x7f70a4005cf0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 -- 172.21.15.37:0/428884635 shutdown_connections 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55a520e1c350 0x55a521251ac0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a520dfb670 0x55a5211d54b0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a520df3490 0x55a5211daa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f708b7fe640 0 client.17025 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 --2- 172.21.15.37:0/428884635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a520ddacd0 0x55a5211da500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.667+0000 7f70b88d5740 1 -- 172.21.15.37:0/428884635 >> 172.21.15.37:0/428884635 conn(0x55a520e10740 msgr2=0x55a5211d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b88d5740 1 -- 172.21.15.37:0/428884635 shutdown_connections 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b88d5740 1 -- 172.21.15.37:0/428884635 wait complete. 2024-08-31T06:52:52.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b88d5740 20 client.17025 trim_cache size 0 max 16384 2024-08-31T06:52:52.672 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:52:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:52:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b", 2024-08-31T06:52:52.672 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:52:52.672 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 -- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70980b4d50 msgr2=0x7f70980b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70980b4d50 0x7f70980b7260 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f70940e2d80 tx=0x7f7094093040 comp rx=0 tx=0).stop 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 -- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac105030 msgr2=0x7f70ac19a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac105030 0x7f70ac19a790 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f709400c8c0 tx=0x7f709400cd80 comp rx=0 tx=0).stop 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 -- 172.21.15.37:0/109196911 shutdown_connections 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f70980b4d50 0x7f70980b7260 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac105030 0x7f70ac19a790 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70ac10dbb0 0x7f70ac19fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 --2- 172.21.15.37:0/109196911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70ac104600 0x7f70ac19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 -- 172.21.15.37:0/109196911 >> 172.21.15.37:0/109196911 conn(0x7f70ac0794d0 msgr2=0x7f70ac0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 -- 172.21.15.37:0/109196911 shutdown_connections 2024-08-31T06:52:52.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:52.668+0000 7f70b2360640 1 -- 172.21.15.37:0/109196911 wait complete. 2024-08-31T06:52:53.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:52:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:52:53.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:53 smithi037 ceph-mon[18612]: pgmap v501: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-08-31T06:52:53.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:53 smithi106 ceph-mon[22134]: pgmap v501: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-08-31T06:52:53.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:53 smithi066 ceph-mon[22244]: pgmap v501: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 8 op/s 2024-08-31T06:52:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 -- 172.21.15.37:0/48501024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c108140 msgr2=0x7f772c108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 --2- 172.21.15.37:0/48501024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c108140 0x7f772c108550 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7714009900 tx=0x7f771402a410 comp rx=0 tx=0).stop 2024-08-31T06:52:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 -- 172.21.15.37:0/48501024 shutdown_connections 2024-08-31T06:52:54.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 --2- 172.21.15.37:0/48501024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c108140 0x7f772c108550 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 --2- 172.21.15.37:0/48501024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f772c108a90 0x7f772c10f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 --2- 172.21.15.37:0/48501024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f772c102800 0x7f772c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 -- 172.21.15.37:0/48501024 >> 172.21.15.37:0/48501024 conn(0x7f772c0794d0 msgr2=0x7f772c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:54.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 -- 172.21.15.37:0/48501024 shutdown_connections 2024-08-31T06:52:54.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.018+0000 7f7731651640 1 -- 172.21.15.37:0/48501024 wait complete. 2024-08-31T06:52:54.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f7731651640 1 Processor -- start 2024-08-31T06:52:54.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f7731651640 1 -- start start 2024-08-31T06:52:54.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f7731651640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c102800 0x7f772c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f7731651640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f772c108140 0x7f772c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f7731651640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f772c108a90 0x7f772c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f7731651640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1125f0 con 0x7f772c102800 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f7731651640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f772c112470 con 0x7f772c108140 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f7731651640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f772c112770 con 0x7f772c108a90 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f772affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c102800 0x7f772c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f772affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c102800 0x7f772c198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51916/0 (socket says 172.21.15.37:51916) 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f772affd640 1 -- 172.21.15.37:0/2813752956 learned_addr learned my addr 172.21.15.37:0/2813752956 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f772a7fc640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f772c108140 0x7f772c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.019+0000 7f772b7fe640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f772c108a90 0x7f772c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f772affd640 1 -- 172.21.15.37:0/2813752956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f772c108a90 msgr2=0x7f772c199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f772affd640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f772c108a90 0x7f772c199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f772affd640 1 -- 172.21.15.37:0/2813752956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f772c108140 msgr2=0x7f772c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f772affd640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f772c108140 0x7f772c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f772affd640 1 -- 172.21.15.37:0/2813752956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f772c1a8430 con 0x7f772c102800 2024-08-31T06:52:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f772affd640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c102800 0x7f772c198db0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f772400c920 tx=0x7f772400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f7723fff640 1 -- 172.21.15.37:0/2813752956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7724007c70 con 0x7f772c102800 2024-08-31T06:52:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f7723fff640 1 -- 172.21.15.37:0/2813752956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7724007e10 con 0x7f772c102800 2024-08-31T06:52:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f7731651640 1 -- 172.21.15.37:0/2813752956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f772c1a86c0 con 0x7f772c102800 2024-08-31T06:52:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f7723fff640 1 -- 172.21.15.37:0/2813752956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7724018710 con 0x7f772c102800 2024-08-31T06:52:54.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.020+0000 7f7731651640 1 -- 172.21.15.37:0/2813752956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f772c1a8c50 con 0x7f772c102800 2024-08-31T06:52:54.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7737bc6740 1 Processor -- start 2024-08-31T06:52:54.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7723fff640 1 -- 172.21.15.37:0/2813752956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f772400f450 con 0x7f772c102800 2024-08-31T06:52:54.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7737bc6740 1 -- start start 2024-08-31T06:52:54.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece98451b0 0x55ece9c13800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece984d390 0x55ece9c13d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7737bc6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ece9b8a630 con 0x55ece98451b0 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7737bc6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ece9b79bc0 con 0x55ece986e070 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f7737bc6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ece9b7db70 con 0x55ece984d390 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f772affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece98451b0 0x55ece9c13800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f772affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece98451b0 0x55ece9c13800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51922/0 (socket says 172.21.15.37:51922) 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.023+0000 7f772affd640 1 -- 172.21.15.37:0/963326961 learned_addr learned my addr 172.21.15.37:0/963326961 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772b7fe640 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772a7fc640 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece984d390 0x55ece9c13d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f7723fff640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77180b4ca0 0x7f77180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772affd640 1 -- 172.21.15.37:0/963326961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece984d390 msgr2=0x55ece9c13d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772affd640 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece984d390 0x55ece9c13d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772affd640 1 -- 172.21.15.37:0/963326961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 msgr2=0x55ece9c132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772affd640 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c132c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772affd640 1 -- 172.21.15.37:0/963326961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ece98d9650 con 0x55ece98451b0 2024-08-31T06:52:54.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772b7fe640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77180b4ca0 0x7f77180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f772affd640 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece98451b0 0x55ece9c13800 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f77240e2e90 tx=0x7f77240a7d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676b863aeac6b062 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:54.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f7723fff640 1 -- 172.21.15.37:0/2813752956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f77240e5790 con 0x7f772c102800 2024-08-31T06:52:54.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f77217fa640 1 -- 172.21.15.37:0/963326961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240abc90 con 0x55ece98451b0 2024-08-31T06:52:54.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.024+0000 7f77217fa640 1 -- 172.21.15.37:0/963326961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77240ab9d0 con 0x55ece98451b0 2024-08-31T06:52:54.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f77217fa640 1 -- 172.21.15.37:0/963326961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240ab630 con 0x55ece98451b0 2024-08-31T06:52:54.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f7737bc6740 1 -- 172.21.15.37:0/963326961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece98451b0 msgr2=0x55ece9c13800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f772b7fe640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77180b4ca0 0x7f77180b71b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f771c00a4e0 tx=0x7f771c00c040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:54.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f7737bc6740 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece98451b0 0x55ece9c13800 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f77240e2e90 tx=0x7f77240a7d80 comp rx=0 tx=0).stop 2024-08-31T06:52:54.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f7737bc6740 1 -- 172.21.15.37:0/963326961 shutdown_connections 2024-08-31T06:52:54.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f7737bc6740 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece98451b0 0x55ece9c13800 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f7737bc6740 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece984d390 0x55ece9c13d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f7737bc6740 1 --2- 172.21.15.37:0/963326961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.025+0000 7f7737bc6740 1 -- 172.21.15.37:0/963326961 >> 172.21.15.37:0/963326961 conn(0x55ece9862460 msgr2=0x55ece9c111b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 -- 172.21.15.37:0/963326961 shutdown_connections 2024-08-31T06:52:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 -- 172.21.15.37:0/963326961 wait complete. 2024-08-31T06:52:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 -- start start 2024-08-31T06:52:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 Processor -- start 2024-08-31T06:52:54.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c1ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c1ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c2ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ece99dc700 con 0x55ece984d390 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ece9b00700 con 0x55ece986e070 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ece9c21a40 con 0x55ece98451b0 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f7737bc6740 10 client.0 _ll_register_callbacks cb 0x55ece9b2fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.026+0000 7f772a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c1ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772affd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c1ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c1ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51924/0 (socket says 172.21.15.37:51924) 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772a7fc640 1 -- 172.21.15.37:0/406978200 learned_addr learned my addr 172.21.15.37:0/406978200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772b7fe640 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c2ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772a7fc640 1 -- 172.21.15.37:0/406978200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 msgr2=0x55ece9c1ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772a7fc640 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c1ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772a7fc640 1 -- 172.21.15.37:0/406978200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 msgr2=0x55ece9c2ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772a7fc640 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c2ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772a7fc640 1 -- 172.21.15.37:0/406978200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ece9b398b0 con 0x55ece984d390 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f772a7fc640 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c1ef80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7714005940 tx=0x7f7714031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4e9b2fd425dc4b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f77127fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f77127fc640 1 -- 172.21.15.37:0/406978200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714035040 con 0x55ece984d390 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f77127fc640 1 -- 172.21.15.37:0/406978200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7714004250 con 0x55ece984d390 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.027+0000 7f7737bc6740 1 -- 172.21.15.37:0/406978200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77240ab9d0 con 0x55ece984d390 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f77127fc640 1 -- 172.21.15.37:0/406978200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7714004450 con 0x55ece984d390 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f7737bc6740 10 client.17037 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f7737bc6740 1 -- 172.21.15.37:0/406978200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ece9c2d840 con 0x55ece984d390 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f77127fc640 1 -- 172.21.15.37:0/406978200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77240ab9d0 con 0x55ece984d390 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f77127fc640 1 -- 172.21.15.37:0/406978200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f771403d650 con 0x55ece984d390 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f7737bc6740 10 client.17037 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f7737bc6740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:54.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f7737bc6740 20 client.17037 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f7737bc6740 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ece982c9f0 0x55ece9c30d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f7737bc6740 4 client.17037 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f7737bc6740 1 -- 172.21.15.37:0/406978200 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ece9b8c580 con 0x55ece982c9f0 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.028+0000 7f772affd640 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ece982c9f0 0x55ece9c30d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.029+0000 7f772affd640 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ece982c9f0 0x55ece9c30d60 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92674e342ee398bf server_cookie=ff60b323cda30c7f in_seq=0 out_seq=0 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.029+0000 7f77127fc640 10 client.17037 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f77127fc640 1 -- 172.21.15.37:0/406978200 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7724085e50 con 0x55ece982c9f0 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f77127fc640 10 client.17037 handle_command_reply: tid=0 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 client.17037 shutdown 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 -- 172.21.15.37:0/406978200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 msgr2=0x55ece9c1ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c1ef80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7714005940 tx=0x7f7714031630 comp rx=0 tx=0).stop 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 -- 172.21.15.37:0/406978200 shutdown_connections 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ece982c9f0 0x55ece9c30d60 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c1ef80 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c2ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 --2- 172.21.15.37:0/406978200 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c1ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 -- 172.21.15.37:0/406978200 >> 172.21.15.37:0/406978200 conn(0x55ece9862460 msgr2=0x55ece9c164a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:54.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f77127fc640 0 client.17037 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:54.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 -- 172.21.15.37:0/406978200 shutdown_connections 2024-08-31T06:52:54.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 1 -- 172.21.15.37:0/406978200 wait complete. 2024-08-31T06:52:54.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.030+0000 7f7737bc6740 20 client.17037 trim_cache size 0 max 16384 2024-08-31T06:52:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f7737bc6740 1 Processor -- start 2024-08-31T06:52:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f7737bc6740 1 -- start start 2024-08-31T06:52:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c11370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c16ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c2ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f7737bc6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1b3dc0 con 0x55ece984d390 2024-08-31T06:52:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f7737bc6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1b1690 con 0x55ece986e070 2024-08-31T06:52:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f7737bc6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1af4e0 con 0x55ece98451b0 2024-08-31T06:52:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c16ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c16ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51938/0 (socket says 172.21.15.37:51938) 2024-08-31T06:52:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772a7fc640 1 -- 172.21.15.37:0/770689279 learned_addr learned my addr 172.21.15.37:0/770689279 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772affd640 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c11370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772b7fe640 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c2ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772a7fc640 1 -- 172.21.15.37:0/770689279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 msgr2=0x55ece9c11370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772a7fc640 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c11370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772a7fc640 1 -- 172.21.15.37:0/770689279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 msgr2=0x55ece9c2ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.048+0000 7f772a7fc640 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c2ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.049+0000 7f772a7fc640 1 -- 172.21.15.37:0/770689279 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ece9c17010 con 0x55ece984d390 2024-08-31T06:52:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.049+0000 7f772affd640 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c11370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.049+0000 7f772a7fc640 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c16ad0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f771403da50 tx=0x7f7714005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960f4d86351aa1d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.049+0000 7f7720ff9640 1 -- 172.21.15.37:0/770689279 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714000e60 con 0x55ece984d390 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.049+0000 7f7720ff9640 1 -- 172.21.15.37:0/770689279 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7714041070 con 0x55ece984d390 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.049+0000 7f7720ff9640 1 -- 172.21.15.37:0/770689279 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714052070 con 0x55ece984d390 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 -- 172.21.15.37:0/770689279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 msgr2=0x55ece9c16ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c16ad0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f771403da50 tx=0x7f7714005fd0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 -- 172.21.15.37:0/770689279 shutdown_connections 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c16ad0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece986e070 0x55ece9c2ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 --2- 172.21.15.37:0/770689279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece98451b0 0x55ece9c11370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 -- 172.21.15.37:0/770689279 >> 172.21.15.37:0/770689279 conn(0x55ece9862460 msgr2=0x55ece9c163c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 -- 172.21.15.37:0/770689279 shutdown_connections 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 -- 172.21.15.37:0/770689279 wait complete. 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 -- start start 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.050+0000 7f7737bc6740 1 Processor -- start 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece98451b0 0x55ece9c22d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c23270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f7737bc6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece986e070 0x55ece9c237b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f7737bc6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1afb50 con 0x55ece984d390 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f7737bc6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1b0fc0 con 0x55ece98451b0 2024-08-31T06:52:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f7737bc6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f772c1b0220 con 0x55ece986e070 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f7737bc6740 10 client.0 _ll_register_callbacks cb 0x7f7714031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c23270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c23270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51948/0 (socket says 172.21.15.37:51948) 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 -- 172.21.15.37:0/3134987277 learned_addr learned my addr 172.21.15.37:0/3134987277 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772affd640 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece98451b0 0x55ece9c22d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772b7fe640 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece986e070 0x55ece9c237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 -- 172.21.15.37:0/3134987277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece986e070 msgr2=0x55ece9c237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece986e070 0x55ece9c237b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 -- 172.21.15.37:0/3134987277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece98451b0 msgr2=0x55ece9c22d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece98451b0 0x55ece9c22d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 -- 172.21.15.37:0/3134987277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ece9c9a7a0 con 0x55ece984d390 2024-08-31T06:52:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772b7fe640 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece986e070 0x55ece9c237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f772a7fc640 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c23270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7714045410 tx=0x7f771403d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b399418b56fb2ef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.051+0000 7f77127fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f77127fc640 1 -- 172.21.15.37:0/3134987277 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714052070 con 0x55ece984d390 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f77127fc640 1 -- 172.21.15.37:0/3134987277 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8455+0+0 (secure 0 0 0) 0x7f7714004250 con 0x55ece984d390 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 1 -- 172.21.15.37:0/3134987277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7714041070 con 0x55ece984d390 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f77127fc640 1 -- 172.21.15.37:0/3134987277 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7714066050 con 0x55ece984d390 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 10 client.17043 fetch_fsmap learned FSMap version 25 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 1 -- 172.21.15.37:0/3134987277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ece9c9ba30 con 0x55ece984d390 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f77127fc640 1 -- 172.21.15.37:0/3134987277 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7714041070 con 0x55ece984d390 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f77127fc640 1 -- 172.21.15.37:0/3134987277 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f771405f060 con 0x55ece984d390 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 10 client.17043 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:52:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 20 client.17043 populate_metadata read hostname 'smithi037' 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ece9801da0 0x55ece9c9e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 4 client.17043 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.052+0000 7f7737bc6740 1 -- 172.21.15.37:0/3134987277 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ece9b88020 con 0x55ece9801da0 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.053+0000 7f772affd640 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ece9801da0 0x55ece9c9e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.053+0000 7f77127fc640 10 client.17043 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.053+0000 7f772affd640 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ece9801da0 0x55ece9c9e140 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4486f578dedb217 server_cookie=54f93ba69992cf63 in_seq=0 out_seq=0 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.053+0000 7f77127fc640 1 -- 172.21.15.37:0/3134987277 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55ece9b88020 con 0x55ece9801da0 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.053+0000 7f77127fc640 10 client.17043 handle_command_reply: tid=0 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.053+0000 7f7737bc6740 1 client.17043 shutdown 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.053+0000 7f7737bc6740 1 -- 172.21.15.37:0/3134987277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 msgr2=0x55ece9c23270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.053+0000 7f7737bc6740 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c23270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7714045410 tx=0x7f771403d6e0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 1 -- 172.21.15.37:0/3134987277 shutdown_connections 2024-08-31T06:52:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ece9801da0 0x55ece9c9e140 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ece984d390 0x55ece9c23270 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ece986e070 0x55ece9c237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 1 --2- 172.21.15.37:0/3134987277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ece98451b0 0x55ece9c22d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f77127fc640 0 client.17043 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:52:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 1 -- 172.21.15.37:0/3134987277 >> 172.21.15.37:0/3134987277 conn(0x55ece9862460 msgr2=0x55ece9c142f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:54.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 1 -- 172.21.15.37:0/3134987277 shutdown_connections 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 1 -- 172.21.15.37:0/3134987277 wait complete. 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7737bc6740 20 client.17043 trim_cache size 0 max 16384 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b", 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:54.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:52:54.067 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.071 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:52:54.071 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:52:54.071 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:52:54.072 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:52:54.073 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:52:54.074 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:52:54.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7731651640 1 -- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77180b4ca0 msgr2=0x7f77180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7731651640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77180b4ca0 0x7f77180b71b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f771c00a4e0 tx=0x7f771c00c040 comp rx=0 tx=0).stop 2024-08-31T06:52:54.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7731651640 1 -- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c102800 msgr2=0x7f772c198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:52:54.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.054+0000 7f7731651640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c102800 0x7f772c198db0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f772400c920 tx=0x7f772400cde0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.055+0000 7f7731651640 1 -- 172.21.15.37:0/2813752956 shutdown_connections 2024-08-31T06:52:54.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.055+0000 7f7731651640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77180b4ca0 0x7f77180b71b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.055+0000 7f7731651640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f772c108a90 0x7f772c199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.055+0000 7f7731651640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f772c108140 0x7f772c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.055+0000 7f7731651640 1 --2- 172.21.15.37:0/2813752956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f772c102800 0x7f772c198db0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:52:54.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.055+0000 7f7731651640 1 -- 172.21.15.37:0/2813752956 >> 172.21.15.37:0/2813752956 conn(0x7f772c0794d0 msgr2=0x7f772c1050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:52:54.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.055+0000 7f7731651640 1 -- 172.21.15.37:0/2813752956 shutdown_connections 2024-08-31T06:52:54.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:52:54.055+0000 7f7731651640 1 -- 172.21.15.37:0/2813752956 wait complete. 2024-08-31T06:52:54.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:54 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:52:54.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:54 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:54.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:54 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:52:54.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:54 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:54.774 INFO:tasks.cephfs.filesystem:scrub status for tag:2c9db99a-5b71-4fa3-abac-7e410e0a9f5b - {'path': '/', 'tag': '2c9db99a-5b71-4fa3-abac-7e410e0a9f5b', 'options': 'recursive,force'} 2024-08-31T06:52:54.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:54 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:52:54.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:54 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:54.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:54 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:52:54.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:54 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:54.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:54 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:52:54.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:54 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:54.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:54 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:52:54.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:54 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:52:55.782 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:55 smithi037 ceph-mon[18612]: pgmap v502: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-08-31T06:52:55.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:55 smithi106 ceph-mon[22134]: pgmap v502: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-08-31T06:52:55.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:55 smithi066 ceph-mon[22244]: pgmap v502: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-08-31T06:52:57.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:57 smithi106 ceph-mon[22134]: pgmap v503: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-08-31T06:52:57.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:57 smithi037 ceph-mon[18612]: pgmap v503: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-08-31T06:52:57.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:57 smithi066 ceph-mon[22244]: pgmap v503: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8 op/s 2024-08-31T06:52:58.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:58 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:52:58.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:58 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:52:58.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:58 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:52:59.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:59 smithi106 ceph-mon[22134]: pgmap v504: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:59.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:52:59.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:52:59.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:52:59.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:52:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:52:59.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:59 smithi037 ceph-mon[18612]: pgmap v504: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:59.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:52:59.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:52:59.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:52:59.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:52:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:52:59.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:59 smithi066 ceph-mon[22244]: pgmap v504: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:52:59.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:52:59.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:52:59.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:52:59.888 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:52:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:53:01.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:01 smithi106 ceph-mon[22134]: pgmap v505: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:53:01.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:01 smithi037 ceph-mon[18612]: pgmap v505: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:53:01.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:01 smithi066 ceph-mon[22244]: pgmap v505: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:53:03.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:03 smithi106 ceph-mon[22134]: pgmap v506: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-08-31T06:53:03.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:03 smithi037 ceph-mon[18612]: pgmap v506: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-08-31T06:53:03.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:03 smithi066 ceph-mon[22244]: pgmap v506: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-08-31T06:53:05.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:05 smithi106 ceph-mon[22134]: pgmap v507: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:53:05.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:05 smithi037 ceph-mon[18612]: pgmap v507: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:53:05.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:05 smithi066 ceph-mon[22244]: pgmap v507: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:53:07.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:07 smithi106 ceph-mon[22134]: pgmap v508: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:53:07.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:07 smithi037 ceph-mon[18612]: pgmap v508: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:53:07.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:07 smithi066 ceph-mon[22244]: pgmap v508: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:53:09.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:09 smithi106 ceph-mon[22134]: pgmap v509: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:53:09.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:09 smithi106 ceph-mon[22134]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T06:53:09.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:09 smithi037 ceph-mon[18612]: pgmap v509: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:53:09.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:09 smithi037 ceph-mon[18612]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T06:53:09.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:09 smithi066 ceph-mon[22244]: pgmap v509: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:53:09.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:09 smithi066 ceph-mon[22244]: osdmap e77: 12 total, 12 up, 12 in 2024-08-31T06:53:11.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:11 smithi106 ceph-mon[22134]: pgmap v511: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-08-31T06:53:11.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:11 smithi037 ceph-mon[18612]: pgmap v511: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-08-31T06:53:11.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:11 smithi066 ceph-mon[22244]: pgmap v511: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-08-31T06:53:13.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:13 smithi106 ceph-mon[22134]: pgmap v512: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:13.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:13 smithi037 ceph-mon[18612]: pgmap v512: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:13.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:13 smithi066 ceph-mon[22244]: pgmap v512: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:15.815 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:15 smithi106 ceph-mon[22134]: pgmap v513: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:15.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:15 smithi037 ceph-mon[18612]: pgmap v513: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:15.887 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:15 smithi066 ceph-mon[22244]: pgmap v513: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:17 smithi106 ceph-mon[22134]: pgmap v514: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:17 smithi106 ceph-mon[22134]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T06:53:18.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:17 smithi037 ceph-mon[18612]: pgmap v514: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:18.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:17 smithi037 ceph-mon[18612]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T06:53:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:17 smithi066 ceph-mon[22244]: pgmap v514: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:17 smithi066 ceph-mon[22244]: osdmap e78: 12 total, 12 up, 12 in 2024-08-31T06:53:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:19 smithi106 ceph-mon[22134]: pgmap v516: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-08-31T06:53:20.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:19 smithi037 ceph-mon[18612]: pgmap v516: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-08-31T06:53:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:19 smithi066 ceph-mon[22244]: pgmap v516: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-08-31T06:53:22.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:21 smithi106 ceph-mon[22134]: pgmap v517: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:22.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:21 smithi037 ceph-mon[18612]: pgmap v517: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:22.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:21 smithi066 ceph-mon[22244]: pgmap v517: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:53:24.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:23 smithi106 ceph-mon[22134]: pgmap v518: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:53:24.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:23 smithi037 ceph-mon[18612]: pgmap v518: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:53:24.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:23 smithi066 ceph-mon[22244]: pgmap v518: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:53:24.775 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:53:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 -- 172.21.15.37:0/564982150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 msgr2=0x7f77a81085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 --2- 172.21.15.37:0/564982150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 0x7f77a81085b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7790009900 tx=0x7f779002a410 comp rx=0 tx=0).stop 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 -- 172.21.15.37:0/564982150 shutdown_connections 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 --2- 172.21.15.37:0/564982150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 0x7f77a81085b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 --2- 172.21.15.37:0/564982150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a8108af0 0x7f77a810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 --2- 172.21.15.37:0/564982150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77a8102f30 0x7f77a8103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 -- 172.21.15.37:0/564982150 >> 172.21.15.37:0/564982150 conn(0x7f77a8079d30 msgr2=0x7f77a807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 -- 172.21.15.37:0/564982150 shutdown_connections 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.663+0000 7f77aca17640 1 -- 172.21.15.37:0/564982150 wait complete. 2024-08-31T06:53:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77aca17640 1 Processor -- start 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77aca17640 1 -- start start 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77aca17640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77a8102f30 0x7f77a8199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77aca17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 0x7f77a81996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77aca17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a8108af0 0x7f77a819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77aca17640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77a8112610 con 0x7f77a81081a0 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77aca17640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77a8112490 con 0x7f77a8108af0 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77aca17640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f77a8112790 con 0x7f77a8102f30 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f779ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 0x7f77a81996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f779ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 0x7f77a81996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49368/0 (socket says 172.21.15.37:49368) 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f779ffff640 1 -- 172.21.15.37:0/1518627391 learned_addr learned my addr 172.21.15.37:0/1518627391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77a659c640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77a8102f30 0x7f77a8199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a8108af0 0x7f77a819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f779ffff640 1 -- 172.21.15.37:0/1518627391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77a8102f30 msgr2=0x7f77a8199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f779ffff640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77a8102f30 0x7f77a8199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f779ffff640 1 -- 172.21.15.37:0/1518627391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a8108af0 msgr2=0x7f77a819e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f779ffff640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a8108af0 0x7f77a819e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.664+0000 7f779ffff640 1 -- 172.21.15.37:0/1518627391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a819efd0 con 0x7f77a81081a0 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.665+0000 7f779ffff640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 0x7f77a81996c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7790005940 tx=0x7f77900040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.665+0000 7f779f7fe640 1 -- 172.21.15.37:0/1518627391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779003f030 con 0x7f77a81081a0 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.665+0000 7f779f7fe640 1 -- 172.21.15.37:0/1518627391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7790003a80 con 0x7f77a81081a0 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.665+0000 7f77aca17640 1 -- 172.21.15.37:0/1518627391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a819f260 con 0x7f77a81081a0 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.665+0000 7f779f7fe640 1 -- 172.21.15.37:0/1518627391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7790035070 con 0x7f77a81081a0 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.665+0000 7f77aca17640 1 -- 172.21.15.37:0/1518627391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a819f740 con 0x7f77a81081a0 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77b2f8c740 1 Processor -- start 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77b2f8c740 1 -- start start 2024-08-31T06:53:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f779f7fe640 1 -- 172.21.15.37:0/1518627391 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f7790042030 con 0x7f77a81081a0 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b9028f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9025241b0 0x55b9028f2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b9028f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b902869630 con 0x55b90254d070 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b902858bc0 con 0x55b9025241b0 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b90285cb70 con 0x55b90252c390 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77a6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b9028f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77a6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b9028f22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49370/0 (socket says 172.21.15.37:49370) 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77a6d9d640 1 -- 172.21.15.37:0/1751136455 learned_addr learned my addr 172.21.15.37:0/1751136455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f77a659c640 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9025241b0 0x55b9028f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.668+0000 7f779ffff640 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b9028f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f77a6d9d640 1 -- 172.21.15.37:0/1751136455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 msgr2=0x55b9028f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b9028f2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f77a6d9d640 1 -- 172.21.15.37:0/1751136455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9025241b0 msgr2=0x55b9028f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9025241b0 0x55b9028f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f77a6d9d640 1 -- 172.21.15.37:0/1751136455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9025b8650 con 0x55b90254d070 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b9028f22c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009f70 tx=0x7f77a0010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6248994e8f712940 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f779cff9640 1 -- 172.21.15.37:0/1751136455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0016070 con 0x55b90254d070 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f779f7fe640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77940b4cd0 0x7f77940b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f779cff9640 1 -- 172.21.15.37:0/1751136455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77a0004d20 con 0x55b90254d070 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f779cff9640 1 -- 172.21.15.37:0/1751136455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0012760 con 0x55b90254d070 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f77a659c640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77940b4cd0 0x7f77940b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.669+0000 7f779f7fe640 1 -- 172.21.15.37:0/1518627391 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f7790105980 con 0x7f77a81081a0 2024-08-31T06:53:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 -- 172.21.15.37:0/1751136455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 msgr2=0x55b9028f22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77a659c640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77940b4cd0 0x7f77940b71e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55b9028f0f40 tx=0x7f779800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b9028f22c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009f70 tx=0x7f77a0010800 comp rx=0 tx=0).stop 2024-08-31T06:53:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 -- 172.21.15.37:0/1751136455 shutdown_connections 2024-08-31T06:53:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b9028f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b9025241b0 0x55b9028f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/1751136455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b9028f22c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 -- 172.21.15.37:0/1751136455 >> 172.21.15.37:0/1751136455 conn(0x55b902541460 msgr2=0x55b9028f01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 -- 172.21.15.37:0/1751136455 shutdown_connections 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.670+0000 7f77b2f8c740 1 -- 172.21.15.37:0/1751136455 wait complete. 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 1 -- start start 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 1 Processor -- start 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b9025241b0 0x55b9028ffc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90252c390 0x55b902900180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b90290bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b9026bb700 con 0x55b90254d070 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b9027df700 con 0x55b90252c390 2024-08-31T06:53:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b902902c00 con 0x55b9025241b0 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77b2f8c740 10 client.0 _ll_register_callbacks cb 0x55b90280edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77a6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b90290bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77a6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b90290bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49372/0 (socket says 172.21.15.37:49372) 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f77a6d9d640 1 -- 172.21.15.37:0/2047976711 learned_addr learned my addr 172.21.15.37:0/2047976711 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.671+0000 7f779ffff640 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90252c390 0x55b902900180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77a659c640 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b9025241b0 0x55b9028ffc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77a6d9d640 1 -- 172.21.15.37:0/2047976711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b9025241b0 msgr2=0x55b9028ffc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b9025241b0 0x55b9028ffc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77a6d9d640 1 -- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90252c390 msgr2=0x55b902900180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90252c390 0x55b902900180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77a6d9d640 1 -- 172.21.15.37:0/2047976711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9028188b0 con 0x55b90254d070 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f779ffff640 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90252c390 0x55b902900180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b90290bf90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f77a0011010 tx=0x7f77a0009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfcd0355fa14801 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f778dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f778dffb640 1 -- 172.21.15.37:0/2047976711 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0016070 con 0x55b90254d070 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f778dffb640 1 -- 172.21.15.37:0/2047976711 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f77a0003b70 con 0x55b90254d070 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77b2f8c740 1 -- 172.21.15.37:0/2047976711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77a0004d20 con 0x55b90254d070 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f778dffb640 1 -- 172.21.15.37:0/2047976711 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f77a0003d70 con 0x55b90254d070 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77b2f8c740 10 client.17055 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.672+0000 7f77b2f8c740 1 -- 172.21.15.37:0/2047976711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b90290ea30 con 0x55b90254d070 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f778dffb640 1 -- 172.21.15.37:0/2047976711 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77a0004d20 con 0x55b90254d070 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f778dffb640 1 -- 172.21.15.37:0/2047976711 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f77a000f040 con 0x55b90254d070 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f77b2f8c740 10 client.17055 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f77b2f8c740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f77b2f8c740 20 client.17055 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b90250b9f0 0x55b902911e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f77b2f8c740 4 client.17055 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f77b2f8c740 1 -- 172.21.15.37:0/2047976711 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b90286b580 con 0x55b90250b9f0 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.673+0000 7f77a659c640 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b90250b9f0 0x55b902911e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.674+0000 7f77a659c640 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b90250b9f0 0x55b902911e40 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5cc138d9b026ac8 server_cookie=d101239eff920fd6 in_seq=0 out_seq=0 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.674+0000 7f778dffb640 10 client.17055 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.674+0000 7f778dffb640 1 -- 172.21.15.37:0/2047976711 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b90286b580 con 0x55b90250b9f0 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.674+0000 7f778dffb640 10 client.17055 handle_command_reply: tid=0 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 client.17055 shutdown 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 -- 172.21.15.37:0/2047976711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 msgr2=0x55b90290bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b90290bf90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f77a0011010 tx=0x7f77a0009b70 comp rx=0 tx=0).stop 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 -- 172.21.15.37:0/2047976711 shutdown_connections 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b90250b9f0 0x55b902911e40 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b90254d070 0x55b90290bf90 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90252c390 0x55b902900180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/2047976711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b9025241b0 0x55b9028ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 -- 172.21.15.37:0/2047976711 >> 172.21.15.37:0/2047976711 conn(0x55b902541460 msgr2=0x55b9028ee770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f778dffb640 0 client.17055 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 -- 172.21.15.37:0/2047976711 shutdown_connections 2024-08-31T06:53:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 1 -- 172.21.15.37:0/2047976711 wait complete. 2024-08-31T06:53:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.675+0000 7f77b2f8c740 20 client.17055 trim_cache size 0 max 16384 2024-08-31T06:53:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.693+0000 7f77b2f8c740 1 Processor -- start 2024-08-31T06:53:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.693+0000 7f77b2f8c740 1 -- start start 2024-08-31T06:53:25.694 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:25 smithi037 ceph-mon[18612]: pgmap v519: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:53:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.693+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b90290bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.693+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b90290c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.693+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9028efb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.693+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77a81afaf0 con 0x55b9025241b0 2024-08-31T06:53:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.693+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77a81ad3c0 con 0x55b90254d070 2024-08-31T06:53:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.693+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f77a81ab230 con 0x55b90252c390 2024-08-31T06:53:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b90290bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f779ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b90290c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b90290bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49380/0 (socket says 172.21.15.37:49380) 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f779ffff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b90290c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.37:51118/0 (socket says 172.21.15.37:51118) 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 -- 172.21.15.37:0/111387424 learned_addr learned my addr 172.21.15.37:0/111387424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9028efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 -- 172.21.15.37:0/111387424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 msgr2=0x55b90290c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b90290c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 -- 172.21.15.37:0/111387424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 msgr2=0x55b9028efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9028efb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 -- 172.21.15.37:0/111387424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9028f30e0 con 0x55b9025241b0 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f779ffff640 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b90290c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9028efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:53:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.694+0000 7f77a659c640 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b90290bf00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f779800b010 tx=0x7f7798019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d8475c870bbefb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.695+0000 7f778ffff640 1 -- 172.21.15.37:0/111387424 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798033070 con 0x55b9025241b0 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.695+0000 7f778ffff640 1 -- 172.21.15.37:0/111387424 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f779801be50 con 0x55b9025241b0 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.695+0000 7f778ffff640 1 -- 172.21.15.37:0/111387424 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7798028680 con 0x55b9025241b0 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.695+0000 7f77b2f8c740 1 -- 172.21.15.37:0/111387424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 msgr2=0x55b90290bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.695+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b90290bf00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f779800b010 tx=0x7f7798019000 comp rx=0 tx=0).stop 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 -- 172.21.15.37:0/111387424 shutdown_connections 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9028efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b90290c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/111387424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b90290bf00 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 -- 172.21.15.37:0/111387424 >> 172.21.15.37:0/111387424 conn(0x55b902541460 msgr2=0x55b9028fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 -- 172.21.15.37:0/111387424 shutdown_connections 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 -- 172.21.15.37:0/111387424 wait complete. 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 -- start start 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.696+0000 7f77b2f8c740 1 Processor -- start 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b902910f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b902911480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77b2f8c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9029119c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f77a81ab880 con 0x55b9025241b0 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f77a81accf0 con 0x55b90254d070 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77b2f8c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f77a81abf50 con 0x55b90252c390 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77b2f8c740 10 client.0 _ll_register_callbacks cb 0x7f779800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b902910f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b902910f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49382/0 (socket says 172.21.15.37:49382) 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 -- 172.21.15.37:0/3911684996 learned_addr learned my addr 172.21.15.37:0/3911684996 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a6d9d640 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9029119c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f779ffff640 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b902911480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 -- 172.21.15.37:0/3911684996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 msgr2=0x55b902911480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b902911480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 -- 172.21.15.37:0/3911684996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 msgr2=0x55b9029119c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9029119c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 -- 172.21.15.37:0/3911684996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b90297b6b0 con 0x55b9025241b0 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f77a659c640 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b902910f40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f7798005940 tx=0x7f77980050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80c0aa5bcf07de7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.697+0000 7f778dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f778dffb640 1 -- 172.21.15.37:0/3911684996 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77980054e0 con 0x55b9025241b0 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f778dffb640 1 -- 172.21.15.37:0/3911684996 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f77980046c0 con 0x55b9025241b0 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 1 -- 172.21.15.37:0/3911684996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f779801be50 con 0x55b9025241b0 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f778dffb640 1 -- 172.21.15.37:0/3911684996 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f77980048c0 con 0x55b9025241b0 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 10 client.17061 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 1 -- 172.21.15.37:0/3911684996 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b9028f85f0 con 0x55b9025241b0 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f778dffb640 1 -- 172.21.15.37:0/3911684996 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f779801be50 con 0x55b9025241b0 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f778dffb640 1 -- 172.21.15.37:0/3911684996 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7798045050 con 0x55b9025241b0 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 10 client.17061 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:53:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 20 client.17061 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b9024e0da0 0x55b9028f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 4 client.17061 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:53:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.698+0000 7f77b2f8c740 1 -- 172.21.15.37:0/3911684996 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b902867020 con 0x55b9024e0da0 2024-08-31T06:53:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.699+0000 7f779ffff640 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b9024e0da0 0x55b9028f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.699+0000 7f778dffb640 10 client.17061 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.699+0000 7f779ffff640 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b9024e0da0 0x55b9028f8ca0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d483c34c5b0a0417 server_cookie=c6122a968d0eaeaa in_seq=0 out_seq=0 2024-08-31T06:53:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.699+0000 7f778dffb640 1 -- 172.21.15.37:0/3911684996 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x55b902867020 con 0x55b9024e0da0 2024-08-31T06:53:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f778dffb640 10 client.17061 handle_command_reply: tid=0 2024-08-31T06:53:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 client.17061 shutdown 2024-08-31T06:53:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 -- 172.21.15.37:0/3911684996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 msgr2=0x55b902910f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b902910f40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f7798005940 tx=0x7f77980050c0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 -- 172.21.15.37:0/3911684996 shutdown_connections 2024-08-31T06:53:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b9024e0da0 0x55b9028f8ca0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b90254d070 0x55b9029119c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b90252c390 0x55b902911480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 --2- 172.21.15.37:0/3911684996 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9025241b0 0x55b902910f40 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 -- 172.21.15.37:0/3911684996 >> 172.21.15.37:0/3911684996 conn(0x55b902541460 msgr2=0x55b9028fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f778dffb640 0 client.17061 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 -- 172.21.15.37:0/3911684996 shutdown_connections 2024-08-31T06:53:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 1 -- 172.21.15.37:0/3911684996 wait complete. 2024-08-31T06:53:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.700+0000 7f77b2f8c740 20 client.17061 trim_cache size 0 max 16384 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.711 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:53:25.712 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.713 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.715 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:53:25.716 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:53:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 -- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77940b4cd0 msgr2=0x7f77940b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77940b4cd0 0x7f77940b71e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55b9028f0f40 tx=0x7f779800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 -- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 msgr2=0x7f77a81996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 0x7f77a81996c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7790005940 tx=0x7f77900040e0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 -- 172.21.15.37:0/1518627391 shutdown_connections 2024-08-31T06:53:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77940b4cd0 0x7f77940b71e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77a81081a0 0x7f77a81996c0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a8108af0 0x7f77a819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 --2- 172.21.15.37:0/1518627391 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77a8102f30 0x7f77a8199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 -- 172.21.15.37:0/1518627391 >> 172.21.15.37:0/1518627391 conn(0x7f77a8079d30 msgr2=0x7f77a8106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 -- 172.21.15.37:0/1518627391 shutdown_connections 2024-08-31T06:53:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:25.701+0000 7f77aca17640 1 -- 172.21.15.37:0/1518627391 wait complete. 2024-08-31T06:53:26.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:25 smithi106 ceph-mon[22134]: pgmap v519: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:53:26.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:25 smithi066 ceph-mon[22244]: pgmap v519: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:53:26.610 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:53:26.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:53:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 -- 172.21.15.37:0/2815519168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d70105050 msgr2=0x7f8d7010d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 --2- 172.21.15.37:0/2815519168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d70105050 0x7f8d7010d690 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009900 tx=0x7f8d6002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 -- 172.21.15.37:0/2815519168 shutdown_connections 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 --2- 172.21.15.37:0/2815519168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d70105050 0x7f8d7010d690 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 --2- 172.21.15.37:0/2815519168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d7010dbd0 0x7f8d701100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 --2- 172.21.15.37:0/2815519168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d70104620 0x7f8d70104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 -- 172.21.15.37:0/2815519168 >> 172.21.15.37:0/2815519168 conn(0x7f8d700794f0 msgr2=0x7f8d70079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 -- 172.21.15.37:0/2815519168 shutdown_connections 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.341+0000 7f8d7813a640 1 -- 172.21.15.37:0/2815519168 wait complete. 2024-08-31T06:53:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.342+0000 7f8d7813a640 1 Processor -- start 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.342+0000 7f8d7813a640 1 -- start start 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.342+0000 7f8d7813a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d70104620 0x7f8d7019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d7813a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d70105050 0x7f8d7019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d7813a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7010dbd0 0x7f8d7019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d7813a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70113700 con 0x7f8d7010dbd0 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d7813a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70113580 con 0x7f8d70104620 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d7813a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70113880 con 0x7f8d70105050 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7010dbd0 0x7f8d7019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7010dbd0 0x7f8d7019f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49402/0 (socket says 172.21.15.37:49402) 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 -- 172.21.15.37:0/3375245669 learned_addr learned my addr 172.21.15.37:0/3375245669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d75ed6640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d70104620 0x7f8d7019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d756d5640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d70105050 0x7f8d7019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 -- 172.21.15.37:0/3375245669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d70105050 msgr2=0x7f8d7019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d70105050 0x7f8d7019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 -- 172.21.15.37:0/3375245669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d70104620 msgr2=0x7f8d7019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d70104620 0x7f8d7019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 -- 172.21.15.37:0/3375245669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7019ffe0 con 0x7f8d7010dbd0 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d75ed6640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d70104620 0x7f8d7019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d756d5640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d70105050 0x7f8d7019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d766d7640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7010dbd0 0x7f8d7019f970 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800cce0 tx=0x7f8d6800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d66ffd640 1 -- 172.21.15.37:0/3375245669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6800f450 con 0x7f8d7010dbd0 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d66ffd640 1 -- 172.21.15.37:0/3375245669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d6800fa80 con 0x7f8d7010dbd0 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d701a02d0 con 0x7f8d7010dbd0 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d66ffd640 1 -- 172.21.15.37:0/3375245669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68018ad0 con 0x7f8d7010dbd0 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.343+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d701a6af0 con 0x7f8d7010dbd0 2024-08-31T06:53:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.344+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d70104a30 con 0x7f8d7010dbd0 2024-08-31T06:53:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.346+0000 7f8d66ffd640 1 -- 172.21.15.37:0/3375245669 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f8d6800f5f0 con 0x7f8d7010dbd0 2024-08-31T06:53:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.347+0000 7f8d66ffd640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d5c0b4cd0 0x7f8d5c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.347+0000 7f8d75ed6640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d5c0b4cd0 0x7f8d5c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.347+0000 7f8d66ffd640 1 -- 172.21.15.37:0/3375245669 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f8d680e5ed0 con 0x7f8d7010dbd0 2024-08-31T06:53:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.347+0000 7f8d75ed6640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d5c0b4cd0 0x7f8d5c0b71e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00baa0 tx=0x7f8d6c005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.350+0000 7f8d66ffd640 1 -- 172.21.15.37:0/3375245669 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f8d68014030 con 0x7f8d7010dbd0 2024-08-31T06:53:27.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.571+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d7019b260 con 0x7f8d7010dbd0 2024-08-31T06:53:27.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.572+0000 7f8d66ffd640 1 -- 172.21.15.37:0/3375245669 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f8d7019b260 con 0x7f8d7010dbd0 2024-08-31T06:53:27.573 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:53:27.574 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:53:27.574 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d5c0b4cd0 msgr2=0x7f8d5c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d5c0b4cd0 0x7f8d5c0b71e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00baa0 tx=0x7f8d6c005d90 comp rx=0 tx=0).stop 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7010dbd0 msgr2=0x7f8d7019f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7010dbd0 0x7f8d7019f970 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800cce0 tx=0x7f8d6800a620 comp rx=0 tx=0).stop 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 shutdown_connections 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8d5c0b4cd0 0x7f8d5c0b71e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d7010dbd0 0x7f8d7019f970 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d70105050 0x7f8d7019a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 --2- 172.21.15.37:0/3375245669 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d70104620 0x7f8d7019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 >> 172.21.15.37:0/3375245669 conn(0x7f8d700794f0 msgr2=0x7f8d70106660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 shutdown_connections 2024-08-31T06:53:27.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:27.575+0000 7f8d7813a640 1 -- 172.21.15.37:0/3375245669 wait complete. 2024-08-31T06:53:27.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:27 smithi037 ceph-mon[18612]: pgmap v520: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:53:27.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:27 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3375245669' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:53:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:27 smithi106 ceph-mon[22134]: pgmap v520: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:53:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:27 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3375245669' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:53:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:27 smithi066 ceph-mon[22244]: pgmap v520: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:53:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:27 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3375245669' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:53:28.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:53:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:53:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.026+0000 7fa380f65640 1 -- 172.21.15.37:0/2625000582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 msgr2=0x7fa37c1100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.026+0000 7fa380f65640 1 --2- 172.21.15.37:0/2625000582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 0x7fa37c1100a0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa374009ca0 tx=0x7fa37402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.027+0000 7fa380f65640 1 -- 172.21.15.37:0/2625000582 shutdown_connections 2024-08-31T06:53:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.027+0000 7fa380f65640 1 --2- 172.21.15.37:0/2625000582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 0x7fa37c1100a0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.027+0000 7fa380f65640 1 --2- 172.21.15.37:0/2625000582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa37c1050a0 0x7fa37c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.027+0000 7fa380f65640 1 --2- 172.21.15.37:0/2625000582 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa37c104750 0x7fa37c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.027+0000 7fa380f65640 1 -- 172.21.15.37:0/2625000582 >> 172.21.15.37:0/2625000582 conn(0x7fa37c0794c0 msgr2=0x7fa37c0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:29.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.027+0000 7fa380f65640 1 -- 172.21.15.37:0/2625000582 shutdown_connections 2024-08-31T06:53:29.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.027+0000 7fa380f65640 1 -- 172.21.15.37:0/2625000582 wait complete. 2024-08-31T06:53:29.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.027+0000 7fa380f65640 1 Processor -- start 2024-08-31T06:53:29.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa380f65640 1 -- start start 2024-08-31T06:53:29.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa380f65640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa37c104750 0x7fa37c19a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa380f65640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa37c1050a0 0x7fa37c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa380f65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 0x7fa37c19f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa380f65640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c113730 con 0x7fa37c10dbb0 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa380f65640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1135b0 con 0x7fa37c1050a0 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa380f65640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1138b0 con 0x7fa37c104750 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa37ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 0x7fa37c19f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa37ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 0x7fa37c19f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49412/0 (socket says 172.21.15.37:49412) 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa37ad9d640 1 -- 172.21.15.37:0/2700339945 learned_addr learned my addr 172.21.15.37:0/2700339945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa371d9b640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa37c1050a0 0x7fa37c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa37a59c640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa37c104750 0x7fa37c19a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa37ad9d640 1 -- 172.21.15.37:0/2700339945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa37c104750 msgr2=0x7fa37c19a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa37ad9d640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa37c104750 0x7fa37c19a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa37ad9d640 1 -- 172.21.15.37:0/2700339945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa37c1050a0 msgr2=0x7fa37c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.028+0000 7fa37ad9d640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa37c1050a0 0x7fa37c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.029+0000 7fa37ad9d640 1 -- 172.21.15.37:0/2700339945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c1a0090 con 0x7fa37c10dbb0 2024-08-31T06:53:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.029+0000 7fa37ad9d640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 0x7fa37c19f960 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa374005e30 tx=0x7fa3740093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.029+0000 7fa373fff640 1 -- 172.21.15.37:0/2700339945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374032d10 con 0x7fa37c10dbb0 2024-08-31T06:53:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.029+0000 7fa380f65640 1 -- 172.21.15.37:0/2700339945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c1a0320 con 0x7fa37c10dbb0 2024-08-31T06:53:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.029+0000 7fa373fff640 1 -- 172.21.15.37:0/2700339945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa374032eb0 con 0x7fa37c10dbb0 2024-08-31T06:53:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.029+0000 7fa373fff640 1 -- 172.21.15.37:0/2700339945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa374030b20 con 0x7fa37c10dbb0 2024-08-31T06:53:29.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.029+0000 7fa380f65640 1 -- 172.21.15.37:0/2700339945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c1a6ae0 con 0x7fa37c10dbb0 2024-08-31T06:53:29.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa3874da740 1 Processor -- start 2024-08-31T06:53:29.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa373fff640 1 -- 172.21.15.37:0/2700339945 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa374030cc0 con 0x7fa37c10dbb0 2024-08-31T06:53:29.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa3874da740 1 -- start start 2024-08-31T06:53:29.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa3874da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc59b070 0x55eabc940310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa3874da740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 0x55eabc940850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa3874da740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc57a390 0x55eabc940d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa3874da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eabc8b7680 con 0x55eabc59b070 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa3874da740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eabc8a6c10 con 0x55eabc5721b0 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.032+0000 7fa3874da740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55eabc8aabc0 con 0x55eabc57a390 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc59b070 0x55eabc940310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc59b070 0x55eabc940310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49420/0 (socket says 172.21.15.37:49420) 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 -- 172.21.15.37:0/517711149 learned_addr learned my addr 172.21.15.37:0/517711149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc57a390 0x55eabc940d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa373fff640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa3680b4ca0 0x7fa3680b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa37a59c640 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 0x55eabc940850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 -- 172.21.15.37:0/517711149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc57a390 msgr2=0x55eabc940d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc57a390 0x55eabc940d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 -- 172.21.15.37:0/517711149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 msgr2=0x55eabc940850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 0x55eabc940850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 -- 172.21.15.37:0/517711149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eabc606650 con 0x55eabc59b070 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa373fff640 1 -- 172.21.15.37:0/2700339945 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7fa374106830 con 0x7fa37c10dbb0 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa37ad9d640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa3680b4ca0 0x7fa3680b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa371d9b640 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc59b070 0x55eabc940310 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa36400df90 tx=0x7fa36400d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205db7054fbf1af1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.033+0000 7fa370d99640 1 -- 172.21.15.37:0/517711149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364004030 con 0x55eabc59b070 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa370d99640 1 -- 172.21.15.37:0/517711149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa364005020 con 0x55eabc59b070 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa37ad9d640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa3680b4ca0 0x7fa3680b71b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa3740ccc30 tx=0x7fa374009480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:29.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa370d99640 1 -- 172.21.15.37:0/517711149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3640049e0 con 0x55eabc59b070 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa3874da740 1 -- 172.21.15.37:0/517711149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc59b070 msgr2=0x55eabc940310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa3874da740 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc59b070 0x55eabc940310 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa36400df90 tx=0x7fa36400d610 comp rx=0 tx=0).stop 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa3874da740 1 -- 172.21.15.37:0/517711149 shutdown_connections 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa3874da740 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc57a390 0x55eabc940d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa3874da740 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 0x55eabc940850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.034+0000 7fa3874da740 1 --2- 172.21.15.37:0/517711149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc59b070 0x55eabc940310 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 -- 172.21.15.37:0/517711149 >> 172.21.15.37:0/517711149 conn(0x55eabc58f460 msgr2=0x55eabc93e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 -- 172.21.15.37:0/517711149 shutdown_connections 2024-08-31T06:53:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 -- 172.21.15.37:0/517711149 wait complete. 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 -- start start 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 Processor -- start 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 0x55eabc94bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc94c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc59b070 0x55eabc957de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eabc709700 con 0x55eabc57a390 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55eabc82d750 con 0x55eabc5721b0 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.035+0000 7fa3874da740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55eabc94eaf0 con 0x55eabc59b070 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa3874da740 10 client.0 _ll_register_callbacks cb 0x55eabc85ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc94c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc94c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49424/0 (socket says 172.21.15.37:49424) 2024-08-31T06:53:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 -- 172.21.15.37:0/4221161173 learned_addr learned my addr 172.21.15.37:0/4221161173 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa371d9b640 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 0x55eabc94bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa371d9b640 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc59b070 0x55eabc957de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 -- 172.21.15.37:0/4221161173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc59b070 msgr2=0x55eabc957de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc59b070 0x55eabc957de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 -- 172.21.15.37:0/4221161173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 msgr2=0x55eabc94bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 0x55eabc94bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 -- 172.21.15.37:0/4221161173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eabc866900 con 0x55eabc57a390 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa371d9b640 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc59b070 0x55eabc957de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa37a59c640 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc94c050 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa36c013710 tx=0x7fa36c013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f4013e772e0be8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa361ffb640 1 -- 172.21.15.37:0/4221161173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c011dd0 con 0x55eabc57a390 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa3874da740 1 -- 172.21.15.37:0/4221161173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa364005020 con 0x55eabc57a390 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.036+0000 7fa361ffb640 1 -- 172.21.15.37:0/4221161173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7fa36c004030 con 0x55eabc57a390 2024-08-31T06:53:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa361ffb640 1 -- 172.21.15.37:0/4221161173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa36c004230 con 0x55eabc57a390 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa3874da740 10 client.17079 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa3874da740 1 -- 172.21.15.37:0/4221161173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eabc95a980 con 0x55eabc57a390 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa361ffb640 1 -- 172.21.15.37:0/4221161173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa364005020 con 0x55eabc57a390 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa361ffb640 1 -- 172.21.15.37:0/4221161173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa36c01a070 con 0x55eabc57a390 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa3874da740 10 client.17079 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa3874da740 10 client.17079 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa3874da740 20 client.17079 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa3874da740 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55eabc5599f0 0x55eabc95df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa3874da740 4 client.17079 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa3874da740 1 -- 172.21.15.37:0/4221161173 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eabc8b95d0 con 0x55eabc5599f0 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.037+0000 7fa371d9b640 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55eabc5599f0 0x55eabc95df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.038+0000 7fa371d9b640 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55eabc5599f0 0x55eabc95df30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5426e7083b797ee0 server_cookie=f6b2c191c8bd7964 in_seq=0 out_seq=0 2024-08-31T06:53:29.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.038+0000 7fa361ffb640 10 client.17079 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.038+0000 7fa361ffb640 1 -- 172.21.15.37:0/4221161173 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eabc8b95d0 con 0x55eabc5599f0 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa361ffb640 10 client.17079 handle_command_reply: tid=0 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 client.17079 shutdown 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 -- 172.21.15.37:0/4221161173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 msgr2=0x55eabc94c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc94c050 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa36c013710 tx=0x7fa36c013bd0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 -- 172.21.15.37:0/4221161173 shutdown_connections 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc94c050 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55eabc5599f0 0x55eabc95df30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc59b070 0x55eabc957de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 --2- 172.21.15.37:0/4221161173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5721b0 0x55eabc94bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa361ffb640 0 client.17079 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 -- 172.21.15.37:0/4221161173 >> 172.21.15.37:0/4221161173 conn(0x55eabc58f460 msgr2=0x55eabc9434f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 -- 172.21.15.37:0/4221161173 shutdown_connections 2024-08-31T06:53:29.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 1 -- 172.21.15.37:0/4221161173 wait complete. 2024-08-31T06:53:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.039+0000 7fa3874da740 20 client.17079 trim_cache size 0 max 16384 2024-08-31T06:53:29.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa3874da740 1 Processor -- start 2024-08-31T06:53:29.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa3874da740 1 -- start start 2024-08-31T06:53:29.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa3874da740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 0x55eabc93e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa3874da740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 0x55eabc957ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa3874da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc958220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa3874da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1b1bf0 con 0x55eabc57a390 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa3874da740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1af4c0 con 0x55eabc5599f0 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa3874da740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1ad330 con 0x55eabc5721b0 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa371d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc958220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa371d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc958220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49428/0 (socket says 172.21.15.37:49428) 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.052+0000 7fa371d9b640 1 -- 172.21.15.37:0/1873877354 learned_addr learned my addr 172.21.15.37:0/1873877354 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa37a59c640 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 0x55eabc957ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa371d9b640 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 0x55eabc93e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa371d9b640 1 -- 172.21.15.37:0/1873877354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 msgr2=0x55eabc957ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa371d9b640 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 0x55eabc957ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa371d9b640 1 -- 172.21.15.37:0/1873877354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 msgr2=0x55eabc93e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:29.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa371d9b640 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 0x55eabc93e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa371d9b640 1 -- 172.21.15.37:0/1873877354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eabc943170 con 0x55eabc57a390 2024-08-31T06:53:29.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa371d9b640 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc958220 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa364013e40 tx=0x7fa36400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893dd24d4e7e8993 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:29.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa363fff640 1 -- 172.21.15.37:0/1873877354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364005430 con 0x55eabc57a390 2024-08-31T06:53:29.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa363fff640 1 -- 172.21.15.37:0/1873877354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3640055d0 con 0x55eabc57a390 2024-08-31T06:53:29.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.053+0000 7fa363fff640 1 -- 172.21.15.37:0/1873877354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364003d10 con 0x55eabc57a390 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 -- 172.21.15.37:0/1873877354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 msgr2=0x55eabc958220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc958220 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa364013e40 tx=0x7fa36400ded0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 -- 172.21.15.37:0/1873877354 shutdown_connections 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc958220 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 0x55eabc957ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 --2- 172.21.15.37:0/1873877354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 0x55eabc93e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 -- 172.21.15.37:0/1873877354 >> 172.21.15.37:0/1873877354 conn(0x55eabc58f460 msgr2=0x55eabc93db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 -- 172.21.15.37:0/1873877354 shutdown_connections 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 -- 172.21.15.37:0/1873877354 wait complete. 2024-08-31T06:53:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 -- start start 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.054+0000 7fa3874da740 1 Processor -- start 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa3874da740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 0x55eabc950620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa3874da740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 0x55eabc950c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa3874da740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc9c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa3874da740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1ad980 con 0x55eabc57a390 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa3874da740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1aedf0 con 0x55eabc5599f0 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa3874da740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1ae050 con 0x55eabc5721b0 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa3874da740 10 client.0 _ll_register_callbacks cb 0x7fa36c009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc9c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc9c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49436/0 (socket says 172.21.15.37:49436) 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 -- 172.21.15.37:0/573578095 learned_addr learned my addr 172.21.15.37:0/573578095 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa37a59c640 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 0x55eabc950c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 -- 172.21.15.37:0/573578095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 msgr2=0x55eabc950c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 0x55eabc950c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 -- 172.21.15.37:0/573578095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 msgr2=0x55eabc950620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 0x55eabc950620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 -- 172.21.15.37:0/573578095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eabc9c6380 con 0x55eabc57a390 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa371d9b640 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc9c5d10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa364005fd0 tx=0x7fa36400d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7754bb5bda5fff3e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.055+0000 7fa361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa361ffb640 1 -- 172.21.15.37:0/573578095 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364040060 con 0x55eabc57a390 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa361ffb640 1 -- 172.21.15.37:0/573578095 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7fa364027040 con 0x55eabc57a390 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 1 -- 172.21.15.37:0/573578095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3640055d0 con 0x55eabc57a390 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa361ffb640 1 -- 172.21.15.37:0/573578095 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa36402e780 con 0x55eabc57a390 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 10 client.17085 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 1 -- 172.21.15.37:0/573578095 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eabc9cd6c0 con 0x55eabc57a390 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa361ffb640 1 -- 172.21.15.37:0/573578095 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3640055d0 con 0x55eabc57a390 2024-08-31T06:53:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa361ffb640 1 -- 172.21.15.37:0/573578095 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa364032040 con 0x55eabc57a390 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 10 client.17085 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 10 client.17085 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 20 client.17085 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55eabc59b070 0x55eabc9cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 4 client.17085 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.056+0000 7fa3874da740 1 -- 172.21.15.37:0/573578095 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eabc8b5070 con 0x55eabc59b070 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa37a59c640 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55eabc59b070 0x55eabc9cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa37a59c640 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55eabc59b070 0x55eabc9cfc30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3d31241dd5e8742 server_cookie=e54c754ae822c45f in_seq=0 out_seq=0 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa361ffb640 10 client.17085 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa361ffb640 1 -- 172.21.15.37:0/573578095 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eabc8b5070 con 0x55eabc59b070 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa361ffb640 10 client.17085 handle_command_reply: tid=0 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 client.17085 shutdown 2024-08-31T06:53:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 -- 172.21.15.37:0/573578095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 msgr2=0x55eabc9c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc9c5d10 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa364005fd0 tx=0x7fa36400d610 comp rx=0 tx=0).stop 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 -- 172.21.15.37:0/573578095 shutdown_connections 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eabc57a390 0x55eabc9c5d10 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55eabc59b070 0x55eabc9cfc30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eabc5721b0 0x55eabc950c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 --2- 172.21.15.37:0/573578095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55eabc5599f0 0x55eabc950620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 -- 172.21.15.37:0/573578095 >> 172.21.15.37:0/573578095 conn(0x55eabc58f460 msgr2=0x55eabc943410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa361ffb640 0 client.17085 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.057+0000 7fa3874da740 1 -- 172.21.15.37:0/573578095 shutdown_connections 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa3874da740 1 -- 172.21.15.37:0/573578095 wait complete. 2024-08-31T06:53:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa3874da740 20 client.17085 trim_cache size 0 max 16384 2024-08-31T06:53:29.065 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:53:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 -- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa3680b4ca0 msgr2=0x7fa3680b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa3680b4ca0 0x7fa3680b71b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa3740ccc30 tx=0x7fa374009480 comp rx=0 tx=0).stop 2024-08-31T06:53:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 -- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 msgr2=0x7fa37c19f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 0x7fa37c19f960 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa374005e30 tx=0x7fa3740093d0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 -- 172.21.15.37:0/2700339945 shutdown_connections 2024-08-31T06:53:29.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa3680b4ca0 0x7fa3680b71b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c10dbb0 0x7fa37c19f960 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa37c1050a0 0x7fa37c19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 --2- 172.21.15.37:0/2700339945 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa37c104750 0x7fa37c19a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:29.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 -- 172.21.15.37:0/2700339945 >> 172.21.15.37:0/2700339945 conn(0x7fa37c0794c0 msgr2=0x7fa37c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:29.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 -- 172.21.15.37:0/2700339945 shutdown_connections 2024-08-31T06:53:29.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:29.058+0000 7fa380f65640 1 -- 172.21.15.37:0/2700339945 wait complete. 2024-08-31T06:53:29.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:53:30.057 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:53:30.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:29 smithi106 ceph-mon[22134]: pgmap v521: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-31T06:53:30.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:29 smithi037 ceph-mon[18612]: pgmap v521: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-31T06:53:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:29 smithi066 ceph-mon[22244]: pgmap v521: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-08-31T06:53:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 -- 172.21.15.37:0/1076134388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 msgr2=0x7fa98410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 --2- 172.21.15.37:0/1076134388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 0x7fa98410f2d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009ca0 tx=0x7fa97c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 -- 172.21.15.37:0/1076134388 shutdown_connections 2024-08-31T06:53:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 --2- 172.21.15.37:0/1076134388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 0x7fa98410f2d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 --2- 172.21.15.37:0/1076134388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa984108150 0x7fa984108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 --2- 172.21.15.37:0/1076134388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa984102810 0x7fa984102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 -- 172.21.15.37:0/1076134388 >> 172.21.15.37:0/1076134388 conn(0x7fa9840794d0 msgr2=0x7fa9840798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 -- 172.21.15.37:0/1076134388 shutdown_connections 2024-08-31T06:53:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 -- 172.21.15.37:0/1076134388 wait complete. 2024-08-31T06:53:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.503+0000 7fa98900d640 1 Processor -- start 2024-08-31T06:53:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98900d640 1 -- start start 2024-08-31T06:53:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98900d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa984102810 0x7fa98410fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98900d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa984108150 0x7fa9841100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98900d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 0x7fa9841105e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98900d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa984113730 con 0x7fa984108aa0 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98900d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841135b0 con 0x7fa984102810 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98900d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841138b0 con 0x7fa984108150 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 0x7fa9841105e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 0x7fa9841105e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49462/0 (socket says 172.21.15.37:49462) 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98359e640 1 -- 172.21.15.37:0/3450983592 learned_addr learned my addr 172.21.15.37:0/3450983592 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa982d9d640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa984102810 0x7fa98410fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.504+0000 7fa98259c640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa984108150 0x7fa9841100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa98359e640 1 -- 172.21.15.37:0/3450983592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa984108150 msgr2=0x7fa9841100a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa98359e640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa984108150 0x7fa9841100a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa98359e640 1 -- 172.21.15.37:0/3450983592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa984102810 msgr2=0x7fa98410fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa98359e640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa984102810 0x7fa98410fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa98359e640 1 -- 172.21.15.37:0/3450983592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9841a82b0 con 0x7fa984108aa0 2024-08-31T06:53:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa98359e640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 0x7fa9841105e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa97c005cc0 tx=0x7fa97c032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa96bfff640 1 -- 172.21.15.37:0/3450983592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c004040 con 0x7fa984108aa0 2024-08-31T06:53:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa96bfff640 1 -- 172.21.15.37:0/3450983592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa97c004670 con 0x7fa984108aa0 2024-08-31T06:53:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa98900d640 1 -- 172.21.15.37:0/3450983592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9841a8540 con 0x7fa984108aa0 2024-08-31T06:53:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa96bfff640 1 -- 172.21.15.37:0/3450983592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c030cc0 con 0x7fa984108aa0 2024-08-31T06:53:30.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.505+0000 7fa98900d640 1 -- 172.21.15.37:0/3450983592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9841a8a80 con 0x7fa984108aa0 2024-08-31T06:53:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98f582740 1 Processor -- start 2024-08-31T06:53:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa96bfff640 1 -- 172.21.15.37:0/3450983592 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa97c04e440 con 0x7fa984108aa0 2024-08-31T06:53:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98f582740 1 -- start start 2024-08-31T06:53:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98f582740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c58310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98f582740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c58850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98f582740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c58d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98f582740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e5a3bcf680 con 0x55e5a388a1b0 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98f582740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5a3bbec10 con 0x55e5a38b3070 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98f582740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e5a3bc2bc0 con 0x55e5a3892390 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa982d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c58850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa982d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c58850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49474/0 (socket says 172.21.15.37:49474) 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa982d9d640 1 -- 172.21.15.37:0/1645672930 learned_addr learned my addr 172.21.15.37:0/1645672930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98259c640 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c58310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.508+0000 7fa98259c640 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c58d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa982d9d640 1 -- 172.21.15.37:0/1645672930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 msgr2=0x55e5a3c58d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa982d9d640 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c58d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa96bfff640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa96c0b4ca0 0x7fa96c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa982d9d640 1 -- 172.21.15.37:0/1645672930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 msgr2=0x55e5a3c58310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa982d9d640 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c58310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa982d9d640 1 -- 172.21.15.37:0/1645672930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a391e650 con 0x55e5a388a1b0 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa98259c640 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c58310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa98359e640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa96c0b4ca0 0x7fa96c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa982d9d640 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c58850 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa97400ac80 tx=0x7fa97400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f48848c86d759e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa96bfff640 1 -- 172.21.15.37:0/3450983592 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7fa97c106910 con 0x7fa984108aa0 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa9697fa640 1 -- 172.21.15.37:0/1645672930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97401d070 con 0x55e5a388a1b0 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa9697fa640 1 -- 172.21.15.37:0/1645672930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa974018ad0 con 0x55e5a388a1b0 2024-08-31T06:53:30.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.509+0000 7fa9697fa640 1 -- 172.21.15.37:0/1645672930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa974010a40 con 0x55e5a388a1b0 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 -- 172.21.15.37:0/1645672930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 msgr2=0x55e5a3c58850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98359e640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa96c0b4ca0 0x7fa96c0b71b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0b2fd0 tx=0x7fa97c04a000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c58850 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa97400ac80 tx=0x7fa97400f790 comp rx=0 tx=0).stop 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 -- 172.21.15.37:0/1645672930 shutdown_connections 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c58850 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c58d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 --2- 172.21.15.37:0/1645672930 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c58310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 -- 172.21.15.37:0/1645672930 >> 172.21.15.37:0/1645672930 conn(0x55e5a38a7460 msgr2=0x55e5a3c56200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 -- 172.21.15.37:0/1645672930 shutdown_connections 2024-08-31T06:53:30.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 -- 172.21.15.37:0/1645672930 wait complete. 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.510+0000 7fa98f582740 1 -- start start 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98f582740 1 Processor -- start 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98f582740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c63ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98f582740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c64010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98f582740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c6fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98f582740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e5a3a21700 con 0x55e5a388a1b0 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98f582740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e5a3b45750 con 0x55e5a38b3070 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98f582740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e5a3c66af0 con 0x55e5a3892390 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98f582740 10 client.0 _ll_register_callbacks cb 0x55e5a3b74e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c63ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c63ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49476/0 (socket says 172.21.15.37:49476) 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98259c640 1 -- 172.21.15.37:0/1147949553 learned_addr learned my addr 172.21.15.37:0/1147949553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:30.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa982d9d640 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c64010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98259c640 1 -- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 msgr2=0x55e5a3c64010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98259c640 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c64010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98259c640 1 -- 172.21.15.37:0/1147949553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 msgr2=0x55e5a3c6fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98259c640 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c6fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa98259c640 1 -- 172.21.15.37:0/1147949553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a3b7e900 con 0x55e5a388a1b0 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.511+0000 7fa982d9d640 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c64010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa98259c640 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c63ad0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa978011b50 tx=0x7fa97800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66325d3dd0471d59 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa966ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa966ff5640 1 -- 172.21.15.37:0/1147949553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978005220 con 0x55e5a388a1b0 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa966ff5640 1 -- 172.21.15.37:0/1147949553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7fa9780053c0 con 0x55e5a388a1b0 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa98f582740 1 -- 172.21.15.37:0/1147949553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa974018ad0 con 0x55e5a388a1b0 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa966ff5640 1 -- 172.21.15.37:0/1147949553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa978011e50 con 0x55e5a388a1b0 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa98f582740 10 client.17097 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:30.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa98f582740 1 -- 172.21.15.37:0/1147949553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5a3c72930 con 0x55e5a388a1b0 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa966ff5640 1 -- 172.21.15.37:0/1147949553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa974018ad0 con 0x55e5a388a1b0 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.512+0000 7fa966ff5640 1 -- 172.21.15.37:0/1147949553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa97801c660 con 0x55e5a388a1b0 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.513+0000 7fa98f582740 10 client.17097 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.513+0000 7fa98f582740 10 client.17097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.513+0000 7fa98f582740 20 client.17097 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.513+0000 7fa98f582740 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55e5a38719f0 0x55e5a3c75e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.513+0000 7fa98f582740 4 client.17097 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.513+0000 7fa98f582740 1 -- 172.21.15.37:0/1147949553 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5a3bd15d0 con 0x55e5a38719f0 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.513+0000 7fa982d9d640 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55e5a38719f0 0x55e5a3c75e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa982d9d640 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55e5a38719f0 0x55e5a3c75e90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5cbce4a5779c2e10 server_cookie=1eb1a2dbc5b008bb in_seq=0 out_seq=0 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa966ff5640 10 client.17097 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa966ff5640 1 -- 172.21.15.37:0/1147949553 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e5a3bd15d0 con 0x55e5a38719f0 2024-08-31T06:53:30.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa966ff5640 10 client.17097 handle_command_reply: tid=0 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 client.17097 shutdown 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 -- 172.21.15.37:0/1147949553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 msgr2=0x55e5a3c63ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c63ad0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa978011b50 tx=0x7fa97800f7f0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 -- 172.21.15.37:0/1147949553 shutdown_connections 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55e5a38719f0 0x55e5a3c75e90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c6fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c64010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa966ff5640 0 client.17097 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 --2- 172.21.15.37:0/1147949553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c63ad0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.514+0000 7fa98f582740 1 -- 172.21.15.37:0/1147949553 >> 172.21.15.37:0/1147949553 conn(0x55e5a38a7460 msgr2=0x55e5a3c5b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.515+0000 7fa98f582740 1 -- 172.21.15.37:0/1147949553 shutdown_connections 2024-08-31T06:53:30.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.515+0000 7fa98f582740 1 -- 172.21.15.37:0/1147949553 wait complete. 2024-08-31T06:53:30.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.515+0000 7fa98f582740 20 client.17097 trim_cache size 0 max 16384 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98f582740 1 Processor -- start 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98f582740 1 -- start start 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98f582740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c5b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98f582740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a3892390 0x55e5a3c5b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98f582740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a38b3070 0x55e5a3c60cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98f582740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b3d90 con 0x55e5a388a1b0 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98f582740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b1660 con 0x55e5a3892390 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98f582740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841af4d0 con 0x55e5a38b3070 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c5b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c5b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49478/0 (socket says 172.21.15.37:49478) 2024-08-31T06:53:30.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.528+0000 7fa98259c640 1 -- 172.21.15.37:0/697024756 learned_addr learned my addr 172.21.15.37:0/697024756 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa98259c640 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a38b3070 0x55e5a3c60cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa982d9d640 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a3892390 0x55e5a3c5b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa98259c640 1 -- 172.21.15.37:0/697024756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a38b3070 msgr2=0x55e5a3c60cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa98259c640 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a38b3070 0x55e5a3c60cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa98259c640 1 -- 172.21.15.37:0/697024756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a3892390 msgr2=0x55e5a3c5b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa98259c640 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a3892390 0x55e5a3c5b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa98259c640 1 -- 172.21.15.37:0/697024756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5a3c64d90 con 0x55e5a388a1b0 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa982d9d640 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a3892390 0x55e5a3c5b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa98259c640 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c5b410 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa978004700 tx=0x7fa97800fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae07a3ba3706691 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa968ff9640 1 -- 172.21.15.37:0/697024756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9780055c0 con 0x55e5a388a1b0 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa968ff9640 1 -- 172.21.15.37:0/697024756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa978011e50 con 0x55e5a388a1b0 2024-08-31T06:53:30.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.529+0000 7fa968ff9640 1 -- 172.21.15.37:0/697024756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978004a90 con 0x55e5a388a1b0 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 -- 172.21.15.37:0/697024756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 msgr2=0x55e5a3c5b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c5b410 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa978004700 tx=0x7fa97800fcf0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 -- 172.21.15.37:0/697024756 shutdown_connections 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a38b3070 0x55e5a3c60cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a3892390 0x55e5a3c5b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 --2- 172.21.15.37:0/697024756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c5b410 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 -- 172.21.15.37:0/697024756 >> 172.21.15.37:0/697024756 conn(0x55e5a38a7460 msgr2=0x55e5a3c62350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 -- 172.21.15.37:0/697024756 shutdown_connections 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 -- 172.21.15.37:0/697024756 wait complete. 2024-08-31T06:53:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.530+0000 7fa98f582740 1 -- start start 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98f582740 1 Processor -- start 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98f582740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c67ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98f582740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c68400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98f582740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c68940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98f582740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841afb20 con 0x55e5a388a1b0 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98f582740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b0f90 con 0x55e5a38b3070 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98f582740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa9841b01f0 con 0x55e5a3892390 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98f582740 10 client.0 _ll_register_callbacks cb 0x7fa978005870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c67ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c67ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49486/0 (socket says 172.21.15.37:49486) 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 -- 172.21.15.37:0/436519008 learned_addr learned my addr 172.21.15.37:0/436519008 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa982d9d640 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c68400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c68940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 -- 172.21.15.37:0/436519008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 msgr2=0x55e5a3c68400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c68400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 -- 172.21.15.37:0/436519008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 msgr2=0x55e5a3c68940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c68940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.531+0000 7fa98259c640 1 -- 172.21.15.37:0/436519008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5a3cdfa40 con 0x55e5a388a1b0 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa98259c640 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c67ec0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa978005940 tx=0x7fa97800a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c48f71de3b8742 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa966ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa966ff5640 1 -- 172.21.15.37:0/436519008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa978038040 con 0x55e5a388a1b0 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa966ff5640 1 -- 172.21.15.37:0/436519008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7fa978004930 con 0x55e5a388a1b0 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa98f582740 1 -- 172.21.15.37:0/436519008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa978011e50 con 0x55e5a388a1b0 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa966ff5640 1 -- 172.21.15.37:0/436519008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa978045050 con 0x55e5a388a1b0 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa98f582740 10 client.17103 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa98f582740 1 -- 172.21.15.37:0/436519008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5a3ce0c30 con 0x55e5a388a1b0 2024-08-31T06:53:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa966ff5640 1 -- 172.21.15.37:0/436519008 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa978011e50 con 0x55e5a388a1b0 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa966ff5640 1 -- 172.21.15.37:0/436519008 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa9780307f0 con 0x55e5a388a1b0 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa98f582740 10 client.17103 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa98f582740 10 client.17103 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa98f582740 20 client.17103 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.532+0000 7fa98f582740 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55e5a3846da0 0x55e5a3ce32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.533+0000 7fa98f582740 4 client.17103 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.533+0000 7fa98f582740 1 -- 172.21.15.37:0/436519008 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5a3bcd070 con 0x55e5a3846da0 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.533+0000 7fa982d9d640 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55e5a3846da0 0x55e5a3ce32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.533+0000 7fa982d9d640 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55e5a3846da0 0x55e5a3ce32b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=50848f3b9b9e32e3 server_cookie=50cff874c8430a50 in_seq=0 out_seq=0 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.533+0000 7fa966ff5640 10 client.17103 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.533+0000 7fa966ff5640 1 -- 172.21.15.37:0/436519008 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5a3bcd070 con 0x55e5a3846da0 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.533+0000 7fa966ff5640 10 client.17103 handle_command_reply: tid=0 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.533+0000 7fa98f582740 1 client.17103 shutdown 2024-08-31T06:53:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 -- 172.21.15.37:0/436519008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 msgr2=0x55e5a3c67ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c67ec0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa978005940 tx=0x7fa97800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 -- 172.21.15.37:0/436519008 shutdown_connections 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55e5a3846da0 0x55e5a3ce32b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e5a38b3070 0x55e5a3c68940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5a3892390 0x55e5a3c68400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 --2- 172.21.15.37:0/436519008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e5a388a1b0 0x55e5a3c67ec0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 -- 172.21.15.37:0/436519008 >> 172.21.15.37:0/436519008 conn(0x55e5a38a7460 msgr2=0x55e5a3c5b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa966ff5640 0 client.17103 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 -- 172.21.15.37:0/436519008 shutdown_connections 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 1 -- 172.21.15.37:0/436519008 wait complete. 2024-08-31T06:53:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98f582740 20 client.17103 trim_cache size 0 max 16384 2024-08-31T06:53:30.540 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:53:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 -- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa96c0b4ca0 msgr2=0x7fa96c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa96c0b4ca0 0x7fa96c0b71b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0b2fd0 tx=0x7fa97c04a000 comp rx=0 tx=0).stop 2024-08-31T06:53:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 -- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 msgr2=0x7fa9841105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 0x7fa9841105e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa97c005cc0 tx=0x7fa97c032c40 comp rx=0 tx=0).stop 2024-08-31T06:53:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 -- 172.21.15.37:0/3450983592 shutdown_connections 2024-08-31T06:53:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa96c0b4ca0 0x7fa96c0b71b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa984108aa0 0x7fa9841105e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa984108150 0x7fa9841100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.534+0000 7fa98900d640 1 --2- 172.21.15.37:0/3450983592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa984102810 0x7fa98410fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.535+0000 7fa98900d640 1 -- 172.21.15.37:0/3450983592 >> 172.21.15.37:0/3450983592 conn(0x7fa9840794d0 msgr2=0x7fa984104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.535+0000 7fa98900d640 1 -- 172.21.15.37:0/3450983592 shutdown_connections 2024-08-31T06:53:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:30.535+0000 7fa98900d640 1 -- 172.21.15.37:0/3450983592 wait complete. 2024-08-31T06:53:31.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:53:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:53:32.013 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:31 smithi037 ceph-mon[18612]: pgmap v522: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:53:32.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 -- 172.21.15.37:0/1353552470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108ac0 msgr2=0x7f7acc10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1353552470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108ac0 0x7f7acc10f2f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009ca0 tx=0x7f7ac402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 -- 172.21.15.37:0/1353552470 shutdown_connections 2024-08-31T06:53:32.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1353552470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108ac0 0x7f7acc10f2f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1353552470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7acc108170 0x7f7acc108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1353552470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7acc102830 0x7f7acc102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 -- 172.21.15.37:0/1353552470 >> 172.21.15.37:0/1353552470 conn(0x7f7acc0794f0 msgr2=0x7f7acc079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:32.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 -- 172.21.15.37:0/1353552470 shutdown_connections 2024-08-31T06:53:32.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.020+0000 7f7ad4067640 1 -- 172.21.15.37:0/1353552470 wait complete. 2024-08-31T06:53:32.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad4067640 1 Processor -- start 2024-08-31T06:53:32.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad4067640 1 -- start start 2024-08-31T06:53:32.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad4067640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7acc102830 0x7f7acc19af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad4067640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108170 0x7f7acc19b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad4067640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7acc108ac0 0x7f7acc19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad4067640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc112620 con 0x7f7acc108170 2024-08-31T06:53:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad4067640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1124a0 con 0x7f7acc102830 2024-08-31T06:53:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad4067640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1127a0 con 0x7f7acc108ac0 2024-08-31T06:53:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad1602640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108170 0x7f7acc19b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad1602640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108170 0x7f7acc19b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49496/0 (socket says 172.21.15.37:49496) 2024-08-31T06:53:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad1602640 1 -- 172.21.15.37:0/1732258427 learned_addr learned my addr 172.21.15.37:0/1732258427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7acc102830 0x7f7acc19af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.021+0000 7f7ad2604640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7acc108ac0 0x7f7acc19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ad1602640 1 -- 172.21.15.37:0/1732258427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7acc108ac0 msgr2=0x7f7acc19b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ad1602640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7acc108ac0 0x7f7acc19b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ad1602640 1 -- 172.21.15.37:0/1732258427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7acc102830 msgr2=0x7f7acc19af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ad1602640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7acc102830 0x7f7acc19af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ad1602640 1 -- 172.21.15.37:0/1732258427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc1a61a0 con 0x7f7acc108170 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ad1602640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108170 0x7f7acc19b450 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00d770 tx=0x7f7abc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/1732258427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc017070 con 0x7f7acc108170 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/1732258427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7abc009c30 con 0x7f7acc108170 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.022+0000 7f7ad4067640 1 -- 172.21.15.37:0/1732258427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7acc1a6490 con 0x7f7acc108170 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.023+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/1732258427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00f620 con 0x7f7acc108170 2024-08-31T06:53:32.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.023+0000 7f7ad4067640 1 -- 172.21.15.37:0/1732258427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7acc1a69d0 con 0x7f7acc108170 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.025+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/1732258427 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f7abc01a070 con 0x7f7acc108170 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.025+0000 7f7ada5dc740 1 Processor -- start 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.025+0000 7f7ada5dc740 1 -- start start 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ac2ffd640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ab80b4cd0 0x7f7ab80b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55acee343680 con 0x55acee027070 2024-08-31T06:53:32.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55acee332c10 con 0x55acedffe1b0 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55acee336bc0 con 0x55acee006390 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad2604640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ab80b4cd0 0x7f7ab80b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3cc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49510/0 (socket says 172.21.15.37:49510) 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 -- 172.21.15.37:0/3218983621 learned_addr learned my addr 172.21.15.37:0/3218983621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ac2ffd640 1 -- 172.21.15.37:0/1732258427 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f7abc0e50a0 con 0x7f7acc108170 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad2604640 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1602640 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 -- 172.21.15.37:0/3218983621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 msgr2=0x55acee3ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 -- 172.21.15.37:0/3218983621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 msgr2=0x55acee3cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 -- 172.21.15.37:0/3218983621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acee092650 con 0x55acee027070 2024-08-31T06:53:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad2604640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ab80b4cd0 0x7f7ab80b71e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4006010 tx=0x7f7ac40317d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.026+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3cc310 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800bc90 tx=0x7f7ac800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e652e725017c1f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.027+0000 7f7ab7fff640 1 -- 172.21.15.37:0/3218983621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8015070 con 0x55acee027070 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.027+0000 7f7ab7fff640 1 -- 172.21.15.37:0/3218983621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac801a8f0 con 0x55acee027070 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.027+0000 7f7ab7fff640 1 -- 172.21.15.37:0/3218983621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8011760 con 0x55acee027070 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 -- 172.21.15.37:0/3218983621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 msgr2=0x55acee3cc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3cc310 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800bc90 tx=0x7f7ac800f730 comp rx=0 tx=0).stop 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 -- 172.21.15.37:0/3218983621 shutdown_connections 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/3218983621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3cc310 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 -- 172.21.15.37:0/3218983621 >> 172.21.15.37:0/3218983621 conn(0x55acee01b460 msgr2=0x55acee3ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 -- 172.21.15.37:0/3218983621 shutdown_connections 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 -- 172.21.15.37:0/3218983621 wait complete. 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 -- start start 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.028+0000 7f7ada5dc740 1 Processor -- start 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acedffe1b0 0x55acee3dbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee006390 0x55acee3dc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3e8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55acee195700 con 0x55acee006390 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55acee2b9750 con 0x55acee027070 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55acee3dee50 con 0x55acedffe1b0 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ada5dc740 10 client.0 _ll_register_callbacks cb 0x55acee2e8e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee006390 0x55acee3dc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee006390 0x55acee3dc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49524/0 (socket says 172.21.15.37:49524) 2024-08-31T06:53:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 -- 172.21.15.37:0/2241291292 learned_addr learned my addr 172.21.15.37:0/2241291292 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad2604640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3e8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acedffe1b0 0x55acee3dbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 -- 172.21.15.37:0/2241291292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acedffe1b0 msgr2=0x55acee3dbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acedffe1b0 0x55acee3dbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 -- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 msgr2=0x55acee3e8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3e8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 -- 172.21.15.37:0/2241291292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acee2f2900 con 0x55acee006390 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad2604640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acedffe1b0 0x55acee3dbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ad1602640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee006390 0x55acee3dc430 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0ab4a0 tx=0x7f7abc0cfb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b26631e3dddce2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.029+0000 7f7ab57fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2241291292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc021070 con 0x55acee006390 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2241291292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f7abc0d2340 con 0x55acee006390 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2241291292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ac801a8f0 con 0x55acee006390 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2241291292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7abc0abea0 con 0x55acee006390 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 10 client.17115 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2241291292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55acee3eac90 con 0x55acee006390 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2241291292 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac801a8f0 con 0x55acee006390 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2241291292 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7abc0a7a30 con 0x55acee006390 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 10 client.17115 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 20 client.17115 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55acedfe59f0 0x55acee3ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 4 client.17115 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:53:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.030+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2241291292 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acee3455d0 con 0x55acedfe59f0 2024-08-31T06:53:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.031+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55acedfe59f0 0x55acee3ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.031+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55acedfe59f0 0x55acee3ee0f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd3be118f78345e server_cookie=34d8f134ca2491d4 in_seq=0 out_seq=0 2024-08-31T06:53:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.031+0000 7f7ab57fa640 10 client.17115 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2241291292 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55acee3455d0 con 0x55acedfe59f0 2024-08-31T06:53:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ab57fa640 10 client.17115 handle_command_reply: tid=0 2024-08-31T06:53:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 client.17115 shutdown 2024-08-31T06:53:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2241291292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee006390 msgr2=0x55acee3dc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee006390 0x55acee3dc430 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0ab4a0 tx=0x7f7abc0cfb00 comp rx=0 tx=0).stop 2024-08-31T06:53:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2241291292 shutdown_connections 2024-08-31T06:53:32.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55acedfe59f0 0x55acee3ee0f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee006390 0x55acee3dc430 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3e8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2241291292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acedffe1b0 0x55acee3dbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ab57fa640 0 client.17115 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2241291292 >> 172.21.15.37:0/2241291292 conn(0x55acee01b460 msgr2=0x55acee3c87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2241291292 shutdown_connections 2024-08-31T06:53:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2241291292 wait complete. 2024-08-31T06:53:32.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.032+0000 7f7ada5dc740 20 client.17115 trim_cache size 0 max 16384 2024-08-31T06:53:32.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.045+0000 7f7ada5dc740 1 Processor -- start 2024-08-31T06:53:32.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.045+0000 7f7ada5dc740 1 -- start start 2024-08-31T06:53:32.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1afa80 con 0x55acee027070 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1ad350 con 0x55acedffe1b0 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1ab1c0 con 0x55acee006390 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad2604640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad2604640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49528/0 (socket says 172.21.15.37:49528) 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad2604640 1 -- 172.21.15.37:0/624811159 learned_addr learned my addr 172.21.15.37:0/624811159 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad1602640 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad2604640 1 -- 172.21.15.37:0/624811159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 msgr2=0x55acee3dacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad2604640 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3dacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad2604640 1 -- 172.21.15.37:0/624811159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 msgr2=0x55acee3da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad2604640 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3da770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad2604640 1 -- 172.21.15.37:0/624811159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acee3dd1b0 con 0x55acee027070 2024-08-31T06:53:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad1602640 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.046+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.047+0000 7f7ad2604640 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3c9b40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4031ce0 tx=0x7f7ac4009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f8bdbe01017b60 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.047+0000 7f7ab77fe640 1 -- 172.21.15.37:0/624811159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40045b0 con 0x55acee027070 2024-08-31T06:53:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.047+0000 7f7ab77fe640 1 -- 172.21.15.37:0/624811159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac4036040 con 0x55acee027070 2024-08-31T06:53:32.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.047+0000 7f7ab77fe640 1 -- 172.21.15.37:0/624811159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac403e430 con 0x55acee027070 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 -- 172.21.15.37:0/624811159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 msgr2=0x55acee3c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3c9b40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4031ce0 tx=0x7f7ac4009420 comp rx=0 tx=0).stop 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 -- 172.21.15.37:0/624811159 shutdown_connections 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acee027070 0x55acee3c9b40 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/624811159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acedffe1b0 0x55acee3da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 -- 172.21.15.37:0/624811159 >> 172.21.15.37:0/624811159 conn(0x55acee01b460 msgr2=0x55acee3d7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 -- 172.21.15.37:0/624811159 shutdown_connections 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 -- 172.21.15.37:0/624811159 wait complete. 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 -- start start 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 Processor -- start 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acedffe1b0 0x55acee3e42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.048+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3e4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ada5dc740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3df0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1ab810 con 0x55acedffe1b0 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1acc80 con 0x55acee027070 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ada5dc740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1abee0 con 0x55acee006390 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ada5dc740 10 client.0 _ll_register_callbacks cb 0x7f7abc010ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acedffe1b0 0x55acee3e42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acedffe1b0 0x55acee3e42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49532/0 (socket says 172.21.15.37:49532) 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 -- 172.21.15.37:0/2806329998 learned_addr learned my addr 172.21.15.37:0/2806329998 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1602640 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad2604640 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3df0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 -- 172.21.15.37:0/2806329998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 msgr2=0x55acee3e4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3e4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 -- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 msgr2=0x55acee3df0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3df0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 -- 172.21.15.37:0/2806329998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acee3df690 con 0x55acedffe1b0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad2604640 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ad1e03640 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acedffe1b0 0x55acee3e42f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8000c00 tx=0x7f7ac800fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4482d37b400a5f6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ab57fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2806329998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8015070 con 0x55acedffe1b0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2806329998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f7ac8004440 con 0x55acedffe1b0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.049+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2806329998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ac4036040 con 0x55acedffe1b0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2806329998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7ac8028040 con 0x55acedffe1b0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ada5dc740 10 client.17121 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2806329998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55acee4592c0 con 0x55acedffe1b0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2806329998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ac4036040 con 0x55acedffe1b0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2806329998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7ac8004b10 con 0x55acedffe1b0 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ada5dc740 10 client.17121 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:32.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ada5dc740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ada5dc740 20 client.17121 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55acedfbada0 0x55acee45b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ada5dc740 4 client.17121 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2806329998 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55acee341070 con 0x55acedfbada0 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.050+0000 7f7ad1602640 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55acedfbada0 0x55acee45b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ab57fa640 10 client.17121 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ad1602640 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55acedfbada0 0x55acee45b7c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b6d9e24a59d13e5 server_cookie=e37d492ddead2b22 in_seq=0 out_seq=0 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ab57fa640 1 -- 172.21.15.37:0/2806329998 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55acee341070 con 0x55acedfbada0 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ab57fa640 10 client.17121 handle_command_reply: tid=0 2024-08-31T06:53:32.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 client.17121 shutdown 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2806329998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acedffe1b0 msgr2=0x55acee3e42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acedffe1b0 0x55acee3e42f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8000c00 tx=0x7f7ac800fd50 comp rx=0 tx=0).stop 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2806329998 shutdown_connections 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55acedfbada0 0x55acee45b7c0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55acee027070 0x55acee3df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acee006390 0x55acee3e4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 --2- 172.21.15.37:0/2806329998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55acedffe1b0 0x55acee3e42f0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ab57fa640 0 client.17121 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2806329998 >> 172.21.15.37:0/2806329998 conn(0x55acee01b460 msgr2=0x55acee3c9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2806329998 shutdown_connections 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 1 -- 172.21.15.37:0/2806329998 wait complete. 2024-08-31T06:53:32.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.051+0000 7f7ada5dc740 20 client.17121 trim_cache size 0 max 16384 2024-08-31T06:53:32.058 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:53:32.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 -- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ab80b4cd0 msgr2=0x7f7ab80b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ab80b4cd0 0x7f7ab80b71e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4006010 tx=0x7f7ac40317d0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 -- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108170 msgr2=0x7f7acc19b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108170 0x7f7acc19b450 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00d770 tx=0x7f7abc00dc30 comp rx=0 tx=0).stop 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 -- 172.21.15.37:0/1732258427 shutdown_connections 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7ab80b4cd0 0x7f7ab80b71e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7acc108170 0x7f7acc19b450 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7acc108ac0 0x7f7acc19b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 --2- 172.21.15.37:0/1732258427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7acc102830 0x7f7acc19af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 -- 172.21.15.37:0/1732258427 >> 172.21.15.37:0/1732258427 conn(0x7f7acc0794f0 msgr2=0x7f7acc105030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 -- 172.21.15.37:0/1732258427 shutdown_connections 2024-08-31T06:53:32.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:32.052+0000 7f7ad4067640 1 -- 172.21.15.37:0/1732258427 wait complete. 2024-08-31T06:53:32.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:31 smithi106 ceph-mon[22134]: pgmap v522: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:53:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:31 smithi066 ceph-mon[22244]: pgmap v522: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:53:33.830 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:53:33.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:53:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:33 smithi106 ceph-mon[22134]: pgmap v523: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:53:34.095 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:53:34.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:33 smithi037 ceph-mon[18612]: pgmap v523: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:53:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:33 smithi066 ceph-mon[22244]: pgmap v523: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:53:34.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 -- 172.21.15.37:0/3638043078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109240 msgr2=0x7f2664109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 --2- 172.21.15.37:0/3638043078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109240 0x7f2664109650 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f2658009900 tx=0x7f265802a410 comp rx=0 tx=0).stop 2024-08-31T06:53:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 -- 172.21.15.37:0/3638043078 shutdown_connections 2024-08-31T06:53:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 --2- 172.21.15.37:0/3638043078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109240 0x7f2664109650 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 --2- 172.21.15.37:0/3638043078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2664109b90 0x7f26641103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 --2- 172.21.15.37:0/3638043078 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2664103900 0x7f2664103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 -- 172.21.15.37:0/3638043078 >> 172.21.15.37:0/3638043078 conn(0x7f266407b5f0 msgr2=0x7f266407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 -- 172.21.15.37:0/3638043078 shutdown_connections 2024-08-31T06:53:34.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.573+0000 7f266ae5c640 1 -- 172.21.15.37:0/3638043078 wait complete. 2024-08-31T06:53:34.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f266ae5c640 1 Processor -- start 2024-08-31T06:53:34.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f266ae5c640 1 -- start start 2024-08-31T06:53:34.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f266ae5c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2664103900 0x7f266419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f266ae5c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2664109240 0x7f266419a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f266ae5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109b90 0x7f266419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f266ae5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26641137a0 con 0x7f2664109b90 2024-08-31T06:53:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f266ae5c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2664113620 con 0x7f2664103900 2024-08-31T06:53:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f266ae5c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2664113920 con 0x7f2664109240 2024-08-31T06:53:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f26693f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109b90 0x7f266419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f26693f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109b90 0x7f266419fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42466/0 (socket says 172.21.15.37:42466) 2024-08-31T06:53:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.574+0000 7f26693f9640 1 -- 172.21.15.37:0/1404933539 learned_addr learned my addr 172.21.15.37:0/1404933539 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f2663fff640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2664109240 0x7f266419a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f2668bf8640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2664103900 0x7f266419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f26693f9640 1 -- 172.21.15.37:0/1404933539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2664109240 msgr2=0x7f266419a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f26693f9640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2664109240 0x7f266419a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f26693f9640 1 -- 172.21.15.37:0/1404933539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2664103900 msgr2=0x7f266419a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f26693f9640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2664103900 0x7f266419a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f26693f9640 1 -- 172.21.15.37:0/1404933539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26641a0260 con 0x7f2664109b90 2024-08-31T06:53:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f2668bf8640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2664103900 0x7f266419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f26693f9640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109b90 0x7f266419fb30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f265c00b970 tx=0x7f265c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f2661ffb640 1 -- 172.21.15.37:0/1404933539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c019070 con 0x7f2664109b90 2024-08-31T06:53:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f266ae5c640 1 -- 172.21.15.37:0/1404933539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26641a0550 con 0x7f2664109b90 2024-08-31T06:53:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f2661ffb640 1 -- 172.21.15.37:0/1404933539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f265c014440 con 0x7f2664109b90 2024-08-31T06:53:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f2661ffb640 1 -- 172.21.15.37:0/1404933539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c0075d0 con 0x7f2664109b90 2024-08-31T06:53:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.575+0000 7f266ae5c640 1 -- 172.21.15.37:0/1404933539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26641a6cb0 con 0x7f2664109b90 2024-08-31T06:53:34.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f26713d1740 1 Processor -- start 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f2661ffb640 1 -- 172.21.15.37:0/1404933539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f265c01c070 con 0x7f2664109b90 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f26713d1740 1 -- start start 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f26713d1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af202780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f26713d1740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 0x55b7af202cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f26713d1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af203200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f26713d1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b7af1785f0 con 0x55b7aee5c350 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f26713d1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b7af167b80 con 0x55b7aee3b670 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f26713d1740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b7af16bb30 con 0x55b7aee33490 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f2663fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af202780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f2663fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af202780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42480/0 (socket says 172.21.15.37:42480) 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.578+0000 7f2663fff640 1 -- 172.21.15.37:0/1227531128 learned_addr learned my addr 172.21.15.37:0/1227531128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2668bf8640 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 0x55b7af202cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2663fff640 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af203200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2663fff640 1 -- 172.21.15.37:0/1227531128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 msgr2=0x55b7af202cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2663fff640 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 0x55b7af202cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2663fff640 1 -- 172.21.15.37:0/1227531128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 msgr2=0x55b7af203200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2663fff640 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af203200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2663fff640 1 -- 172.21.15.37:0/1227531128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7aeec7930 con 0x55b7aee5c350 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2661ffb640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f264c0b4ca0 0x7f264c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2663fff640 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af202780 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f26580057c0 tx=0x7f2658005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0a4e76ad23aae4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2668bf8640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f264c0b4ca0 0x7f264c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f264affd640 1 -- 172.21.15.37:0/1227531128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658035070 con 0x55b7aee5c350 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f2661ffb640 1 -- 172.21.15.37:0/1404933539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f265c0e49a0 con 0x7f2664109b90 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f264affd640 1 -- 172.21.15.37:0/1227531128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26580044c0 con 0x55b7aee5c350 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.579+0000 7f264affd640 1 -- 172.21.15.37:0/1227531128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658003cf0 con 0x55b7aee5c350 2024-08-31T06:53:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.580+0000 7f26713d1740 1 -- 172.21.15.37:0/1227531128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 msgr2=0x55b7af202780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.580+0000 7f2668bf8640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f264c0b4ca0 0x7f264c0b71b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55b7af201400 tx=0x7f2654008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.580+0000 7f26713d1740 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af202780 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f26580057c0 tx=0x7f2658005fd0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 -- 172.21.15.37:0/1227531128 shutdown_connections 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af203200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 0x55b7af202cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 --2- 172.21.15.37:0/1227531128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af202780 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 -- 172.21.15.37:0/1227531128 >> 172.21.15.37:0/1227531128 conn(0x55b7aee50740 msgr2=0x55b7af200670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 -- 172.21.15.37:0/1227531128 shutdown_connections 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 -- 172.21.15.37:0/1227531128 wait complete. 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 -- start start 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.581+0000 7f26713d1740 1 Processor -- start 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f26713d1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee33490 0x55b7af20df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f26713d1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af20e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f26713d1740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 0x55b7af21a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f26713d1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b7aefca890 con 0x55b7aee33490 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f26713d1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b7af0ee790 con 0x55b7aee3b670 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f26713d1740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b7af210f00 con 0x55b7aee5c350 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f26713d1740 10 client.0 _ll_register_callbacks cb 0x55b7aee73ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2668bf8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee33490 0x55b7af20df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2668bf8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee33490 0x55b7af20df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42494/0 (socket says 172.21.15.37:42494) 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2668bf8640 1 -- 172.21.15.37:0/2454128733 learned_addr learned my addr 172.21.15.37:0/2454128733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f26693f9640 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 0x55b7af21a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2663fff640 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af20e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2668bf8640 1 -- 172.21.15.37:0/2454128733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 msgr2=0x55b7af21a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2668bf8640 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 0x55b7af21a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2668bf8640 1 -- 172.21.15.37:0/2454128733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 msgr2=0x55b7af20e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2668bf8640 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af20e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.582+0000 7f2668bf8640 1 -- 172.21.15.37:0/2454128733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7af125f30 con 0x55b7aee33490 2024-08-31T06:53:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f2668bf8640 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee33490 0x55b7af20df60 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f26540167f0 tx=0x7f26540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68b07be692a8798 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f2643fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f2643fff640 1 -- 172.21.15.37:0/2454128733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265401c050 con 0x55b7aee33490 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f2643fff640 1 -- 172.21.15.37:0/2454128733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f2654014930 con 0x55b7aee33490 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f26713d1740 1 -- 172.21.15.37:0/2454128733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b7af17a540 con 0x55b7aee33490 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f2643fff640 1 -- 172.21.15.37:0/2454128733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2654014b30 con 0x55b7aee33490 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f26713d1740 10 client.17133 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f26713d1740 1 -- 172.21.15.37:0/2454128733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b7af21cdc0 con 0x55b7aee33490 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.583+0000 7f2643fff640 1 -- 172.21.15.37:0/2454128733 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b7af17a540 con 0x55b7aee33490 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.584+0000 7f2643fff640 1 -- 172.21.15.37:0/2454128733 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2654006350 con 0x55b7aee33490 2024-08-31T06:53:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.584+0000 7f26713d1740 10 client.17133 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.584+0000 7f26713d1740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.584+0000 7f26713d1740 20 client.17133 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.584+0000 7f26713d1740 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b7aee1acd0 0x55b7af220370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.584+0000 7f26713d1740 4 client.17133 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.584+0000 7f26713d1740 1 -- 172.21.15.37:0/2454128733 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7af175fe0 con 0x55b7aee1acd0 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.584+0000 7f2663fff640 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b7aee1acd0 0x55b7af220370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.585+0000 7f2643fff640 10 client.17133 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.585+0000 7f2663fff640 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b7aee1acd0 0x55b7af220370 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf6d8e086595692 server_cookie=21bab7724bd902d9 in_seq=0 out_seq=0 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.585+0000 7f2643fff640 1 -- 172.21.15.37:0/2454128733 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b7af175fe0 con 0x55b7aee1acd0 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.585+0000 7f2643fff640 10 client.17133 handle_command_reply: tid=0 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.585+0000 7f26713d1740 1 client.17133 shutdown 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.585+0000 7f26713d1740 1 -- 172.21.15.37:0/2454128733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee33490 msgr2=0x55b7af20df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.585+0000 7f26713d1740 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee33490 0x55b7af20df60 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f26540167f0 tx=0x7f26540046c0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 1 -- 172.21.15.37:0/2454128733 shutdown_connections 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b7aee1acd0 0x55b7af220370 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 0x55b7af21a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af20e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 1 --2- 172.21.15.37:0/2454128733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee33490 0x55b7af20df60 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 1 -- 172.21.15.37:0/2454128733 >> 172.21.15.37:0/2454128733 conn(0x55b7aee50740 msgr2=0x55b7af205960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f2643fff640 0 client.17133 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 1 -- 172.21.15.37:0/2454128733 shutdown_connections 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 1 -- 172.21.15.37:0/2454128733 wait complete. 2024-08-31T06:53:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.586+0000 7f26713d1740 20 client.17133 trim_cache size 0 max 16384 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26713d1740 1 Processor -- start 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26713d1740 1 -- start start 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26713d1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee33490 0x55b7af209710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26713d1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee3b670 0x55b7af205f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26713d1740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 0x55b7af20b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26713d1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26641b1d90 con 0x55b7aee3b670 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26713d1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26641af660 con 0x55b7aee33490 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26713d1740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f26641ad4d0 con 0x55b7aee5c350 2024-08-31T06:53:34.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f2663fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee3b670 0x55b7af205f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f2663fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee3b670 0x55b7af205f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42502/0 (socket says 172.21.15.37:42502) 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f2663fff640 1 -- 172.21.15.37:0/1492275927 learned_addr learned my addr 172.21.15.37:0/1492275927 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f2668bf8640 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee33490 0x55b7af209710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f26693f9640 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 0x55b7af20b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f2663fff640 1 -- 172.21.15.37:0/1492275927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 msgr2=0x55b7af20b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.604+0000 7f2663fff640 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 0x55b7af20b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.605+0000 7f2663fff640 1 -- 172.21.15.37:0/1492275927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee33490 msgr2=0x55b7af209710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.605+0000 7f2663fff640 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee33490 0x55b7af209710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.605+0000 7f2663fff640 1 -- 172.21.15.37:0/1492275927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7af20f220 con 0x55b7aee3b670 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.605+0000 7f2663fff640 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee3b670 0x55b7af205f90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f265802a930 tx=0x7f2658005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9bf20065ed065a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.605+0000 7f264a7fc640 1 -- 172.21.15.37:0/1492275927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658035040 con 0x55b7aee3b670 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.605+0000 7f264a7fc640 1 -- 172.21.15.37:0/1492275927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f265803b8f0 con 0x55b7aee3b670 2024-08-31T06:53:34.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.605+0000 7f264a7fc640 1 -- 172.21.15.37:0/1492275927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265804b680 con 0x55b7aee3b670 2024-08-31T06:53:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 -- 172.21.15.37:0/1492275927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee3b670 msgr2=0x55b7af205f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee3b670 0x55b7af205f90 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f265802a930 tx=0x7f2658005e00 comp rx=0 tx=0).stop 2024-08-31T06:53:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 -- 172.21.15.37:0/1492275927 shutdown_connections 2024-08-31T06:53:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee3b670 0x55b7af205f90 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee5c350 0x55b7af20b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 --2- 172.21.15.37:0/1492275927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee33490 0x55b7af209710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 -- 172.21.15.37:0/1492275927 >> 172.21.15.37:0/1492275927 conn(0x55b7aee50740 msgr2=0x55b7af205880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 -- 172.21.15.37:0/1492275927 shutdown_connections 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 -- 172.21.15.37:0/1492275927 wait complete. 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 -- start start 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.606+0000 7f26713d1740 1 Processor -- start 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26713d1740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 0x55b7af212590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26713d1740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af212b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26713d1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af289d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26713d1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f26641adb20 con 0x55b7aee5c350 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26713d1740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f26641aef90 con 0x55b7aee3b670 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26713d1740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f26641ae1f0 con 0x55b7aee33490 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26713d1740 10 client.0 _ll_register_callbacks cb 0x7f26540164a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af289d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af289d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42514/0 (socket says 172.21.15.37:42514) 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 -- 172.21.15.37:0/2391257921 learned_addr learned my addr 172.21.15.37:0/2391257921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f2663fff640 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af212b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f2668bf8640 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 0x55b7af212590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 -- 172.21.15.37:0/2391257921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 msgr2=0x55b7af212590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 0x55b7af212590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 -- 172.21.15.37:0/2391257921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 msgr2=0x55b7af212b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af212b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 -- 172.21.15.37:0/2391257921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7af28a270 con 0x55b7aee5c350 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f26693f9640 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af289d30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f265c0e21b0 tx=0x7f265c0aad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab23290c762dbe4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.607+0000 7f2643fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f2643fff640 1 -- 172.21.15.37:0/2391257921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c0b43c0 con 0x55b7aee5c350 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f2643fff640 1 -- 172.21.15.37:0/2391257921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f265c0b3f30 con 0x55b7aee5c350 2024-08-31T06:53:34.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 1 -- 172.21.15.37:0/2391257921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f265803b8f0 con 0x55b7aee5c350 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f2643fff640 1 -- 172.21.15.37:0/2391257921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f265c0b4130 con 0x55b7aee5c350 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 10 client.17139 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 1 -- 172.21.15.37:0/2391257921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b7af28b460 con 0x55b7aee5c350 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f2643fff640 1 -- 172.21.15.37:0/2391257921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f265803b8f0 con 0x55b7aee5c350 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f2643fff640 1 -- 172.21.15.37:0/2391257921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f265c0aa540 con 0x55b7aee5c350 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 10 client.17139 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 20 client.17139 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b7aedf0080 0x55b7af28dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 4 client.17139 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f26713d1740 1 -- 172.21.15.37:0/2391257921 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b7af173720 con 0x55b7aedf0080 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.608+0000 7f2668bf8640 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b7aedf0080 0x55b7af28dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.609+0000 7f2668bf8640 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b7aedf0080 0x55b7af28dbc0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2ea29a48b03025b server_cookie=a738348a9924c840 in_seq=0 out_seq=0 2024-08-31T06:53:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.609+0000 7f2643fff640 10 client.17139 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:34.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f2643fff640 1 -- 172.21.15.37:0/2391257921 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b7af173720 con 0x55b7aedf0080 2024-08-31T06:53:34.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f2643fff640 10 client.17139 handle_command_reply: tid=0 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 client.17139 shutdown 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 -- 172.21.15.37:0/2391257921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 msgr2=0x55b7af289d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af289d30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f265c0e21b0 tx=0x7f265c0aad30 comp rx=0 tx=0).stop 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 -- 172.21.15.37:0/2391257921 shutdown_connections 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b7aedf0080 0x55b7af28dbc0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b7aee5c350 0x55b7af289d30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b7aee3b670 0x55b7af212b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 --2- 172.21.15.37:0/2391257921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b7aee33490 0x55b7af212590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 -- 172.21.15.37:0/2391257921 >> 172.21.15.37:0/2391257921 conn(0x55b7aee50740 msgr2=0x55b7af206010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f2643fff640 0 client.17139 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 -- 172.21.15.37:0/2391257921 shutdown_connections 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 1 -- 172.21.15.37:0/2391257921 wait complete. 2024-08-31T06:53:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.611+0000 7f26713d1740 20 client.17139 trim_cache size 0 max 16384 2024-08-31T06:53:34.616 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:53:34.616 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:53:34.616 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "0e98be92-c53a-4308-8d00-e98ba735e9d7", 2024-08-31T06:53:34.616 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:53:34.616 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:53:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 -- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f264c0b4ca0 msgr2=0x7f264c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f264c0b4ca0 0x7f264c0b71b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x55b7af201400 tx=0x7f2654008040 comp rx=0 tx=0).stop 2024-08-31T06:53:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 -- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109b90 msgr2=0x7f266419fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109b90 0x7f266419fb30 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f265c00b970 tx=0x7f265c00be30 comp rx=0 tx=0).stop 2024-08-31T06:53:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 -- 172.21.15.37:0/1404933539 shutdown_connections 2024-08-31T06:53:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f264c0b4ca0 0x7f264c0b71b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2664109b90 0x7f266419fb30 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2664109240 0x7f266419a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 --2- 172.21.15.37:0/1404933539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2664103900 0x7f266419a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 -- 172.21.15.37:0/1404933539 >> 172.21.15.37:0/1404933539 conn(0x7f266407b5f0 msgr2=0x7f2664107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 -- 172.21.15.37:0/1404933539 shutdown_connections 2024-08-31T06:53:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:34.612+0000 7f266ae5c640 1 -- 172.21.15.37:0/1404933539 wait complete. 2024-08-31T06:53:34.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:34 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:53:34.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:34 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:53:34.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:34 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:53:34.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:34 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:53:35.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:34 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:53:35.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:34 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:53:35.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:34 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:53:35.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:34 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:53:35.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:34 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:53:35.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:34 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:53:35.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:34 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:53:35.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:34 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:53:35.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:53:35.561 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:53:35.932 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:35 smithi037 ceph-mon[18612]: pgmap v524: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:53:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 -- 172.21.15.37:0/3723315454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 msgr2=0x7efe6c10d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 --2- 172.21.15.37:0/3723315454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 0x7efe6c10d690 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7efe60009900 tx=0x7efe6002a410 comp rx=0 tx=0).stop 2024-08-31T06:53:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 -- 172.21.15.37:0/3723315454 shutdown_connections 2024-08-31T06:53:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 --2- 172.21.15.37:0/3723315454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 0x7efe6c10d690 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 --2- 172.21.15.37:0/3723315454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe6c10dbd0 0x7efe6c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 --2- 172.21.15.37:0/3723315454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6c104620 0x7efe6c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 -- 172.21.15.37:0/3723315454 >> 172.21.15.37:0/3723315454 conn(0x7efe6c079500 msgr2=0x7efe6c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:36.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 -- 172.21.15.37:0/3723315454 shutdown_connections 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.021+0000 7efe72823640 1 -- 172.21.15.37:0/3723315454 wait complete. 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe72823640 1 Processor -- start 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe72823640 1 -- start start 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe72823640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe6c104620 0x7efe6c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe72823640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 0x7efe6c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe72823640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6c10dbd0 0x7efe6c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe72823640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c1136a0 con 0x7efe6c105050 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe72823640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c113520 con 0x7efe6c104620 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe72823640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c113820 con 0x7efe6c10dbd0 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 0x7efe6c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 0x7efe6c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42528/0 (socket says 172.21.15.37:42528) 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe6b7fe640 1 -- 172.21.15.37:0/3596910369 learned_addr learned my addr 172.21.15.37:0/3596910369 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:36.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe70dc0640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6c10dbd0 0x7efe6c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.022+0000 7efe6bfff640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe6c104620 0x7efe6c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe6b7fe640 1 -- 172.21.15.37:0/3596910369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6c10dbd0 msgr2=0x7efe6c19f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6c10dbd0 0x7efe6c19f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe6b7fe640 1 -- 172.21.15.37:0/3596910369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe6c104620 msgr2=0x7efe6c19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe6c104620 0x7efe6c19a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe6b7fe640 1 -- 172.21.15.37:0/3596910369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6c1a00c0 con 0x7efe6c105050 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 0x7efe6c19a6f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7efe60005940 tx=0x7efe600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe697fa640 1 -- 172.21.15.37:0/3596910369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6003f030 con 0x7efe6c105050 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe72823640 1 -- 172.21.15.37:0/3596910369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6c1a0350 con 0x7efe6c105050 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe697fa640 1 -- 172.21.15.37:0/3596910369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe60003c90 con 0x7efe6c105050 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe697fa640 1 -- 172.21.15.37:0/3596910369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60035070 con 0x7efe6c105050 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.023+0000 7efe72823640 1 -- 172.21.15.37:0/3596910369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6c1a6b10 con 0x7efe6c105050 2024-08-31T06:53:36.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe78d98740 1 Processor -- start 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe78d98740 1 -- start start 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe697fa640 1 -- 172.21.15.37:0/3596910369 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7efe60042030 con 0x7efe6c105050 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe78d98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea4e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe78d98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6801b0 0x55db1ea4e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe78d98740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 0x55db1ea4ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe78d98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55db1e9c5630 con 0x55db1e6801b0 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe78d98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55db1e9b4bc0 con 0x55db1e6a9070 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe78d98740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55db1e9b8b70 con 0x55db1e688390 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6801b0 0x55db1ea4e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.026+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6801b0 0x55db1ea4e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42532/0 (socket says 172.21.15.37:42532) 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6bfff640 1 -- 172.21.15.37:0/2473694342 learned_addr learned my addr 172.21.15.37:0/2473694342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe70dc0640 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea4e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 0x55db1ea4ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6bfff640 1 -- 172.21.15.37:0/2473694342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 msgr2=0x55db1ea4ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 0x55db1ea4ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6bfff640 1 -- 172.21.15.37:0/2473694342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 msgr2=0x55db1ea4e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea4e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6bfff640 1 -- 172.21.15.37:0/2473694342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1e714650 con 0x55db1e6801b0 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe70dc0640 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea4e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 0x55db1ea4ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6801b0 0x55db1ea4e840 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00b790 tx=0x7efe5c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29faa93a670e88c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe697fa640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe540b4ca0 0x7efe540b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe527fc640 1 -- 172.21.15.37:0/2473694342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c003dd0 con 0x55db1e6801b0 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe70dc0640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe540b4ca0 0x7efe540b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe527fc640 1 -- 172.21.15.37:0/2473694342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe5c015070 con 0x55db1e6801b0 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe697fa640 1 -- 172.21.15.37:0/3596910369 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7efe60105a00 con 0x7efe6c105050 2024-08-31T06:53:36.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.027+0000 7efe527fc640 1 -- 172.21.15.37:0/2473694342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c004cf0 con 0x55db1e6801b0 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 -- 172.21.15.37:0/2473694342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6801b0 msgr2=0x55db1ea4e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe70dc0640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe540b4ca0 0x7efe540b71b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efe64005fd0 tx=0x7efe64009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6801b0 0x55db1ea4e840 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00b790 tx=0x7efe5c00bc50 comp rx=0 tx=0).stop 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 -- 172.21.15.37:0/2473694342 shutdown_connections 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6801b0 0x55db1ea4e840 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 0x55db1ea4ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 --2- 172.21.15.37:0/2473694342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea4e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 -- 172.21.15.37:0/2473694342 >> 172.21.15.37:0/2473694342 conn(0x55db1e69d460 msgr2=0x55db1ea4c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 -- 172.21.15.37:0/2473694342 shutdown_connections 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.028+0000 7efe78d98740 1 -- 172.21.15.37:0/2473694342 wait complete. 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.029+0000 7efe78d98740 1 -- start start 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.029+0000 7efe78d98740 1 Processor -- start 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.029+0000 7efe78d98740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea5de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.029+0000 7efe78d98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e688390 0x55db1ea5e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.029+0000 7efe78d98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea6a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe78d98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55db1e817700 con 0x55db1e688390 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe78d98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55db1e93b700 con 0x55db1e6a9070 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe78d98740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55db1ea60e10 con 0x55db1e6801b0 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe78d98740 10 client.0 _ll_register_callbacks cb 0x55db1e96adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e688390 0x55db1ea5e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e688390 0x55db1ea5e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42540/0 (socket says 172.21.15.37:42540) 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 -- 172.21.15.37:0/2072022971 learned_addr learned my addr 172.21.15.37:0/2072022971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea5de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe70dc0640 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea6a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 -- 172.21.15.37:0/2072022971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 msgr2=0x55db1ea5de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea5de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 -- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 msgr2=0x55db1ea6a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea6a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 -- 172.21.15.37:0/2072022971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1e9748b0 con 0x55db1e688390 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe70dc0640 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea6a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e688390 0x55db1ea5e3c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7efe60000c00 tx=0x7efe60103660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4078cd9e761c38 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe4b7fe640 1 -- 172.21.15.37:0/2072022971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60049070 con 0x55db1e688390 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe78d98740 1 -- 172.21.15.37:0/2072022971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe5c015070 con 0x55db1e688390 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.030+0000 7efe4b7fe640 1 -- 172.21.15.37:0/2072022971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7efe600cc410 con 0x55db1e688390 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe4b7fe640 1 -- 172.21.15.37:0/2072022971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe600cbb00 con 0x55db1e688390 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe78d98740 10 client.17151 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe78d98740 1 -- 172.21.15.37:0/2072022971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db1ea6cc50 con 0x55db1e688390 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe4b7fe640 1 -- 172.21.15.37:0/2072022971 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe5c015070 con 0x55db1e688390 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe4b7fe640 1 -- 172.21.15.37:0/2072022971 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe600d4f90 con 0x55db1e688390 2024-08-31T06:53:36.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe78d98740 10 client.17151 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe78d98740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe78d98740 20 client.17151 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe78d98740 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55db1e6679f0 0x55db1ea70140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe78d98740 4 client.17151 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe78d98740 1 -- 172.21.15.37:0/2072022971 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db1e9c7580 con 0x55db1e6679f0 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.031+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55db1e6679f0 0x55db1ea70140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.032+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55db1e6679f0 0x55db1ea70140 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=286f6014ae5e388 server_cookie=422be65e1793fba5 in_seq=0 out_seq=0 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.032+0000 7efe4b7fe640 10 client.17151 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe4b7fe640 1 -- 172.21.15.37:0/2072022971 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db1e9c7580 con 0x55db1e6679f0 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe4b7fe640 10 client.17151 handle_command_reply: tid=0 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 client.17151 shutdown 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 -- 172.21.15.37:0/2072022971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e688390 msgr2=0x55db1ea5e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e688390 0x55db1ea5e3c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7efe60000c00 tx=0x7efe60103660 comp rx=0 tx=0).stop 2024-08-31T06:53:36.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 -- 172.21.15.37:0/2072022971 shutdown_connections 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55db1e6679f0 0x55db1ea70140 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e688390 0x55db1ea5e3c0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6a9070 0x55db1ea6a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 --2- 172.21.15.37:0/2072022971 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea5de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe4b7fe640 0 client.17151 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 -- 172.21.15.37:0/2072022971 >> 172.21.15.37:0/2072022971 conn(0x55db1e69d460 msgr2=0x55db1ea51490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 -- 172.21.15.37:0/2072022971 shutdown_connections 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 1 -- 172.21.15.37:0/2072022971 wait complete. 2024-08-31T06:53:36.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.033+0000 7efe78d98740 20 client.17151 trim_cache size 0 max 16384 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.051+0000 7efe78d98740 1 Processor -- start 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.051+0000 7efe78d98740 1 -- start start 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe78d98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea5e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe78d98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6801b0 0x55db1ea6a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe78d98740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 0x55db1ea5b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe78d98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c1af9b0 con 0x55db1e6679f0 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe78d98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c1ad280 con 0x55db1e6801b0 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe78d98740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c1ab0f0 con 0x55db1e688390 2024-08-31T06:53:36.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea5e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea5e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42550/0 (socket says 172.21.15.37:42550) 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 -- 172.21.15.37:0/2285637846 learned_addr learned my addr 172.21.15.37:0/2285637846 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 -- 172.21.15.37:0/2285637846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 msgr2=0x55db1ea5b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2285637846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 0x55db1ea5b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 -- 172.21.15.37:0/2285637846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6801b0 msgr2=0x55db1ea6a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2285637846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6801b0 0x55db1ea6a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 -- 172.21.15.37:0/2285637846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1ea523b0 con 0x55db1e6679f0 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe6bfff640 1 --2- 172.21.15.37:0/2285637846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea5e460 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0044d0 tx=0x7efe5c00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158420a0d4e42943 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe51ffb640 1 -- 172.21.15.37:0/2285637846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c011640 con 0x55db1e6679f0 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe51ffb640 1 -- 172.21.15.37:0/2285637846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe5c015040 con 0x55db1e6679f0 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.052+0000 7efe51ffb640 1 -- 172.21.15.37:0/2285637846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c019880 con 0x55db1e6679f0 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 -- 172.21.15.37:0/2285637846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 msgr2=0x55db1ea5e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 --2- 172.21.15.37:0/2285637846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea5e460 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0044d0 tx=0x7efe5c00bf80 comp rx=0 tx=0).stop 2024-08-31T06:53:36.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 -- 172.21.15.37:0/2285637846 shutdown_connections 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 --2- 172.21.15.37:0/2285637846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e688390 0x55db1ea5b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 --2- 172.21.15.37:0/2285637846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e6801b0 0x55db1ea6a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 --2- 172.21.15.37:0/2285637846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea5e460 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 -- 172.21.15.37:0/2285637846 >> 172.21.15.37:0/2285637846 conn(0x55db1e69d460 msgr2=0x55db1ea5c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 -- 172.21.15.37:0/2285637846 shutdown_connections 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.053+0000 7efe78d98740 1 -- 172.21.15.37:0/2285637846 wait complete. 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 1 -- start start 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 1 Processor -- start 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea62700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e688390 0x55db1ea62c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c1ab740 con 0x55db1e6679f0 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c1acbb0 con 0x55db1e688390 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c1abe10 con 0x55db1e6801b0 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.054+0000 7efe78d98740 10 client.0 _ll_register_callbacks cb 0x7efe6003b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42556/0 (socket says 172.21.15.37:42556) 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 -- 172.21.15.37:0/3155764227 learned_addr learned my addr 172.21.15.37:0/3155764227 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe70dc0640 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e688390 0x55db1ea62c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea62700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 -- 172.21.15.37:0/3155764227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 msgr2=0x55db1ea62700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:36.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea62700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 -- 172.21.15.37:0/3155764227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e688390 msgr2=0x55db1ea62c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e688390 0x55db1ea62c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 -- 172.21.15.37:0/3155764227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db1ead9c30 con 0x55db1e6679f0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea62700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe6bfff640 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea621c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00bc90 tx=0x7efe5c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4582134527772ed7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe4b7fe640 1 -- 172.21.15.37:0/3155764227 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5c004020 con 0x55db1e6679f0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe4b7fe640 1 -- 172.21.15.37:0/3155764227 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7efe5c0195c0 con 0x55db1e6679f0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe78d98740 1 -- 172.21.15.37:0/3155764227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe5c015040 con 0x55db1e6679f0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.055+0000 7efe4b7fe640 1 -- 172.21.15.37:0/3155764227 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe5c0197c0 con 0x55db1e6679f0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe78d98740 10 client.17157 fetch_fsmap learned FSMap version 25 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe78d98740 1 -- 172.21.15.37:0/3155764227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db1eadaea0 con 0x55db1e6679f0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe4b7fe640 1 -- 172.21.15.37:0/3155764227 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe5c015040 con 0x55db1e6679f0 2024-08-31T06:53:36.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe4b7fe640 1 -- 172.21.15.37:0/3155764227 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe5c0118b0 con 0x55db1e6679f0 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe78d98740 10 client.17157 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe78d98740 10 client.17157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe78d98740 20 client.17157 populate_metadata read hostname 'smithi037' 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe78d98740 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55db1e6a9070 0x55db1eadd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe78d98740 4 client.17157 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe78d98740 1 -- 172.21.15.37:0/3155764227 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55db1e9c3020 con 0x55db1e6a9070 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.056+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55db1e6a9070 0x55db1eadd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe6b7fe640 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55db1e6a9070 0x55db1eadd380 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0ad04ec9b8b3447 server_cookie=b69ea84179f8eff2 in_seq=0 out_seq=0 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe4b7fe640 10 client.17157 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe4b7fe640 1 -- 172.21.15.37:0/3155764227 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x7efe60049e80 con 0x55db1e6a9070 2024-08-31T06:53:36.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe4b7fe640 10 client.17157 handle_command_reply: tid=0 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 client.17157 shutdown 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 -- 172.21.15.37:0/3155764227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 msgr2=0x55db1ea621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea621c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7efe5c00bc90 tx=0x7efe5c0046d0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 -- 172.21.15.37:0/3155764227 shutdown_connections 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55db1e6a9070 0x55db1eadd380 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55db1e688390 0x55db1ea62c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db1e6801b0 0x55db1ea62700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 --2- 172.21.15.37:0/3155764227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55db1e6679f0 0x55db1ea621c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 -- 172.21.15.37:0/3155764227 >> 172.21.15.37:0/3155764227 conn(0x55db1e69d460 msgr2=0x55db1ea4f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe4b7fe640 0 client.17157 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 -- 172.21.15.37:0/3155764227 shutdown_connections 2024-08-31T06:53:36.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 1 -- 172.21.15.37:0/3155764227 wait complete. 2024-08-31T06:53:36.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.057+0000 7efe78d98740 20 client.17157 trim_cache size 0 max 16384 2024-08-31T06:53:36.067 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:53:36.067 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:53:36.067 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:53:36.067 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:53:36.067 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "0e98be92-c53a-4308-8d00-e98ba735e9d7", 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.068 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.069 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:53:36.070 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.071 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.072 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:53:36.073 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.074 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:53:36.075 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:53:36.076 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:35 smithi106 ceph-mon[22134]: pgmap v524: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:53:36.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 -- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe540b4ca0 msgr2=0x7efe540b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe540b4ca0 0x7efe540b71b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7efe64005fd0 tx=0x7efe64009600 comp rx=0 tx=0).stop 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 -- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 msgr2=0x7efe6c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 0x7efe6c19a6f0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7efe60005940 tx=0x7efe600042f0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 -- 172.21.15.37:0/3596910369 shutdown_connections 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe540b4ca0 0x7efe540b71b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe6c105050 0x7efe6c19a6f0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6c10dbd0 0x7efe6c19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 --2- 172.21.15.37:0/3596910369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe6c104620 0x7efe6c19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 -- 172.21.15.37:0/3596910369 >> 172.21.15.37:0/3596910369 conn(0x7efe6c079500 msgr2=0x7efe6c100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 -- 172.21.15.37:0/3596910369 shutdown_connections 2024-08-31T06:53:36.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:53:36.058+0000 7efe72823640 1 -- 172.21.15.37:0/3596910369 wait complete. 2024-08-31T06:53:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:35 smithi066 ceph-mon[22244]: pgmap v524: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:53:36.913 INFO:tasks.cephfs.filesystem:scrub status for tag:0e98be92-c53a-4308-8d00-e98ba735e9d7 - {'path': '/', 'tag': '0e98be92-c53a-4308-8d00-e98ba735e9d7', 'options': 'recursive,force'} 2024-08-31T06:53:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:37 smithi106 ceph-mon[22134]: pgmap v525: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-08-31T06:53:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:37 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:53:38.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:37 smithi037 ceph-mon[18612]: pgmap v525: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-08-31T06:53:38.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:37 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:53:38.140 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:37 smithi066 ceph-mon[22244]: pgmap v525: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 7 op/s 2024-08-31T06:53:38.141 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:37 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:53:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:39 smithi106 ceph-mon[22134]: pgmap v526: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:53:40.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:39 smithi037 ceph-mon[18612]: pgmap v526: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:53:40.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:39 smithi066 ceph-mon[22244]: pgmap v526: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:53:42.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:41 smithi106 ceph-mon[22134]: pgmap v527: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:53:42.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:41 smithi037 ceph-mon[18612]: pgmap v527: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:53:42.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:41 smithi066 ceph-mon[22244]: pgmap v527: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:53:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:43 smithi106 ceph-mon[22134]: pgmap v528: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T06:53:44.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:43 smithi037 ceph-mon[18612]: pgmap v528: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T06:53:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:43 smithi066 ceph-mon[22244]: pgmap v528: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T06:53:46.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:45 smithi106 ceph-mon[22134]: pgmap v529: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:53:46.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:45 smithi037 ceph-mon[18612]: pgmap v529: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:53:46.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:45 smithi066 ceph-mon[22244]: pgmap v529: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:53:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:47 smithi106 ceph-mon[22134]: pgmap v530: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:53:48.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:47 smithi037 ceph-mon[18612]: pgmap v530: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:53:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:47 smithi066 ceph-mon[22244]: pgmap v530: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:53:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:49 smithi106 ceph-mon[22134]: pgmap v531: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-08-31T06:53:50.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:49 smithi037 ceph-mon[18612]: pgmap v531: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-08-31T06:53:50.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:49 smithi066 ceph-mon[22244]: pgmap v531: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-08-31T06:53:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:51 smithi106 ceph-mon[22134]: pgmap v532: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:53:52.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:51 smithi037 ceph-mon[18612]: pgmap v532: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:53:52.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:51 smithi066 ceph-mon[22244]: pgmap v532: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:53:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:53 smithi106 ceph-mon[22134]: pgmap v533: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:53:54.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:53 smithi037 ceph-mon[18612]: pgmap v533: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:53:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:53 smithi066 ceph-mon[22244]: pgmap v533: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:53:56.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:55 smithi106 ceph-mon[22134]: pgmap v534: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:53:56.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:55 smithi037 ceph-mon[18612]: pgmap v534: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:53:56.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:55 smithi066 ceph-mon[22244]: pgmap v534: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:53:58.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:57 smithi106 ceph-mon[22134]: pgmap v535: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:53:58.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:57 smithi037 ceph-mon[18612]: pgmap v535: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:53:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:57 smithi066 ceph-mon[22244]: pgmap v535: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:54:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: pgmap v536: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:54:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:54:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:54:00.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:53:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:54:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: pgmap v536: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:54:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:54:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:54:00.106 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:53:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:54:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: pgmap v536: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:54:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:54:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:54:00.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:53:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:54:01.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:00 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-08-31T06:54:01.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:00 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi037 to 177.0M 2024-08-31T06:54:01.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:00 smithi106 ceph-mon[22134]: Adjusting osd_memory_target on smithi106 to 176.0M 2024-08-31T06:54:01.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:00 smithi106 ceph-mon[22134]: Unable to set osd_memory_target on smithi066 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-08-31T06:54:01.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:00 smithi106 ceph-mon[22134]: Unable to set osd_memory_target on smithi037 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:54:01.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:00 smithi106 ceph-mon[22134]: Unable to set osd_memory_target on smithi106 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-08-31T06:54:01.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:00 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-08-31T06:54:01.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:00 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi037 to 177.0M 2024-08-31T06:54:01.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:00 smithi037 ceph-mon[18612]: Adjusting osd_memory_target on smithi106 to 176.0M 2024-08-31T06:54:01.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:00 smithi037 ceph-mon[18612]: Unable to set osd_memory_target on smithi066 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-08-31T06:54:01.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:00 smithi037 ceph-mon[18612]: Unable to set osd_memory_target on smithi037 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:54:01.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:00 smithi037 ceph-mon[18612]: Unable to set osd_memory_target on smithi106 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-08-31T06:54:01.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:00 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi066 to 176.0M 2024-08-31T06:54:01.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:00 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi037 to 177.0M 2024-08-31T06:54:01.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:00 smithi066 ceph-mon[22244]: Adjusting osd_memory_target on smithi106 to 176.0M 2024-08-31T06:54:01.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:00 smithi066 ceph-mon[22244]: Unable to set osd_memory_target on smithi066 to 184567398: error parsing value: Value '184567398' is below minimum 939524096 2024-08-31T06:54:01.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:00 smithi066 ceph-mon[22244]: Unable to set osd_memory_target on smithi037 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-08-31T06:54:01.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:00 smithi066 ceph-mon[22244]: Unable to set osd_memory_target on smithi106 to 184589619: error parsing value: Value '184589619' is below minimum 939524096 2024-08-31T06:54:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:01 smithi106 ceph-mon[22134]: pgmap v537: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:54:02.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:01 smithi037 ceph-mon[18612]: pgmap v537: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:54:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:01 smithi066 ceph-mon[22244]: pgmap v537: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:54:04.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:03 smithi106 ceph-mon[22134]: pgmap v538: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:54:04.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:03 smithi037 ceph-mon[18612]: pgmap v538: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:54:04.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:03 smithi066 ceph-mon[22244]: pgmap v538: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:54:06.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:05 smithi106 ceph-mon[22134]: pgmap v539: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:54:06.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:05 smithi037 ceph-mon[18612]: pgmap v539: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:54:06.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:05 smithi066 ceph-mon[22244]: pgmap v539: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:54:06.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:54:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:07.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 -- 172.21.15.37:0/2707695397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 msgr2=0x7f6da0102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 --2- 172.21.15.37:0/2707695397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 0x7f6da0102c10 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009900 tx=0x7f6d9402a3f0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 -- 172.21.15.37:0/2707695397 shutdown_connections 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 --2- 172.21.15.37:0/2707695397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da0108a90 0x7f6da010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 --2- 172.21.15.37:0/2707695397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da0108140 0x7f6da0108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 --2- 172.21.15.37:0/2707695397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 0x7f6da0102c10 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 -- 172.21.15.37:0/2707695397 >> 172.21.15.37:0/2707695397 conn(0x7f6da00794d0 msgr2=0x7f6da00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 -- 172.21.15.37:0/2707695397 shutdown_connections 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.677+0000 7f6da704f640 1 -- 172.21.15.37:0/2707695397 wait complete. 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da704f640 1 Processor -- start 2024-08-31T06:54:07.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da704f640 1 -- start start 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da704f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 0x7f6da019af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da704f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da0108140 0x7f6da019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da704f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da0108a90 0x7f6da019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da704f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01125a0 con 0x7f6da0102800 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da704f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0112420 con 0x7f6da0108140 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da704f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0112720 con 0x7f6da0108a90 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da4deb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 0x7f6da019af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da4deb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 0x7f6da019af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46880/0 (socket says 172.21.15.37:46880) 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da4deb640 1 -- 172.21.15.37:0/324697147 learned_addr learned my addr 172.21.15.37:0/324697147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da0108140 0x7f6da019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.678+0000 7f6da55ec640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da0108a90 0x7f6da019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da4deb640 1 -- 172.21.15.37:0/324697147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da0108a90 msgr2=0x7f6da019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da4deb640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da0108a90 0x7f6da019ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da4deb640 1 -- 172.21.15.37:0/324697147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da0108140 msgr2=0x7f6da019b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da4deb640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da0108140 0x7f6da019b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da4deb640 1 -- 172.21.15.37:0/324697147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da01a6210 con 0x7f6da0102800 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da55ec640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da0108a90 0x7f6da019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da0108140 0x7f6da019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da4deb640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 0x7f6da019af90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009a20 tx=0x7f6d94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6d9dffb640 1 -- 172.21.15.37:0/324697147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9403f030 con 0x7f6da0102800 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da704f640 1 -- 172.21.15.37:0/324697147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da01a64a0 con 0x7f6da0102800 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6d9dffb640 1 -- 172.21.15.37:0/324697147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d940035f0 con 0x7f6da0102800 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6d9dffb640 1 -- 172.21.15.37:0/324697147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d94035070 con 0x7f6da0102800 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.679+0000 7f6da704f640 1 -- 172.21.15.37:0/324697147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da01a69d0 con 0x7f6da0102800 2024-08-31T06:54:07.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.682+0000 7f6dad5c4740 1 Processor -- start 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.682+0000 7f6dad5c4740 1 -- start start 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.682+0000 7f6d9dffb640 1 -- 172.21.15.37:0/324697147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f6d94003aa0 con 0x7f6da0102800 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127c4070 0x560912b692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b69820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127a3390 0x560912b69d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560912ae0630 con 0x5609127a3390 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560912acfbc0 con 0x56091279b1b0 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560912ad3b70 con 0x5609127c4070 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127a3390 0x560912b69d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127a3390 0x560912b69d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46896/0 (socket says 172.21.15.37:46896) 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 -- 172.21.15.37:0/1743492816 learned_addr learned my addr 172.21.15.37:0/1743492816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6da4deb640 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b69820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6da55ec640 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127c4070 0x560912b692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 -- 172.21.15.37:0/1743492816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127c4070 msgr2=0x560912b692e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127c4070 0x560912b692e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 -- 172.21.15.37:0/1743492816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 msgr2=0x560912b69820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b69820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 -- 172.21.15.37:0/1743492816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56091282f650 con 0x5609127a3390 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6da4deb640 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b69820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.683+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127a3390 0x560912b69d60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00cc40 tx=0x7f6d8c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a40d4f8a3e3d8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.684+0000 7f6d9dffb640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d900b4ca0 0x7f6d900b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.684+0000 7f6da55ec640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d900b4ca0 0x7f6d900b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.684+0000 7f6d8affd640 1 -- 172.21.15.37:0/1743492816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c014070 con 0x5609127a3390 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.684+0000 7f6d8affd640 1 -- 172.21.15.37:0/1743492816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d8c0047a0 con 0x5609127a3390 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.684+0000 7f6d8affd640 1 -- 172.21.15.37:0/1743492816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c010690 con 0x5609127a3390 2024-08-31T06:54:07.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.684+0000 7f6d9dffb640 1 -- 172.21.15.37:0/324697147 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f6d94105fc0 con 0x7f6da0102800 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1743492816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127a3390 msgr2=0x560912b69d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127a3390 0x560912b69d60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00cc40 tx=0x7f6d8c00e720 comp rx=0 tx=0).stop 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6da55ec640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d900b4ca0 0x7f6d900b71b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6d98005cc0 tx=0x7f6d98008670 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1743492816 shutdown_connections 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127a3390 0x560912b69d60 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b69820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1743492816 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127c4070 0x560912b692e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1743492816 >> 172.21.15.37:0/1743492816 conn(0x5609127b8460 msgr2=0x560912b671d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1743492816 shutdown_connections 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1743492816 wait complete. 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.685+0000 7f6dad5c4740 1 -- start start 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6dad5c4740 1 Processor -- start 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b74a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 0x560912b74f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b851c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560912932700 con 0x5609127c4070 2024-08-31T06:54:07.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x560912a56700 con 0x5609127a3390 2024-08-31T06:54:07.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x560912b7bed0 con 0x56091279b1b0 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6dad5c4740 10 client.0 _ll_register_callbacks cb 0x560912a85dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6da55ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b851c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6da55ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b851c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46902/0 (socket says 172.21.15.37:46902) 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6da55ec640 1 -- 172.21.15.37:0/360441936 learned_addr learned my addr 172.21.15.37:0/360441936 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.686+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 0x560912b74f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6da4deb640 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b74a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6da55ec640 1 -- 172.21.15.37:0/360441936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 msgr2=0x560912b74a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6da55ec640 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b74a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6da55ec640 1 -- 172.21.15.37:0/360441936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 msgr2=0x560912b74f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6da55ec640 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 0x560912b74f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6da55ec640 1 -- 172.21.15.37:0/360441936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560912a8f8b0 con 0x5609127c4070 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6da4deb640 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b74a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:07.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6da55ec640 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b851c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6d9801bd20 tx=0x7f6d98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd632caf1e8bdac0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6d7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6d7ffff640 1 -- 172.21.15.37:0/360441936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98028060 con 0x5609127c4070 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6d7ffff640 1 -- 172.21.15.37:0/360441936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f6d98023410 con 0x5609127c4070 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6dad5c4740 1 -- 172.21.15.37:0/360441936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d8c0047a0 con 0x5609127c4070 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6d7ffff640 1 -- 172.21.15.37:0/360441936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6d98019e50 con 0x5609127c4070 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6dad5c4740 10 client.17169 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.687+0000 7f6dad5c4740 1 -- 172.21.15.37:0/360441936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560912b87ce0 con 0x5609127c4070 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6d7ffff640 1 -- 172.21.15.37:0/360441936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d8c0047a0 con 0x5609127c4070 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6d7ffff640 1 -- 172.21.15.37:0/360441936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6d98017040 con 0x5609127c4070 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6dad5c4740 10 client.17169 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6dad5c4740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:07.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6dad5c4740 20 client.17169 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5609127829f0 0x560912b8b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6dad5c4740 4 client.17169 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6dad5c4740 1 -- 172.21.15.37:0/360441936 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560912ae2580 con 0x5609127829f0 2024-08-31T06:54:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.688+0000 7f6da4deb640 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5609127829f0 0x560912b8b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.689+0000 7f6da4deb640 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5609127829f0 0x560912b8b280 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6b394feb52b5de7 server_cookie=f373d9b627e8dc77 in_seq=0 out_seq=0 2024-08-31T06:54:07.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.689+0000 7f6d7ffff640 10 client.17169 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6d7ffff640 1 -- 172.21.15.37:0/360441936 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560912ae2580 con 0x5609127829f0 2024-08-31T06:54:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6d7ffff640 10 client.17169 handle_command_reply: tid=0 2024-08-31T06:54:07.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 client.17169 shutdown 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 -- 172.21.15.37:0/360441936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 msgr2=0x560912b851c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b851c0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f6d9801bd20 tx=0x7f6d98004a40 comp rx=0 tx=0).stop 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 -- 172.21.15.37:0/360441936 shutdown_connections 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5609127829f0 0x560912b8b280 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b851c0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 0x560912b74f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6d7ffff640 0 client.17169 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/360441936 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b74a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.690+0000 7f6dad5c4740 1 -- 172.21.15.37:0/360441936 >> 172.21.15.37:0/360441936 conn(0x5609127b8460 msgr2=0x560912b6c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.691+0000 7f6dad5c4740 1 -- 172.21.15.37:0/360441936 shutdown_connections 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.691+0000 7f6dad5c4740 1 -- 172.21.15.37:0/360441936 wait complete. 2024-08-31T06:54:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.691+0000 7f6dad5c4740 20 client.17169 trim_cache size 0 max 16384 2024-08-31T06:54:07.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6dad5c4740 1 Processor -- start 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6dad5c4740 1 -- start start 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b6caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 0x560912b850c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b85600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01afaf0 con 0x5609127c4070 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01ad3c0 con 0x5609127a3390 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01ab230 con 0x56091279b1b0 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da55ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b85600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da55ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b85600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46904/0 (socket says 172.21.15.37:46904) 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da55ec640 1 -- 172.21.15.37:0/3067199836 learned_addr learned my addr 172.21.15.37:0/3067199836 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 0x560912b850c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da4deb640 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b6caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da55ec640 1 -- 172.21.15.37:0/3067199836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 msgr2=0x560912b6caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da55ec640 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b6caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da55ec640 1 -- 172.21.15.37:0/3067199836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 msgr2=0x560912b850c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da55ec640 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 0x560912b850c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.709+0000 7f6da55ec640 1 -- 172.21.15.37:0/3067199836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560912b6d030 con 0x5609127c4070 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.710+0000 7f6da55ec640 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b85600 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6d98004af0 tx=0x7f6d98008930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56ad4123b69de31 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.710+0000 7f6d8a7fc640 1 -- 172.21.15.37:0/3067199836 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9803a070 con 0x5609127c4070 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.710+0000 7f6d8a7fc640 1 -- 172.21.15.37:0/3067199836 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d980223b0 con 0x5609127c4070 2024-08-31T06:54:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.710+0000 7f6d8a7fc640 1 -- 172.21.15.37:0/3067199836 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d98035b70 con 0x5609127c4070 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 -- 172.21.15.37:0/3067199836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 msgr2=0x560912b85600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b85600 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f6d98004af0 tx=0x7f6d98008930 comp rx=0 tx=0).stop 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 -- 172.21.15.37:0/3067199836 shutdown_connections 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b85600 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5609127a3390 0x560912b850c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/3067199836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56091279b1b0 0x560912b6caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 -- 172.21.15.37:0/3067199836 >> 172.21.15.37:0/3067199836 conn(0x5609127b8460 msgr2=0x560912b6c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 -- 172.21.15.37:0/3067199836 shutdown_connections 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.711+0000 7f6dad5c4740 1 -- 172.21.15.37:0/3067199836 wait complete. 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 1 -- start start 2024-08-31T06:54:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 1 Processor -- start 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b81a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127a3390 0x560912b7dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b7e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01ab880 con 0x5609127c4070 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01accf0 con 0x56091279b1b0 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6da01abf50 con 0x5609127a3390 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6dad5c4740 10 client.0 _ll_register_callbacks cb 0x7f6d98008b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6da55ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b7e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6da55ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b7e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46908/0 (socket says 172.21.15.37:46908) 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6da55ec640 1 -- 172.21.15.37:0/1731134739 learned_addr learned my addr 172.21.15.37:0/1731134739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127a3390 0x560912b7dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.712+0000 7f6da4deb640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b81a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6da55ec640 1 -- 172.21.15.37:0/1731134739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127a3390 msgr2=0x560912b7dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6da55ec640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127a3390 0x560912b7dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6da55ec640 1 -- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 msgr2=0x560912b81a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6da55ec640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b81a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6da55ec640 1 -- 172.21.15.37:0/1731134739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560912b7ec80 con 0x5609127c4070 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6d9ffff640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127a3390 0x560912b7dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6da4deb640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b81a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6da55ec640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b7e4f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f6d9801bd20 tx=0x7f6d98022bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0b44da4b7e1307 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6d7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6d7ffff640 1 -- 172.21.15.37:0/1731134739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9803a030 con 0x5609127c4070 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6d7ffff640 1 -- 172.21.15.37:0/1731134739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8499+0+0 (secure 0 0 0) 0x7f6d98035480 con 0x5609127c4070 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1731134739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d980223b0 con 0x5609127c4070 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.713+0000 7f6d7ffff640 1 -- 172.21.15.37:0/1731134739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6d98019e50 con 0x5609127c4070 2024-08-31T06:54:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6dad5c4740 10 client.17175 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1731134739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560912bf6ca0 con 0x5609127c4070 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6d7ffff640 1 -- 172.21.15.37:0/1731134739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d980223b0 con 0x5609127c4070 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6d7ffff640 1 -- 172.21.15.37:0/1731134739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6d98017040 con 0x5609127c4070 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6dad5c4740 10 client.17175 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6dad5c4740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6dad5c4740 20 client.17175 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560912757da0 0x560912bf9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6dad5c4740 4 client.17175 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:54:07.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1731134739 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560912ade020 con 0x560912757da0 2024-08-31T06:54:07.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.714+0000 7f6da4deb640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560912757da0 0x560912bf9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:07.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6d7ffff640 10 client.17175 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:07.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6da4deb640 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560912757da0 0x560912bf9340 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b51bf2eba78bb73 server_cookie=207a459e74f89e48 in_seq=0 out_seq=0 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6d7ffff640 1 -- 172.21.15.37:0/1731134739 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x560912ade020 con 0x560912757da0 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6d7ffff640 10 client.17175 handle_command_reply: tid=0 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 client.17175 shutdown 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1731134739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 msgr2=0x560912b7e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b7e4f0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f6d9801bd20 tx=0x7f6d98022bb0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1731134739 shutdown_connections 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x560912757da0 0x560912bf9340 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5609127c4070 0x560912b7e4f0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5609127a3390 0x560912b7dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 --2- 172.21.15.37:0/1731134739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56091279b1b0 0x560912b81a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6d7ffff640 0 client.17175 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1731134739 >> 172.21.15.37:0/1731134739 conn(0x5609127b8460 msgr2=0x560912b6a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:07.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1731134739 shutdown_connections 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.715+0000 7f6dad5c4740 1 -- 172.21.15.37:0/1731134739 wait complete. 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6dad5c4740 20 client.17175 trim_cache size 0 max 16384 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.721 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:54:07.722 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.723 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.724 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.725 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.726 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.727 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:07.728 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:07.729 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 -- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d900b4ca0 msgr2=0x7f6d900b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d900b4ca0 0x7f6d900b71b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6d98005cc0 tx=0x7f6d98008670 comp rx=0 tx=0).stop 2024-08-31T06:54:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 -- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 msgr2=0x7f6da019af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 0x7f6da019af90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009a20 tx=0x7f6d94004270 comp rx=0 tx=0).stop 2024-08-31T06:54:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 -- 172.21.15.37:0/324697147 shutdown_connections 2024-08-31T06:54:07.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6d900b4ca0 0x7f6d900b71b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6da0108a90 0x7f6da019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6da0108140 0x7f6da019b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 --2- 172.21.15.37:0/324697147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6da0102800 0x7f6da019af90 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.716+0000 7f6da704f640 1 -- 172.21.15.37:0/324697147 >> 172.21.15.37:0/324697147 conn(0x7f6da00794d0 msgr2=0x7f6da01013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.717+0000 7f6da704f640 1 -- 172.21.15.37:0/324697147 shutdown_connections 2024-08-31T06:54:07.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:07.717+0000 7f6da704f640 1 -- 172.21.15.37:0/324697147 wait complete. 2024-08-31T06:54:07.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:07 smithi037 ceph-mon[18612]: pgmap v540: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:54:08.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:07 smithi106 ceph-mon[22134]: pgmap v540: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:54:08.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:07 smithi066 ceph-mon[22244]: pgmap v540: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:54:08.624 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:54:08.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:54:08.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:08 smithi037 ceph-mon[18612]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T06:54:08.884 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:09.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:08 smithi106 ceph-mon[22134]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T06:54:09.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:08 smithi066 ceph-mon[22244]: osdmap e79: 12 total, 12 up, 12 in 2024-08-31T06:54:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 -- 172.21.15.37:0/85144003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124109b90 msgr2=0x7f41241103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 --2- 172.21.15.37:0/85144003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124109b90 0x7f41241103c0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f411c009ca0 tx=0x7f411c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 -- 172.21.15.37:0/85144003 shutdown_connections 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 --2- 172.21.15.37:0/85144003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124109b90 0x7f41241103c0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 --2- 172.21.15.37:0/85144003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4124109240 0x7f4124109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 --2- 172.21.15.37:0/85144003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4124103900 0x7f4124103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 -- 172.21.15.37:0/85144003 >> 172.21.15.37:0/85144003 conn(0x7f412407b5f0 msgr2=0x7f412407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 -- 172.21.15.37:0/85144003 shutdown_connections 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.391+0000 7f4129ae9640 1 -- 172.21.15.37:0/85144003 wait complete. 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f4129ae9640 1 Processor -- start 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f4129ae9640 1 -- start start 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f4129ae9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124103900 0x7f412419a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f4129ae9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4124109240 0x7f412419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f4129ae9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4124109b90 0x7f412419f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f4129ae9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4124113750 con 0x7f4124103900 2024-08-31T06:54:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f4129ae9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f41241135d0 con 0x7f4124109240 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f4129ae9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f41241138d0 con 0x7f4124109b90 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.392+0000 7f41237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124103900 0x7f412419a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f41237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124103900 0x7f412419a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46916/0 (socket says 172.21.15.37:46916) 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f41237fe640 1 -- 172.21.15.37:0/3147391372 learned_addr learned my addr 172.21.15.37:0/3147391372 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4123fff640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4124109b90 0x7f412419f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4122ffd640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4124109240 0x7f412419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f41237fe640 1 -- 172.21.15.37:0/3147391372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4124109b90 msgr2=0x7f412419f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f41237fe640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4124109b90 0x7f412419f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f41237fe640 1 -- 172.21.15.37:0/3147391372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4124109240 msgr2=0x7f412419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f41237fe640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4124109240 0x7f412419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f41237fe640 1 -- 172.21.15.37:0/3147391372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41241a0050 con 0x7f4124103900 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4122ffd640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4124109240 0x7f412419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4123fff640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4124109b90 0x7f412419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f41237fe640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124103900 0x7f412419a1a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f411400c920 tx=0x7f411400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4120ff9640 1 -- 172.21.15.37:0/3147391372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114007c70 con 0x7f4124103900 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4120ff9640 1 -- 172.21.15.37:0/3147391372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4114007e10 con 0x7f4124103900 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41241a0340 con 0x7f4124103900 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4120ff9640 1 -- 172.21.15.37:0/3147391372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114018710 con 0x7f4124103900 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.393+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41241a6b60 con 0x7f4124103900 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.395+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4124103d10 con 0x7f4124103900 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.396+0000 7f4120ff9640 1 -- 172.21.15.37:0/3147391372 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f411400f450 con 0x7f4124103900 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.396+0000 7f4120ff9640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f410c0b4cd0 0x7f410c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.397+0000 7f4122ffd640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f410c0b4cd0 0x7f410c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.397+0000 7f4120ff9640 1 -- 172.21.15.37:0/3147391372 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7f41140e5800 con 0x7f4124103900 2024-08-31T06:54:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.397+0000 7f4122ffd640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f410c0b4cd0 0x7f410c0b71e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4118005fd0 tx=0x7f4118005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.402+0000 7f4120ff9640 1 -- 172.21.15.37:0/3147391372 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4114014030 con 0x7f4124103900 2024-08-31T06:54:09.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.625+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f412419b2d0 con 0x7f4124103900 2024-08-31T06:54:09.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.625+0000 7f4120ff9640 1 -- 172.21.15.37:0/3147391372 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f41140ac580 con 0x7f4124103900 2024-08-31T06:54:09.627 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:54:09.627 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:54:09.627 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f410c0b4cd0 msgr2=0x7f410c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f410c0b4cd0 0x7f410c0b71e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4118005fd0 tx=0x7f4118005850 comp rx=0 tx=0).stop 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124103900 msgr2=0x7f412419a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124103900 0x7f412419a1a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f411400c920 tx=0x7f411400cde0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 shutdown_connections 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f410c0b4cd0 0x7f410c0b71e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4124109b90 0x7f412419f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4124109240 0x7f412419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 --2- 172.21.15.37:0/3147391372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4124103900 0x7f412419a1a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:09.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 >> 172.21.15.37:0/3147391372 conn(0x7f412407b5f0 msgr2=0x7f4124107330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:09.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 shutdown_connections 2024-08-31T06:54:09.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:09.628+0000 7f4129ae9640 1 -- 172.21.15.37:0/3147391372 wait complete. 2024-08-31T06:54:10.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:09 smithi106 ceph-mon[22134]: pgmap v542: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:54:10.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:09 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3147391372' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:10.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:09 smithi037 ceph-mon[18612]: pgmap v542: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:54:10.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:09 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3147391372' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:10.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:09 smithi066 ceph-mon[22244]: pgmap v542: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:54:10.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:09 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3147391372' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:10.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:54:10.576 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:11.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 -- 172.21.15.37:0/2846716900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4102880 msgr2=0x7f8ff4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/2846716900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4102880 0x7f8ff4102c90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009900 tx=0x7f8fe402a410 comp rx=0 tx=0).stop 2024-08-31T06:54:11.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 -- 172.21.15.37:0/2846716900 shutdown_connections 2024-08-31T06:54:11.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/2846716900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff4108ac0 0x7f8ff410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/2846716900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4108170 0x7f8ff4108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/2846716900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4102880 0x7f8ff4102c90 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 -- 172.21.15.37:0/2846716900 >> 172.21.15.37:0/2846716900 conn(0x7f8ff4079550 msgr2=0x7f8ff4079960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:11.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 -- 172.21.15.37:0/2846716900 shutdown_connections 2024-08-31T06:54:11.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.058+0000 7f8ff8d74640 1 -- 172.21.15.37:0/2846716900 wait complete. 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff8d74640 1 Processor -- start 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff8d74640 1 -- start start 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff8d74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4102880 0x7f8ff4198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff8d74640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff4108170 0x7f8ff4199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff8d74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4108ac0 0x7f8ff4199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff8d74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41126f0 con 0x7f8ff4108ac0 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff8d74640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4112570 con 0x7f8ff4102880 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff8d74640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff4112870 con 0x7f8ff4108170 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4108ac0 0x7f8ff4199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4108ac0 0x7f8ff4199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46936/0 (socket says 172.21.15.37:46936) 2024-08-31T06:54:11.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff2d9d640 1 -- 172.21.15.37:0/245516518 learned_addr learned my addr 172.21.15.37:0/245516518 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff259c640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4102880 0x7f8ff4198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff4108170 0x7f8ff4199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff2d9d640 1 -- 172.21.15.37:0/245516518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff4108170 msgr2=0x7f8ff4199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff2d9d640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff4108170 0x7f8ff4199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.059+0000 7f8ff2d9d640 1 -- 172.21.15.37:0/245516518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4102880 msgr2=0x7f8ff4198ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8ff2d9d640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4102880 0x7f8ff4198ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8ff2d9d640 1 -- 172.21.15.37:0/245516518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff41a8580 con 0x7f8ff4108ac0 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff4108170 0x7f8ff4199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8ff259c640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4102880 0x7f8ff4198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8ff2d9d640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4108ac0 0x7f8ff4199950 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00b970 tx=0x7f8fec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8fe37fe640 1 -- 172.21.15.37:0/245516518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec019070 con 0x7f8ff4108ac0 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8ff8d74640 1 -- 172.21.15.37:0/245516518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff41a8870 con 0x7f8ff4108ac0 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8fe37fe640 1 -- 172.21.15.37:0/245516518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fec014440 con 0x7f8ff4108ac0 2024-08-31T06:54:11.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8ff8d74640 1 -- 172.21.15.37:0/245516518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff41a8e30 con 0x7f8ff4108ac0 2024-08-31T06:54:11.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.060+0000 7f8fe37fe640 1 -- 172.21.15.37:0/245516518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0075d0 con 0x7f8ff4108ac0 2024-08-31T06:54:11.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fff2e9740 1 Processor -- start 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fe37fe640 1 -- 172.21.15.37:0/245516518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f8fec01c070 con 0x7f8ff4108ac0 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fff2e9740 1 -- start start 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189f6070 0x55a118d9b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189cd1b0 0x55a118d9b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189d5390 0x55a118d9bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a118d12680 con 0x55a1189cd1b0 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a118d01c10 con 0x55a1189f6070 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.063+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a118d05bc0 con 0x55a1189d5390 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189cd1b0 0x55a118d9b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189cd1b0 0x55a118d9b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46940/0 (socket says 172.21.15.37:46940) 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 -- 172.21.15.37:0/735548318 learned_addr learned my addr 172.21.15.37:0/735548318 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189d5390 0x55a118d9bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189f6070 0x55a118d9b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 -- 172.21.15.37:0/735548318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189d5390 msgr2=0x55a118d9bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189d5390 0x55a118d9bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8fe37fe640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8fdc0b4ca0 0x7f8fdc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 -- 172.21.15.37:0/735548318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189f6070 msgr2=0x55a118d9b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189f6070 0x55a118d9b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 -- 172.21.15.37:0/735548318 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a118a61650 con 0x55a1189cd1b0 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff2d9d640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8fdc0b4ca0 0x7f8fdc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8fe37fe640 1 -- 172.21.15.37:0/245516518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7f8fec0e4c50 con 0x7f8ff4108ac0 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.064+0000 7f8ff259c640 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189cd1b0 0x55a118d9b850 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000c00 tx=0x7f8fe4031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f8d5ffcd71a055 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.065+0000 7f8fe0ff9640 1 -- 172.21.15.37:0/735548318 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4035030 con 0x55a1189cd1b0 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.065+0000 7f8fe0ff9640 1 -- 172.21.15.37:0/735548318 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fe40044c0 con 0x55a1189cd1b0 2024-08-31T06:54:11.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.065+0000 7f8fe0ff9640 1 -- 172.21.15.37:0/735548318 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4003b40 con 0x55a1189cd1b0 2024-08-31T06:54:11.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.065+0000 7f8fff2e9740 1 -- 172.21.15.37:0/735548318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189cd1b0 msgr2=0x55a118d9b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.065+0000 7f8ff2d9d640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8fdc0b4ca0 0x7f8fdc0b71b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0a73b0 tx=0x7f8fec057040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:11.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.065+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189cd1b0 0x55a118d9b850 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000c00 tx=0x7f8fe4031de0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 -- 172.21.15.37:0/735548318 shutdown_connections 2024-08-31T06:54:11.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189cd1b0 0x55a118d9b850 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189d5390 0x55a118d9bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/735548318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189f6070 0x55a118d9b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 -- 172.21.15.37:0/735548318 >> 172.21.15.37:0/735548318 conn(0x55a1189ea460 msgr2=0x55a118d99200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 -- 172.21.15.37:0/735548318 shutdown_connections 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 -- 172.21.15.37:0/735548318 wait complete. 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 -- start start 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 Processor -- start 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 0x55a118da6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189d5390 0x55a118da6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189f6070 0x55a118db2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a118b64700 con 0x55a1189f6070 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a118c88750 con 0x55a1189d5390 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.066+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a118da9a90 con 0x55a1189cd1b0 2024-08-31T06:54:11.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8fff2e9740 10 client.0 _ll_register_callbacks cb 0x55a118cb7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189f6070 0x55a118db2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189f6070 0x55a118db2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46954/0 (socket says 172.21.15.37:46954) 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 -- 172.21.15.37:0/2269459513 learned_addr learned my addr 172.21.15.37:0/2269459513 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 0x55a118da6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff259c640 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189d5390 0x55a118da6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 -- 172.21.15.37:0/2269459513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 msgr2=0x55a118da6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 0x55a118da6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 -- 172.21.15.37:0/2269459513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189d5390 msgr2=0x55a118da6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189d5390 0x55a118da6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 -- 172.21.15.37:0/2269459513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a118cc1900 con 0x55a1189f6070 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189f6070 0x55a118db2db0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8019eb0 tx=0x7f8fe8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e033f13b6399359 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8fd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/2269459513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe801f060 con 0x55a1189f6070 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/2269459513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7f8fe8017460 con 0x55a1189f6070 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.067+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2269459513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a118d145d0 con 0x55a1189f6070 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/2269459513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8fe800f040 con 0x55a1189f6070 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fff2e9740 10 client.17193 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2269459513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a118db5900 con 0x55a1189f6070 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/2269459513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a118d145d0 con 0x55a1189f6070 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/2269459513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8fe8015040 con 0x55a1189f6070 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fff2e9740 10 client.17193 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fff2e9740 10 client.17193 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fff2e9740 20 client.17193 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a1189b49f0 0x55a118db8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fff2e9740 4 client.17193 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2269459513 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a118d10070 con 0x55a1189b49f0 2024-08-31T06:54:11.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.068+0000 7f8ff259c640 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a1189b49f0 0x55a118db8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.069+0000 7f8ff259c640 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a1189b49f0 0x55a118db8df0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81e8cdba2e93f690 server_cookie=861391bc453da96a in_seq=0 out_seq=0 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.069+0000 7f8fd9ffb640 10 client.17193 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/2269459513 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a118d10070 con 0x55a1189b49f0 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fd9ffb640 10 client.17193 handle_command_reply: tid=0 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 client.17193 shutdown 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2269459513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189f6070 msgr2=0x55a118db2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189f6070 0x55a118db2db0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8019eb0 tx=0x7f8fe8008040 comp rx=0 tx=0).stop 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2269459513 shutdown_connections 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189f6070 0x55a118db2db0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a1189b49f0 0x55a118db8df0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189d5390 0x55a118da6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2269459513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 0x55a118da6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2269459513 >> 172.21.15.37:0/2269459513 conn(0x55a1189ea460 msgr2=0x55a118d9e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:11.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fd9ffb640 0 client.17193 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:11.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2269459513 shutdown_connections 2024-08-31T06:54:11.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2269459513 wait complete. 2024-08-31T06:54:11.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.070+0000 7f8fff2e9740 20 client.17193 trim_cache size 0 max 16384 2024-08-31T06:54:11.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.083+0000 7f8fff2e9740 1 Processor -- start 2024-08-31T06:54:11.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.083+0000 7f8fff2e9740 1 -- start start 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189ea460 0x55a118da7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189cd1b0 0x55a118d9e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118d9e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41b3ff0 con 0x55a1189d5390 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41b18c0 con 0x55a1189cd1b0 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41af730 con 0x55a1189ea460 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118d9e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118d9e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46966/0 (socket says 172.21.15.37:46966) 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 -- 172.21.15.37:0/2137425415 learned_addr learned my addr 172.21.15.37:0/2137425415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189ea460 0x55a118da7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff259c640 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189cd1b0 0x55a118d9e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 -- 172.21.15.37:0/2137425415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189ea460 msgr2=0x55a118da7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:11.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189ea460 0x55a118da7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 -- 172.21.15.37:0/2137425415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189cd1b0 msgr2=0x55a118d9e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:11.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189cd1b0 0x55a118d9e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 -- 172.21.15.37:0/2137425415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a118da91f0 con 0x55a1189d5390 2024-08-31T06:54:11.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff259c640 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189cd1b0 0x55a118d9e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:11.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.084+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118d9e950 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8019820 tx=0x7f8fe801b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e530a10825db61 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:11.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fdbfff640 1 -- 172.21.15.37:0/2137425415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8022370 con 0x55a1189d5390 2024-08-31T06:54:11.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fdbfff640 1 -- 172.21.15.37:0/2137425415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fe8022c90 con 0x55a1189d5390 2024-08-31T06:54:11.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fdbfff640 1 -- 172.21.15.37:0/2137425415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe802db60 con 0x55a1189d5390 2024-08-31T06:54:11.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2137425415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 msgr2=0x55a118d9e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118d9e950 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8019820 tx=0x7f8fe801b040 comp rx=0 tx=0).stop 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2137425415 shutdown_connections 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118d9e950 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189cd1b0 0x55a118d9e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/2137425415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189ea460 0x55a118da7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2137425415 >> 172.21.15.37:0/2137425415 conn(0x55a118db9140 msgr2=0x55a118da6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2137425415 shutdown_connections 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.085+0000 7f8fff2e9740 1 -- 172.21.15.37:0/2137425415 wait complete. 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 1 -- start start 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 1 Processor -- start 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 0x55a118dab120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118dab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189ea460 0x55a118e227b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41afd80 con 0x55a1189d5390 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41b11f0 con 0x55a1189ea460 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff41b0450 con 0x55a1189cd1b0 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8fff2e9740 10 client.0 _ll_register_callbacks cb 0x7f8fe800c590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8ff259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118dab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8ff259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118dab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46982/0 (socket says 172.21.15.37:46982) 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8ff259c640 1 -- 172.21.15.37:0/122984385 learned_addr learned my addr 172.21.15.37:0/122984385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189ea460 0x55a118e227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.086+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 0x55a118dab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8ff259c640 1 -- 172.21.15.37:0/122984385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 msgr2=0x55a118dab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8ff259c640 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 0x55a118dab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8ff259c640 1 -- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189ea460 msgr2=0x55a118e227b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8ff259c640 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189ea460 0x55a118e227b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8ff259c640 1 -- 172.21.15.37:0/122984385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a118e22cf0 con 0x55a1189d5390 2024-08-31T06:54:11.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189ea460 0x55a118e227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8ff259c640 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118dab6c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009900 tx=0x7f8fe4031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f6fcfddcdd9134 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8fd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/122984385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4035040 con 0x55a1189d5390 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/122984385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7f8fe4031710 con 0x55a1189d5390 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8fff2e9740 1 -- 172.21.15.37:0/122984385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fe8022c90 con 0x55a1189d5390 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/122984385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8fe405d050 con 0x55a1189d5390 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8fff2e9740 10 client.17199 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8fff2e9740 1 -- 172.21.15.37:0/122984385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a118e23e40 con 0x55a1189d5390 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.087+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/122984385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8fe8022c90 con 0x55a1189d5390 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/122984385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8fe403c4d0 con 0x55a1189d5390 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8fff2e9740 10 client.17199 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8fff2e9740 10 client.17199 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:54:11.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8fff2e9740 20 client.17199 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a1189f6070 0x55a118e26190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8fff2e9740 4 client.17199 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8fff2e9740 1 -- 172.21.15.37:0/122984385 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a118d0d7b0 con 0x55a1189f6070 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a1189f6070 0x55a118e26190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8fd9ffb640 10 client.17199 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.088+0000 7f8ff1d9b640 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a1189f6070 0x55a118e26190 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40bbb90045efc2ff server_cookie=31b6c7aa6702ad14 in_seq=0 out_seq=0 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fd9ffb640 1 -- 172.21.15.37:0/122984385 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a118d0d7b0 con 0x55a1189f6070 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fd9ffb640 10 client.17199 handle_command_reply: tid=0 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 client.17199 shutdown 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 -- 172.21.15.37:0/122984385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 msgr2=0x55a118dab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118dab6c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009900 tx=0x7f8fe4031a20 comp rx=0 tx=0).stop 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 -- 172.21.15.37:0/122984385 shutdown_connections 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a1189d5390 0x55a118dab6c0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a1189f6070 0x55a118e26190 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a1189ea460 0x55a118e227b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 --2- 172.21.15.37:0/122984385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a1189cd1b0 0x55a118dab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 -- 172.21.15.37:0/122984385 >> 172.21.15.37:0/122984385 conn(0x55a118db9140 msgr2=0x55a118d9c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:11.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fd9ffb640 0 client.17199 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:11.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 -- 172.21.15.37:0/122984385 shutdown_connections 2024-08-31T06:54:11.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 1 -- 172.21.15.37:0/122984385 wait complete. 2024-08-31T06:54:11.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.089+0000 7f8fff2e9740 20 client.17199 trim_cache size 0 max 16384 2024-08-31T06:54:11.095 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:11.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 -- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8fdc0b4ca0 msgr2=0x7f8fdc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8fdc0b4ca0 0x7f8fdc0b71b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0a73b0 tx=0x7f8fec057040 comp rx=0 tx=0).stop 2024-08-31T06:54:11.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 -- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4108ac0 msgr2=0x7f8ff4199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:11.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4108ac0 0x7f8ff4199950 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00b970 tx=0x7f8fec00be30 comp rx=0 tx=0).stop 2024-08-31T06:54:11.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 -- 172.21.15.37:0/245516518 shutdown_connections 2024-08-31T06:54:11.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8fdc0b4ca0 0x7f8fdc0b71b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff4108ac0 0x7f8ff4199950 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ff4108170 0x7f8ff4199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 --2- 172.21.15.37:0/245516518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff4102880 0x7f8ff4198ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:11.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 -- 172.21.15.37:0/245516518 >> 172.21.15.37:0/245516518 conn(0x7f8ff4079550 msgr2=0x7f8ff4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:11.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 -- 172.21.15.37:0/245516518 shutdown_connections 2024-08-31T06:54:11.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:11.090+0000 7f8ff8d74640 1 -- 172.21.15.37:0/245516518 wait complete. 2024-08-31T06:54:11.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:54:12.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:11 smithi106 ceph-mon[22134]: pgmap v543: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:54:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:12.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:11 smithi037 ceph-mon[18612]: pgmap v543: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:54:12.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:11 smithi066 ceph-mon[22244]: pgmap v543: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:54:12.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.632+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3689749438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0109b90 msgr2=0x7fcbd01103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.632+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3689749438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0109b90 0x7fcbd01103c0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009ca0 tx=0x7fcbc802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.632+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3689749438 shutdown_connections 2024-08-31T06:54:12.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.632+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3689749438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0109b90 0x7fcbd01103c0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.632+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3689749438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbd0109240 0x7fcbd0109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.632+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3689749438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd0103900 0x7fcbd0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.632+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3689749438 >> 172.21.15.37:0/3689749438 conn(0x7fcbd007b5f0 msgr2=0x7fcbd007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:12.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.633+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3689749438 shutdown_connections 2024-08-31T06:54:12.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.633+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3689749438 wait complete. 2024-08-31T06:54:12.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.633+0000 7fcbd7a84640 1 Processor -- start 2024-08-31T06:54:12.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.633+0000 7fcbd7a84640 1 -- start start 2024-08-31T06:54:12.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd7a84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0103900 0x7fcbd019a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd7a84640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbd0109240 0x7fcbd019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd7a84640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd0109b90 0x7fcbd019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd7a84640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd0113750 con 0x7fcbd0103900 2024-08-31T06:54:12.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd7a84640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01135d0 con 0x7fcbd0109b90 2024-08-31T06:54:12.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd7a84640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01138d0 con 0x7fcbd0109240 2024-08-31T06:54:12.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0103900 0x7fcbd019a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0103900 0x7fcbd019a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46996/0 (socket says 172.21.15.37:46996) 2024-08-31T06:54:12.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 -- 172.21.15.37:0/3499744493 learned_addr learned my addr 172.21.15.37:0/3499744493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:12.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd501f640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbd0109240 0x7fcbd019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd6021640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd0109b90 0x7fcbd019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 -- 172.21.15.37:0/3499744493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbd0109240 msgr2=0x7fcbd019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbd0109240 0x7fcbd019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 -- 172.21.15.37:0/3499744493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd0109b90 msgr2=0x7fcbd019f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd0109b90 0x7fcbd019f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 -- 172.21.15.37:0/3499744493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd01a00b0 con 0x7fcbd0103900 2024-08-31T06:54:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd6021640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd0109b90 0x7fcbd019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd5820640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0103900 0x7fcbd019a140 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c890 tx=0x7fcbcc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbc6ffd640 1 -- 172.21.15.37:0/3499744493 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc004220 con 0x7fcbd0103900 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbc6ffd640 1 -- 172.21.15.37:0/3499744493 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbcc007e40 con 0x7fcbd0103900 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbc6ffd640 1 -- 172.21.15.37:0/3499744493 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc004a00 con 0x7fcbd0103900 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.634+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3499744493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd01a03a0 con 0x7fcbd0103900 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.635+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3499744493 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd01a6b00 con 0x7fcbd0103900 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.637+0000 7fcbddff9740 1 Processor -- start 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.637+0000 7fcbddff9740 1 -- start start 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.637+0000 7fcbc6ffd640 1 -- 172.21.15.37:0/3499744493 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fcbcc0079b0 con 0x7fcbd0103900 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.637+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4bb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4bb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4bbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbddff9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a8ba432680 con 0x55a8ba0f5390 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbddff9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a8ba421c10 con 0x55a8ba116070 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbddff9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a8ba425bc0 con 0x55a8ba0ed1b0 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4bbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4bbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46998/0 (socket says 172.21.15.37:46998) 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 -- 172.21.15.37:0/920695894 learned_addr learned my addr 172.21.15.37:0/920695894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd5820640 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4bb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd6021640 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 -- 172.21.15.37:0/920695894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 msgr2=0x55a8ba4bb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:12.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4bb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 -- 172.21.15.37:0/920695894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 msgr2=0x55a8ba4bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4bb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 -- 172.21.15.37:0/920695894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ba181650 con 0x55a8ba0f5390 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd6021640 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbc6ffd640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbbc0b4ca0 0x7fcbbc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd501f640 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4bbd90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000aaf0 tx=0x7fcbc000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1d19acf08d4f72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbd6021640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbbc0b4ca0 0x7fcbbc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbc6ffd640 1 -- 172.21.15.37:0/3499744493 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7fcbcc0e5250 con 0x7fcbd0103900 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.638+0000 7fcbbbfff640 1 -- 172.21.15.37:0/920695894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0004020 con 0x55a8ba0f5390 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.639+0000 7fcbbbfff640 1 -- 172.21.15.37:0/920695894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbc00041c0 con 0x55a8ba0f5390 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.639+0000 7fcbbbfff640 1 -- 172.21.15.37:0/920695894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00186a0 con 0x55a8ba0f5390 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.639+0000 7fcbddff9740 1 -- 172.21.15.37:0/920695894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 msgr2=0x55a8ba4bbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.639+0000 7fcbd6021640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbbc0b4ca0 0x7fcbbc0b71b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8005e30 tx=0x7fcbc8005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:12.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.639+0000 7fcbddff9740 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4bbd90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000aaf0 tx=0x7fcbc000f3c0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 -- 172.21.15.37:0/920695894 shutdown_connections 2024-08-31T06:54:12.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4bbd90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4bb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 --2- 172.21.15.37:0/920695894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 -- 172.21.15.37:0/920695894 >> 172.21.15.37:0/920695894 conn(0x55a8ba10a460 msgr2=0x55a8ba4b9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 -- 172.21.15.37:0/920695894 shutdown_connections 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 -- 172.21.15.37:0/920695894 wait complete. 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 -- start start 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.640+0000 7fcbddff9740 1 Processor -- start 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbddff9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a8ba284700 con 0x55a8ba0f5390 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbddff9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a8ba3a8750 con 0x55a8ba116070 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbddff9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a8ba4c9af0 con 0x55a8ba0ed1b0 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbddff9740 10 client.0 _ll_register_callbacks cb 0x55a8ba3d7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47006/0 (socket says 172.21.15.37:47006) 2024-08-31T06:54:12.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 -- 172.21.15.37:0/2257090474 learned_addr learned my addr 172.21.15.37:0/2257090474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:12.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd5820640 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd6021640 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 -- 172.21.15.37:0/2257090474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 msgr2=0x55a8ba4c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 -- 172.21.15.37:0/2257090474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 msgr2=0x55a8ba4d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 -- 172.21.15.37:0/2257090474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ba3e1900 con 0x55a8ba0f5390 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbd501f640 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c6fe0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000a520 tx=0x7fcbc0003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c135f332750e3920 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbb97fa640 1 -- 172.21.15.37:0/2257090474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0027020 con 0x55a8ba0f5390 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbb97fa640 1 -- 172.21.15.37:0/2257090474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7fcbc0005040 con 0x55a8ba0f5390 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.641+0000 7fcbddff9740 1 -- 172.21.15.37:0/2257090474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbc00041c0 con 0x55a8ba0f5390 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbb97fa640 1 -- 172.21.15.37:0/2257090474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcbc0032050 con 0x55a8ba0f5390 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbddff9740 10 client.17211 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbddff9740 1 -- 172.21.15.37:0/2257090474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a8ba4d58d0 con 0x55a8ba0f5390 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbb97fa640 1 -- 172.21.15.37:0/2257090474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbc00041c0 con 0x55a8ba0f5390 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbb97fa640 1 -- 172.21.15.37:0/2257090474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcbc0004a30 con 0x55a8ba0f5390 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbddff9740 10 client.17211 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbddff9740 10 client.17211 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbddff9740 20 client.17211 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:12.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbddff9740 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8ba0d49f0 0x55a8ba4d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbddff9740 4 client.17211 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.642+0000 7fcbddff9740 1 -- 172.21.15.37:0/2257090474 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8ba4345d0 con 0x55a8ba0d49f0 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.643+0000 7fcbd5820640 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8ba0d49f0 0x55a8ba4d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.643+0000 7fcbb97fa640 10 client.17211 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.643+0000 7fcbd5820640 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8ba0d49f0 0x55a8ba4d8d40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78543fe3e50de794 server_cookie=b55a81a8bc85bd11 in_seq=0 out_seq=0 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbb97fa640 1 -- 172.21.15.37:0/2257090474 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8ba4345d0 con 0x55a8ba0d49f0 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbb97fa640 10 client.17211 handle_command_reply: tid=0 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 client.17211 shutdown 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 -- 172.21.15.37:0/2257090474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 msgr2=0x55a8ba4c6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c6fe0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000a520 tx=0x7fcbc0003d60 comp rx=0 tx=0).stop 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 -- 172.21.15.37:0/2257090474 shutdown_connections 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8ba0d49f0 0x55a8ba4d8d40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c6fe0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba116070 0x55a8ba4d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbb97fa640 0 client.17211 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 --2- 172.21.15.37:0/2257090474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 -- 172.21.15.37:0/2257090474 >> 172.21.15.37:0/2257090474 conn(0x55a8ba10a460 msgr2=0x55a8ba4be4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 -- 172.21.15.37:0/2257090474 shutdown_connections 2024-08-31T06:54:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 1 -- 172.21.15.37:0/2257090474 wait complete. 2024-08-31T06:54:12.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.644+0000 7fcbddff9740 20 client.17211 trim_cache size 0 max 16384 2024-08-31T06:54:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.657+0000 7fcbddff9740 1 Processor -- start 2024-08-31T06:54:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.657+0000 7fcbddff9740 1 -- start start 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbddff9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01b1e10 con 0x55a8ba0d49f0 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbddff9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01af6e0 con 0x55a8ba0ed1b0 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbddff9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01ad550 con 0x55a8ba0f5390 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4b9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47012/0 (socket says 172.21.15.37:47012) 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 -- 172.21.15.37:0/4075983586 learned_addr learned my addr 172.21.15.37:0/4075983586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd501f640 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 -- 172.21.15.37:0/4075983586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0f5390 msgr2=0x55a8ba4c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 -- 172.21.15.37:0/4075983586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0ed1b0 msgr2=0x55a8ba4d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4d2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 -- 172.21.15.37:0/4075983586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ba4b9e00 con 0x55a8ba0d49f0 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd501f640 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.658+0000 7fcbd5820640 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4b9230 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0a8ba0 tx=0x7fcbcc0a7910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc14ac9d729169 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/4075983586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc01d040 con 0x55a8ba0d49f0 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/4075983586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbcc0ab440 con 0x55a8ba0d49f0 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbbb7fe640 1 -- 172.21.15.37:0/4075983586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0e2c10 con 0x55a8ba0d49f0 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 -- 172.21.15.37:0/4075983586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 msgr2=0x55a8ba4b9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4b9230 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0a8ba0 tx=0x7fcbcc0a7910 comp rx=0 tx=0).stop 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 -- 172.21.15.37:0/4075983586 shutdown_connections 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0f5390 0x55a8ba4c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 --2- 172.21.15.37:0/4075983586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4b9230 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 -- 172.21.15.37:0/4075983586 >> 172.21.15.37:0/4075983586 conn(0x55a8ba10a460 msgr2=0x55a8ba4b8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 -- 172.21.15.37:0/4075983586 shutdown_connections 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.659+0000 7fcbddff9740 1 -- 172.21.15.37:0/4075983586 wait complete. 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 1 -- start start 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 1 Processor -- start 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4dbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0f5390 0x55a8ba4d6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01adba0 con 0x55a8ba0d49f0 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01af010 con 0x55a8ba0f5390 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01ae270 con 0x55a8ba0ed1b0 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbddff9740 10 client.0 _ll_register_callbacks cb 0x7fcbc000a940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.660+0000 7fcbd5820640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4dbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd5820640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4dbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47022/0 (socket says 172.21.15.37:47022) 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd5820640 1 -- 172.21.15.37:0/3411125223 learned_addr learned my addr 172.21.15.37:0/3411125223 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd501f640 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd6021640 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0f5390 0x55a8ba4d6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd5820640 1 -- 172.21.15.37:0/3411125223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 msgr2=0x55a8ba4dc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd5820640 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4dc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd5820640 1 -- 172.21.15.37:0/3411125223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0f5390 msgr2=0x55a8ba4d6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd5820640 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0f5390 0x55a8ba4d6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd5820640 1 -- 172.21.15.37:0/3411125223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ba4dcad0 con 0x55a8ba0d49f0 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbd5820640 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4dbd80 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0e29f0 tx=0x7fcbcc0e2e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121978d0442ff1fd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbb97fa640 1 -- 172.21.15.37:0/3411125223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc01d040 con 0x55a8ba0d49f0 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbddff9740 1 -- 172.21.15.37:0/3411125223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbcc0ab440 con 0x55a8ba0d49f0 2024-08-31T06:54:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbb97fa640 1 -- 172.21.15.37:0/3411125223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7fcbcc0a7f20 con 0x55a8ba0d49f0 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbb97fa640 1 -- 172.21.15.37:0/3411125223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcbcc0056a0 con 0x55a8ba0d49f0 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbddff9740 10 client.17217 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.661+0000 7fcbddff9740 1 -- 172.21.15.37:0/3411125223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a8ba547dc0 con 0x55a8ba0d49f0 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbb97fa640 1 -- 172.21.15.37:0/3411125223 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcbcc0ab440 con 0x55a8ba0d49f0 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbb97fa640 1 -- 172.21.15.37:0/3411125223 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcbcc0aa600 con 0x55a8ba0d49f0 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbddff9740 10 client.17217 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbddff9740 10 client.17217 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbddff9740 20 client.17217 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbddff9740 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8ba116070 0x55a8ba54a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbddff9740 4 client.17217 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbddff9740 1 -- 172.21.15.37:0/3411125223 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a8ba430070 con 0x55a8ba116070 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.662+0000 7fcbd501f640 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8ba116070 0x55a8ba54a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbd501f640 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8ba116070 0x55a8ba54a500 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49dabf44c91ca9a7 server_cookie=248b453154aabbf2 in_seq=0 out_seq=0 2024-08-31T06:54:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbb97fa640 10 client.17217 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbb97fa640 1 -- 172.21.15.37:0/3411125223 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a8ba430070 con 0x55a8ba116070 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbb97fa640 10 client.17217 handle_command_reply: tid=0 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 client.17217 shutdown 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 -- 172.21.15.37:0/3411125223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 msgr2=0x55a8ba4dbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4dbd80 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0e29f0 tx=0x7fcbcc0e2e40 comp rx=0 tx=0).stop 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 -- 172.21.15.37:0/3411125223 shutdown_connections 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8ba116070 0x55a8ba54a500 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8ba0f5390 0x55a8ba4d6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8ba0ed1b0 0x55a8ba4dc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 --2- 172.21.15.37:0/3411125223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8ba0d49f0 0x55a8ba4dbd80 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 -- 172.21.15.37:0/3411125223 >> 172.21.15.37:0/3411125223 conn(0x55a8ba10a460 msgr2=0x55a8ba4bc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbb97fa640 0 client.17217 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 -- 172.21.15.37:0/3411125223 shutdown_connections 2024-08-31T06:54:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 1 -- 172.21.15.37:0/3411125223 wait complete. 2024-08-31T06:54:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.663+0000 7fcbddff9740 20 client.17217 trim_cache size 0 max 16384 2024-08-31T06:54:12.679 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbbc0b4ca0 msgr2=0x7fcbbc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbbc0b4ca0 0x7fcbbc0b71b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8005e30 tx=0x7fcbc8005fd0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0103900 msgr2=0x7fcbd019a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0103900 0x7fcbd019a140 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c890 tx=0x7fcbcc00cd50 comp rx=0 tx=0).stop 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3499744493 shutdown_connections 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fcbbc0b4ca0 0x7fcbbc0b71b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd0109b90 0x7fcbd019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbd0109240 0x7fcbd019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 --2- 172.21.15.37:0/3499744493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd0103900 0x7fcbd019a140 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3499744493 >> 172.21.15.37:0/3499744493 conn(0x7fcbd007b5f0 msgr2=0x7fcbd0105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3499744493 shutdown_connections 2024-08-31T06:54:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:12.664+0000 7fcbd7a84640 1 -- 172.21.15.37:0/3499744493 wait complete. 2024-08-31T06:54:13.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:54:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:13.998 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:13 smithi037 ceph-mon[18612]: pgmap v544: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:14.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:13 smithi106 ceph-mon[22134]: pgmap v544: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 -- 172.21.15.37:0/197489935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c102ce0 msgr2=0x7fbd8c10fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 --2- 172.21.15.37:0/197489935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c102ce0 0x7fbd8c10fa00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009900 tx=0x7fbd7c02a480 comp rx=0 tx=0).stop 2024-08-31T06:54:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 -- 172.21.15.37:0/197489935 shutdown_connections 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 --2- 172.21.15.37:0/197489935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c102ce0 0x7fbd8c10fa00 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 --2- 172.21.15.37:0/197489935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd8c10ff40 0x7fbd8c112360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 --2- 172.21.15.37:0/197489935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd8c102390 0x7fbd8c1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 -- 172.21.15.37:0/197489935 >> 172.21.15.37:0/197489935 conn(0x7fbd8c0794e0 msgr2=0x7fbd8c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 -- 172.21.15.37:0/197489935 shutdown_connections 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.090+0000 7fbd940a1640 1 -- 172.21.15.37:0/197489935 wait complete. 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.091+0000 7fbd940a1640 1 Processor -- start 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.091+0000 7fbd940a1640 1 -- start start 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.091+0000 7fbd940a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd8c102390 0x7fbd8c19c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.091+0000 7fbd940a1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd8c102ce0 0x7fbd8c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.091+0000 7fbd940a1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c10ff40 0x7fbd8c1a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.091+0000 7fbd940a1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1158a0 con 0x7fbd8c10ff40 2024-08-31T06:54:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.091+0000 7fbd940a1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c115720 con 0x7fbd8c102390 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.091+0000 7fbd940a1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c115a20 con 0x7fbd8c102ce0 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c10ff40 0x7fbd8c1a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c10ff40 0x7fbd8c1a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47042/0 (socket says 172.21.15.37:47042) 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 -- 172.21.15.37:0/2599197921 learned_addr learned my addr 172.21.15.37:0/2599197921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd8c102390 0x7fbd8c19c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9163c640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd8c102ce0 0x7fbd8c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 -- 172.21.15.37:0/2599197921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd8c102ce0 msgr2=0x7fbd8c19c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd8c102ce0 0x7fbd8c19c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 -- 172.21.15.37:0/2599197921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd8c102390 msgr2=0x7fbd8c19c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd8c102390 0x7fbd8c19c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 -- 172.21.15.37:0/2599197921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c1a22c0 con 0x7fbd8c10ff40 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd9263e640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c10ff40 0x7fbd8c1a1b90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400eaa0 tx=0x7fbd8400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd82ffd640 1 -- 172.21.15.37:0/2599197921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400cdb0 con 0x7fbd8c10ff40 2024-08-31T06:54:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd82ffd640 1 -- 172.21.15.37:0/2599197921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd84005020 con 0x7fbd8c10ff40 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd82ffd640 1 -- 172.21.15.37:0/2599197921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd840116d0 con 0x7fbd8c10ff40 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd940a1640 1 -- 172.21.15.37:0/2599197921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c1a25b0 con 0x7fbd8c10ff40 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.092+0000 7fbd940a1640 1 -- 172.21.15.37:0/2599197921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c1a8d10 con 0x7fbd8c10ff40 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.095+0000 7fbd9a616740 1 Processor -- start 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.095+0000 7fbd82ffd640 1 -- 172.21.15.37:0/2599197921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fbd840051d0 con 0x7fbd8c10ff40 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.095+0000 7fbd9a616740 1 -- start start 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 0x563f18a74310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a74850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a74d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9a616740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563f189eb680 con 0x563f186ae390 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9a616740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563f189dac10 con 0x563f186a61b0 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9a616740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x563f189debc0 con 0x563f186cf070 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9163c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a74d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9163c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a74d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47048/0 (socket says 172.21.15.37:47048) 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9163c640 1 -- 172.21.15.37:0/2110252363 learned_addr learned my addr 172.21.15.37:0/2110252363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9163c640 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 0x563f18a74310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd82ffd640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd780b4ca0 0x7fbd780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.096+0000 7fbd9263e640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd780b4ca0 0x7fbd780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd91e3d640 1 -- 172.21.15.37:0/2110252363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 msgr2=0x563f18a74310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 0x563f18a74310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd91e3d640 1 -- 172.21.15.37:0/2110252363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 msgr2=0x563f18a74d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a74d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd82ffd640 1 -- 172.21.15.37:0/2599197921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7fbd840e5750 con 0x7fbd8c10ff40 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd91e3d640 1 -- 172.21.15.37:0/2110252363 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f1873a650 con 0x563f186a61b0 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd9163c640 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a74d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a74850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800bbf0 tx=0x7fbd880107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bdadfb44dbfcef7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd9263e640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd780b4ca0 0x7fbd780b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbd840e2f40 tx=0x7fbd840792d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd77fff640 1 -- 172.21.15.37:0/2110252363 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88004030 con 0x563f186a61b0 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd77fff640 1 -- 172.21.15.37:0/2110252363 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd880035f0 con 0x563f186a61b0 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.097+0000 7fbd77fff640 1 -- 172.21.15.37:0/2110252363 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88011680 con 0x563f186a61b0 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 -- 172.21.15.37:0/2110252363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 msgr2=0x563f18a74850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a74850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800bbf0 tx=0x7fbd880107a0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 -- 172.21.15.37:0/2110252363 shutdown_connections 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a74d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a74850 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2110252363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 0x563f18a74310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 -- 172.21.15.37:0/2110252363 >> 172.21.15.37:0/2110252363 conn(0x563f186c3460 msgr2=0x563f18a72200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 -- 172.21.15.37:0/2110252363 shutdown_connections 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.098+0000 7fbd9a616740 1 -- 172.21.15.37:0/2110252363 wait complete. 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 1 -- start start 2024-08-31T06:54:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 1 Processor -- start 2024-08-31T06:54:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186a61b0 0x563f18a7fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186ae390 0x563f18a7fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 0x563f18a8be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563f1883d700 con 0x563f186a61b0 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563f18961750 con 0x563f186ae390 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x563f18a82af0 con 0x563f186cf070 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9a616740 10 client.0 _ll_register_callbacks cb 0x563f18990e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9163c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186a61b0 0x563f18a7fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9163c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186a61b0 0x563f18a7fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47052/0 (socket says 172.21.15.37:47052) 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd9163c640 1 -- 172.21.15.37:0/2317071948 learned_addr learned my addr 172.21.15.37:0/2317071948 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.099+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186ae390 0x563f18a7fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9163c640 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 0x563f18a8be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9163c640 1 -- 172.21.15.37:0/2317071948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 msgr2=0x563f18a8be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9163c640 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 0x563f18a8be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9163c640 1 -- 172.21.15.37:0/2317071948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186ae390 msgr2=0x563f18a7fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9163c640 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186ae390 0x563f18a7fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9163c640 1 -- 172.21.15.37:0/2317071948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f1899a900 con 0x563f186a61b0 2024-08-31T06:54:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9163c640 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186a61b0 0x563f18a7fab0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c006010 tx=0x7fbd7c040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53da380ce7ebb54 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd757fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd757fa640 1 -- 172.21.15.37:0/2317071948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c035040 con 0x563f186a61b0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd757fa640 1 -- 172.21.15.37:0/2317071948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7fbd7c0035f0 con 0x563f186a61b0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9a616740 1 -- 172.21.15.37:0/2317071948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd880035f0 con 0x563f186a61b0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd757fa640 1 -- 172.21.15.37:0/2317071948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd7c0037f0 con 0x563f186a61b0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9a616740 10 client.17229 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.100+0000 7fbd9a616740 1 -- 172.21.15.37:0/2317071948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f18a8e950 con 0x563f186a61b0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd757fa640 1 -- 172.21.15.37:0/2317071948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd880035f0 con 0x563f186a61b0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd757fa640 1 -- 172.21.15.37:0/2317071948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd7c03a040 con 0x563f186a61b0 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd9a616740 10 client.17229 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd9a616740 10 client.17229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd9a616740 20 client.17229 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563f1868d9f0 0x563f18a91d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd9a616740 4 client.17229 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd9a616740 1 -- 172.21.15.37:0/2317071948 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f189ed5d0 con 0x563f1868d9f0 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.101+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563f1868d9f0 0x563f18a91d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.102+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563f1868d9f0 0x563f18a91d90 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e91fdca2b14fe0 server_cookie=eb9f26a20cc9d4a7 in_seq=0 out_seq=0 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.102+0000 7fbd757fa640 10 client.17229 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.102+0000 7fbd757fa640 1 -- 172.21.15.37:0/2317071948 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f189ed5d0 con 0x563f1868d9f0 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.102+0000 7fbd757fa640 10 client.17229 handle_command_reply: tid=0 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.102+0000 7fbd9a616740 1 client.17229 shutdown 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.102+0000 7fbd9a616740 1 -- 172.21.15.37:0/2317071948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186a61b0 msgr2=0x563f18a7fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.102+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186a61b0 0x563f18a7fab0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c006010 tx=0x7fbd7c040040 comp rx=0 tx=0).stop 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 1 -- 172.21.15.37:0/2317071948 shutdown_connections 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563f1868d9f0 0x563f18a91d90 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186cf070 0x563f18a8be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186ae390 0x563f18a7fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd757fa640 0 client.17229 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 1 --2- 172.21.15.37:0/2317071948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186a61b0 0x563f18a7fab0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 1 -- 172.21.15.37:0/2317071948 >> 172.21.15.37:0/2317071948 conn(0x563f186c3460 msgr2=0x563f18a774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 1 -- 172.21.15.37:0/2317071948 shutdown_connections 2024-08-31T06:54:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 1 -- 172.21.15.37:0/2317071948 wait complete. 2024-08-31T06:54:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.103+0000 7fbd9a616740 20 client.17229 trim_cache size 0 max 16384 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9a616740 1 Processor -- start 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9a616740 1 -- start start 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a77b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186ae390 0x563f18a7cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186cf070 0x563f18a7d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9a616740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1b3ef0 con 0x563f186cf070 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9a616740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1b17c0 con 0x563f186a61b0 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9a616740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1af630 con 0x563f186ae390 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9163c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186cf070 0x563f18a7d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9163c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186cf070 0x563f18a7d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47058/0 (socket says 172.21.15.37:47058) 2024-08-31T06:54:14.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9163c640 1 -- 172.21.15.37:0/911800067 learned_addr learned my addr 172.21.15.37:0/911800067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd9163c640 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a77b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.116+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186ae390 0x563f18a7cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd9163c640 1 -- 172.21.15.37:0/911800067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186ae390 msgr2=0x563f18a7cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd9163c640 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186ae390 0x563f18a7cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd9163c640 1 -- 172.21.15.37:0/911800067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 msgr2=0x563f18a77b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd9163c640 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a77b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd9163c640 1 -- 172.21.15.37:0/911800067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f18a76600 con 0x563f186cf070 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186ae390 0x563f18a7cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd9163c640 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186cf070 0x563f18a7d1e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c02a9a0 tx=0x7fbd7c03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cafe999af646821 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd777fe640 1 -- 172.21.15.37:0/911800067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c035070 con 0x563f186cf070 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd777fe640 1 -- 172.21.15.37:0/911800067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd7c031a20 con 0x563f186cf070 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.117+0000 7fbd777fe640 1 -- 172.21.15.37:0/911800067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c003bf0 con 0x563f186cf070 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 -- 172.21.15.37:0/911800067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186cf070 msgr2=0x563f18a7d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186cf070 0x563f18a7d1e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c02a9a0 tx=0x7fbd7c03f040 comp rx=0 tx=0).stop 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 -- 172.21.15.37:0/911800067 shutdown_connections 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186cf070 0x563f18a7d1e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186ae390 0x563f18a7cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 --2- 172.21.15.37:0/911800067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186a61b0 0x563f18a77b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 -- 172.21.15.37:0/911800067 >> 172.21.15.37:0/911800067 conn(0x563f186c3460 msgr2=0x563f18a77410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 -- 172.21.15.37:0/911800067 shutdown_connections 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 -- 172.21.15.37:0/911800067 wait complete. 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 -- start start 2024-08-31T06:54:14.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.118+0000 7fbd9a616740 1 Processor -- start 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186a61b0 0x563f18a883c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a848d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9a616740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186cf070 0x563f18a84e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9a616740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1afc80 con 0x563f186ae390 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9a616740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1b10f0 con 0x563f186cf070 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9a616740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1b0350 con 0x563f186a61b0 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9a616740 10 client.0 _ll_register_callbacks cb 0x7fbd7c031650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a848d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a848d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47072/0 (socket says 172.21.15.37:47072) 2024-08-31T06:54:14.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 -- 172.21.15.37:0/4014411342 learned_addr learned my addr 172.21.15.37:0/4014411342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9163c640 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186a61b0 0x563f18a883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd9163c640 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186cf070 0x563f18a84e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 -- 172.21.15.37:0/4014411342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186a61b0 msgr2=0x563f18a883c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186a61b0 0x563f18a883c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 -- 172.21.15.37:0/4014411342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186cf070 msgr2=0x563f18a84e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186cf070 0x563f18a84e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 -- 172.21.15.37:0/4014411342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f18a853d0 con 0x563f186ae390 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd91e3d640 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a848d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800bb10 tx=0x7fbd8800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7143d7fc7561694 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.119+0000 7fbd757fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd757fa640 1 -- 172.21.15.37:0/4014411342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88005450 con 0x563f186ae390 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 1 -- 172.21.15.37:0/4014411342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7c031a20 con 0x563f186ae390 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd757fa640 1 -- 172.21.15.37:0/4014411342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7fbd880055f0 con 0x563f186ae390 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd757fa640 1 -- 172.21.15.37:0/4014411342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd88035050 con 0x563f186ae390 2024-08-31T06:54:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 10 client.17235 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 1 -- 172.21.15.37:0/4014411342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563f18afd510 con 0x563f186ae390 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd757fa640 1 -- 172.21.15.37:0/4014411342 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd7c031a20 con 0x563f186ae390 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd757fa640 1 -- 172.21.15.37:0/4014411342 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd880287c0 con 0x563f186ae390 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 10 client.17235 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 20 client.17235 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563f18662da0 0x563f18affaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 4 client.17235 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.120+0000 7fbd9a616740 1 -- 172.21.15.37:0/4014411342 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f189e9070 con 0x563f18662da0 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.121+0000 7fbd9163c640 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563f18662da0 0x563f18affaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.121+0000 7fbd9163c640 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563f18662da0 0x563f18affaa0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a2bf90f512ab28b server_cookie=ba646b0743d0e1f in_seq=0 out_seq=0 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.121+0000 7fbd757fa640 10 client.17235 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.121+0000 7fbd757fa640 1 -- 172.21.15.37:0/4014411342 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f189e9070 con 0x563f18662da0 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.121+0000 7fbd757fa640 10 client.17235 handle_command_reply: tid=0 2024-08-31T06:54:14.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.121+0000 7fbd9a616740 1 client.17235 shutdown 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.121+0000 7fbd9a616740 1 -- 172.21.15.37:0/4014411342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 msgr2=0x563f18a848d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.121+0000 7fbd9a616740 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a848d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800bb10 tx=0x7fbd8800bec0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 1 -- 172.21.15.37:0/4014411342 shutdown_connections 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563f18662da0 0x563f18affaa0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f186ae390 0x563f18a848d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x563f186cf070 0x563f18a84e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd757fa640 0 client.17235 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 1 --2- 172.21.15.37:0/4014411342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563f186a61b0 0x563f18a883c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 1 -- 172.21.15.37:0/4014411342 >> 172.21.15.37:0/4014411342 conn(0x563f186c3460 msgr2=0x563f18a80f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 1 -- 172.21.15.37:0/4014411342 shutdown_connections 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 1 -- 172.21.15.37:0/4014411342 wait complete. 2024-08-31T06:54:14.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd9a616740 20 client.17235 trim_cache size 0 max 16384 2024-08-31T06:54:14.128 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 -- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd780b4ca0 msgr2=0x7fbd780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd780b4ca0 0x7fbd780b71b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbd840e2f40 tx=0x7fbd840792d0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 -- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c10ff40 msgr2=0x7fbd8c1a1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c10ff40 0x7fbd8c1a1b90 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400eaa0 tx=0x7fbd8400ef60 comp rx=0 tx=0).stop 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 -- 172.21.15.37:0/2599197921 shutdown_connections 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd780b4ca0 0x7fbd780b71b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd8c10ff40 0x7fbd8c1a1b90 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd8c102ce0 0x7fbd8c19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 --2- 172.21.15.37:0/2599197921 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd8c102390 0x7fbd8c19c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.122+0000 7fbd940a1640 1 -- 172.21.15.37:0/2599197921 >> 172.21.15.37:0/2599197921 conn(0x7fbd8c0794e0 msgr2=0x7fbd8c111450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.123+0000 7fbd940a1640 1 -- 172.21.15.37:0/2599197921 shutdown_connections 2024-08-31T06:54:14.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:14.123+0000 7fbd940a1640 1 -- 172.21.15.37:0/2599197921 wait complete. 2024-08-31T06:54:14.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:13 smithi066 ceph-mon[22244]: pgmap v544: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:15.808 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:54:15.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:54:16.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:15 smithi106 ceph-mon[22134]: pgmap v545: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:16.070 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:16.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:15 smithi037 ceph-mon[18612]: pgmap v545: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:16.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:15 smithi066 ceph-mon[22244]: pgmap v545: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:16.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/3730515581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 msgr2=0x7f8db810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/3730515581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 0x7f8db810d650 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8dac009900 tx=0x7f8dac02a410 comp rx=0 tx=0).stop 2024-08-31T06:54:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/3730515581 shutdown_connections 2024-08-31T06:54:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/3730515581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 0x7f8db810d650 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/3730515581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8db810db90 0x7f8db81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/3730515581 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8db81045e0 0x7f8db81049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/3730515581 >> 172.21.15.37:0/3730515581 conn(0x7f8db80794d0 msgr2=0x7f8db80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/3730515581 shutdown_connections 2024-08-31T06:54:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.526+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/3730515581 wait complete. 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8dbe5c9640 1 Processor -- start 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8dbe5c9640 1 -- start start 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8dbe5c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8db81045e0 0x7f8db81024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8dbe5c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 0x7f8db8102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8dbe5c9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8db810db90 0x7f8db8102f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8dbe5c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8113680 con 0x7f8db8105010 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8dbe5c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8113500 con 0x7f8db81045e0 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8dbe5c9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8db8113800 con 0x7f8db810db90 2024-08-31T06:54:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8db77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 0x7f8db8102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8db77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 0x7f8db8102a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44332/0 (socket says 172.21.15.37:44332) 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8db77fe640 1 -- 172.21.15.37:0/956513754 learned_addr learned my addr 172.21.15.37:0/956513754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.527+0000 7f8db7fff640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8db81045e0 0x7f8db81024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8dbcb66640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8db810db90 0x7f8db8102f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db77fe640 1 -- 172.21.15.37:0/956513754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8db810db90 msgr2=0x7f8db8102f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db77fe640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8db810db90 0x7f8db8102f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db77fe640 1 -- 172.21.15.37:0/956513754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8db81045e0 msgr2=0x7f8db81024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db77fe640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8db81045e0 0x7f8db81024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db77fe640 1 -- 172.21.15.37:0/956513754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db81a8410 con 0x7f8db8105010 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db7fff640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8db81045e0 0x7f8db81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8dbcb66640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8db810db90 0x7f8db8102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db77fe640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 0x7f8db8102a30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8dac005940 tx=0x7f8dac0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db57fa640 1 -- 172.21.15.37:0/956513754 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac03f030 con 0x7f8db8105010 2024-08-31T06:54:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/956513754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db81a86a0 con 0x7f8db8105010 2024-08-31T06:54:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db57fa640 1 -- 172.21.15.37:0/956513754 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dac003a80 con 0x7f8db8105010 2024-08-31T06:54:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8db57fa640 1 -- 172.21.15.37:0/956513754 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac035070 con 0x7f8db8105010 2024-08-31T06:54:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.528+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/956513754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db81a8b80 con 0x7f8db8105010 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dc4b3e740 1 Processor -- start 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dc4b3e740 1 -- start start 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8db57fa640 1 -- 172.21.15.37:0/956513754 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f8dac042030 con 0x7f8db8105010 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211535350 0x5572118db780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55721150c490 0x5572118dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118dc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572118515f0 con 0x557211514670 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557211840b80 con 0x55721150c490 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557211844b30 con 0x557211535350 2024-08-31T06:54:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8db77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118dc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8db77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118dc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44336/0 (socket says 172.21.15.37:44336) 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8db77fe640 1 -- 172.21.15.37:0/1648317364 learned_addr learned my addr 172.21.15.37:0/1648317364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8dbcb66640 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211535350 0x5572118db780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.531+0000 7f8db7fff640 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55721150c490 0x5572118dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8db77fe640 1 -- 172.21.15.37:0/1648317364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211535350 msgr2=0x5572118db780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8db77fe640 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211535350 0x5572118db780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8db77fe640 1 -- 172.21.15.37:0/1648317364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55721150c490 msgr2=0x5572118dbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8db77fe640 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55721150c490 0x5572118dbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8db77fe640 1 -- 172.21.15.37:0/1648317364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572115a0930 con 0x557211514670 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8db57fa640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8da00b4ca0 0x7f8da00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8dbcb66640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8da00b4ca0 0x7f8da00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8db77fe640 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118dc200 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8dac103220 tx=0x7f8dac109e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3c4a710f891a11 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8db57fa640 1 -- 172.21.15.37:0/956513754 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7f8dac105b70 con 0x7f8db8105010 2024-08-31T06:54:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8d9e7fc640 1 -- 172.21.15.37:0/1648317364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac049070 con 0x557211514670 2024-08-31T06:54:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8d9e7fc640 1 -- 172.21.15.37:0/1648317364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dac0cbd60 con 0x557211514670 2024-08-31T06:54:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.532+0000 7f8d9e7fc640 1 -- 172.21.15.37:0/1648317364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0c8110 con 0x557211514670 2024-08-31T06:54:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1648317364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 msgr2=0x5572118dc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118dc200 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8dac103220 tx=0x7f8dac109e40 comp rx=0 tx=0).stop 2024-08-31T06:54:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dbcb66640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8da00b4ca0 0x7f8da00b71b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8db0005fd0 tx=0x7f8db0009790 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1648317364 shutdown_connections 2024-08-31T06:54:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118dc200 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55721150c490 0x5572118dbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1648317364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211535350 0x5572118db780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1648317364 >> 172.21.15.37:0/1648317364 conn(0x557211529740 msgr2=0x5572118d9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1648317364 shutdown_connections 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.533+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1648317364 wait complete. 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 1 -- start start 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 1 Processor -- start 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55721150c490 0x5572118e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118e7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572116a3890 con 0x557211514670 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5572117c7790 con 0x557211535350 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5572118e9d20 con 0x55721150c490 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8dc4b3e740 10 client.0 _ll_register_callbacks cb 0x55721154cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8db77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55721150c490 0x5572118e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8db77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118e7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44338/0 (socket says 172.21.15.37:44338) 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.534+0000 7f8db77fe640 1 -- 172.21.15.37:0/1273950271 learned_addr learned my addr 172.21.15.37:0/1273950271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8dbcb66640 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8db77fe640 1 -- 172.21.15.37:0/1273950271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55721150c490 msgr2=0x5572118e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8db77fe640 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55721150c490 0x5572118e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8db77fe640 1 -- 172.21.15.37:0/1273950271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 msgr2=0x5572118f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8db77fe640 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8db77fe640 1 -- 172.21.15.37:0/1273950271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572117fef30 con 0x557211514670 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8db7fff640 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55721150c490 0x5572118e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8db77fe640 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118e7440 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8dac000c00 tx=0x7f8dac109ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e93d10cbab4d83f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8d977fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8d977fe640 1 -- 172.21.15.37:0/1273950271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac049050 con 0x557211514670 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8d977fe640 1 -- 172.21.15.37:0/1273950271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7f8dac103530 con 0x557211514670 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1273950271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dac0cbd60 con 0x557211514670 2024-08-31T06:54:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8d977fe640 1 -- 172.21.15.37:0/1273950271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8dac0044e0 con 0x557211514670 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8dc4b3e740 10 client.17247 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.535+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1273950271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5572118f5a30 con 0x557211514670 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8d977fe640 1 -- 172.21.15.37:0/1273950271 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8dac0cbd60 con 0x557211514670 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8d977fe640 1 -- 172.21.15.37:0/1273950271 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8dac0cc4b0 con 0x557211514670 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8dc4b3e740 10 client.17247 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8dc4b3e740 10 client.17247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8dc4b3e740 20 client.17247 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5572114f3cd0 0x5572118f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8dc4b3e740 4 client.17247 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1273950271 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557211853540 con 0x5572114f3cd0 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.536+0000 7f8db7fff640 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5572114f3cd0 0x5572118f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.537+0000 7f8d977fe640 10 client.17247 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.537+0000 7f8db7fff640 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5572114f3cd0 0x5572118f8d90 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643ee05626fa89ee server_cookie=48c5447f7b145c99 in_seq=0 out_seq=0 2024-08-31T06:54:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.537+0000 7f8d977fe640 1 -- 172.21.15.37:0/1273950271 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557211853540 con 0x5572114f3cd0 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.537+0000 7f8d977fe640 10 client.17247 handle_command_reply: tid=0 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 client.17247 shutdown 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1273950271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 msgr2=0x5572118e7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118e7440 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8dac000c00 tx=0x7f8dac109ad0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1273950271 shutdown_connections 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5572114f3cd0 0x5572118f8d90 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557211514670 0x5572118e7440 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/1273950271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55721150c490 0x5572118e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1273950271 >> 172.21.15.37:0/1273950271 conn(0x557211529740 msgr2=0x5572118de910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8d977fe640 0 client.17247 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1273950271 shutdown_connections 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/1273950271 wait complete. 2024-08-31T06:54:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.538+0000 7f8dc4b3e740 20 client.17247 trim_cache size 0 max 16384 2024-08-31T06:54:16.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8dc4b3e740 1 Processor -- start 2024-08-31T06:54:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8dc4b3e740 1 -- start start 2024-08-31T06:54:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 0x5572118dcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118d8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81b3e60 con 0x55721150c490 2024-08-31T06:54:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81b1730 con 0x557211535350 2024-08-31T06:54:16.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81af5a0 con 0x557211514670 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118e26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44346/0 (socket says 172.21.15.37:44346) 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.556+0000 7f8db7fff640 1 -- 172.21.15.37:0/909140799 learned_addr learned my addr 172.21.15.37:0/909140799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8db77fe640 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 0x5572118dcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8dbcb66640 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118d8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8db7fff640 1 -- 172.21.15.37:0/909140799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 msgr2=0x5572118dcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8db7fff640 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 0x5572118dcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8db7fff640 1 -- 172.21.15.37:0/909140799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 msgr2=0x5572118d8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8db7fff640 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118d8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8db7fff640 1 -- 172.21.15.37:0/909140799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572118e5e60 con 0x55721150c490 2024-08-31T06:54:16.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8db7fff640 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118e26b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8db8103f40 tx=0x7f8da8014900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51b5d719abd8264 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:16.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8d9dffb640 1 -- 172.21.15.37:0/909140799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80141d0 con 0x55721150c490 2024-08-31T06:54:16.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8d9dffb640 1 -- 172.21.15.37:0/909140799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8da80054b0 con 0x55721150c490 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.557+0000 7f8d9dffb640 1 -- 172.21.15.37:0/909140799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8011500 con 0x55721150c490 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/909140799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 msgr2=0x5572118e26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118e26b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8db8103f40 tx=0x7f8da8014900 comp rx=0 tx=0).stop 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/909140799 shutdown_connections 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118d8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 0x5572118dcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/909140799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118e26b0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/909140799 >> 172.21.15.37:0/909140799 conn(0x557211529740 msgr2=0x5572118dc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/909140799 shutdown_connections 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/909140799 wait complete. 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.558+0000 7f8dc4b3e740 1 -- start start 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8dc4b3e740 1 Processor -- start 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118ef770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 0x5572118eac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8dc4b3e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118eb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81afbf0 con 0x55721150c490 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81b1060 con 0x557211535350 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8dc4b3e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8db81b02c0 con 0x557211514670 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8dc4b3e740 10 client.0 _ll_register_callbacks cb 0x7f8da8009380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118ef770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44352/0 (socket says 172.21.15.37:44352) 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.559+0000 7f8db7fff640 1 -- 172.21.15.37:0/3373736182 learned_addr learned my addr 172.21.15.37:0/3373736182 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8db77fe640 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 0x5572118eac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8dbcb66640 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118eb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8db7fff640 1 -- 172.21.15.37:0/3373736182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 msgr2=0x5572118eac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8db7fff640 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 0x5572118eac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8db7fff640 1 -- 172.21.15.37:0/3373736182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 msgr2=0x5572118eb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8db7fff640 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118eb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8db7fff640 1 -- 172.21.15.37:0/3373736182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572118eb990 con 0x55721150c490 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8db7fff640 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118ef770 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f8da8006010 tx=0x7f8da8014260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21c1c72beb18412 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8d977fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8d977fe640 1 -- 172.21.15.37:0/3373736182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8005020 con 0x55721150c490 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8d977fe640 1 -- 172.21.15.37:0/3373736182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8543+0+0 (secure 0 0 0) 0x7f8da8020030 con 0x55721150c490 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/3373736182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da80054b0 con 0x55721150c490 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8d977fe640 1 -- 172.21.15.37:0/3373736182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8da80051c0 con 0x55721150c490 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8dc4b3e740 10 client.17253 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.560+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/3373736182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5572119636c0 con 0x55721150c490 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8d977fe640 1 -- 172.21.15.37:0/3373736182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8da80054b0 con 0x55721150c490 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8d977fe640 1 -- 172.21.15.37:0/3373736182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8da800f040 con 0x55721150c490 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8dc4b3e740 10 client.17253 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8dc4b3e740 10 client.17253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8dc4b3e740 20 client.17253 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5572114c9080 0x557211965e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8dc4b3e740 4 client.17253 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/3373736182 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55721184efe0 con 0x5572114c9080 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.561+0000 7f8db77fe640 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5572114c9080 0x557211965e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.562+0000 7f8db77fe640 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5572114c9080 0x557211965e00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f88ee8aefa7e03e server_cookie=78ccf36fcbd27288 in_seq=0 out_seq=0 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.562+0000 7f8d977fe640 10 client.17253 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.563+0000 7f8d977fe640 1 -- 172.21.15.37:0/3373736182 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55721184efe0 con 0x5572114c9080 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.563+0000 7f8d977fe640 10 client.17253 handle_command_reply: tid=0 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.563+0000 7f8dc4b3e740 1 client.17253 shutdown 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/3373736182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 msgr2=0x5572118ef770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118ef770 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f8da8006010 tx=0x7f8da8014260 comp rx=0 tx=0).stop 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/3373736182 shutdown_connections 2024-08-31T06:54:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5572114c9080 0x557211965e00 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557211535350 0x5572118eb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557211514670 0x5572118eac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 --2- 172.21.15.37:0/3373736182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55721150c490 0x5572118ef770 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8d977fe640 0 client.17253 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/3373736182 >> 172.21.15.37:0/3373736182 conn(0x557211529740 msgr2=0x5572118dc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/3373736182 shutdown_connections 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 1 -- 172.21.15.37:0/3373736182 wait complete. 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dc4b3e740 20 client.17253 trim_cache size 0 max 16384 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:16.570 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:54:16.571 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "8cea6733-dd4f-4433-886c-26c13da5de04", 2024-08-31T06:54:16.571 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:54:16.571 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:16.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8da00b4ca0 msgr2=0x7f8da00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8da00b4ca0 0x7f8da00b71b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8db0005fd0 tx=0x7f8db0009790 comp rx=0 tx=0).stop 2024-08-31T06:54:16.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 msgr2=0x7f8db8102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.564+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 0x7f8db8102a30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8dac005940 tx=0x7f8dac0040e0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.565+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/956513754 shutdown_connections 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.565+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f8da00b4ca0 0x7f8da00b71b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.565+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8db8105010 0x7f8db8102a30 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.565+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8db810db90 0x7f8db8102f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.565+0000 7f8dbe5c9640 1 --2- 172.21.15.37:0/956513754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8db81045e0 0x7f8db81024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.565+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/956513754 >> 172.21.15.37:0/956513754 conn(0x7f8db80794d0 msgr2=0x7f8db80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.565+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/956513754 shutdown_connections 2024-08-31T06:54:16.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:16.565+0000 7f8dbe5c9640 1 -- 172.21.15.37:0/956513754 wait complete. 2024-08-31T06:54:17.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:16 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:54:17.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:16 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:17.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:16 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:54:17.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:16 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:17.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:16 smithi106 ceph-mon[22134]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T06:54:17.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:16 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:54:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:16 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:16 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:54:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:16 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:17.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:16 smithi037 ceph-mon[18612]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T06:54:17.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:16 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:54:17.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:16 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:17.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:16 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:54:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:16 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:17.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:16 smithi066 ceph-mon[22244]: osdmap e80: 12 total, 12 up, 12 in 2024-08-31T06:54:17.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:54:17.530 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:17.940 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:17 smithi037 ceph-mon[18612]: pgmap v546: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:17.940 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:17 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:54:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 -- 172.21.15.37:0/3772939746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c102f40 msgr2=0x7fbc9c107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 --2- 172.21.15.37:0/3772939746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c102f40 0x7fbc9c107470 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009930 tx=0x7fbc8c02a420 comp rx=0 tx=0).stop 2024-08-31T06:54:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 -- 172.21.15.37:0/3772939746 shutdown_connections 2024-08-31T06:54:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 --2- 172.21.15.37:0/3772939746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c102f40 0x7fbc9c107470 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 --2- 172.21.15.37:0/3772939746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc9c107a30 0x7fbc9c107f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 --2- 172.21.15.37:0/3772939746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c1025f0 0x7fbc9c102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 -- 172.21.15.37:0/3772939746 >> 172.21.15.37:0/3772939746 conn(0x7fbc9c079470 msgr2=0x7fbc9c079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 -- 172.21.15.37:0/3772939746 shutdown_connections 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 -- 172.21.15.37:0/3772939746 wait complete. 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 Processor -- start 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.032+0000 7fbca3391640 1 -- start start 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca3391640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c1025f0 0x7fbc9c1a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca3391640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc9c102f40 0x7fbc9c1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca3391640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c107a30 0x7fbc9c1a6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca3391640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c119d80 con 0x7fbc9c107a30 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca3391640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c119c00 con 0x7fbc9c102f40 2024-08-31T06:54:18.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca3391640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c119f00 con 0x7fbc9c1025f0 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c107a30 0x7fbc9c1a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c107a30 0x7fbc9c1a6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44370/0 (socket says 172.21.15.37:44370) 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 -- 172.21.15.37:0/4053517512 learned_addr learned my addr 172.21.15.37:0/4053517512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca092c640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc9c102f40 0x7fbc9c1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca112d640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c1025f0 0x7fbc9c1a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 -- 172.21.15.37:0/4053517512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c1025f0 msgr2=0x7fbc9c1a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c1025f0 0x7fbc9c1a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 -- 172.21.15.37:0/4053517512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc9c102f40 msgr2=0x7fbc9c1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc9c102f40 0x7fbc9c1a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 -- 172.21.15.37:0/4053517512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9c1a6680 con 0x7fbc9c107a30 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.033+0000 7fbca192e640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c107a30 0x7fbc9c1a6010 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400cce0 tx=0x7fbc9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.034+0000 7fbc927fc640 1 -- 172.21.15.37:0/4053517512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400f450 con 0x7fbc9c107a30 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.034+0000 7fbc927fc640 1 -- 172.21.15.37:0/4053517512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc9400fa80 con 0x7fbc9c107a30 2024-08-31T06:54:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.034+0000 7fbca3391640 1 -- 172.21.15.37:0/4053517512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9c1a6970 con 0x7fbc9c107a30 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.034+0000 7fbc927fc640 1 -- 172.21.15.37:0/4053517512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94018ad0 con 0x7fbc9c107a30 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.034+0000 7fbca3391640 1 -- 172.21.15.37:0/4053517512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9c1a6e30 con 0x7fbc9c107a30 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.037+0000 7fbca9906740 1 Processor -- start 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.037+0000 7fbc927fc640 1 -- 172.21.15.37:0/4053517512 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fbc9400f5f0 con 0x7fbc9c107a30 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.037+0000 7fbca9906740 1 -- start start 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca9906740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e2ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca9906740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 0x55f96e2ea800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca9906740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2ead40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca9906740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f96e261630 con 0x55f96df24390 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca9906740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f96e250bc0 con 0x55f96df45070 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca9906740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55f96e254b70 con 0x55f96df1c1b0 2024-08-31T06:54:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2ead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2ead40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44384/0 (socket says 172.21.15.37:44384) 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 -- 172.21.15.37:0/3016615474 learned_addr learned my addr 172.21.15.37:0/3016615474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e2ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca112d640 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 0x55f96e2ea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbc927fc640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbc880b4cd0 0x7fbc880b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 -- 172.21.15.37:0/3016615474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 msgr2=0x55f96e2ea800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 0x55f96e2ea800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 -- 172.21.15.37:0/3016615474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 msgr2=0x55f96e2ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e2ea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 -- 172.21.15.37:0/3016615474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96dfb0650 con 0x55f96df24390 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca192e640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbc880b4cd0 0x7fbc880b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbca092c640 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2ead40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c005940 tx=0x7fbc8c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35649d2f6b85784c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.038+0000 7fbc927fc640 1 -- 172.21.15.37:0/4053517512 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbc940e5e20 con 0x7fbc9c107a30 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.039+0000 7fbc877fe640 1 -- 172.21.15.37:0/3016615474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c035050 con 0x55f96df24390 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.039+0000 7fbc877fe640 1 -- 172.21.15.37:0/3016615474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc8c0044b0 con 0x55f96df24390 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.039+0000 7fbc877fe640 1 -- 172.21.15.37:0/3016615474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c003e20 con 0x55f96df24390 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 -- 172.21.15.37:0/3016615474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 msgr2=0x55f96e2ead40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2ead40 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c005940 tx=0x7fbc8c005a20 comp rx=0 tx=0).stop 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca192e640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbc880b4cd0 0x7fbc880b71e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbc94058010 tx=0x7fbc94079960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 -- 172.21.15.37:0/3016615474 shutdown_connections 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2ead40 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 0x55f96e2ea800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 --2- 172.21.15.37:0/3016615474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e2ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 -- 172.21.15.37:0/3016615474 >> 172.21.15.37:0/3016615474 conn(0x55f96df39460 msgr2=0x55f96e2e81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 -- 172.21.15.37:0/3016615474 shutdown_connections 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 -- 172.21.15.37:0/3016615474 wait complete. 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 -- start start 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.040+0000 7fbca9906740 1 Processor -- start 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca9906740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 0x55f96e2f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca9906740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2f6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca9906740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e301d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca9906740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f96e0b3700 con 0x55f96df24390 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca9906740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55f96e1d7700 con 0x55f96df45070 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca9906740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55f96e2f8a40 con 0x55f96df1c1b0 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca9906740 10 client.0 _ll_register_callbacks cb 0x55f96e206dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca112d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2f6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca112d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2f6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44396/0 (socket says 172.21.15.37:44396) 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca112d640 1 -- 172.21.15.37:0/1415368322 learned_addr learned my addr 172.21.15.37:0/1415368322 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca092c640 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 0x55f96e2f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca112d640 1 -- 172.21.15.37:0/1415368322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 msgr2=0x55f96e2f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca112d640 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 0x55f96e2f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca112d640 1 -- 172.21.15.37:0/1415368322 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 msgr2=0x55f96e301d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca112d640 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e301d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.041+0000 7fbca112d640 1 -- 172.21.15.37:0/1415368322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96e2108b0 con 0x55f96df24390 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca112d640 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2f6040 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fbc98010770 tx=0x7fbc98010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394a710c275ed12e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbc84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbc84ff9640 1 -- 172.21.15.37:0/1415368322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9801d060 con 0x55f96df24390 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbc84ff9640 1 -- 172.21.15.37:0/1415368322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbc9800eda0 con 0x55f96df24390 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 1 -- 172.21.15.37:0/1415368322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc8c0044b0 con 0x55f96df24390 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbc84ff9640 1 -- 172.21.15.37:0/1415368322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbc98018430 con 0x55f96df24390 2024-08-31T06:54:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 10 client.17265 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 1 -- 172.21.15.37:0/1415368322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f96e304900 con 0x55f96df24390 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbc84ff9640 1 -- 172.21.15.37:0/1415368322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc8c0044b0 con 0x55f96df24390 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbc84ff9640 1 -- 172.21.15.37:0/1415368322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbc9800d430 con 0x55f96df24390 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 10 client.17265 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 10 client.17265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 20 client.17265 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f96df039f0 0x55f96e307e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 4 client.17265 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.042+0000 7fbca9906740 1 -- 172.21.15.37:0/1415368322 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f96e263580 con 0x55f96df039f0 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.043+0000 7fbca092c640 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f96df039f0 0x55f96e307e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.043+0000 7fbc84ff9640 10 client.17265 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.043+0000 7fbca092c640 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f96df039f0 0x55f96e307e50 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11e967f31da9b944 server_cookie=ab6bd8c43d1bb1ae in_seq=0 out_seq=0 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbc84ff9640 1 -- 172.21.15.37:0/1415368322 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f96e263580 con 0x55f96df039f0 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbc84ff9640 10 client.17265 handle_command_reply: tid=0 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 client.17265 shutdown 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 -- 172.21.15.37:0/1415368322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 msgr2=0x55f96e2f6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2f6040 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fbc98010770 tx=0x7fbc98010c30 comp rx=0 tx=0).stop 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 -- 172.21.15.37:0/1415368322 shutdown_connections 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f96df039f0 0x55f96e307e50 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e2f6040 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e301d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbc84ff9640 0 client.17265 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:18.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 --2- 172.21.15.37:0/1415368322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df1c1b0 0x55f96e2f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 -- 172.21.15.37:0/1415368322 >> 172.21.15.37:0/1415368322 conn(0x55f96df39460 msgr2=0x55f96e2ed4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 -- 172.21.15.37:0/1415368322 shutdown_connections 2024-08-31T06:54:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.044+0000 7fbca9906740 1 -- 172.21.15.37:0/1415368322 wait complete. 2024-08-31T06:54:18.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.045+0000 7fbca9906740 20 client.17265 trim_cache size 0 max 16384 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.062+0000 7fbca9906740 1 Processor -- start 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.062+0000 7fbca9906740 1 -- start start 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.062+0000 7fbca9906740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df1c1b0 0x55f96e2f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca9906740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e301c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca9906740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df45070 0x55f96e302170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca9906740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c1b8180 con 0x55f96df24390 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca9906740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c1b5a50 con 0x55f96df1c1b0 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca9906740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c1b38c0 con 0x55f96df45070 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e301c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e301c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44410/0 (socket says 172.21.15.37:44410) 2024-08-31T06:54:18.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 -- 172.21.15.37:0/2606719191 learned_addr learned my addr 172.21.15.37:0/2606719191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca092c640 1 --2- 172.21.15.37:0/2606719191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df45070 0x55f96e302170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 -- 172.21.15.37:0/2606719191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df45070 msgr2=0x55f96e302170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 --2- 172.21.15.37:0/2606719191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df45070 0x55f96e302170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 -- 172.21.15.37:0/2606719191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df1c1b0 msgr2=0x55f96e2f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 --2- 172.21.15.37:0/2606719191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df1c1b0 0x55f96e2f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 -- 172.21.15.37:0/2606719191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f96e2f64c0 con 0x55f96df24390 2024-08-31T06:54:18.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbca112d640 1 --2- 172.21.15.37:0/2606719191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e301c30 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800b610 tx=0x7fbc9800de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34a2baa07cc065c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:18.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:17 smithi106 ceph-mon[22134]: pgmap v546: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:18.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:17 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:54:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbc86ffd640 1 -- 172.21.15.37:0/2606719191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800d3a0 con 0x55f96df24390 2024-08-31T06:54:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbc86ffd640 1 -- 172.21.15.37:0/2606719191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc9800d540 con 0x55f96df24390 2024-08-31T06:54:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.063+0000 7fbc86ffd640 1 -- 172.21.15.37:0/2606719191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc980056f0 con 0x55f96df24390 2024-08-31T06:54:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 -- 172.21.15.37:0/2606719191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 msgr2=0x55f96e301c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 --2- 172.21.15.37:0/2606719191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e301c30 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800b610 tx=0x7fbc9800de30 comp rx=0 tx=0).stop 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 -- 172.21.15.37:0/2606719191 shutdown_connections 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 --2- 172.21.15.37:0/2606719191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df24390 0x55f96e301c30 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 --2- 172.21.15.37:0/2606719191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df45070 0x55f96e302170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 --2- 172.21.15.37:0/2606719191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df1c1b0 0x55f96e2f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 -- 172.21.15.37:0/2606719191 >> 172.21.15.37:0/2606719191 conn(0x55f96df39460 msgr2=0x55f96e2f5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 -- 172.21.15.37:0/2606719191 shutdown_connections 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.064+0000 7fbca9906740 1 -- 172.21.15.37:0/2606719191 wait complete. 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 1 -- start start 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 1 Processor -- start 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df1c1b0 0x55f96e2f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df24390 0x55f96e2fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e2fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c1b3f10 con 0x55f96df1c1b0 2024-08-31T06:54:18.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c1b5380 con 0x55f96df45070 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c1b45e0 con 0x55f96df24390 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca9906740 10 client.0 _ll_register_callbacks cb 0x7fbc9800b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca092c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df1c1b0 0x55f96e2f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca092c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df1c1b0 0x55f96e2f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44414/0 (socket says 172.21.15.37:44414) 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.065+0000 7fbca092c640 1 -- 172.21.15.37:0/4124704905 learned_addr learned my addr 172.21.15.37:0/4124704905 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca112d640 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df24390 0x55f96e2fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca092c640 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e2fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca092c640 1 -- 172.21.15.37:0/4124704905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df24390 msgr2=0x55f96e2fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca092c640 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df24390 0x55f96e2fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca092c640 1 -- 172.21.15.37:0/4124704905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 msgr2=0x55f96e2fa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca092c640 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e2fa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca092c640 1 -- 172.21.15.37:0/4124704905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f96e3717f0 con 0x55f96df1c1b0 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca092c640 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df1c1b0 0x55f96e2f9c60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c033000 tx=0x7fbc8c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567f9584ca65a6c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:18.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbc84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbc84ff9640 1 -- 172.21.15.37:0/4124704905 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c058020 con 0x55f96df1c1b0 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbc84ff9640 1 -- 172.21.15.37:0/4124704905 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbc8c004030 con 0x55f96df1c1b0 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca9906740 1 -- 172.21.15.37:0/4124704905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc9800d540 con 0x55f96df1c1b0 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbc84ff9640 1 -- 172.21.15.37:0/4124704905 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbc8c054020 con 0x55f96df1c1b0 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca9906740 10 client.17271 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbca9906740 1 -- 172.21.15.37:0/4124704905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f96e372a20 con 0x55f96df1c1b0 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.066+0000 7fbc84ff9640 1 -- 172.21.15.37:0/4124704905 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc9800d540 con 0x55f96df1c1b0 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbc84ff9640 1 -- 172.21.15.37:0/4124704905 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbc8c0035f0 con 0x55f96df1c1b0 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbca9906740 10 client.17271 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbca9906740 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbca9906740 20 client.17271 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbca9906740 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f96ded8da0 0x55f96e374cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbca9906740 4 client.17271 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbca9906740 1 -- 172.21.15.37:0/4124704905 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f96e25f020 con 0x55f96ded8da0 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbca112d640 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f96ded8da0 0x55f96e374cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbca112d640 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f96ded8da0 0x55f96e374cb0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28f86d7677d3f514 server_cookie=bc8fffc4b1848c8e in_seq=0 out_seq=0 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.067+0000 7fbc84ff9640 10 client.17271 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbc84ff9640 1 -- 172.21.15.37:0/4124704905 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x55f96e25f020 con 0x55f96ded8da0 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbc84ff9640 10 client.17271 handle_command_reply: tid=0 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 client.17271 shutdown 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 -- 172.21.15.37:0/4124704905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df1c1b0 msgr2=0x55f96e2f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df1c1b0 0x55f96e2f9c60 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c033000 tx=0x7fbc8c005fd0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 -- 172.21.15.37:0/4124704905 shutdown_connections 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55f96ded8da0 0x55f96e374cb0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbc84ff9640 0 client.17271 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55f96df45070 0x55f96e2fa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f96df24390 0x55f96e2fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 --2- 172.21.15.37:0/4124704905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f96df1c1b0 0x55f96e2f9c60 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 -- 172.21.15.37:0/4124704905 >> 172.21.15.37:0/4124704905 conn(0x55f96df39460 msgr2=0x55f96e2e7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 -- 172.21.15.37:0/4124704905 shutdown_connections 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 1 -- 172.21.15.37:0/4124704905 wait complete. 2024-08-31T06:54:18.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.068+0000 7fbca9906740 20 client.17271 trim_cache size 0 max 16384 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.075 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.076 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.077 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:54:18.078 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:54:18.079 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.080 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.081 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:18.082 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 -- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbc880b4cd0 msgr2=0x7fbc880b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbc880b4cd0 0x7fbc880b71e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbc94058010 tx=0x7fbc94079960 comp rx=0 tx=0).stop 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 -- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c107a30 msgr2=0x7fbc9c1a6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c107a30 0x7fbc9c1a6010 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400cce0 tx=0x7fbc9400a620 comp rx=0 tx=0).stop 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 -- 172.21.15.37:0/4053517512 shutdown_connections 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbc880b4cd0 0x7fbc880b71e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c107a30 0x7fbc9c1a6010 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc9c102f40 0x7fbc9c1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 --2- 172.21.15.37:0/4053517512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc9c1025f0 0x7fbc9c1a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 -- 172.21.15.37:0/4053517512 >> 172.21.15.37:0/4053517512 conn(0x7fbc9c079470 msgr2=0x7fbc9c105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 -- 172.21.15.37:0/4053517512 shutdown_connections 2024-08-31T06:54:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:18.069+0000 7fbca3391640 1 -- 172.21.15.37:0/4053517512 wait complete. 2024-08-31T06:54:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:17 smithi066 ceph-mon[22244]: pgmap v546: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:17 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:54:18.833 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:54:18.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:54:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:19.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 -- 172.21.15.37:0/3518830819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 msgr2=0x7f2710102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:19.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 --2- 172.21.15.37:0/3518830819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 0x7f2710102a30 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2700009900 tx=0x7f270002a410 comp rx=0 tx=0).stop 2024-08-31T06:54:19.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 -- 172.21.15.37:0/3518830819 shutdown_connections 2024-08-31T06:54:19.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 --2- 172.21.15.37:0/3518830819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27101088b0 0x7f271010f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 --2- 172.21.15.37:0/3518830819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2710107f60 0x7f2710108370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 --2- 172.21.15.37:0/3518830819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 0x7f2710102a30 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 -- 172.21.15.37:0/3518830819 >> 172.21.15.37:0/3518830819 conn(0x7f27100fe070 msgr2=0x7f27101004c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 -- 172.21.15.37:0/3518830819 shutdown_connections 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.531+0000 7f270f59e640 1 -- 172.21.15.37:0/3518830819 wait complete. 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.532+0000 7f270f59e640 1 Processor -- start 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.532+0000 7f270f59e640 1 -- start start 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.532+0000 7f270f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 0x7f271019a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:19.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.532+0000 7f270f59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2710107f60 0x7f271019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.532+0000 7f270f59e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27101088b0 0x7f271019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.532+0000 7f270f59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2710112480 con 0x7f2710102620 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.532+0000 7f270f59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2710112300 con 0x7f2710107f60 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.532+0000 7f270f59e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2710112600 con 0x7f27101088b0 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 0x7f271019a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 0x7f271019a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44428/0 (socket says 172.21.15.37:44428) 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 -- 172.21.15.37:0/968666306 learned_addr learned my addr 172.21.15.37:0/968666306 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270ed9d640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27101088b0 0x7f271019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270dd9b640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2710107f60 0x7f271019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 -- 172.21.15.37:0/968666306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27101088b0 msgr2=0x7f271019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27101088b0 0x7f271019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 -- 172.21.15.37:0/968666306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2710107f60 msgr2=0x7f271019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2710107f60 0x7f271019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 -- 172.21.15.37:0/968666306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271019ff90 con 0x7f2710102620 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270e59c640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 0x7f271019a020 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2700009230 tx=0x7f2700004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f26ff7fe640 1 -- 172.21.15.37:0/968666306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f270003f030 con 0x7f2710102620 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27101a0220 con 0x7f2710102620 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f26ff7fe640 1 -- 172.21.15.37:0/968666306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2700003a80 con 0x7f2710102620 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f26ff7fe640 1 -- 172.21.15.37:0/968666306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2700035070 con 0x7f2710102620 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.533+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27101a69e0 con 0x7f2710102620 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.534+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2710102a30 con 0x7f2710102620 2024-08-31T06:54:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.536+0000 7f26ff7fe640 1 -- 172.21.15.37:0/968666306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f2700042030 con 0x7f2710102620 2024-08-31T06:54:19.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.536+0000 7f26ff7fe640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26f80b4ca0 0x7f26f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:19.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.537+0000 7f270dd9b640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26f80b4ca0 0x7f26f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:19.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.537+0000 7f26ff7fe640 1 -- 172.21.15.37:0/968666306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f27001060e0 con 0x7f2710102620 2024-08-31T06:54:19.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.537+0000 7f270dd9b640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26f80b4ca0 0x7f26f80b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2704005fd0 tx=0x7f2704005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:19.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.540+0000 7f26ff7fe640 1 -- 172.21.15.37:0/968666306 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f27000ccee0 con 0x7f2710102620 2024-08-31T06:54:19.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.766+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f271019b150 con 0x7f2710102620 2024-08-31T06:54:19.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.766+0000 7f26ff7fe640 1 -- 172.21.15.37:0/968666306 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f271019b150 con 0x7f2710102620 2024-08-31T06:54:19.768 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:54:19.768 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:54:19.768 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:54:19.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26f80b4ca0 msgr2=0x7f26f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26f80b4ca0 0x7f26f80b71b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2704005fd0 tx=0x7f2704005850 comp rx=0 tx=0).stop 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 msgr2=0x7f271019a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 0x7f271019a020 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2700009230 tx=0x7f2700004270 comp rx=0 tx=0).stop 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 shutdown_connections 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f26f80b4ca0 0x7f26f80b71b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27101088b0 0x7f271019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2710107f60 0x7f271019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 --2- 172.21.15.37:0/968666306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2710102620 0x7f271019a020 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 >> 172.21.15.37:0/968666306 conn(0x7f27100fe070 msgr2=0x7f2710101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 shutdown_connections 2024-08-31T06:54:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:19.769+0000 7f270f59e640 1 -- 172.21.15.37:0/968666306 wait complete. 2024-08-31T06:54:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:19 smithi106 ceph-mon[22134]: pgmap v548: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:19 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/968666306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:20.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:19 smithi037 ceph-mon[18612]: pgmap v548: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:20.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:19 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/968666306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:19 smithi066 ceph-mon[22244]: pgmap v548: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:19 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/968666306' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:20.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:54:20.731 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 -- 172.21.15.37:0/648302905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 msgr2=0x7f88c8108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 --2- 172.21.15.37:0/648302905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 0x7f88c8108560 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009900 tx=0x7f88bc02a410 comp rx=0 tx=0).stop 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 -- 172.21.15.37:0/648302905 shutdown_connections 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 --2- 172.21.15.37:0/648302905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 0x7f88c8108560 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 --2- 172.21.15.37:0/648302905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8108aa0 0x7f88c810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 --2- 172.21.15.37:0/648302905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c8102810 0x7f88c8102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 -- 172.21.15.37:0/648302905 >> 172.21.15.37:0/648302905 conn(0x7f88c80794d0 msgr2=0x7f88c80798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 -- 172.21.15.37:0/648302905 shutdown_connections 2024-08-31T06:54:21.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 -- 172.21.15.37:0/648302905 wait complete. 2024-08-31T06:54:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.210+0000 7f88ce41d640 1 Processor -- start 2024-08-31T06:54:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88ce41d640 1 -- start start 2024-08-31T06:54:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88ce41d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c8102810 0x7f88c819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88ce41d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 0x7f88c819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88ce41d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8108aa0 0x7f88c819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88ce41d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88c81136e0 con 0x7f88c8108150 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88ce41d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8113560 con 0x7f88c8102810 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88ce41d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f88c8113860 con 0x7f88c8108aa0 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 0x7f88c819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 0x7f88c819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44436/0 (socket says 172.21.15.37:44436) 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c77fe640 1 -- 172.21.15.37:0/4034840638 learned_addr learned my addr 172.21.15.37:0/4034840638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c7fff640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c8102810 0x7f88c819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88cc9ba640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8108aa0 0x7f88c819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c77fe640 1 -- 172.21.15.37:0/4034840638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8108aa0 msgr2=0x7f88c819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c77fe640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8108aa0 0x7f88c819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c77fe640 1 -- 172.21.15.37:0/4034840638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c8102810 msgr2=0x7f88c819a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c77fe640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c8102810 0x7f88c819a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c77fe640 1 -- 172.21.15.37:0/4034840638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c81a00c0 con 0x7f88c8108150 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.211+0000 7f88c7fff640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c8102810 0x7f88c819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.212+0000 7f88c77fe640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 0x7f88c819a6f0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f88bc005940 tx=0x7f88bc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:21.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.212+0000 7f88c57fa640 1 -- 172.21.15.37:0/4034840638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc03f030 con 0x7f88c8108150 2024-08-31T06:54:21.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.212+0000 7f88c57fa640 1 -- 172.21.15.37:0/4034840638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88bc004440 con 0x7f88c8108150 2024-08-31T06:54:21.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.212+0000 7f88c57fa640 1 -- 172.21.15.37:0/4034840638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc035070 con 0x7f88c8108150 2024-08-31T06:54:21.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.212+0000 7f88ce41d640 1 -- 172.21.15.37:0/4034840638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c81a0350 con 0x7f88c8108150 2024-08-31T06:54:21.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.212+0000 7f88ce41d640 1 -- 172.21.15.37:0/4034840638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c81a6b10 con 0x7f88c8108150 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.214+0000 7f88d4992740 1 Processor -- start 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88d4992740 1 -- start start 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88d4992740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99564070 0x561f99909310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88d4992740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f9953b1b0 0x561f99909850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88d4992740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99909d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88d4992740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f99880680 con 0x561f99564070 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88d4992740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561f9986fc10 con 0x561f9953b1b0 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88d4992740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561f99873bc0 con 0x561f99543390 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88c57fa640 1 -- 172.21.15.37:0/4034840638 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f88bc042030 con 0x7f88c8108150 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88cc9ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99564070 0x561f99909310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88cc9ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99564070 0x561f99909310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44448/0 (socket says 172.21.15.37:44448) 2024-08-31T06:54:21.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88cc9ba640 1 -- 172.21.15.37:0/1192692269 learned_addr learned my addr 172.21.15.37:0/1192692269 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f9953b1b0 0x561f99909850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88c77fe640 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99909d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88cc9ba640 1 -- 172.21.15.37:0/1192692269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 msgr2=0x561f99909d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88cc9ba640 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99909d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88cc9ba640 1 -- 172.21.15.37:0/1192692269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f9953b1b0 msgr2=0x561f99909850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88cc9ba640 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f9953b1b0 0x561f99909850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88cc9ba640 1 -- 172.21.15.37:0/1192692269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f995cf650 con 0x561f99564070 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f9953b1b0 0x561f99909850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.215+0000 7f88c77fe640 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99909d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.216+0000 7f88cc9ba640 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99564070 0x561f99909310 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009f40 tx=0x7f88c0010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c872faecca0d9c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.216+0000 7f88ae7fc640 1 -- 172.21.15.37:0/1192692269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0003b70 con 0x561f99564070 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.216+0000 7f88ae7fc640 1 -- 172.21.15.37:0/1192692269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88c0003d10 con 0x561f99564070 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.216+0000 7f88ae7fc640 1 -- 172.21.15.37:0/1192692269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011830 con 0x561f99564070 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.216+0000 7f88c57fa640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88b00b4d20 0x7f88b00b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.216+0000 7f88c7fff640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88b00b4d20 0x7f88b00b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.216+0000 7f88c57fa640 1 -- 172.21.15.37:0/4034840638 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f88bc105a20 con 0x7f88c8108150 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 -- 172.21.15.37:0/1192692269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99564070 msgr2=0x561f99909310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88c7fff640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88b00b4d20 0x7f88b00b7230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x561f99907f90 tx=0x7f88b80092a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99564070 0x561f99909310 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f88c0009f40 tx=0x7f88c0010860 comp rx=0 tx=0).stop 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 -- 172.21.15.37:0/1192692269 shutdown_connections 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99909d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f9953b1b0 0x561f99909850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 --2- 172.21.15.37:0/1192692269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99564070 0x561f99909310 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 -- 172.21.15.37:0/1192692269 >> 172.21.15.37:0/1192692269 conn(0x561f99558460 msgr2=0x561f99907200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 -- 172.21.15.37:0/1192692269 shutdown_connections 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 -- 172.21.15.37:0/1192692269 wait complete. 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.217+0000 7f88d4992740 1 -- start start 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88d4992740 1 Processor -- start 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88d4992740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f9953b1b0 0x561f99914ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88d4992740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99543390 0x561f99915000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88d4992740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f99920e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88d4992740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f996d2700 con 0x561f99543390 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88d4992740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561f997f6750 con 0x561f99564070 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88d4992740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561f99917af0 con 0x561f9953b1b0 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88d4992740 10 client.0 _ll_register_callbacks cb 0x561f99825e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99543390 0x561f99915000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99543390 0x561f99915000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44464/0 (socket says 172.21.15.37:44464) 2024-08-31T06:54:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c77fe640 1 -- 172.21.15.37:0/3476337369 learned_addr learned my addr 172.21.15.37:0/3476337369 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88cc9ba640 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f99920e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f9953b1b0 0x561f99914ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c77fe640 1 -- 172.21.15.37:0/3476337369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f9953b1b0 msgr2=0x561f99914ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f9953b1b0 0x561f99914ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c77fe640 1 -- 172.21.15.37:0/3476337369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 msgr2=0x561f99920e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f99920e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c77fe640 1 -- 172.21.15.37:0/3476337369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9982f900 con 0x561f99543390 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.218+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f9953b1b0 0x561f99914ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88c77fe640 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99543390 0x561f99915000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f88bc000c00 tx=0x7f88bc0cbad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c12089557acca5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88a77fe640 1 -- 172.21.15.37:0/3476337369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88bc049070 con 0x561f99543390 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88a77fe640 1 -- 172.21.15.37:0/3476337369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f88bc0cc320 con 0x561f99543390 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 1 -- 172.21.15.37:0/3476337369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c0003d10 con 0x561f99543390 2024-08-31T06:54:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88a77fe640 1 -- 172.21.15.37:0/3476337369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f88bc1035b0 con 0x561f99543390 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 10 client.17289 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 1 -- 172.21.15.37:0/3476337369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561f999237e0 con 0x561f99543390 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88a77fe640 1 -- 172.21.15.37:0/3476337369 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88c0003d10 con 0x561f99543390 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88a77fe640 1 -- 172.21.15.37:0/3476337369 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f88bc0d4f50 con 0x561f99543390 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 10 client.17289 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 10 client.17289 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 20 client.17289 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x561f995229f0 0x561f99926c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 4 client.17289 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.219+0000 7f88d4992740 1 -- 172.21.15.37:0/3476337369 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f998825d0 con 0x561f995229f0 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.220+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x561f995229f0 0x561f99926c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.220+0000 7f88a77fe640 10 client.17289 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.220+0000 7f88c7fff640 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x561f995229f0 0x561f99926c00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ecabe988e2366181 server_cookie=a33f668ea1d14555 in_seq=0 out_seq=0 2024-08-31T06:54:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88a77fe640 1 -- 172.21.15.37:0/3476337369 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f998825d0 con 0x561f995229f0 2024-08-31T06:54:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88a77fe640 10 client.17289 handle_command_reply: tid=0 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 client.17289 shutdown 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 -- 172.21.15.37:0/3476337369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99543390 msgr2=0x561f99915000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99543390 0x561f99915000 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f88bc000c00 tx=0x7f88bc0cbad0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 -- 172.21.15.37:0/3476337369 shutdown_connections 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f99543390 0x561f99915000 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x561f995229f0 0x561f99926c00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f99920e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 --2- 172.21.15.37:0/3476337369 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f9953b1b0 0x561f99914ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88a77fe640 0 client.17289 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 -- 172.21.15.37:0/3476337369 >> 172.21.15.37:0/3476337369 conn(0x561f99558460 msgr2=0x561f9990c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.221+0000 7f88d4992740 1 -- 172.21.15.37:0/3476337369 shutdown_connections 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.222+0000 7f88d4992740 1 -- 172.21.15.37:0/3476337369 wait complete. 2024-08-31T06:54:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.222+0000 7f88d4992740 20 client.17289 trim_cache size 0 max 16384 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88d4992740 1 Processor -- start 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88d4992740 1 -- start start 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88d4992740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9990cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88d4992740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99911cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88d4992740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f999121f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88d4992740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88c81b1c80 con 0x561f9953b1b0 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88d4992740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88c81af550 con 0x561f99564070 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88d4992740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f88c81ad3c0 con 0x561f99543390 2024-08-31T06:54:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9990cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9990cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44476/0 (socket says 172.21.15.37:44476) 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c7fff640 1 -- 172.21.15.37:0/1491674891 learned_addr learned my addr 172.21.15.37:0/1491674891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88cc9ba640 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f999121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c7fff640 1 -- 172.21.15.37:0/1491674891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 msgr2=0x561f99911cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c77fe640 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99911cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99911cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c7fff640 1 -- 172.21.15.37:0/1491674891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 msgr2=0x561f999121f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f999121f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c7fff640 1 -- 172.21.15.37:0/1491674891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9990bba0 con 0x561f9953b1b0 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.235+0000 7f88c77fe640 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99911cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.236+0000 7f88c7fff640 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9990cb20 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009ee0 tx=0x7f88b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5b17fcc39d820d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.236+0000 7f88adffb640 1 -- 172.21.15.37:0/1491674891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b802b070 con 0x561f9953b1b0 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.236+0000 7f88adffb640 1 -- 172.21.15.37:0/1491674891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88b801e8b0 con 0x561f9953b1b0 2024-08-31T06:54:21.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.236+0000 7f88adffb640 1 -- 172.21.15.37:0/1491674891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b80106c0 con 0x561f9953b1b0 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 -- 172.21.15.37:0/1491674891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 msgr2=0x561f9990cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9990cb20 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009ee0 tx=0x7f88b8015000 comp rx=0 tx=0).stop 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 -- 172.21.15.37:0/1491674891 shutdown_connections 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f999121f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99911cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 --2- 172.21.15.37:0/1491674891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9990cb20 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 -- 172.21.15.37:0/1491674891 >> 172.21.15.37:0/1491674891 conn(0x561f99558460 msgr2=0x561f9990c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 -- 172.21.15.37:0/1491674891 shutdown_connections 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 -- 172.21.15.37:0/1491674891 wait complete. 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 -- start start 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.237+0000 7f88d4992740 1 Processor -- start 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88d4992740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9991d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88d4992740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99919740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88d4992740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f99919c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88d4992740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88c81ada10 con 0x561f9953b1b0 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88d4992740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f88c81aee80 con 0x561f99564070 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88d4992740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f88c81ae0e0 con 0x561f99543390 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88d4992740 10 client.0 _ll_register_callbacks cb 0x7f88bc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9991d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9991d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44480/0 (socket says 172.21.15.37:44480) 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 -- 172.21.15.37:0/194699761 learned_addr learned my addr 172.21.15.37:0/194699761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88cc9ba640 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f99919c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c77fe640 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99919740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 -- 172.21.15.37:0/194699761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 msgr2=0x561f99919740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99919740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 -- 172.21.15.37:0/194699761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 msgr2=0x561f99919c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:21.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f99919c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 -- 172.21.15.37:0/194699761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9991a1c0 con 0x561f9953b1b0 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88c7fff640 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9991d280 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f88b8005780 tx=0x7f88b801e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c64cd562a433c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.238+0000 7f88a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88a77fe640 1 -- 172.21.15.37:0/194699761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b802b030 con 0x561f9953b1b0 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88a77fe640 1 -- 172.21.15.37:0/194699761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f88b8025070 con 0x561f9953b1b0 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 1 -- 172.21.15.37:0/194699761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88b801e8b0 con 0x561f9953b1b0 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88a77fe640 1 -- 172.21.15.37:0/194699761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f88b801e620 con 0x561f9953b1b0 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 10 client.17295 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:21.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 1 -- 172.21.15.37:0/194699761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561f999921a0 con 0x561f9953b1b0 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88a77fe640 1 -- 172.21.15.37:0/194699761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88b801e8b0 con 0x561f9953b1b0 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88a77fe640 1 -- 172.21.15.37:0/194699761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f88b80046c0 con 0x561f9953b1b0 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 10 client.17295 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 10 client.17295 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 20 client.17295 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x561f994f7da0 0x561f99994980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 4 client.17295 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.239+0000 7f88d4992740 1 -- 172.21.15.37:0/194699761 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f9987e070 con 0x561f994f7da0 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88c77fe640 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x561f994f7da0 0x561f99994980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88a77fe640 10 client.17295 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88c77fe640 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x561f994f7da0 0x561f99994980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2bd976dcf4b129d server_cookie=37bbae322664ee91 in_seq=0 out_seq=0 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88a77fe640 1 -- 172.21.15.37:0/194699761 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f9987e070 con 0x561f994f7da0 2024-08-31T06:54:21.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88a77fe640 10 client.17295 handle_command_reply: tid=0 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88d4992740 1 client.17295 shutdown 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88d4992740 1 -- 172.21.15.37:0/194699761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 msgr2=0x561f9991d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88d4992740 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9991d280 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f88b8005780 tx=0x7f88b801e4b0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88d4992740 1 -- 172.21.15.37:0/194699761 shutdown_connections 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.240+0000 7f88d4992740 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x561f994f7da0 0x561f99994980 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88d4992740 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561f99564070 0x561f99919c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88d4992740 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561f99543390 0x561f99919740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88a77fe640 0 client.17295 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88d4992740 1 --2- 172.21.15.37:0/194699761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9953b1b0 0x561f9991d280 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88d4992740 1 -- 172.21.15.37:0/194699761 >> 172.21.15.37:0/194699761 conn(0x561f99558460 msgr2=0x561f9990a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88d4992740 1 -- 172.21.15.37:0/194699761 shutdown_connections 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88d4992740 1 -- 172.21.15.37:0/194699761 wait complete. 2024-08-31T06:54:21.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88d4992740 20 client.17295 trim_cache size 0 max 16384 2024-08-31T06:54:21.247 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88ce41d640 1 -- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88b00b4d20 msgr2=0x7f88b00b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88ce41d640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88b00b4d20 0x7f88b00b7230 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x561f99907f90 tx=0x7f88b80092a0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88ce41d640 1 -- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 msgr2=0x7f88c819a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.241+0000 7f88ce41d640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 0x7f88c819a6f0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f88bc005940 tx=0x7f88bc004040 comp rx=0 tx=0).stop 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.242+0000 7f88ce41d640 1 -- 172.21.15.37:0/4034840638 shutdown_connections 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.242+0000 7f88ce41d640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f88b00b4d20 0x7f88b00b7230 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.242+0000 7f88ce41d640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c8108150 0x7f88c819a6f0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.242+0000 7f88ce41d640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c8108aa0 0x7f88c819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.242+0000 7f88ce41d640 1 --2- 172.21.15.37:0/4034840638 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88c8102810 0x7f88c819a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.242+0000 7f88ce41d640 1 -- 172.21.15.37:0/4034840638 >> 172.21.15.37:0/4034840638 conn(0x7f88c80794d0 msgr2=0x7f88c81050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.242+0000 7f88ce41d640 1 -- 172.21.15.37:0/4034840638 shutdown_connections 2024-08-31T06:54:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:21.242+0000 7f88ce41d640 1 -- 172.21.15.37:0/4034840638 wait complete. 2024-08-31T06:54:21.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:21 smithi037 ceph-mon[18612]: pgmap v549: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:21.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:54:22.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:21 smithi106 ceph-mon[22134]: pgmap v549: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:22.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:21 smithi066 ceph-mon[22244]: pgmap v549: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:54:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 -- 172.21.15.37:0/1794218752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 msgr2=0x7f3c081103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/1794218752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 0x7f3c081103c0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009ca0 tx=0x7f3c0002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 -- 172.21.15.37:0/1794218752 shutdown_connections 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/1794218752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 0x7f3c081103c0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/1794218752 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c08109240 0x7f3c08109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/1794218752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c08103900 0x7f3c08103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 -- 172.21.15.37:0/1794218752 >> 172.21.15.37:0/1794218752 conn(0x7f3c0807b5f0 msgr2=0x7f3c0807ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 -- 172.21.15.37:0/1794218752 shutdown_connections 2024-08-31T06:54:22.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 -- 172.21.15.37:0/1794218752 wait complete. 2024-08-31T06:54:22.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.741+0000 7f3c0dc69640 1 Processor -- start 2024-08-31T06:54:22.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c0dc69640 1 -- start start 2024-08-31T06:54:22.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c0dc69640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c08103900 0x7f3c0819a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c0dc69640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c08109240 0x7f3c0819a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c0dc69640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 0x7f3c0819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c0dc69640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08113750 con 0x7f3c08109b90 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c0dc69640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081135d0 con 0x7f3c08103900 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c0dc69640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081138d0 con 0x7f3c08109240 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c07fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 0x7f3c0819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c07fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 0x7f3c0819faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44498/0 (socket says 172.21.15.37:44498) 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c07fff640 1 -- 172.21.15.37:0/891858135 learned_addr learned my addr 172.21.15.37:0/891858135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c077fe640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c08103900 0x7f3c0819a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3bfffff640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c08109240 0x7f3c0819a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c07fff640 1 -- 172.21.15.37:0/891858135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c08109240 msgr2=0x7f3c0819a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c07fff640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c08109240 0x7f3c0819a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c07fff640 1 -- 172.21.15.37:0/891858135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c08103900 msgr2=0x7f3c0819a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c07fff640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c08103900 0x7f3c0819a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.742+0000 7f3c07fff640 1 -- 172.21.15.37:0/891858135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c081a01d0 con 0x7f3c08109b90 2024-08-31T06:54:22.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.743+0000 7f3c07fff640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 0x7f3c0819faa0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3c00005e30 tx=0x7f3c000093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:22.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.743+0000 7f3c057fa640 1 -- 172.21.15.37:0/891858135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00032d10 con 0x7f3c08109b90 2024-08-31T06:54:22.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.743+0000 7f3c057fa640 1 -- 172.21.15.37:0/891858135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c00032eb0 con 0x7f3c08109b90 2024-08-31T06:54:22.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.743+0000 7f3c0dc69640 1 -- 172.21.15.37:0/891858135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c081a0460 con 0x7f3c08109b90 2024-08-31T06:54:22.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.743+0000 7f3c057fa640 1 -- 172.21.15.37:0/891858135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00030b20 con 0x7f3c08109b90 2024-08-31T06:54:22.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.743+0000 7f3c0dc69640 1 -- 172.21.15.37:0/891858135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c081a6c20 con 0x7f3c08109b90 2024-08-31T06:54:22.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.745+0000 7f3c141de740 1 Processor -- start 2024-08-31T06:54:22.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c057fa640 1 -- 172.21.15.37:0/891858135 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f3c00030ce0 con 0x7f3c08109b90 2024-08-31T06:54:22.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c141de740 1 -- start start 2024-08-31T06:54:22.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c141de740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dcb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c141de740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0dcb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c141de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c141de740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dca0d42680 con 0x55dca0a26070 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c141de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dca0d31c10 con 0x55dca0a05390 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c141de740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dca0d35bc0 con 0x55dca09fd1b0 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dcb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dcb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44506/0 (socket says 172.21.15.37:44506) 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3bfffff640 1 -- 172.21.15.37:0/1247536272 learned_addr learned my addr 172.21.15.37:0/1247536272 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3c077fe640 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0dcb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.746+0000 7f3bfffff640 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3c057fa640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3bf40b4d20 0x7f3bf40b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfffff640 1 -- 172.21.15.37:0/1247536272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 msgr2=0x55dca0dcb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfffff640 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0dcb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfffff640 1 -- 172.21.15.37:0/1247536272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 msgr2=0x55dca0dcbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:22.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfffff640 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfffff640 1 -- 172.21.15.37:0/1247536272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0a91650 con 0x55dca0a26070 2024-08-31T06:54:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3c057fa640 1 -- 172.21.15.37:0/891858135 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f3c001066d0 con 0x7f3c08109b90 2024-08-31T06:54:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3c07fff640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3bf40b4d20 0x7f3bf40b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfffff640 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dcb310 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0013500 tx=0x7f3bf000b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3561a37564df1a85 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfdffb640 1 -- 172.21.15.37:0/1247536272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0019030 con 0x55dca0a26070 2024-08-31T06:54:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfdffb640 1 -- 172.21.15.37:0/1247536272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bf0005bf0 con 0x55dca0a26070 2024-08-31T06:54:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.747+0000 7f3bfdffb640 1 -- 172.21.15.37:0/1247536272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf001d620 con 0x55dca0a26070 2024-08-31T06:54:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 -- 172.21.15.37:0/1247536272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 msgr2=0x55dca0dcb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dcb310 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0013500 tx=0x7f3bf000b5a0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c07fff640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3bf40b4d20 0x7f3bf40b7230 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3c000ca040 tx=0x7f3c00009460 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 -- 172.21.15.37:0/1247536272 shutdown_connections 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0dcb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 --2- 172.21.15.37:0/1247536272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dcb310 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 -- 172.21.15.37:0/1247536272 >> 172.21.15.37:0/1247536272 conn(0x55dca0a1a460 msgr2=0x55dca0dc9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 -- 172.21.15.37:0/1247536272 shutdown_connections 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.748+0000 7f3c141de740 1 -- 172.21.15.37:0/1247536272 wait complete. 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 1 -- start start 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 1 Processor -- start 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca09fd1b0 0x55dca0ddae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca0a05390 0x55dca0ddb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0de7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dca0b94700 con 0x55dca0a26070 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dca0cb8750 con 0x55dca09fd1b0 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dca0ddddf0 con 0x55dca0a05390 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3c141de740 10 client.0 _ll_register_callbacks cb 0x55dca0ce7e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0de7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0de7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44510/0 (socket says 172.21.15.37:44510) 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3bfffff640 1 -- 172.21.15.37:0/522568605 learned_addr learned my addr 172.21.15.37:0/522568605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.749+0000 7f3bfffff640 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca09fd1b0 0x55dca0ddae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3c077fe640 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca0a05390 0x55dca0ddb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3bfffff640 1 -- 172.21.15.37:0/522568605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca0a05390 msgr2=0x55dca0ddb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3bfffff640 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca0a05390 0x55dca0ddb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3bfffff640 1 -- 172.21.15.37:0/522568605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca09fd1b0 msgr2=0x55dca0ddae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3bfffff640 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca09fd1b0 0x55dca0ddae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3bfffff640 1 -- 172.21.15.37:0/522568605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0cf1900 con 0x55dca0a26070 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3bfffff640 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0de7150 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000be30 tx=0x7f3bf000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2f37577af98b5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3be6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3be6ffd640 1 -- 172.21.15.37:0/522568605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0019040 con 0x55dca0a26070 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3be6ffd640 1 -- 172.21.15.37:0/522568605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f3bf00117f0 con 0x55dca0a26070 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3c141de740 1 -- 172.21.15.37:0/522568605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dca0d445d0 con 0x55dca0a26070 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3be6ffd640 1 -- 172.21.15.37:0/522568605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3bf00119f0 con 0x55dca0a26070 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3c141de740 10 client.17307 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.750+0000 7f3c141de740 1 -- 172.21.15.37:0/522568605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dca0de9bf0 con 0x55dca0a26070 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3be6ffd640 1 -- 172.21.15.37:0/522568605 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55dca0d445d0 con 0x55dca0a26070 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3be6ffd640 1 -- 172.21.15.37:0/522568605 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3bf002f4a0 con 0x55dca0a26070 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3c141de740 10 client.17307 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3c141de740 10 client.17307 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3c141de740 20 client.17307 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3c141de740 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dca09e49f0 0x55dca0decfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3c141de740 4 client.17307 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:22.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3c141de740 1 -- 172.21.15.37:0/522568605 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dca0d40070 con 0x55dca09e49f0 2024-08-31T06:54:22.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.751+0000 7f3c077fe640 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dca09e49f0 0x55dca0decfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.752+0000 7f3be6ffd640 10 client.17307 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.752+0000 7f3c077fe640 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dca09e49f0 0x55dca0decfb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51dd6e6979834191 server_cookie=dee623b6b2d06d07 in_seq=0 out_seq=0 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.752+0000 7f3be6ffd640 1 -- 172.21.15.37:0/522568605 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dca0d40070 con 0x55dca09e49f0 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.752+0000 7f3be6ffd640 10 client.17307 handle_command_reply: tid=0 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 client.17307 shutdown 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 -- 172.21.15.37:0/522568605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 msgr2=0x55dca0de7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0de7150 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000be30 tx=0x7f3bf000be60 comp rx=0 tx=0).stop 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 -- 172.21.15.37:0/522568605 shutdown_connections 2024-08-31T06:54:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dca09e49f0 0x55dca0decfb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0de7150 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca0a05390 0x55dca0ddb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 --2- 172.21.15.37:0/522568605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca09fd1b0 0x55dca0ddae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3be6ffd640 0 client.17307 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 -- 172.21.15.37:0/522568605 >> 172.21.15.37:0/522568605 conn(0x55dca0a1a460 msgr2=0x55dca0dc77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 -- 172.21.15.37:0/522568605 shutdown_connections 2024-08-31T06:54:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 1 -- 172.21.15.37:0/522568605 wait complete. 2024-08-31T06:54:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.753+0000 7f3c141de740 20 client.17307 trim_cache size 0 max 16384 2024-08-31T06:54:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.766+0000 7f3c141de740 1 Processor -- start 2024-08-31T06:54:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.766+0000 7f3c141de740 1 -- start start 2024-08-31T06:54:22.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3c141de740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0dd0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3c141de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3c141de740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dd8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3c141de740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081afad0 con 0x55dca0a26070 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3c141de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081ad3a0 con 0x55dca0a05390 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3c141de740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081ab210 con 0x55dca09fd1b0 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dd8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dd8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44516/0 (socket says 172.21.15.37:44516) 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 -- 172.21.15.37:0/1275564120 learned_addr learned my addr 172.21.15.37:0/1275564120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0dd0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3c077fe640 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 -- 172.21.15.37:0/1275564120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 msgr2=0x55dca0dd0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0dd0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 -- 172.21.15.37:0/1275564120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 msgr2=0x55dca0dcca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 -- 172.21.15.37:0/1275564120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dca0dc45a0 con 0x55dca0a26070 2024-08-31T06:54:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3c077fe640 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.767+0000 7f3bfffff640 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dd8070 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3bf002fa10 tx=0x7f3bf0015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e2c176da8d4395 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3bfd7fa640 1 -- 172.21.15.37:0/1275564120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0019070 con 0x55dca0a26070 2024-08-31T06:54:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3bfd7fa640 1 -- 172.21.15.37:0/1275564120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bf0011d30 con 0x55dca0a26070 2024-08-31T06:54:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3bfd7fa640 1 -- 172.21.15.37:0/1275564120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf002fa90 con 0x55dca0a26070 2024-08-31T06:54:22.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3c141de740 1 -- 172.21.15.37:0/1275564120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 msgr2=0x55dca0dd8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3c141de740 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dd8070 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f3bf002fa10 tx=0x7f3bf0015040 comp rx=0 tx=0).stop 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3c141de740 1 -- 172.21.15.37:0/1275564120 shutdown_connections 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3c141de740 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a26070 0x55dca0dd8070 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3c141de740 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a05390 0x55dca0dcca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3c141de740 1 --2- 172.21.15.37:0/1275564120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0dd0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3c141de740 1 -- 172.21.15.37:0/1275564120 >> 172.21.15.37:0/1275564120 conn(0x55dca0a1a460 msgr2=0x55dca0dcc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.768+0000 7f3c141de740 1 -- 172.21.15.37:0/1275564120 shutdown_connections 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 -- 172.21.15.37:0/1275564120 wait complete. 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 -- start start 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 Processor -- start 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0de0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a05390 0x55dca0de1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a26070 0x55dca0e4e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081ab860 con 0x55dca0a05390 2024-08-31T06:54:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081accd0 con 0x55dca0a26070 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c141de740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3c081abf30 con 0x55dca09fd1b0 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.769+0000 7f3c077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a05390 0x55dca0de1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c141de740 10 client.0 _ll_register_callbacks cb 0x7f3bf8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a05390 0x55dca0de1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44518/0 (socket says 172.21.15.37:44518) 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c077fe640 1 -- 172.21.15.37:0/2924471983 learned_addr learned my addr 172.21.15.37:0/2924471983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3bfffff640 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0de0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3bfffff640 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a26070 0x55dca0e4e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c077fe640 1 -- 172.21.15.37:0/2924471983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 msgr2=0x55dca0de0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c077fe640 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0de0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c077fe640 1 -- 172.21.15.37:0/2924471983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a26070 msgr2=0x55dca0e4e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c077fe640 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a26070 0x55dca0e4e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c077fe640 1 -- 172.21.15.37:0/2924471983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dca0e4ee70 con 0x55dca0a05390 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c077fe640 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a05390 0x55dca0de1150 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009e50 tx=0x7f3bf80044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5218e27c787f4b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3be6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3be6ffd640 1 -- 172.21.15.37:0/2924471983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8029060 con 0x55dca0a05390 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3be6ffd640 1 -- 172.21.15.37:0/2924471983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f3bf8010430 con 0x55dca0a05390 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c141de740 1 -- 172.21.15.37:0/2924471983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bf0011d30 con 0x55dca0a05390 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3be6ffd640 1 -- 172.21.15.37:0/2924471983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3bf8010630 con 0x55dca0a05390 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c141de740 10 client.17313 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.770+0000 7f3c141de740 1 -- 172.21.15.37:0/2924471983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dca0e57370 con 0x55dca0a05390 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3be6ffd640 1 -- 172.21.15.37:0/2924471983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bf0011d30 con 0x55dca0a05390 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3be6ffd640 1 -- 172.21.15.37:0/2924471983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3bf801f780 con 0x55dca0a05390 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3c141de740 10 client.17313 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3c141de740 10 client.17313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3c141de740 20 client.17313 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3c141de740 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dca09b9da0 0x55dca0e59b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3c141de740 4 client.17313 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:22.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3c141de740 1 -- 172.21.15.37:0/2924471983 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dca0d3d7b0 con 0x55dca09b9da0 2024-08-31T06:54:22.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.771+0000 7f3bfffff640 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dca09b9da0 0x55dca0e59b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:22.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3bfffff640 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dca09b9da0 0x55dca0e59b10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a8f08b0c6cb25198 server_cookie=b2266018a2471482 in_seq=0 out_seq=0 2024-08-31T06:54:22.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3be6ffd640 10 client.17313 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3be6ffd640 1 -- 172.21.15.37:0/2924471983 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dca0d3d7b0 con 0x55dca09b9da0 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3be6ffd640 10 client.17313 handle_command_reply: tid=0 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 client.17313 shutdown 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 -- 172.21.15.37:0/2924471983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a05390 msgr2=0x55dca0de1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a05390 0x55dca0de1150 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009e50 tx=0x7f3bf80044d0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 -- 172.21.15.37:0/2924471983 shutdown_connections 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dca09b9da0 0x55dca0e59b10 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dca0a05390 0x55dca0de1150 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dca0a26070 0x55dca0e4e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 --2- 172.21.15.37:0/2924471983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dca09fd1b0 0x55dca0de0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3be6ffd640 0 client.17313 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:22.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 -- 172.21.15.37:0/2924471983 >> 172.21.15.37:0/2924471983 conn(0x55dca0a1a460 msgr2=0x55dca0dd0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:22.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 -- 172.21.15.37:0/2924471983 shutdown_connections 2024-08-31T06:54:22.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.772+0000 7f3c141de740 1 -- 172.21.15.37:0/2924471983 wait complete. 2024-08-31T06:54:22.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c141de740 20 client.17313 trim_cache size 0 max 16384 2024-08-31T06:54:22.778 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 -- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3bf40b4d20 msgr2=0x7f3bf40b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3bf40b4d20 0x7f3bf40b7230 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3c000ca040 tx=0x7f3c00009460 comp rx=0 tx=0).stop 2024-08-31T06:54:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 -- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 msgr2=0x7f3c0819faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 0x7f3c0819faa0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3c00005e30 tx=0x7f3c000093d0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 -- 172.21.15.37:0/891858135 shutdown_connections 2024-08-31T06:54:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3bf40b4d20 0x7f3bf40b7230 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c08109b90 0x7f3c0819faa0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c08109240 0x7f3c0819a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 --2- 172.21.15.37:0/891858135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c08103900 0x7f3c0819a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 -- 172.21.15.37:0/891858135 >> 172.21.15.37:0/891858135 conn(0x7f3c0807b5f0 msgr2=0x7f3c081053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 -- 172.21.15.37:0/891858135 shutdown_connections 2024-08-31T06:54:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:22.773+0000 7f3c0dc69640 1 -- 172.21.15.37:0/891858135 wait complete. 2024-08-31T06:54:23.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:54:23.689 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:24.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:23 smithi106 ceph-mon[22134]: pgmap v550: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:54:24.082 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:23 smithi037 ceph-mon[18612]: pgmap v550: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:54:24.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:23 smithi066 ceph-mon[22244]: pgmap v550: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:54:24.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 -- 172.21.15.37:0/3597468461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 msgr2=0x7f7a24108550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/3597468461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 0x7f7a24108550 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009900 tx=0x7f7a1802a410 comp rx=0 tx=0).stop 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 -- 172.21.15.37:0/3597468461 shutdown_connections 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/3597468461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 0x7f7a24108550 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/3597468461 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a24108a90 0x7f7a2410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/3597468461 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a24102800 0x7f7a24102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 -- 172.21.15.37:0/3597468461 >> 172.21.15.37:0/3597468461 conn(0x7f7a240794d0 msgr2=0x7f7a240798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 -- 172.21.15.37:0/3597468461 shutdown_connections 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.174+0000 7f7a28cd1640 1 -- 172.21.15.37:0/3597468461 wait complete. 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.175+0000 7f7a28cd1640 1 Processor -- start 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.175+0000 7f7a28cd1640 1 -- start start 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.175+0000 7f7a28cd1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a24102800 0x7f7a2419a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.175+0000 7f7a28cd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 0x7f7a2419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.175+0000 7f7a28cd1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a24108a90 0x7f7a2419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.175+0000 7f7a28cd1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a241136d0 con 0x7f7a24108140 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.175+0000 7f7a28cd1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a24113550 con 0x7f7a24102800 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.175+0000 7f7a28cd1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7a24113850 con 0x7f7a24108a90 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 0x7f7a2419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 0x7f7a2419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44536/0 (socket says 172.21.15.37:44536) 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 -- 172.21.15.37:0/1058948805 learned_addr learned my addr 172.21.15.37:0/1058948805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a24108a90 0x7f7a2419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a2259c640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a24102800 0x7f7a2419a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 -- 172.21.15.37:0/1058948805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a24108a90 msgr2=0x7f7a2419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a24108a90 0x7f7a2419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 -- 172.21.15.37:0/1058948805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a24102800 msgr2=0x7f7a2419a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a24102800 0x7f7a2419a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 -- 172.21.15.37:0/1058948805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a241a0090 con 0x7f7a24108140 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a2259c640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a24102800 0x7f7a2419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:24.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a21d9b640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 0x7f7a2419a6c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f7a18005940 tx=0x7f7a180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a137fe640 1 -- 172.21.15.37:0/1058948805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1803f030 con 0x7f7a24108140 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a137fe640 1 -- 172.21.15.37:0/1058948805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a18003c90 con 0x7f7a24108140 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a137fe640 1 -- 172.21.15.37:0/1058948805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18035070 con 0x7f7a24108140 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.176+0000 7f7a28cd1640 1 -- 172.21.15.37:0/1058948805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a241a0320 con 0x7f7a24108140 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.177+0000 7f7a28cd1640 1 -- 172.21.15.37:0/1058948805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a241a6ae0 con 0x7f7a24108140 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.179+0000 7f7a2f246740 1 Processor -- start 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.179+0000 7f7a2f246740 1 -- start start 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 0x561fe45fb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45fb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 0x561fe45fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2f246740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561fe4572680 con 0x561fe422d1b0 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2f246740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561fe4561c10 con 0x561fe4256070 2024-08-31T06:54:24.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a137fe640 1 -- 172.21.15.37:0/1058948805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f7a18042030 con 0x7f7a24108140 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2f246740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561fe4565bc0 con 0x561fe4235390 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45fb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44540/0 (socket says 172.21.15.37:44540) 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 -- 172.21.15.37:0/1039508117 learned_addr learned my addr 172.21.15.37:0/1039508117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/1039508117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 0x561fe45fb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 -- 172.21.15.37:0/1039508117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 msgr2=0x561fe45fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 --2- 172.21.15.37:0/1039508117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 0x561fe45fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 -- 172.21.15.37:0/1039508117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 msgr2=0x561fe45fb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 --2- 172.21.15.37:0/1039508117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 0x561fe45fb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 -- 172.21.15.37:0/1039508117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fe42c1650 con 0x561fe422d1b0 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.180+0000 7f7a2259c640 1 --2- 172.21.15.37:0/1039508117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45fb850 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400bd40 tx=0x7f7a1400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b295244e70b36e90 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.181+0000 7f7a137fe640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a0c0b4d20 0x7f7a0c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.181+0000 7f7a10ff9640 1 -- 172.21.15.37:0/1039508117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14004220 con 0x561fe422d1b0 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.181+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a0c0b4d20 0x7f7a0c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.181+0000 7f7a10ff9640 1 -- 172.21.15.37:0/1039508117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a1400be30 con 0x561fe422d1b0 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.181+0000 7f7a10ff9640 1 -- 172.21.15.37:0/1039508117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a140038e0 con 0x561fe422d1b0 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.181+0000 7f7a137fe640 1 -- 172.21.15.37:0/1058948805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f7a18105aa0 con 0x7f7a24108140 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a0c0b4d20 0x7f7a0c0b7230 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c005fd0 tx=0x7f7a1c0096e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 -- 172.21.15.37:0/1039508117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 msgr2=0x561fe45fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1039508117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45fb850 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400bd40 tx=0x7f7a1400f730 comp rx=0 tx=0).stop 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 -- 172.21.15.37:0/1039508117 shutdown_connections 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1039508117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45fb850 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1039508117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 0x561fe45fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1039508117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 0x561fe45fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 -- 172.21.15.37:0/1039508117 >> 172.21.15.37:0/1039508117 conn(0x561fe424a460 msgr2=0x561fe45f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 -- 172.21.15.37:0/1039508117 shutdown_connections 2024-08-31T06:54:24.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 -- 172.21.15.37:0/1039508117 wait complete. 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 -- start start 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.182+0000 7f7a2f246740 1 Processor -- start 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe422d1b0 0x561fe4606b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4235390 0x561fe46070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 0x561fe4612e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a2f246740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561fe43c4700 con 0x561fe4235390 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a2f246740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x561fe44e8750 con 0x561fe4256070 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a2f246740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x561fe4609af0 con 0x561fe422d1b0 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a2f246740 10 client.0 _ll_register_callbacks cb 0x561fe4517e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a21d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4235390 0x561fe46070c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a21d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4235390 0x561fe46070c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44552/0 (socket says 172.21.15.37:44552) 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a21d9b640 1 -- 172.21.15.37:0/244993694 learned_addr learned my addr 172.21.15.37:0/244993694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 0x561fe4612e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a2259c640 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe422d1b0 0x561fe4606b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a21d9b640 1 -- 172.21.15.37:0/244993694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe422d1b0 msgr2=0x561fe4606b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a21d9b640 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe422d1b0 0x561fe4606b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a21d9b640 1 -- 172.21.15.37:0/244993694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 msgr2=0x561fe4612e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a21d9b640 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 0x561fe4612e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.183+0000 7f7a21d9b640 1 -- 172.21.15.37:0/244993694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fe4521900 con 0x561fe4235390 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a21d9b640 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4235390 0x561fe46070c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f7a18103800 tx=0x7f7a180c8660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef0df3ab3dc1972 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a09ffb640 1 -- 172.21.15.37:0/244993694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18049070 con 0x561fe4235390 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a09ffb640 1 -- 172.21.15.37:0/244993694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f7a180cc610 con 0x561fe4235390 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a2f246740 1 -- 172.21.15.37:0/244993694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a1400be30 con 0x561fe4235390 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a09ffb640 1 -- 172.21.15.37:0/244993694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a180cbaf0 con 0x561fe4235390 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a2f246740 10 client.17325 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a2f246740 1 -- 172.21.15.37:0/244993694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561fe4615980 con 0x561fe4235390 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a09ffb640 1 -- 172.21.15.37:0/244993694 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a1400be30 con 0x561fe4235390 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a09ffb640 1 -- 172.21.15.37:0/244993694 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a180d5030 con 0x561fe4235390 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a2f246740 10 client.17325 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a2f246740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.184+0000 7f7a2f246740 20 client.17325 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.185+0000 7f7a2f246740 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561fe42149f0 0x561fe4618dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.185+0000 7f7a2f246740 4 client.17325 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.185+0000 7f7a2f246740 1 -- 172.21.15.37:0/244993694 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fe45745d0 con 0x561fe42149f0 2024-08-31T06:54:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.185+0000 7f7a2259c640 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561fe42149f0 0x561fe4618dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.185+0000 7f7a2259c640 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561fe42149f0 0x561fe4618dd0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bcd58e6bdda981 server_cookie=9d1471b4de1ae9fd in_seq=0 out_seq=0 2024-08-31T06:54:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.185+0000 7f7a09ffb640 10 client.17325 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a09ffb640 1 -- 172.21.15.37:0/244993694 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561fe45745d0 con 0x561fe42149f0 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a09ffb640 10 client.17325 handle_command_reply: tid=0 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 client.17325 shutdown 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 -- 172.21.15.37:0/244993694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4235390 msgr2=0x561fe46070c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4235390 0x561fe46070c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f7a18103800 tx=0x7f7a180c8660 comp rx=0 tx=0).stop 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 -- 172.21.15.37:0/244993694 shutdown_connections 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561fe42149f0 0x561fe4618dd0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4235390 0x561fe46070c0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4256070 0x561fe4612e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 --2- 172.21.15.37:0/244993694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe422d1b0 0x561fe4606b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a09ffb640 0 client.17325 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 -- 172.21.15.37:0/244993694 >> 172.21.15.37:0/244993694 conn(0x561fe424a460 msgr2=0x561fe45fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 -- 172.21.15.37:0/244993694 shutdown_connections 2024-08-31T06:54:24.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 1 -- 172.21.15.37:0/244993694 wait complete. 2024-08-31T06:54:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.186+0000 7f7a2f246740 20 client.17325 trim_cache size 0 max 16384 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.199+0000 7f7a2f246740 1 Processor -- start 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2f246740 1 -- start start 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45feb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4235390 0x561fe4612d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4256070 0x561fe4613250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2f246740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a241afab0 con 0x561fe422d1b0 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2f246740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a241ad380 con 0x561fe4235390 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2f246740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7a241ab1f0 con 0x561fe4256070 2024-08-31T06:54:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45feb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45feb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57522/0 (socket says 172.21.15.37:57522) 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 -- 172.21.15.37:0/2770626459 learned_addr learned my addr 172.21.15.37:0/2770626459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a21d9b640 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4235390 0x561fe4612d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4256070 0x561fe4613250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 -- 172.21.15.37:0/2770626459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4256070 msgr2=0x561fe4613250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4256070 0x561fe4613250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 -- 172.21.15.37:0/2770626459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4235390 msgr2=0x561fe4612d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4235390 0x561fe4612d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 -- 172.21.15.37:0/2770626459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fe4601750 con 0x561fe422d1b0 2024-08-31T06:54:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.200+0000 7f7a2259c640 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45feb20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400bd40 tx=0x7f7a1400b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8952a48e7c1ad518 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a0bfff640 1 -- 172.21.15.37:0/2770626459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a140148e0 con 0x561fe422d1b0 2024-08-31T06:54:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a0bfff640 1 -- 172.21.15.37:0/2770626459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a140054d0 con 0x561fe422d1b0 2024-08-31T06:54:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a0bfff640 1 -- 172.21.15.37:0/2770626459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14004a00 con 0x561fe422d1b0 2024-08-31T06:54:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a2f246740 1 -- 172.21.15.37:0/2770626459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 msgr2=0x561fe45feb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a2f246740 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45feb20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400bd40 tx=0x7f7a1400b660 comp rx=0 tx=0).stop 2024-08-31T06:54:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a2f246740 1 -- 172.21.15.37:0/2770626459 shutdown_connections 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a2f246740 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4256070 0x561fe4613250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a2f246740 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe4235390 0x561fe4612d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a2f246740 1 --2- 172.21.15.37:0/2770626459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe422d1b0 0x561fe45feb20 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a2f246740 1 -- 172.21.15.37:0/2770626459 >> 172.21.15.37:0/2770626459 conn(0x561fe424a460 msgr2=0x561fe45fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.201+0000 7f7a2f246740 1 -- 172.21.15.37:0/2770626459 shutdown_connections 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 -- 172.21.15.37:0/2770626459 wait complete. 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 -- start start 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 Processor -- start 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe422d1b0 0x561fe460b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 0x561fe460be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4256070 0x561fe467c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7a241ab840 con 0x561fe4256070 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7a241accb0 con 0x561fe422d1b0 2024-08-31T06:54:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7a241abf10 con 0x561fe4235390 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a2f246740 10 client.0 _ll_register_callbacks cb 0x7f7a1803b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a22d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4256070 0x561fe467c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a22d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4256070 0x561fe467c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57526/0 (socket says 172.21.15.37:57526) 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.202+0000 7f7a22d9d640 1 -- 172.21.15.37:0/1982386132 learned_addr learned my addr 172.21.15.37:0/1982386132 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a2259c640 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe422d1b0 0x561fe460b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a21d9b640 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 0x561fe460be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a22d9d640 1 -- 172.21.15.37:0/1982386132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 msgr2=0x561fe460be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 0x561fe460be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a22d9d640 1 -- 172.21.15.37:0/1982386132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe422d1b0 msgr2=0x561fe460b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe422d1b0 0x561fe460b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a22d9d640 1 -- 172.21.15.37:0/1982386132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fe467cf00 con 0x561fe4256070 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a22d9d640 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4256070 0x561fe467c890 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c01f930 tx=0x7f7a1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d43c66324255b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a09ffb640 1 -- 172.21.15.37:0/1982386132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c01f020 con 0x561fe4256070 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a09ffb640 1 -- 172.21.15.37:0/1982386132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f7a1c01f1c0 con 0x561fe4256070 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.203+0000 7f7a2f246740 1 -- 172.21.15.37:0/1982386132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a140054d0 con 0x561fe4256070 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a09ffb640 1 -- 172.21.15.37:0/1982386132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a1c01d710 con 0x561fe4256070 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2f246740 10 client.17331 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2f246740 1 -- 172.21.15.37:0/1982386132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561fe46842f0 con 0x561fe4256070 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a09ffb640 1 -- 172.21.15.37:0/1982386132 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a140054d0 con 0x561fe4256070 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a09ffb640 1 -- 172.21.15.37:0/1982386132 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a1c027070 con 0x561fe4256070 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2f246740 10 client.17331 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2f246740 10 client.17331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2f246740 20 client.17331 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561fe41e9da0 0x561fe4686b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2f246740 4 client.17331 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:24.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2f246740 1 -- 172.21.15.37:0/1982386132 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561fe4570070 con 0x561fe41e9da0 2024-08-31T06:54:24.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.204+0000 7f7a2259c640 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561fe41e9da0 0x561fe4686b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2259c640 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561fe41e9da0 0x561fe4686b60 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a3254a253de082f server_cookie=d45098019d181f34 in_seq=0 out_seq=0 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a09ffb640 10 client.17331 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a09ffb640 1 -- 172.21.15.37:0/1982386132 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561fe4570070 con 0x561fe41e9da0 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a09ffb640 10 client.17331 handle_command_reply: tid=0 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 client.17331 shutdown 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 -- 172.21.15.37:0/1982386132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4256070 msgr2=0x561fe467c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4256070 0x561fe467c890 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c01f930 tx=0x7f7a1c004a40 comp rx=0 tx=0).stop 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 -- 172.21.15.37:0/1982386132 shutdown_connections 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x561fe41e9da0 0x561fe4686b60 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561fe4256070 0x561fe467c890 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561fe4235390 0x561fe460be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 --2- 172.21.15.37:0/1982386132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x561fe422d1b0 0x561fe460b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a09ffb640 0 client.17331 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:24.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 -- 172.21.15.37:0/1982386132 >> 172.21.15.37:0/1982386132 conn(0x561fe424a460 msgr2=0x561fe4607ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:24.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 -- 172.21.15.37:0/1982386132 shutdown_connections 2024-08-31T06:54:24.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.205+0000 7f7a2f246740 1 -- 172.21.15.37:0/1982386132 wait complete. 2024-08-31T06:54:24.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a2f246740 20 client.17331 trim_cache size 0 max 16384 2024-08-31T06:54:24.211 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 -- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a0c0b4d20 msgr2=0x7f7a0c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a0c0b4d20 0x7f7a0c0b7230 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c005fd0 tx=0x7f7a1c0096e0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 -- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 msgr2=0x7f7a2419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 0x7f7a2419a6c0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f7a18005940 tx=0x7f7a180042f0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 -- 172.21.15.37:0/1058948805 shutdown_connections 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7a0c0b4d20 0x7f7a0c0b7230 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a24108140 0x7f7a2419a6c0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a24108a90 0x7f7a2419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 --2- 172.21.15.37:0/1058948805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a24102800 0x7f7a2419a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:24.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 -- 172.21.15.37:0/1058948805 >> 172.21.15.37:0/1058948805 conn(0x7f7a240794d0 msgr2=0x7f7a24105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:24.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 -- 172.21.15.37:0/1058948805 shutdown_connections 2024-08-31T06:54:24.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:24.206+0000 7f7a28cd1640 1 -- 172.21.15.37:0/1058948805 wait complete. 2024-08-31T06:54:25.898 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:54:25.899 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:54:26.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:25 smithi106 ceph-mon[22134]: pgmap v551: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:54:26.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:25 smithi037 ceph-mon[18612]: pgmap v551: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:54:26.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:25 smithi066 ceph-mon[22244]: pgmap v551: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:54:26.165 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 -- 172.21.15.37:0/1165525505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108160 msgr2=0x7fbfbc108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 --2- 172.21.15.37:0/1165525505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108160 0x7fbfbc108570 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009900 tx=0x7fbfac02a410 comp rx=0 tx=0).stop 2024-08-31T06:54:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 -- 172.21.15.37:0/1165525505 shutdown_connections 2024-08-31T06:54:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 --2- 172.21.15.37:0/1165525505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108160 0x7fbfbc108570 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 --2- 172.21.15.37:0/1165525505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc108ab0 0x7fbfbc10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 --2- 172.21.15.37:0/1165525505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfbc102820 0x7fbfbc102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 -- 172.21.15.37:0/1165525505 >> 172.21.15.37:0/1165525505 conn(0x7fbfbc0794e0 msgr2=0x7fbfbc0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 -- 172.21.15.37:0/1165525505 shutdown_connections 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 -- 172.21.15.37:0/1165525505 wait complete. 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.604+0000 7fbfc3946640 1 Processor -- start 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc3946640 1 -- start start 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc3946640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfbc102820 0x7fbfbc19afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc3946640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc108160 0x7fbfbc19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc3946640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108ab0 0x7fbfbc19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc3946640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1125b0 con 0x7fbfbc108ab0 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc3946640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc112430 con 0x7fbfbc108160 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc3946640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc112730 con 0x7fbfbc102820 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc1ee3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108ab0 0x7fbfbc19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc1ee3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108ab0 0x7fbfbc19ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57550/0 (socket says 172.21.15.37:57550) 2024-08-31T06:54:26.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc1ee3640 1 -- 172.21.15.37:0/2048757825 learned_addr learned my addr 172.21.15.37:0/2048757825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfbc102820 0x7fbfbc19afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc108160 0x7fbfbc19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc1ee3640 1 -- 172.21.15.37:0/2048757825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfbc102820 msgr2=0x7fbfbc19afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc1ee3640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfbc102820 0x7fbfbc19afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc1ee3640 1 -- 172.21.15.37:0/2048757825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc108160 msgr2=0x7fbfbc19b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc1ee3640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc108160 0x7fbfbc19b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc1ee3640 1 -- 172.21.15.37:0/2048757825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfbc1a61a0 con 0x7fbfbc108ab0 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.605+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc108160 0x7fbfbc19b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.606+0000 7fbfc1ee3640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108ab0 0x7fbfbc19ba20 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400cce0 tx=0x7fbfb400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.606+0000 7fbfb27fc640 1 -- 172.21.15.37:0/2048757825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400f450 con 0x7fbfbc108ab0 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.606+0000 7fbfb27fc640 1 -- 172.21.15.37:0/2048757825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfb400fa80 con 0x7fbfbc108ab0 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.606+0000 7fbfb27fc640 1 -- 172.21.15.37:0/2048757825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4018ad0 con 0x7fbfbc108ab0 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.606+0000 7fbfc3946640 1 -- 172.21.15.37:0/2048757825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfbc1a6490 con 0x7fbfbc108ab0 2024-08-31T06:54:26.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.606+0000 7fbfc3946640 1 -- 172.21.15.37:0/2048757825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfbc1a6980 con 0x7fbfbc108ab0 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfb27fc640 1 -- 172.21.15.37:0/2048757825 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fbfb400f5f0 con 0x7fbfbc108ab0 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfc9ebb740 1 Processor -- start 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfc9ebb740 1 -- start start 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 0x557f5cfea780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5cfeacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5cfeb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557f5cf605f0 con 0x557f5cc1b490 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557f5cf4fb80 con 0x557f5cc44350 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.609+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557f5cf53b30 con 0x557f5cc23670 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5cfeacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5cfeacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57558/0 (socket says 172.21.15.37:57558) 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 -- 172.21.15.37:0/3626413983 learned_addr learned my addr 172.21.15.37:0/3626413983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:26.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 0x557f5cfea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5cfeb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfb27fc640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfa80b4d50 0x7fbfa80b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 -- 172.21.15.37:0/3626413983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 msgr2=0x557f5cfeb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5cfeb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 -- 172.21.15.37:0/3626413983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 msgr2=0x557f5cfea780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 0x557f5cfea780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 -- 172.21.15.37:0/3626413983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5ccaf930 con 0x557f5cc1b490 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc1ee3640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfa80b4d50 0x7fbfa80b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfb27fc640 1 -- 172.21.15.37:0/2048757825 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbfb40e5c80 con 0x7fbfbc108ab0 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5cfeacc0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8004650 tx=0x7fbfb800bba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8692b983fb9850 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfa77fe640 1 -- 172.21.15.37:0/3626413983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8003b50 con 0x557f5cc1b490 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.610+0000 7fbfc1ee3640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfa80b4d50 0x7fbfa80b7260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40e3490 tx=0x7fbfb4078580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfa77fe640 1 -- 172.21.15.37:0/3626413983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfb8015070 con 0x557f5cc1b490 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfa77fe640 1 -- 172.21.15.37:0/3626413983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8004ba0 con 0x557f5cc1b490 2024-08-31T06:54:26.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/3626413983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 msgr2=0x557f5cfeacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5cfeacc0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8004650 tx=0x7fbfb800bba0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/3626413983 shutdown_connections 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5cfeacc0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5cfeb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/3626413983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 0x557f5cfea780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/3626413983 >> 172.21.15.37:0/3626413983 conn(0x557f5cc38740 msgr2=0x557f5cfe8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/3626413983 shutdown_connections 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.611+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/3626413983 wait complete. 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.612+0000 7fbfc9ebb740 1 -- start start 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.612+0000 7fbfc9ebb740 1 Processor -- start 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.612+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cff5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.612+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc23670 0x557f5cff64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.612+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc44350 0x557f5d002250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.612+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557f5cdb2890 con 0x557f5cc23670 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.612+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557f5ced6790 con 0x557f5cc1b490 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.612+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557f5cff8f60 con 0x557f5cc44350 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc9ebb740 10 client.0 _ll_register_callbacks cb 0x557f5cc5bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc23670 0x557f5cff64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc23670 0x557f5cff64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57570/0 (socket says 172.21.15.37:57570) 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 -- 172.21.15.37:0/1654577705 learned_addr learned my addr 172.21.15.37:0/1654577705 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc44350 0x557f5d002250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cff5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 -- 172.21.15.37:0/1654577705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc44350 msgr2=0x557f5d002250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc44350 0x557f5d002250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 -- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 msgr2=0x557f5cff5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cff5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 -- 172.21.15.37:0/1654577705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5cf0df30 con 0x557f5cc23670 2024-08-31T06:54:26.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cff5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc23670 0x557f5cff64a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8006010 tx=0x7fbfb8004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6b79ea4076062e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/1654577705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8028060 con 0x557f5cc23670 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/1654577705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbfb8011440 con 0x557f5cc23670 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.613+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/1654577705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfb8015070 con 0x557f5cc23670 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/1654577705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbfb8011640 con 0x557f5cc23670 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc9ebb740 10 client.17343 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/1654577705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557f5d004d60 con 0x557f5cc23670 2024-08-31T06:54:26.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/1654577705 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfb8015070 con 0x557f5cc23670 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/1654577705 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbfb8022070 con 0x557f5cc23670 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc9ebb740 10 client.17343 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc9ebb740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc9ebb740 20 client.17343 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557f5cc02cd0 0x557f5d008170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc9ebb740 4 client.17343 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/1654577705 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f5cf62540 con 0x557f5cc02cd0 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.614+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557f5cc02cd0 0x557f5d008170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.615+0000 7fbfa4ff9640 10 client.17343 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.615+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557f5cc02cd0 0x557f5d008170 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44bfcea38630b2e1 server_cookie=4a997502973d6d57 in_seq=0 out_seq=0 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/1654577705 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557f5cf62540 con 0x557f5cc02cd0 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfa4ff9640 10 client.17343 handle_command_reply: tid=0 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 client.17343 shutdown 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/1654577705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc23670 msgr2=0x557f5cff64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc23670 0x557f5cff64a0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8006010 tx=0x7fbfb8004450 comp rx=0 tx=0).stop 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/1654577705 shutdown_connections 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557f5cc02cd0 0x557f5d008170 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc23670 0x557f5cff64a0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc44350 0x557f5d002250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfa4ff9640 0 client.17343 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/1654577705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cff5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/1654577705 >> 172.21.15.37:0/1654577705 conn(0x557f5cc38740 msgr2=0x557f5cfed960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/1654577705 shutdown_connections 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/1654577705 wait complete. 2024-08-31T06:54:26.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.616+0000 7fbfc9ebb740 20 client.17343 trim_cache size 0 max 16384 2024-08-31T06:54:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.639+0000 7fbfc9ebb740 1 Processor -- start 2024-08-31T06:54:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.639+0000 7fbfc9ebb740 1 -- start start 2024-08-31T06:54:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.639+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cfedf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.639+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5cff3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.639+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc44350 0x557f5cff3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.639+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1afa20 con 0x557f5cc44350 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.639+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1ad2f0 con 0x557f5cc1b490 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.639+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1ab160 con 0x557f5cc23670 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc44350 0x557f5cff3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc44350 0x557f5cff3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57582/0 (socket says 172.21.15.37:57582) 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 -- 172.21.15.37:0/750785428 learned_addr learned my addr 172.21.15.37:0/750785428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cfedf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5cff3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 -- 172.21.15.37:0/750785428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 msgr2=0x557f5cff3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5cff3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 -- 172.21.15.37:0/750785428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 msgr2=0x557f5cfedf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cfedf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 -- 172.21.15.37:0/750785428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5cff7220 con 0x557f5cc44350 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc44350 0x557f5cff3690 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009850 tx=0x7fbfac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc103f974d73523 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfa6ffd640 1 -- 172.21.15.37:0/750785428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac035040 con 0x557f5cc44350 2024-08-31T06:54:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfa6ffd640 1 -- 172.21.15.37:0/750785428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfac04e020 con 0x557f5cc44350 2024-08-31T06:54:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.640+0000 7fbfa6ffd640 1 -- 172.21.15.37:0/750785428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0039c0 con 0x557f5cc44350 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/750785428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc44350 msgr2=0x557f5cff3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc44350 0x557f5cff3690 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009850 tx=0x7fbfac000bc0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/750785428 shutdown_connections 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc44350 0x557f5cff3690 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5cff3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/750785428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc1b490 0x557f5cfedf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/750785428 >> 172.21.15.37:0/750785428 conn(0x557f5cc38740 msgr2=0x557f5cfed880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/750785428 shutdown_connections 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.641+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/750785428 wait complete. 2024-08-31T06:54:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 1 -- start start 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 1 Processor -- start 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5d009c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5d00a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 0x557f5d06a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1ab7b0 con 0x557f5cc1b490 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1acc20 con 0x557f5cc44350 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbfbc1abe80 con 0x557f5cc23670 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc9ebb740 10 client.0 _ll_register_callbacks cb 0x7fbfac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc0ee1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5d009c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc0ee1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5d009c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57584/0 (socket says 172.21.15.37:57584) 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.642+0000 7fbfc0ee1640 1 -- 172.21.15.37:0/2227844661 learned_addr learned my addr 172.21.15.37:0/2227844661 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5d00a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 0x557f5d06a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc0ee1640 1 -- 172.21.15.37:0/2227844661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 msgr2=0x557f5d00a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5d00a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc0ee1640 1 -- 172.21.15.37:0/2227844661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 msgr2=0x557f5d06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 0x557f5d06a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc0ee1640 1 -- 172.21.15.37:0/2227844661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f5d06af20 con 0x557f5cc1b490 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc0ee1640 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5d009c30 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0057c0 tx=0x7fbfac0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4e78f9809a07b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfa4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/2227844661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac035040 con 0x557f5cc1b490 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/2227844661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbfac04f040 con 0x557f5cc1b490 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/2227844661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbfac04e020 con 0x557f5cc1b490 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/2227844661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbfac004330 con 0x557f5cc1b490 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc9ebb740 10 client.17349 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.643+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/2227844661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557f5d073440 con 0x557f5cc1b490 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/2227844661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfac04e020 con 0x557f5cc1b490 2024-08-31T06:54:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/2227844661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbfac03a040 con 0x557f5cc1b490 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfc9ebb740 10 client.17349 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfc9ebb740 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfc9ebb740 20 client.17349 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557f5cbd8080 0x557f5d075af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfc9ebb740 4 client.17349 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/2227844661 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557f5cf5dfe0 con 0x557f5cbd8080 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.644+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557f5cbd8080 0x557f5d075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.645+0000 7fbfa4ff9640 10 client.17349 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.645+0000 7fbfc16e2640 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557f5cbd8080 0x557f5d075af0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f342dc7f8845e89 server_cookie=a548dab10efa80e5 in_seq=0 out_seq=0 2024-08-31T06:54:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.647+0000 7fbfa4ff9640 1 -- 172.21.15.37:0/2227844661 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557f5cf5dfe0 con 0x557f5cbd8080 2024-08-31T06:54:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.647+0000 7fbfa4ff9640 10 client.17349 handle_command_reply: tid=0 2024-08-31T06:54:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.647+0000 7fbfc9ebb740 1 client.17349 shutdown 2024-08-31T06:54:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/2227844661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 msgr2=0x557f5d009c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5d009c30 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0057c0 tx=0x7fbfac0092d0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/2227844661 shutdown_connections 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557f5cbd8080 0x557f5d075af0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557f5cc44350 0x557f5d06a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557f5cc23670 0x557f5d00a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 --2- 172.21.15.37:0/2227844661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557f5cc1b490 0x557f5d009c30 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/2227844661 >> 172.21.15.37:0/2227844661 conn(0x557f5cc38740 msgr2=0x557f5cfee010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfa4ff9640 0 client.17349 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/2227844661 shutdown_connections 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 1 -- 172.21.15.37:0/2227844661 wait complete. 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.648+0000 7fbfc9ebb740 20 client.17349 trim_cache size 0 max 16384 2024-08-31T06:54:26.651 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:26.652 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:54:26.652 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "5235cd7a-0026-439c-bb69-023a1bfcedc7", 2024-08-31T06:54:26.652 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:54:26.652 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 -- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfa80b4d50 msgr2=0x7fbfa80b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfa80b4d50 0x7fbfa80b7260 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbfb40e3490 tx=0x7fbfb4078580 comp rx=0 tx=0).stop 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 -- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108ab0 msgr2=0x7fbfbc19ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108ab0 0x7fbfbc19ba20 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400cce0 tx=0x7fbfb400a620 comp rx=0 tx=0).stop 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 -- 172.21.15.37:0/2048757825 shutdown_connections 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbfa80b4d50 0x7fbfa80b7260 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfbc108ab0 0x7fbfbc19ba20 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfbc108160 0x7fbfbc19b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 --2- 172.21.15.37:0/2048757825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfbc102820 0x7fbfbc19afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 -- 172.21.15.37:0/2048757825 >> 172.21.15.37:0/2048757825 conn(0x7fbfbc0794e0 msgr2=0x7fbfbc104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 -- 172.21.15.37:0/2048757825 shutdown_connections 2024-08-31T06:54:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:26.649+0000 7fbfc3946640 1 -- 172.21.15.37:0/2048757825 wait complete. 2024-08-31T06:54:27.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:26 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:54:27.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:26 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:27.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:26 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:54:27.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:26 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:27.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:26 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:54:27.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:26 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:27.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:26 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:54:27.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:26 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:27.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:26 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:54:27.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:26 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:27.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:26 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:54:27.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:26 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:27.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:54:27.709 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:27 smithi106 ceph-mon[22134]: pgmap v552: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-08-31T06:54:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:27 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:54:28.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:27 smithi037 ceph-mon[18612]: pgmap v552: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-08-31T06:54:28.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:27 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:54:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:27 smithi066 ceph-mon[22244]: pgmap v552: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-08-31T06:54:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:27 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:54:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 -- 172.21.15.37:0/2638518762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 msgr2=0x7f933c1100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 --2- 172.21.15.37:0/2638518762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 0x7f933c1100c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9334009ca0 tx=0x7f933402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 -- 172.21.15.37:0/2638518762 shutdown_connections 2024-08-31T06:54:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 --2- 172.21.15.37:0/2638518762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 0x7f933c1100c0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 --2- 172.21.15.37:0/2638518762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f933c105070 0x7f933c10d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 --2- 172.21.15.37:0/2638518762 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f933c104640 0x7f933c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 -- 172.21.15.37:0/2638518762 >> 172.21.15.37:0/2638518762 conn(0x7f933c0794e0 msgr2=0x7f933c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 -- 172.21.15.37:0/2638518762 shutdown_connections 2024-08-31T06:54:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.234+0000 7f93414eb640 1 -- 172.21.15.37:0/2638518762 wait complete. 2024-08-31T06:54:28.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f93414eb640 1 Processor -- start 2024-08-31T06:54:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f93414eb640 1 -- start start 2024-08-31T06:54:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f93414eb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f933c104640 0x7f933c102550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f93414eb640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f933c105070 0x7f933c102a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f93414eb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 0x7f933c102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f93414eb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f933c113710 con 0x7f933c10dbf0 2024-08-31T06:54:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f93414eb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f933c113590 con 0x7f933c104640 2024-08-31T06:54:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f93414eb640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f933c113890 con 0x7f933c105070 2024-08-31T06:54:28.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f933b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 0x7f933c102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f933b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 0x7f933c102fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57606/0 (socket says 172.21.15.37:57606) 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f933b7fe640 1 -- 172.21.15.37:0/4272231763 learned_addr learned my addr 172.21.15.37:0/4272231763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f933affd640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f933c104640 0x7f933c102550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.235+0000 7f933a7fc640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f933c105070 0x7f933c102a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f933b7fe640 1 -- 172.21.15.37:0/4272231763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f933c105070 msgr2=0x7f933c102a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f933b7fe640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f933c105070 0x7f933c102a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f933b7fe640 1 -- 172.21.15.37:0/4272231763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f933c104640 msgr2=0x7f933c102550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f933b7fe640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f933c104640 0x7f933c102550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f933b7fe640 1 -- 172.21.15.37:0/4272231763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933c1a8420 con 0x7f933c10dbf0 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f933b7fe640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 0x7f933c102fd0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9334031040 tx=0x7f9334032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f9323fff640 1 -- 172.21.15.37:0/4272231763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334004040 con 0x7f933c10dbf0 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f93414eb640 1 -- 172.21.15.37:0/4272231763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933c1a86b0 con 0x7f933c10dbf0 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f9323fff640 1 -- 172.21.15.37:0/4272231763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9334004670 con 0x7f933c10dbf0 2024-08-31T06:54:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f9323fff640 1 -- 172.21.15.37:0/4272231763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334030bb0 con 0x7f933c10dbf0 2024-08-31T06:54:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.236+0000 7f93414eb640 1 -- 172.21.15.37:0/4272231763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933c1a8c40 con 0x7f933c10dbf0 2024-08-31T06:54:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9347a60740 1 Processor -- start 2024-08-31T06:54:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9323fff640 1 -- 172.21.15.37:0/4272231763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f93340041e0 con 0x7f933c10dbf0 2024-08-31T06:54:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9347a60740 1 -- start start 2024-08-31T06:54:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9347a60740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953ce9070 0x55995408e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9347a60740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc01b0 0x55995408e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9347a60740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x55995408ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9347a60740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559954005630 con 0x559953cc8390 2024-08-31T06:54:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9347a60740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559953ff4bc0 con 0x559953cc01b0 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.239+0000 7f9347a60740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559953ff8b70 con 0x559953ce9070 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x55995408ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x55995408ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57614/0 (socket says 172.21.15.37:57614) 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 -- 172.21.15.37:0/311495201 learned_addr learned my addr 172.21.15.37:0/311495201 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953ce9070 0x55995408e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933affd640 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc01b0 0x55995408e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f9323fff640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f93240b4ca0 0x7f93240b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 -- 172.21.15.37:0/311495201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953ce9070 msgr2=0x55995408e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953ce9070 0x55995408e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 -- 172.21.15.37:0/311495201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc01b0 msgr2=0x55995408e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc01b0 0x55995408e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 -- 172.21.15.37:0/311495201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559953d54650 con 0x559953cc8390 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933b7fe640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f93240b4ca0 0x7f93240b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933affd640 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc01b0 0x55995408e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f9323fff640 1 -- 172.21.15.37:0/4272231763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f9334106810 con 0x7f933c10dbf0 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.240+0000 7f933a7fc640 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x55995408ed80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9330014920 tx=0x7f933000c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85dcf80ac507d21 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.241+0000 7f93217fa640 1 -- 172.21.15.37:0/311495201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300142d0 con 0x559953cc8390 2024-08-31T06:54:28.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.241+0000 7f93217fa640 1 -- 172.21.15.37:0/311495201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f933000fbf0 con 0x559953cc8390 2024-08-31T06:54:28.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.241+0000 7f93217fa640 1 -- 172.21.15.37:0/311495201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330012850 con 0x559953cc8390 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.241+0000 7f9347a60740 1 -- 172.21.15.37:0/311495201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 msgr2=0x55995408ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.241+0000 7f933b7fe640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f93240b4ca0 0x7f93240b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f93340ca180 tx=0x7f93340b4040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.241+0000 7f9347a60740 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x55995408ed80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9330014920 tx=0x7f933000c430 comp rx=0 tx=0).stop 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 -- 172.21.15.37:0/311495201 shutdown_connections 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x55995408ed80 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc01b0 0x55995408e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 --2- 172.21.15.37:0/311495201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953ce9070 0x55995408e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 -- 172.21.15.37:0/311495201 >> 172.21.15.37:0/311495201 conn(0x559953cdd460 msgr2=0x55995408c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:28.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 -- 172.21.15.37:0/311495201 shutdown_connections 2024-08-31T06:54:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 -- 172.21.15.37:0/311495201 wait complete. 2024-08-31T06:54:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 -- start start 2024-08-31T06:54:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 Processor -- start 2024-08-31T06:54:28.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x559954099b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x55995409a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ce9070 0x5599540a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559953e57700 con 0x559953ce9070 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559953f7b700 con 0x559953cc8390 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55995409cae0 con 0x559953cc01b0 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.242+0000 7f9347a60740 10 client.0 _ll_register_callbacks cb 0x559953faadc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ce9070 0x5599540a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ce9070 0x5599540a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57616/0 (socket says 172.21.15.37:57616) 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 -- 172.21.15.37:0/2339919629 learned_addr learned my addr 172.21.15.37:0/2339919629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x559954099b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933affd640 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x55995409a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 -- 172.21.15.37:0/2339919629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 msgr2=0x559954099b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x559954099b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 -- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 msgr2=0x55995409a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x55995409a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 -- 172.21.15.37:0/2339919629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559953fb48b0 con 0x559953ce9070 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933affd640 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x55995409a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f933a7fc640 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ce9070 0x5599540a5e00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f933000fda0 tx=0x7f93300124f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8bb61d5c97954a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f931eff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:28.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f931eff5640 1 -- 172.21.15.37:0/2339919629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300140d0 con 0x559953ce9070 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f931eff5640 1 -- 172.21.15.37:0/2339919629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f9330014270 con 0x559953ce9070 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.243+0000 7f9347a60740 1 -- 172.21.15.37:0/2339919629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f933000fbf0 con 0x559953ce9070 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f931eff5640 1 -- 172.21.15.37:0/2339919629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f933000f760 con 0x559953ce9070 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f9347a60740 10 client.17361 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f9347a60740 1 -- 172.21.15.37:0/2339919629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5599540a8970 con 0x559953ce9070 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f931eff5640 1 -- 172.21.15.37:0/2339919629 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f933000fbf0 con 0x559953ce9070 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f931eff5640 1 -- 172.21.15.37:0/2339919629 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f93300048a0 con 0x559953ce9070 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f9347a60740 10 client.17361 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f9347a60740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:28.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f9347a60740 20 client.17361 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f9347a60740 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559953ca79f0 0x5599540abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f9347a60740 4 client.17361 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f9347a60740 1 -- 172.21.15.37:0/2339919629 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559954007580 con 0x559953ca79f0 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.244+0000 7f933affd640 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559953ca79f0 0x5599540abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.245+0000 7f931eff5640 10 client.17361 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.245+0000 7f933affd640 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559953ca79f0 0x5599540abd20 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c48091c017c2bb8d server_cookie=41f9d0ce68110fd1 in_seq=0 out_seq=0 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f931eff5640 1 -- 172.21.15.37:0/2339919629 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559954007580 con 0x559953ca79f0 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f931eff5640 10 client.17361 handle_command_reply: tid=0 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 client.17361 shutdown 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 -- 172.21.15.37:0/2339919629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ce9070 msgr2=0x5599540a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ce9070 0x5599540a5e00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f933000fda0 tx=0x7f93300124f0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 -- 172.21.15.37:0/2339919629 shutdown_connections 2024-08-31T06:54:28.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559953ca79f0 0x5599540abd20 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f931eff5640 0 client.17361 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ce9070 0x5599540a5e00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x55995409a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 --2- 172.21.15.37:0/2339919629 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x559954099b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 -- 172.21.15.37:0/2339919629 >> 172.21.15.37:0/2339919629 conn(0x559953cdd460 msgr2=0x559954091490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 -- 172.21.15.37:0/2339919629 shutdown_connections 2024-08-31T06:54:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 1 -- 172.21.15.37:0/2339919629 wait complete. 2024-08-31T06:54:28.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.246+0000 7f9347a60740 20 client.17361 trim_cache size 0 max 16384 2024-08-31T06:54:28.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f9347a60740 1 Processor -- start 2024-08-31T06:54:28.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f9347a60740 1 -- start start 2024-08-31T06:54:28.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f9347a60740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953ca79f0 0x55995408fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f9347a60740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x55995409b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f9347a60740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x5599540a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f9347a60740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f933c1b3f00 con 0x559953cc8390 2024-08-31T06:54:28.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f9347a60740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f933c1b17d0 con 0x559953ca79f0 2024-08-31T06:54:28.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f9347a60740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f933c1af640 con 0x559953cc01b0 2024-08-31T06:54:28.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f933a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x5599540a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f933a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x5599540a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57632/0 (socket says 172.21.15.37:57632) 2024-08-31T06:54:28.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f933a7fc640 1 -- 172.21.15.37:0/3489605950 learned_addr learned my addr 172.21.15.37:0/3489605950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:28.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.264+0000 7f933affd640 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x55995409b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f933a7fc640 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953ca79f0 0x55995408fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f933a7fc640 1 -- 172.21.15.37:0/3489605950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 msgr2=0x55995409b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:28.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f933a7fc640 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x55995409b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f933a7fc640 1 -- 172.21.15.37:0/3489605950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953ca79f0 msgr2=0x55995408fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:28.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f933a7fc640 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953ca79f0 0x55995408fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f933a7fc640 1 -- 172.21.15.37:0/3489605950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55995409c610 con 0x559953cc8390 2024-08-31T06:54:28.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f933a7fc640 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x5599540a5d00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f9330001eb0 tx=0x7f933000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0658825722175a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:28.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f9320ff9640 1 -- 172.21.15.37:0/3489605950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933000c910 con 0x559953cc8390 2024-08-31T06:54:28.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f9320ff9640 1 -- 172.21.15.37:0/3489605950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9330005bf0 con 0x559953cc8390 2024-08-31T06:54:28.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.265+0000 7f9320ff9640 1 -- 172.21.15.37:0/3489605950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300140d0 con 0x559953cc8390 2024-08-31T06:54:28.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 -- 172.21.15.37:0/3489605950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 msgr2=0x5599540a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x5599540a5d00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f9330001eb0 tx=0x7f933000cb70 comp rx=0 tx=0).stop 2024-08-31T06:54:28.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 -- 172.21.15.37:0/3489605950 shutdown_connections 2024-08-31T06:54:28.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953cc8390 0x5599540a5d00 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x55995409b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 --2- 172.21.15.37:0/3489605950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953ca79f0 0x55995408fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 -- 172.21.15.37:0/3489605950 >> 172.21.15.37:0/3489605950 conn(0x559953cdd460 msgr2=0x55995409b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:28.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 -- 172.21.15.37:0/3489605950 shutdown_connections 2024-08-31T06:54:28.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 -- 172.21.15.37:0/3489605950 wait complete. 2024-08-31T06:54:28.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 -- start start 2024-08-31T06:54:28.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.266+0000 7f9347a60740 1 Processor -- start 2024-08-31T06:54:28.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f9347a60740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ca79f0 0x5599540a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f9347a60740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x5599540a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f9347a60740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x559954115590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f9347a60740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f933c1afc90 con 0x559953ca79f0 2024-08-31T06:54:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f9347a60740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f933c1b1100 con 0x559953cc8390 2024-08-31T06:54:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f9347a60740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f933c1b0360 con 0x559953cc01b0 2024-08-31T06:54:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f9347a60740 10 client.0 _ll_register_callbacks cb 0x7f932c00b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ca79f0 0x5599540a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ca79f0 0x5599540a04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57638/0 (socket says 172.21.15.37:57638) 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 -- 172.21.15.37:0/1824019313 learned_addr learned my addr 172.21.15.37:0/1824019313 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933affd640 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x5599540a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x559954115590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 -- 172.21.15.37:0/1824019313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 msgr2=0x5599540a09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x5599540a09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 -- 172.21.15.37:0/1824019313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 msgr2=0x559954115590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x559954115590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 -- 172.21.15.37:0/1824019313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559954115ad0 con 0x559953ca79f0 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f933a7fc640 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ca79f0 0x5599540a04a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f933000ce20 tx=0x7f933000c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc3bf4eb17e2bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f931eff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f931eff5640 1 -- 172.21.15.37:0/1824019313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93300140d0 con 0x559953ca79f0 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.267+0000 7f931eff5640 1 -- 172.21.15.37:0/1824019313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f933002a040 con 0x559953ca79f0 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 1 -- 172.21.15.37:0/1824019313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559954003020 con 0x559953ca79f0 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f931eff5640 1 -- 172.21.15.37:0/1824019313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9330044080 con 0x559953ca79f0 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 10 client.17367 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 1 -- 172.21.15.37:0/1824019313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559954116d60 con 0x559953ca79f0 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f931eff5640 1 -- 172.21.15.37:0/1824019313 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x559954003020 con 0x559953ca79f0 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f931eff5640 1 -- 172.21.15.37:0/1824019313 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9330049050 con 0x559953ca79f0 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 10 client.17367 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 20 client.17367 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559953ce9070 0x559954119380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:28.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 4 client.17367 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f9347a60740 1 -- 172.21.15.37:0/1824019313 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559954000760 con 0x559953ce9070 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.268+0000 7f933affd640 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559953ce9070 0x559954119380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f933affd640 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559953ce9070 0x559954119380 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59e408202c145db3 server_cookie=3b97c92ae5d1e7db in_seq=0 out_seq=0 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f931eff5640 10 client.17367 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f931eff5640 1 -- 172.21.15.37:0/1824019313 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x559954000760 con 0x559953ce9070 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f931eff5640 10 client.17367 handle_command_reply: tid=0 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 client.17367 shutdown 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 -- 172.21.15.37:0/1824019313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ca79f0 msgr2=0x5599540a04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ca79f0 0x5599540a04a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f933000ce20 tx=0x7f933000c500 comp rx=0 tx=0).stop 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 -- 172.21.15.37:0/1824019313 shutdown_connections 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x559953ce9070 0x559954119380 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559953cc8390 0x559954115590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559953cc01b0 0x5599540a09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 --2- 172.21.15.37:0/1824019313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559953ca79f0 0x5599540a04a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.269+0000 7f9347a60740 1 -- 172.21.15.37:0/1824019313 >> 172.21.15.37:0/1824019313 conn(0x559953cdd460 msgr2=0x55995408fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:28.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f931eff5640 0 client.17367 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:28.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f9347a60740 1 -- 172.21.15.37:0/1824019313 shutdown_connections 2024-08-31T06:54:28.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f9347a60740 1 -- 172.21.15.37:0/1824019313 wait complete. 2024-08-31T06:54:28.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f9347a60740 20 client.17367 trim_cache size 0 max 16384 2024-08-31T06:54:28.281 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "5235cd7a-0026-439c-bb69-023a1bfcedc7": { 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:26.646033+0000", 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.282 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:54:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:54:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.283 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:54:28.284 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.285 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.286 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.287 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.288 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.289 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:28.291 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 -- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f93240b4ca0 msgr2=0x7f93240b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f93240b4ca0 0x7f93240b71b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f93340ca180 tx=0x7f93340b4040 comp rx=0 tx=0).stop 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 -- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 msgr2=0x7f933c102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 0x7f933c102fd0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9334031040 tx=0x7f9334032bc0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 -- 172.21.15.37:0/4272231763 shutdown_connections 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f93240b4ca0 0x7f93240b71b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c10dbf0 0x7f933c102fd0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f933c105070 0x7f933c102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 --2- 172.21.15.37:0/4272231763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f933c104640 0x7f933c102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 -- 172.21.15.37:0/4272231763 >> 172.21.15.37:0/4272231763 conn(0x7f933c0794e0 msgr2=0x7f933c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 -- 172.21.15.37:0/4272231763 shutdown_connections 2024-08-31T06:54:28.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:28.270+0000 7f93414eb640 1 -- 172.21.15.37:0/4272231763 wait complete. 2024-08-31T06:54:29.025 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:54:29.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:54:29.279 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.850+0000 7fa933ee0640 1 -- 172.21.15.37:0/1164763620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c108160 msgr2=0x7fa92c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.850+0000 7fa933ee0640 1 --2- 172.21.15.37:0/1164763620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c108160 0x7fa92c108570 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009900 tx=0x7fa91c02a410 comp rx=0 tx=0).stop 2024-08-31T06:54:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.850+0000 7fa933ee0640 1 -- 172.21.15.37:0/1164763620 shutdown_connections 2024-08-31T06:54:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.850+0000 7fa933ee0640 1 --2- 172.21.15.37:0/1164763620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c108160 0x7fa92c108570 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.850+0000 7fa933ee0640 1 --2- 172.21.15.37:0/1164763620 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa92c108ab0 0x7fa92c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.850+0000 7fa933ee0640 1 --2- 172.21.15.37:0/1164763620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa92c102820 0x7fa92c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.850+0000 7fa933ee0640 1 -- 172.21.15.37:0/1164763620 >> 172.21.15.37:0/1164763620 conn(0x7fa92c0794e0 msgr2=0x7fa92c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.850+0000 7fa933ee0640 1 -- 172.21.15.37:0/1164763620 shutdown_connections 2024-08-31T06:54:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.851+0000 7fa933ee0640 1 -- 172.21.15.37:0/1164763620 wait complete. 2024-08-31T06:54:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.851+0000 7fa933ee0640 1 Processor -- start 2024-08-31T06:54:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.851+0000 7fa933ee0640 1 -- start start 2024-08-31T06:54:29.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.851+0000 7fa933ee0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c102820 0x7fa92c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:29.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa933ee0640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa92c108160 0x7fa92c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:29.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa933ee0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa92c108ab0 0x7fa92c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:29.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa933ee0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c1125b0 con 0x7fa92c102820 2024-08-31T06:54:29.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa933ee0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c112430 con 0x7fa92c108ab0 2024-08-31T06:54:29.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa933ee0640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c112730 con 0x7fa92c108160 2024-08-31T06:54:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c102820 0x7fa92c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c102820 0x7fa92c198e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57660/0 (socket says 172.21.15.37:57660) 2024-08-31T06:54:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 -- 172.21.15.37:0/3421213411 learned_addr learned my addr 172.21.15.37:0/3421213411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa93147b640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa92c108160 0x7fa92c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa93247d640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa92c108ab0 0x7fa92c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:29.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 -- 172.21.15.37:0/3421213411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa92c108160 msgr2=0x7fa92c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa92c108160 0x7fa92c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 -- 172.21.15.37:0/3421213411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa92c108ab0 msgr2=0x7fa92c1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa92c108ab0 0x7fa92c1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 -- 172.21.15.37:0/3421213411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c1a8500 con 0x7fa92c102820 2024-08-31T06:54:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa93247d640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa92c108ab0 0x7fa92c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa931c7c640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c102820 0x7fa92c198e50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa92800d950 tx=0x7fa92800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:29.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.852+0000 7fa922ffd640 1 -- 172.21.15.37:0/3421213411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa928017030 con 0x7fa92c102820 2024-08-31T06:54:29.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.853+0000 7fa922ffd640 1 -- 172.21.15.37:0/3421213411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa928004020 con 0x7fa92c102820 2024-08-31T06:54:29.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.853+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92c1a87f0 con 0x7fa92c102820 2024-08-31T06:54:29.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.853+0000 7fa922ffd640 1 -- 172.21.15.37:0/3421213411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9280055d0 con 0x7fa92c102820 2024-08-31T06:54:29.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.853+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92c1a8d50 con 0x7fa92c102820 2024-08-31T06:54:29.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.854+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92c103aa0 con 0x7fa92c102820 2024-08-31T06:54:29.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.856+0000 7fa922ffd640 1 -- 172.21.15.37:0/3421213411 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa928009a30 con 0x7fa92c102820 2024-08-31T06:54:29.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.857+0000 7fa922ffd640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9180b4d20 0x7fa9180b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:29.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.857+0000 7fa93147b640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9180b4d20 0x7fa9180b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:29.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.857+0000 7fa922ffd640 1 -- 172.21.15.37:0/3421213411 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fa9280e5550 con 0x7fa92c102820 2024-08-31T06:54:29.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.857+0000 7fa93147b640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9180b4d20 0x7fa9180b7230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa91c004770 tx=0x7fa91c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:29.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:29.860+0000 7fa922ffd640 1 -- 172.21.15.37:0/3421213411 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa9280ac370 con 0x7fa92c102820 2024-08-31T06:54:30.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:29 smithi106 ceph-mon[22134]: pgmap v553: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-08-31T06:54:30.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.082+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa92c102c30 con 0x7fa92c102820 2024-08-31T06:54:30.084 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:29 smithi037 ceph-mon[18612]: pgmap v553: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-08-31T06:54:30.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.083+0000 7fa922ffd640 1 -- 172.21.15.37:0/3421213411 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fa92c102c30 con 0x7fa92c102820 2024-08-31T06:54:30.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:54:30.086 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:54:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:54:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.085+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9180b4d20 msgr2=0x7fa9180b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.085+0000 7fa933ee0640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9180b4d20 0x7fa9180b7230 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa91c004770 tx=0x7fa91c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:54:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.085+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c102820 msgr2=0x7fa92c198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.085+0000 7fa933ee0640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c102820 0x7fa92c198e50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fa92800d950 tx=0x7fa92800de10 comp rx=0 tx=0).stop 2024-08-31T06:54:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.086+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 shutdown_connections 2024-08-31T06:54:30.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.086+0000 7fa933ee0640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa9180b4d20 0x7fa9180b7230 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.086+0000 7fa933ee0640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa92c108ab0 0x7fa92c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.086+0000 7fa933ee0640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa92c108160 0x7fa92c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.086+0000 7fa933ee0640 1 --2- 172.21.15.37:0/3421213411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa92c102820 0x7fa92c198e50 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.086+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 >> 172.21.15.37:0/3421213411 conn(0x7fa92c0794e0 msgr2=0x7fa92c1051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.086+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 shutdown_connections 2024-08-31T06:54:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:30.086+0000 7fa933ee0640 1 -- 172.21.15.37:0/3421213411 wait complete. 2024-08-31T06:54:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:29 smithi066 ceph-mon[22244]: pgmap v553: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 7 op/s 2024-08-31T06:54:30.830 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:54:30.853 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:30 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3421213411' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:31.082 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:31.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:30 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3421213411' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:30 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3421213411' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 -- 172.21.15.37:0/3987274047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154109240 msgr2=0x7f5154109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 --2- 172.21.15.37:0/3987274047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154109240 0x7f5154109650 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5148009900 tx=0x7f514802a410 comp rx=0 tx=0).stop 2024-08-31T06:54:31.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 -- 172.21.15.37:0/3987274047 shutdown_connections 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 --2- 172.21.15.37:0/3987274047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154109240 0x7f5154109650 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 --2- 172.21.15.37:0/3987274047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154109b90 0x7f51541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 --2- 172.21.15.37:0/3987274047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5154103900 0x7f5154103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 -- 172.21.15.37:0/3987274047 >> 172.21.15.37:0/3987274047 conn(0x7f515407b5f0 msgr2=0x7f515407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 -- 172.21.15.37:0/3987274047 shutdown_connections 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 -- 172.21.15.37:0/3987274047 wait complete. 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 Processor -- start 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.551+0000 7f515c5e9640 1 -- start start 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515c5e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154103900 0x7f515419a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515c5e9640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5154109240 0x7f515419a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515c5e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154109b90 0x7f515419fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515c5e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5154113790 con 0x7f5154103900 2024-08-31T06:54:31.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515c5e9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5154113610 con 0x7f5154109b90 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515c5e9640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5154113910 con 0x7f5154109240 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154103900 0x7f515419a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154103900 0x7f515419a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57672/0 (socket says 172.21.15.37:57672) 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 -- 172.21.15.37:0/4023619659 learned_addr learned my addr 172.21.15.37:0/4023619659 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f5159b84640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5154109240 0x7f515419a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 -- 172.21.15.37:0/4023619659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5154109240 msgr2=0x7f515419a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5154109240 0x7f515419a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 -- 172.21.15.37:0/4023619659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154109b90 msgr2=0x7f515419fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154109b90 0x7f515419fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 -- 172.21.15.37:0/4023619659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51541a0170 con 0x7f5154103900 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f515a385640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154103900 0x7f515419a200 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f514400ea80 tx=0x7f514400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.552+0000 7f51537fe640 1 -- 172.21.15.37:0/4023619659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514400ce40 con 0x7f5154103900 2024-08-31T06:54:31.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.553+0000 7f51537fe640 1 -- 172.21.15.37:0/4023619659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5144005020 con 0x7f5154103900 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.553+0000 7f51537fe640 1 -- 172.21.15.37:0/4023619659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51440116d0 con 0x7f5154103900 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.553+0000 7f515c5e9640 1 -- 172.21.15.37:0/4023619659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51541a0460 con 0x7f5154103900 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.553+0000 7f515c5e9640 1 -- 172.21.15.37:0/4023619659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51541a6bc0 con 0x7f5154103900 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.555+0000 7f5162b5e740 1 Processor -- start 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.555+0000 7f5162b5e740 1 -- start start 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f51537fe640 1 -- 172.21.15.37:0/4023619659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f5144004a40 con 0x7f5154103900 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 0x55a76a4b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f5162b5e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a76a427680 con 0x55a76a10b070 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f5162b5e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a76a416c10 con 0x55a76a0e21b0 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f5162b5e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a76a41abc0 con 0x55a76a0ea390 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57684/0 (socket says 172.21.15.37:57684) 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 -- 172.21.15.37:0/3301212883 learned_addr learned my addr 172.21.15.37:0/3301212883 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f5159b84640 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 0x55a76a4b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515a385640 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 -- 172.21.15.37:0/3301212883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 msgr2=0x55a76a4b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 0x55a76a4b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 -- 172.21.15.37:0/3301212883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 msgr2=0x55a76a4b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 -- 172.21.15.37:0/3301212883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76a176650 con 0x55a76a10b070 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515a385640 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.556+0000 7f515ab86640 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4b0350 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f514c009790 tx=0x7f514c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dc498bab504ef5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:31.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.557+0000 7f51537fe640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f513c0b4d20 0x7f513c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.557+0000 7f5150ff9640 1 -- 172.21.15.37:0/3301212883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c015020 con 0x55a76a10b070 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.557+0000 7f515a385640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f513c0b4d20 0x7f513c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.557+0000 7f5150ff9640 1 -- 172.21.15.37:0/3301212883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f514c011420 con 0x55a76a10b070 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.557+0000 7f5150ff9640 1 -- 172.21.15.37:0/3301212883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c0105e0 con 0x55a76a10b070 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.557+0000 7f51537fe640 1 -- 172.21.15.37:0/4023619659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f51440e5aa0 con 0x7f5154103900 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301212883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 msgr2=0x55a76a4b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4b0350 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f514c009790 tx=0x7f514c009c50 comp rx=0 tx=0).stop 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f515a385640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f513c0b4d20 0x7f513c0b7230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f51440e32b0 tx=0x7f51440e5da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301212883 shutdown_connections 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 0x55a76a4b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301212883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4b0350 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301212883 >> 172.21.15.37:0/3301212883 conn(0x55a76a0ff460 msgr2=0x55a76a4ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301212883 shutdown_connections 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301212883 wait complete. 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 -- start start 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.558+0000 7f5162b5e740 1 Processor -- start 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 0x55a76a4cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5162b5e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a76a279700 con 0x55a76a0ea390 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5162b5e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a76a39d750 con 0x55a76a10b070 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5162b5e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a76a4c2e90 con 0x55a76a0e21b0 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5162b5e740 10 client.0 _ll_register_callbacks cb 0x55a76a3cce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57686/0 (socket says 172.21.15.37:57686) 2024-08-31T06:54:31.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 -- 172.21.15.37:0/3301877032 learned_addr learned my addr 172.21.15.37:0/3301877032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f515ab86640 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f515ab86640 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 0x55a76a4cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 -- 172.21.15.37:0/3301877032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 msgr2=0x55a76a4bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 -- 172.21.15.37:0/3301877032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 msgr2=0x55a76a4cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 0x55a76a4cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 -- 172.21.15.37:0/3301877032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76a3d6900 con 0x55a76a0ea390 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f515ab86640 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5159b84640 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c0420 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f51480057c0 tx=0x7f51480035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2845e742e98ccefa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.559+0000 7f5139ffb640 1 -- 172.21.15.37:0/3301877032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148035040 con 0x55a76a0ea390 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5139ffb640 1 -- 172.21.15.37:0/3301877032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f5148003cb0 con 0x55a76a0ea390 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301877032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514c011420 con 0x55a76a0ea390 2024-08-31T06:54:31.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5139ffb640 1 -- 172.21.15.37:0/3301877032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f514803c440 con 0x55a76a0ea390 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 10 client.17385 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301877032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a76a4cebf0 con 0x55a76a0ea390 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5139ffb640 1 -- 172.21.15.37:0/3301877032 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f514c011420 con 0x55a76a0ea390 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5139ffb640 1 -- 172.21.15.37:0/3301877032 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f514804f5e0 con 0x55a76a0ea390 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 10 client.17385 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 10 client.17385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 20 client.17385 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a76a0c99f0 0x55a76a4d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 4 client.17385 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301877032 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a76a4295d0 con 0x55a76a0c99f0 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.560+0000 7f515ab86640 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a76a0c99f0 0x55a76a4d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.561+0000 7f5139ffb640 10 client.17385 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.561+0000 7f515ab86640 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a76a0c99f0 0x55a76a4d20d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=792fc94ffbd5e5ad server_cookie=980e7fdf5fa2bc9f in_seq=0 out_seq=0 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5139ffb640 1 -- 172.21.15.37:0/3301877032 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a76a4295d0 con 0x55a76a0c99f0 2024-08-31T06:54:31.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5139ffb640 10 client.17385 handle_command_reply: tid=0 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 client.17385 shutdown 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301877032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 msgr2=0x55a76a4c0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c0420 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f51480057c0 tx=0x7f51480035f0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301877032 shutdown_connections 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c0420 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a76a0c99f0 0x55a76a4d20d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 0x55a76a4cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3301877032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5139ffb640 0 client.17385 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301877032 >> 172.21.15.37:0/3301877032 conn(0x55a76a0ff460 msgr2=0x55a76a4b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301877032 shutdown_connections 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 1 -- 172.21.15.37:0/3301877032 wait complete. 2024-08-31T06:54:31.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.562+0000 7f5162b5e740 20 client.17385 trim_cache size 0 max 16384 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5162b5e740 1 Processor -- start 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5162b5e740 1 -- start start 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 0x55a76a4cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4bd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5162b5e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f51541afb50 con 0x55a76a10b070 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5162b5e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f51541ad420 con 0x55a76a0e21b0 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5162b5e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f51541ab290 con 0x55a76a0ea390 2024-08-31T06:54:31.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4bd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4bd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57692/0 (socket says 172.21.15.37:57692) 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 -- 172.21.15.37:0/1219550523 learned_addr learned my addr 172.21.15.37:0/1219550523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f5159b84640 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 0x55a76a4cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 -- 172.21.15.37:0/1219550523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 msgr2=0x55a76a4cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 0x55a76a4cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 -- 172.21.15.37:0/1219550523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 msgr2=0x55a76a4ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4ae270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.576+0000 7f515ab86640 1 -- 172.21.15.37:0/1219550523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a76a4d2470 con 0x55a76a10b070 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.577+0000 7f515ab86640 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4bd0d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f514c011bb0 tx=0x7f514c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73d7ad6eda556e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.577+0000 7f513bfff640 1 -- 172.21.15.37:0/1219550523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c015040 con 0x55a76a10b070 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.577+0000 7f513bfff640 1 -- 172.21.15.37:0/1219550523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f514c028070 con 0x55a76a10b070 2024-08-31T06:54:31.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.577+0000 7f513bfff640 1 -- 172.21.15.37:0/1219550523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c01c440 con 0x55a76a10b070 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- 172.21.15.37:0/1219550523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 msgr2=0x55a76a4bd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4bd0d0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f514c011bb0 tx=0x7f514c000bc0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- 172.21.15.37:0/1219550523 shutdown_connections 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a10b070 0x55a76a4bd0d0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0ea390 0x55a76a4cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 --2- 172.21.15.37:0/1219550523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a0e21b0 0x55a76a4ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- 172.21.15.37:0/1219550523 >> 172.21.15.37:0/1219550523 conn(0x55a76a0ff460 msgr2=0x55a76a4adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- 172.21.15.37:0/1219550523 shutdown_connections 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- 172.21.15.37:0/1219550523 wait complete. 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- start start 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 Processor -- start 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 0x55a76a4c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f51541ab8e0 con 0x55a76a0ea390 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f51541acd50 con 0x55a76a10b070 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f51541abfb0 con 0x55a76a0e21b0 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.578+0000 7f5162b5e740 10 client.0 _ll_register_callbacks cb 0x7f5148004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57700/0 (socket says 172.21.15.37:57700) 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 -- 172.21.15.37:0/3286630208 learned_addr learned my addr 172.21.15.37:0/3286630208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f515ab86640 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 -- 172.21.15.37:0/3286630208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 msgr2=0x55a76a4c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 -- 172.21.15.37:0/3286630208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 msgr2=0x55a76a4c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:31.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 0x55a76a4c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 -- 172.21.15.37:0/3286630208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a76a53bae0 con 0x55a76a0ea390 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5159b84640 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c4600 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5148009900 tx=0x7f5148050e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f607d0b71fa07f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5139ffb640 1 -- 172.21.15.37:0/3286630208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148035070 con 0x55a76a0ea390 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5162b5e740 1 -- 172.21.15.37:0/3286630208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514c028070 con 0x55a76a0ea390 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5139ffb640 1 -- 172.21.15.37:0/3286630208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f514804f680 con 0x55a76a0ea390 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5139ffb640 1 -- 172.21.15.37:0/3286630208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f514805d050 con 0x55a76a0ea390 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5162b5e740 10 client.17391 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.579+0000 7f5162b5e740 1 -- 172.21.15.37:0/3286630208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a76a53cd60 con 0x55a76a0ea390 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f5139ffb640 1 -- 172.21.15.37:0/3286630208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f514c028070 con 0x55a76a0ea390 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f5139ffb640 1 -- 172.21.15.37:0/3286630208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f514803cae0 con 0x55a76a0ea390 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f5162b5e740 10 client.17391 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f5162b5e740 10 client.17391 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:54:31.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f5162b5e740 20 client.17391 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a76a09eda0 0x55a76a53f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f5162b5e740 4 client.17391 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f5162b5e740 1 -- 172.21.15.37:0/3286630208 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a76a425070 con 0x55a76a09eda0 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.580+0000 7f515ab86640 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a76a09eda0 0x55a76a53f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f515ab86640 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a76a09eda0 0x55a76a53f5a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2019aed1ebe26148 server_cookie=a060fd617db492bc in_seq=0 out_seq=0 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5139ffb640 10 client.17391 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5139ffb640 1 -- 172.21.15.37:0/3286630208 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a76a425070 con 0x55a76a09eda0 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5139ffb640 10 client.17391 handle_command_reply: tid=0 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 client.17391 shutdown 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 -- 172.21.15.37:0/3286630208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 msgr2=0x55a76a4c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c4600 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5148009900 tx=0x7f5148050e00 comp rx=0 tx=0).stop 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 -- 172.21.15.37:0/3286630208 shutdown_connections 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a76a0ea390 0x55a76a4c4600 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55a76a09eda0 0x55a76a53f5a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a76a10b070 0x55a76a4c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 --2- 172.21.15.37:0/3286630208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a76a0e21b0 0x55a76a4c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5139ffb640 0 client.17391 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:31.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 -- 172.21.15.37:0/3286630208 >> 172.21.15.37:0/3286630208 conn(0x55a76a0ff460 msgr2=0x55a76a4b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:31.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 -- 172.21.15.37:0/3286630208 shutdown_connections 2024-08-31T06:54:31.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 1 -- 172.21.15.37:0/3286630208 wait complete. 2024-08-31T06:54:31.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.581+0000 7f5162b5e740 20 client.17391 trim_cache size 0 max 16384 2024-08-31T06:54:31.587 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 -- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f513c0b4d20 msgr2=0x7f513c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f513c0b4d20 0x7f513c0b7230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f51440e32b0 tx=0x7f51440e5da0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 -- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154103900 msgr2=0x7f515419a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154103900 0x7f515419a200 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f514400ea80 tx=0x7f514400ef40 comp rx=0 tx=0).stop 2024-08-31T06:54:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 -- 172.21.15.37:0/4023619659 shutdown_connections 2024-08-31T06:54:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f513c0b4d20 0x7f513c0b7230 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5154109b90 0x7f515419fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5154109240 0x7f515419a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 --2- 172.21.15.37:0/4023619659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5154103900 0x7f515419a200 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 -- 172.21.15.37:0/4023619659 >> 172.21.15.37:0/4023619659 conn(0x7f515407b5f0 msgr2=0x7f51541052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 -- 172.21.15.37:0/4023619659 shutdown_connections 2024-08-31T06:54:31.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:31.582+0000 7f515c5e9640 1 -- 172.21.15.37:0/4023619659 wait complete. 2024-08-31T06:54:32.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:31 smithi037 ceph-mon[18612]: pgmap v554: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6 op/s 2024-08-31T06:54:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:31 smithi066 ceph-mon[22244]: pgmap v554: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6 op/s 2024-08-31T06:54:32.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:54:32.317 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:31 smithi106 ceph-mon[22134]: pgmap v554: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6 op/s 2024-08-31T06:54:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:33.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 -- 172.21.15.37:0/4024066407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c109b90 msgr2=0x7f497c1103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 --2- 172.21.15.37:0/4024066407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c109b90 0x7f497c1103c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f4974009ca0 tx=0x7f497402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 -- 172.21.15.37:0/4024066407 shutdown_connections 2024-08-31T06:54:33.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 --2- 172.21.15.37:0/4024066407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c109b90 0x7f497c1103c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 --2- 172.21.15.37:0/4024066407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f497c109240 0x7f497c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 --2- 172.21.15.37:0/4024066407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f497c103900 0x7f497c103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 -- 172.21.15.37:0/4024066407 >> 172.21.15.37:0/4024066407 conn(0x7f497c07b5f0 msgr2=0x7f497c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 -- 172.21.15.37:0/4024066407 shutdown_connections 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.058+0000 7f4982db4640 1 -- 172.21.15.37:0/4024066407 wait complete. 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4982db4640 1 Processor -- start 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4982db4640 1 -- start start 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4982db4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c103900 0x7f497c0754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4982db4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f497c109240 0x7f497c0759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4982db4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f497c109b90 0x7f497c075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4982db4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f497c113750 con 0x7f497c103900 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4982db4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1135d0 con 0x7f497c109b90 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4982db4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1138d0 con 0x7f497c109240 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4980b50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c103900 0x7f497c0754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4980b50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c103900 0x7f497c0754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57714/0 (socket says 172.21.15.37:57714) 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4980b50640 1 -- 172.21.15.37:0/1516568974 learned_addr learned my addr 172.21.15.37:0/1516568974 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f4981351640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f497c109b90 0x7f497c075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.059+0000 7f497bfff640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f497c109240 0x7f497c0759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4980b50640 1 -- 172.21.15.37:0/1516568974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f497c109240 msgr2=0x7f497c0759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4980b50640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f497c109240 0x7f497c0759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4980b50640 1 -- 172.21.15.37:0/1516568974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f497c109b90 msgr2=0x7f497c075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4980b50640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f497c109b90 0x7f497c075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4980b50640 1 -- 172.21.15.37:0/1516568974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497c1a8520 con 0x7f497c103900 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4980b50640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c103900 0x7f497c0754b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f497000c970 tx=0x7f497000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4979ffb640 1 -- 172.21.15.37:0/1516568974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970007bb0 con 0x7f497c103900 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4979ffb640 1 -- 172.21.15.37:0/1516568974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4970007d50 con 0x7f497c103900 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4982db4640 1 -- 172.21.15.37:0/1516568974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497c1a8810 con 0x7f497c103900 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4979ffb640 1 -- 172.21.15.37:0/1516568974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970004e40 con 0x7f497c103900 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.060+0000 7f4982db4640 1 -- 172.21.15.37:0/1516568974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497c1a8d00 con 0x7f497c103900 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4989329740 1 Processor -- start 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4979ffb640 1 -- 172.21.15.37:0/1516568974 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f4970005020 con 0x7f497c103900 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4989329740 1 -- start start 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4989329740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59c5070 0x55a8c5d6a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4989329740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4989329740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d6ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4989329740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a8c5ce1680 con 0x55a8c59c5070 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4989329740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a8c5cd0c10 con 0x55a8c599c1b0 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4989329740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a8c5cd4bc0 con 0x55a8c59a4390 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4981351640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59c5070 0x55a8c5d6a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4981351640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59c5070 0x55a8c5d6a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57716/0 (socket says 172.21.15.37:57716) 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4981351640 1 -- 172.21.15.37:0/2379327743 learned_addr learned my addr 172.21.15.37:0/2379327743 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f4980b50640 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.063+0000 7f497bfff640 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d6ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4981351640 1 -- 172.21.15.37:0/2379327743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 msgr2=0x55a8c5d6ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4981351640 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d6ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4979ffb640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f496c0b4ca0 0x7f496c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4981351640 1 -- 172.21.15.37:0/2379327743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 msgr2=0x55a8c5d6a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:33.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4981351640 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4981351640 1 -- 172.21.15.37:0/2379327743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8c5a30650 con 0x55a8c59c5070 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4979ffb640 1 -- 172.21.15.37:0/1516568974 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f49700e5280 con 0x7f497c103900 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4981351640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f496c0b4ca0 0x7f496c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4981351640 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59c5070 0x55a8c5d6a310 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f497402aeb0 tx=0x7f4974031690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180d18022712928c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4966ffd640 1 -- 172.21.15.37:0/2379327743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974031ce0 con 0x55a8c59c5070 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4966ffd640 1 -- 172.21.15.37:0/2379327743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4974036030 con 0x55a8c59c5070 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.064+0000 7f4966ffd640 1 -- 172.21.15.37:0/2379327743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49740305c0 con 0x55a8c59c5070 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 -- 172.21.15.37:0/2379327743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59c5070 msgr2=0x55a8c5d6a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59c5070 0x55a8c5d6a310 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f497402aeb0 tx=0x7f4974031690 comp rx=0 tx=0).stop 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4981351640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f496c0b4ca0 0x7f496c0b71b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4974031920 tx=0x7f4974030920 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 -- 172.21.15.37:0/2379327743 shutdown_connections 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d6ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 --2- 172.21.15.37:0/2379327743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59c5070 0x55a8c5d6a310 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 -- 172.21.15.37:0/2379327743 >> 172.21.15.37:0/2379327743 conn(0x55a8c59b9460 msgr2=0x55a8c5d68200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 -- 172.21.15.37:0/2379327743 shutdown_connections 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.065+0000 7f4989329740 1 -- 172.21.15.37:0/2379327743 wait complete. 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 1 -- start start 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 1 Processor -- start 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c599c1b0 0x55a8c5d75ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59a4390 0x55a8c5d75ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c59c5070 0x55a8c5d81c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a8c5b33700 con 0x55a8c59a4390 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55a8c5c57750 con 0x55a8c59c5070 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55a8c5d78970 con 0x55a8c599c1b0 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f4989329740 10 client.0 _ll_register_callbacks cb 0x55a8c5c86e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.066+0000 7f497bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59a4390 0x55a8c5d75ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f497bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59a4390 0x55a8c5d75ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57732/0 (socket says 172.21.15.37:57732) 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f497bfff640 1 -- 172.21.15.37:0/3939934410 learned_addr learned my addr 172.21.15.37:0/3939934410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f4980b50640 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c599c1b0 0x55a8c5d75ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f4981351640 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c59c5070 0x55a8c5d81c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f497bfff640 1 -- 172.21.15.37:0/3939934410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c599c1b0 msgr2=0x55a8c5d75ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f497bfff640 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c599c1b0 0x55a8c5d75ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f497bfff640 1 -- 172.21.15.37:0/3939934410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c59c5070 msgr2=0x55a8c5d81c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f497bfff640 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c59c5070 0x55a8c5d81c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f497bfff640 1 -- 172.21.15.37:0/3939934410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8c5c90900 con 0x55a8c59a4390 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f4981351640 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c59c5070 0x55a8c5d81c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f497bfff640 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59a4390 0x55a8c5d75ff0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f4968011710 tx=0x7f4968011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e393d716717d30 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f495bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f495bfff640 1 -- 172.21.15.37:0/3939934410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496800fdb0 con 0x55a8c59a4390 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.067+0000 7f4989329740 1 -- 172.21.15.37:0/3939934410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4974036030 con 0x55a8c59a4390 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f495bfff640 1 -- 172.21.15.37:0/3939934410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f4968005020 con 0x55a8c59a4390 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f495bfff640 1 -- 172.21.15.37:0/3939934410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4968005220 con 0x55a8c59a4390 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4989329740 10 client.17403 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4989329740 1 -- 172.21.15.37:0/3939934410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a8c5d84820 con 0x55a8c59a4390 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f495bfff640 1 -- 172.21.15.37:0/3939934410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4974036030 con 0x55a8c59a4390 2024-08-31T06:54:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f495bfff640 1 -- 172.21.15.37:0/3939934410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4968018030 con 0x55a8c59a4390 2024-08-31T06:54:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4989329740 10 client.17403 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4989329740 10 client.17403 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:54:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4989329740 20 client.17403 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4989329740 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8c59839f0 0x55a8c5d87d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4989329740 4 client.17403 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4989329740 1 -- 172.21.15.37:0/3939934410 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8c5ce35d0 con 0x55a8c59839f0 2024-08-31T06:54:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.068+0000 7f4980b50640 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8c59839f0 0x55a8c5d87d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.069+0000 7f4980b50640 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8c59839f0 0x55a8c5d87d90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=46c5efbb3ee54c3f server_cookie=b61689a82af7cc2d in_seq=0 out_seq=0 2024-08-31T06:54:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.069+0000 7f495bfff640 10 client.17403 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f495bfff640 1 -- 172.21.15.37:0/3939934410 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8c5ce35d0 con 0x55a8c59839f0 2024-08-31T06:54:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f495bfff640 10 client.17403 handle_command_reply: tid=0 2024-08-31T06:54:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 client.17403 shutdown 2024-08-31T06:54:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 -- 172.21.15.37:0/3939934410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59a4390 msgr2=0x55a8c5d75ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59a4390 0x55a8c5d75ff0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f4968011710 tx=0x7f4968011bd0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 -- 172.21.15.37:0/3939934410 shutdown_connections 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8c59839f0 0x55a8c5d87d90 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f495bfff640 0 client.17403 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59a4390 0x55a8c5d75ff0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c59c5070 0x55a8c5d81c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 --2- 172.21.15.37:0/3939934410 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c599c1b0 0x55a8c5d75ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 -- 172.21.15.37:0/3939934410 >> 172.21.15.37:0/3939934410 conn(0x55a8c59b9460 msgr2=0x55a8c5d6d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 -- 172.21.15.37:0/3939934410 shutdown_connections 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 1 -- 172.21.15.37:0/3939934410 wait complete. 2024-08-31T06:54:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.070+0000 7f4989329740 20 client.17403 trim_cache size 0 max 16384 2024-08-31T06:54:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.083+0000 7f4989329740 1 Processor -- start 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4989329740 1 -- start start 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4989329740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d683c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4989329740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4989329740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d81b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4989329740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1b3f40 con 0x55a8c59839f0 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4989329740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1b1810 con 0x55a8c599c1b0 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4989329740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1af680 con 0x55a8c59a4390 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d683c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57736/0 (socket says 172.21.15.37:57736) 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 -- 172.21.15.37:0/1587623758 learned_addr learned my addr 172.21.15.37:0/1587623758 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f497bfff640 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 -- 172.21.15.37:0/1587623758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 msgr2=0x55a8c5d81b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d81b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 -- 172.21.15.37:0/1587623758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 msgr2=0x55a8c5d6db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 -- 172.21.15.37:0/1587623758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8c5d6c600 con 0x55a8c59839f0 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f497bfff640 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.084+0000 7f4980b50640 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d683c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f49700e2a40 tx=0x7f49700e8dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fee2339f6df3bf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f49667fc640 1 -- 172.21.15.37:0/1587623758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497001d040 con 0x55a8c59839f0 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f49667fc640 1 -- 172.21.15.37:0/1587623758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49700055d0 con 0x55a8c59839f0 2024-08-31T06:54:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f49667fc640 1 -- 172.21.15.37:0/1587623758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49700ab980 con 0x55a8c59839f0 2024-08-31T06:54:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f4989329740 1 -- 172.21.15.37:0/1587623758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 msgr2=0x55a8c5d683c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f4989329740 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d683c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f49700e2a40 tx=0x7f49700e8dd0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f4989329740 1 -- 172.21.15.37:0/1587623758 shutdown_connections 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f4989329740 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d81b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f4989329740 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d6db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f4989329740 1 --2- 172.21.15.37:0/1587623758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d683c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.085+0000 7f4989329740 1 -- 172.21.15.37:0/1587623758 >> 172.21.15.37:0/1587623758 conn(0x55a8c59b9460 msgr2=0x55a8c5d6d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 -- 172.21.15.37:0/1587623758 shutdown_connections 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 -- 172.21.15.37:0/1587623758 wait complete. 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 -- start start 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 Processor -- start 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d79ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d7a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d7a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1afcd0 con 0x55a8c59839f0 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1b1140 con 0x55a8c599c1b0 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.086+0000 7f4989329740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f497c1b03a0 con 0x55a8c59a4390 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4989329740 10 client.0 _ll_register_callbacks cb 0x7f496800cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d79ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d79ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57750/0 (socket says 172.21.15.37:57750) 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 -- 172.21.15.37:0/3028065439 learned_addr learned my addr 172.21.15.37:0/3028065439 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f497bfff640 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d7a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4981351640 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d7a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 -- 172.21.15.37:0/3028065439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 msgr2=0x55a8c5d7a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d7a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 -- 172.21.15.37:0/3028065439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 msgr2=0x55a8c5d7a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d7a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 -- 172.21.15.37:0/3028065439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8c5df1770 con 0x55a8c59839f0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f497bfff640 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d7a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4980b50640 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d79ae0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f49700a7a00 tx=0x7f49700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3d2b72caee3f2a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f495bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f495bfff640 1 -- 172.21.15.37:0/3028065439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497001d070 con 0x55a8c59839f0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f495bfff640 1 -- 172.21.15.37:0/3028065439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f49700e2c60 con 0x55a8c59839f0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4989329740 1 -- 172.21.15.37:0/3028065439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a8c5cdf070 con 0x55a8c59839f0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f495bfff640 1 -- 172.21.15.37:0/3028065439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49700ab0f0 con 0x55a8c59839f0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4989329740 10 client.17409 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.087+0000 7f4989329740 1 -- 172.21.15.37:0/3028065439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a8c5df2960 con 0x55a8c59839f0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f495bfff640 1 -- 172.21.15.37:0/3028065439 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55a8c5cdf070 con 0x55a8c59839f0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f495bfff640 1 -- 172.21.15.37:0/3028065439 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49700a72f0 con 0x55a8c59839f0 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f4989329740 10 client.17409 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f4989329740 10 client.17409 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:54:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f4989329740 20 client.17409 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f4989329740 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8c59c5070 0x55a8c5df5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f4989329740 4 client.17409 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f4989329740 1 -- 172.21.15.37:0/3028065439 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a8c5cdc7b0 con 0x55a8c59c5070 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.088+0000 7f497bfff640 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8c59c5070 0x55a8c5df5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f497bfff640 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8c59c5070 0x55a8c5df5150 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e05a20caf8ef636 server_cookie=e0e36be461f694b8 in_seq=0 out_seq=0 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f495bfff640 10 client.17409 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f495bfff640 1 -- 172.21.15.37:0/3028065439 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a8c5cdc7b0 con 0x55a8c59c5070 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f495bfff640 10 client.17409 handle_command_reply: tid=0 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 client.17409 shutdown 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 -- 172.21.15.37:0/3028065439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 msgr2=0x55a8c5d79ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d79ae0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f49700a7a00 tx=0x7f49700048f0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 -- 172.21.15.37:0/3028065439 shutdown_connections 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55a8c59c5070 0x55a8c5df5150 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a8c59a4390 0x55a8c5d7a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55a8c599c1b0 0x55a8c5d7a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 --2- 172.21.15.37:0/3028065439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a8c59839f0 0x55a8c5d79ae0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 -- 172.21.15.37:0/3028065439 >> 172.21.15.37:0/3028065439 conn(0x55a8c59b9460 msgr2=0x55a8c5d76f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f495bfff640 0 client.17409 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 -- 172.21.15.37:0/3028065439 shutdown_connections 2024-08-31T06:54:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 1 -- 172.21.15.37:0/3028065439 wait complete. 2024-08-31T06:54:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.089+0000 7f4989329740 20 client.17409 trim_cache size 0 max 16384 2024-08-31T06:54:33.095 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 -- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f496c0b4ca0 msgr2=0x7f496c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f496c0b4ca0 0x7f496c0b71b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4974031920 tx=0x7f4974030920 comp rx=0 tx=0).stop 2024-08-31T06:54:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 -- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c103900 msgr2=0x7f497c0754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c103900 0x7f497c0754b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f497000c970 tx=0x7f497000ce30 comp rx=0 tx=0).stop 2024-08-31T06:54:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 -- 172.21.15.37:0/1516568974 shutdown_connections 2024-08-31T06:54:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f496c0b4ca0 0x7f496c0b71b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f497c109b90 0x7f497c075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f497c109240 0x7f497c0759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 --2- 172.21.15.37:0/1516568974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f497c103900 0x7f497c0754b0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:33.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 -- 172.21.15.37:0/1516568974 >> 172.21.15.37:0/1516568974 conn(0x7f497c07b5f0 msgr2=0x7f497c1053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:33.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 -- 172.21.15.37:0/1516568974 shutdown_connections 2024-08-31T06:54:33.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:33.090+0000 7f4982db4640 1 -- 172.21.15.37:0/1516568974 wait complete. 2024-08-31T06:54:33.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:54:34.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:33 smithi037 ceph-mon[18612]: pgmap v555: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-08-31T06:54:34.117 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:33 smithi106 ceph-mon[22134]: pgmap v555: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-08-31T06:54:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:33 smithi066 ceph-mon[22244]: pgmap v555: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-08-31T06:54:34.214 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 -- 172.21.15.37:0/3416238264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40102f60 msgr2=0x7fce40103370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 --2- 172.21.15.37:0/3416238264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40102f60 0x7fce40103370 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fce30009900 tx=0x7fce3002a410 comp rx=0 tx=0).stop 2024-08-31T06:54:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 -- 172.21.15.37:0/3416238264 shutdown_connections 2024-08-31T06:54:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 --2- 172.21.15.37:0/3416238264 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce40105880 0x7fce4010f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 --2- 172.21.15.37:0/3416238264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce40104f30 0x7fce40105340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 --2- 172.21.15.37:0/3416238264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40102f60 0x7fce40103370 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 -- 172.21.15.37:0/3416238264 >> 172.21.15.37:0/3416238264 conn(0x7fce40077a00 msgr2=0x7fce40077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 -- 172.21.15.37:0/3416238264 shutdown_connections 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.728+0000 7fce464b1640 1 -- 172.21.15.37:0/3416238264 wait complete. 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce464b1640 1 Processor -- start 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce464b1640 1 -- start start 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce464b1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce40102f60 0x7fce4019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce464b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40104f30 0x7fce4019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce464b1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce40105880 0x7fce4019f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce464b1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce40113750 con 0x7fce40104f30 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce464b1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fce401135d0 con 0x7fce40105880 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce464b1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fce401138d0 con 0x7fce40102f60 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40104f30 0x7fce4019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40104f30 0x7fce4019a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35744/0 (socket says 172.21.15.37:35744) 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce3f7fe640 1 -- 172.21.15.37:0/4275397135 learned_addr learned my addr 172.21.15.37:0/4275397135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:34.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce44a4e640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce40105880 0x7fce4019f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.729+0000 7fce3ffff640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce40102f60 0x7fce4019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3f7fe640 1 -- 172.21.15.37:0/4275397135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce40102f60 msgr2=0x7fce4019a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce40102f60 0x7fce4019a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3f7fe640 1 -- 172.21.15.37:0/4275397135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce40105880 msgr2=0x7fce4019f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce40105880 0x7fce4019f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3f7fe640 1 -- 172.21.15.37:0/4275397135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce401a0110 con 0x7fce40104f30 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce44a4e640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce40105880 0x7fce4019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40104f30 0x7fce4019a740 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fce3400b450 tx=0x7fce3400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3d7fa640 1 -- 172.21.15.37:0/4275397135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34015020 con 0x7fce40104f30 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3d7fa640 1 -- 172.21.15.37:0/4275397135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce34011d20 con 0x7fce40104f30 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce464b1640 1 -- 172.21.15.37:0/4275397135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce401a0400 con 0x7fce40104f30 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce3d7fa640 1 -- 172.21.15.37:0/4275397135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34010e10 con 0x7fce40104f30 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.730+0000 7fce464b1640 1 -- 172.21.15.37:0/4275397135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce401a6b60 con 0x7fce40104f30 2024-08-31T06:54:34.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce4ca26740 1 Processor -- start 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce4ca26740 1 -- start start 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce3d7fa640 1 -- 172.21.15.37:0/4275397135 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fce34018020 con 0x7fce40104f30 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad6250e070 0x55ad628b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 0x55ad628b3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad628b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce4ca26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ad6282a680 con 0x55ad6250e070 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce4ca26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ad62819c10 con 0x55ad624ed390 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce4ca26740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ad6281dbc0 con 0x55ad624e51b0 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce44a4e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad6250e070 0x55ad628b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce44a4e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad6250e070 0x55ad628b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35748/0 (socket says 172.21.15.37:35748) 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce44a4e640 1 -- 172.21.15.37:0/2791549363 learned_addr learned my addr 172.21.15.37:0/2791549363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad628b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.733+0000 7fce3ffff640 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 0x55ad628b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce44a4e640 1 -- 172.21.15.37:0/2791549363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 msgr2=0x55ad628b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce44a4e640 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 0x55ad628b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce44a4e640 1 -- 172.21.15.37:0/2791549363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 msgr2=0x55ad628b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce44a4e640 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad628b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce44a4e640 1 -- 172.21.15.37:0/2791549363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad62579650 con 0x55ad6250e070 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce44a4e640 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad6250e070 0x55ad628b3310 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fce38009fd0 tx=0x7fce380108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cc63dfd032e1e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce3d7fa640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fce280b4ca0 0x7fce280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce267fc640 1 -- 172.21.15.37:0/2791549363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38011700 con 0x55ad6250e070 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce3ffff640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fce280b4ca0 0x7fce280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce267fc640 1 -- 172.21.15.37:0/2791549363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce38011d30 con 0x55ad6250e070 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce267fc640 1 -- 172.21.15.37:0/2791549363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3801bda0 con 0x55ad6250e070 2024-08-31T06:54:34.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.734+0000 7fce3d7fa640 1 -- 172.21.15.37:0/4275397135 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fce340e4ff0 con 0x7fce40104f30 2024-08-31T06:54:34.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 -- 172.21.15.37:0/2791549363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad6250e070 msgr2=0x55ad628b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad6250e070 0x55ad628b3310 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fce38009fd0 tx=0x7fce380108e0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce3ffff640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fce280b4ca0 0x7fce280b71b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fce30000c00 tx=0x7fce30009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 -- 172.21.15.37:0/2791549363 shutdown_connections 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad628b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 0x55ad628b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2791549363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad6250e070 0x55ad628b3310 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 -- 172.21.15.37:0/2791549363 >> 172.21.15.37:0/2791549363 conn(0x55ad62502460 msgr2=0x55ad628b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 -- 172.21.15.37:0/2791549363 shutdown_connections 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.735+0000 7fce4ca26740 1 -- 172.21.15.37:0/2791549363 wait complete. 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 1 -- start start 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 1 Processor -- start 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624e51b0 0x55ad628c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 0x55ad628c3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad6250e070 0x55ad628cf180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ad6267c700 con 0x55ad624e51b0 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55ad627a0750 con 0x55ad6250e070 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55ad628c5e50 con 0x55ad624ed390 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce4ca26740 10 client.0 _ll_register_callbacks cb 0x55ad627cfe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624e51b0 0x55ad628c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624e51b0 0x55ad628c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35758/0 (socket says 172.21.15.37:35758) 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.736+0000 7fce3ffff640 1 -- 172.21.15.37:0/3358057800 learned_addr learned my addr 172.21.15.37:0/3358057800 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce44a4e640 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad6250e070 0x55ad628cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 0x55ad628c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce3ffff640 1 -- 172.21.15.37:0/3358057800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 msgr2=0x55ad628c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce3ffff640 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 0x55ad628c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce3ffff640 1 -- 172.21.15.37:0/3358057800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad6250e070 msgr2=0x55ad628cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce3ffff640 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad6250e070 0x55ad628cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce3ffff640 1 -- 172.21.15.37:0/3358057800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad627d9900 con 0x55ad624e51b0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce3ffff640 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624e51b0 0x55ad628c2f20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fce30009900 tx=0x7fce30009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61eba506e391b410 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce1f7fe640 1 -- 172.21.15.37:0/3358057800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3004c030 con 0x55ad624e51b0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce1f7fe640 1 -- 172.21.15.37:0/3358057800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fce300035f0 con 0x55ad624e51b0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce4ca26740 1 -- 172.21.15.37:0/3358057800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce38011d30 con 0x55ad624e51b0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce1f7fe640 1 -- 172.21.15.37:0/3358057800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fce30035040 con 0x55ad624e51b0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce4ca26740 10 client.17421 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.737+0000 7fce4ca26740 1 -- 172.21.15.37:0/3358057800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad628d1cc0 con 0x55ad624e51b0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce1f7fe640 1 -- 172.21.15.37:0/3358057800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce38011d30 con 0x55ad624e51b0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce1f7fe640 1 -- 172.21.15.37:0/3358057800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fce3005a890 con 0x55ad624e51b0 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce4ca26740 10 client.17421 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce4ca26740 10 client.17421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:34.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce4ca26740 20 client.17421 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ad624cc9f0 0x55ad628d51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce4ca26740 4 client.17421 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce4ca26740 1 -- 172.21.15.37:0/3358057800 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad6282c5d0 con 0x55ad624cc9f0 2024-08-31T06:54:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.738+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ad624cc9f0 0x55ad628d51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.739+0000 7fce1f7fe640 10 client.17421 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.739+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ad624cc9f0 0x55ad628d51e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c408fba7c362ce7d server_cookie=fa4e70a07e5282c8 in_seq=0 out_seq=0 2024-08-31T06:54:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce1f7fe640 1 -- 172.21.15.37:0/3358057800 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad6282c5d0 con 0x55ad624cc9f0 2024-08-31T06:54:34.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce1f7fe640 10 client.17421 handle_command_reply: tid=0 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 client.17421 shutdown 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 -- 172.21.15.37:0/3358057800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624e51b0 msgr2=0x55ad628c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624e51b0 0x55ad628c2f20 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fce30009900 tx=0x7fce30009260 comp rx=0 tx=0).stop 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 -- 172.21.15.37:0/3358057800 shutdown_connections 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ad624cc9f0 0x55ad628d51e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce1f7fe640 0 client.17421 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad6250e070 0x55ad628cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 0x55ad628c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3358057800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624e51b0 0x55ad628c2f20 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 -- 172.21.15.37:0/3358057800 >> 172.21.15.37:0/3358057800 conn(0x55ad62502460 msgr2=0x55ad628af7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 -- 172.21.15.37:0/3358057800 shutdown_connections 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 1 -- 172.21.15.37:0/3358057800 wait complete. 2024-08-31T06:54:34.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.740+0000 7fce4ca26740 20 client.17421 trim_cache size 0 max 16384 2024-08-31T06:54:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.753+0000 7fce4ca26740 1 Processor -- start 2024-08-31T06:54:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.753+0000 7fce4ca26740 1 -- start start 2024-08-31T06:54:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624e51b0 0x55ad628c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 0x55ad628cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce4ca26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce401afaf0 con 0x55ad624cc9f0 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce4ca26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fce401ad3c0 con 0x55ad624e51b0 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce4ca26740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fce401ab230 con 0x55ad624ed390 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35766/0 (socket says 172.21.15.37:35766) 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 -- 172.21.15.37:0/3402611868 learned_addr learned my addr 172.21.15.37:0/3402611868 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 -- 172.21.15.37:0/3402611868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 msgr2=0x55ad628cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 --2- 172.21.15.37:0/3402611868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 0x55ad628cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 -- 172.21.15.37:0/3402611868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624e51b0 msgr2=0x55ad628c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 --2- 172.21.15.37:0/3402611868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624e51b0 0x55ad628c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 -- 172.21.15.37:0/3402611868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad628b6140 con 0x55ad624cc9f0 2024-08-31T06:54:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce3ffff640 1 --2- 172.21.15.37:0/3402611868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628b4d00 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fce30009230 tx=0x7fce30032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a49638727278579 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce25ffb640 1 -- 172.21.15.37:0/3402611868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3004c070 con 0x55ad624cc9f0 2024-08-31T06:54:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce25ffb640 1 -- 172.21.15.37:0/3402611868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce3005f020 con 0x55ad624cc9f0 2024-08-31T06:54:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.754+0000 7fce25ffb640 1 -- 172.21.15.37:0/3402611868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30003ae0 con 0x55ad624cc9f0 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 -- 172.21.15.37:0/3402611868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 msgr2=0x55ad628b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3402611868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628b4d00 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fce30009230 tx=0x7fce30032f30 comp rx=0 tx=0).stop 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 -- 172.21.15.37:0/3402611868 shutdown_connections 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3402611868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624ed390 0x55ad628cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3402611868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624e51b0 0x55ad628c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 --2- 172.21.15.37:0/3402611868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628b4d00 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 -- 172.21.15.37:0/3402611868 >> 172.21.15.37:0/3402611868 conn(0x55ad62502460 msgr2=0x55ad628c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 -- 172.21.15.37:0/3402611868 shutdown_connections 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.755+0000 7fce4ca26740 1 -- 172.21.15.37:0/3402611868 wait complete. 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 1 -- start start 2024-08-31T06:54:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 1 Processor -- start 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 0x55ad628ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad62937b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fce401ab880 con 0x55ad624cc9f0 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fce401accf0 con 0x55ad624ed390 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fce401abf50 con 0x55ad624e51b0 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce4ca26740 10 client.0 _ll_register_callbacks cb 0x7fce30009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35768/0 (socket says 172.21.15.37:35768) 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.756+0000 7fce3ffff640 1 -- 172.21.15.37:0/2676428974 learned_addr learned my addr 172.21.15.37:0/2676428974 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce44a4e640 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad62937b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 0x55ad628ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce3ffff640 1 -- 172.21.15.37:0/2676428974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 msgr2=0x55ad628ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce3ffff640 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 0x55ad628ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce3ffff640 1 -- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 msgr2=0x55ad62937b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce3ffff640 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad62937b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce3ffff640 1 -- 172.21.15.37:0/2676428974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad629381e0 con 0x55ad624cc9f0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce44a4e640 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad62937b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce3ffff640 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628c9b60 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fce3002a450 tx=0x7fce30003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b324737fefa6a7f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce1f7fe640 1 -- 172.21.15.37:0/2676428974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3004c040 con 0x55ad624cc9f0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce4ca26740 1 -- 172.21.15.37:0/2676428974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce3005f020 con 0x55ad624cc9f0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce1f7fe640 1 -- 172.21.15.37:0/2676428974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fce300035f0 con 0x55ad624cc9f0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce1f7fe640 1 -- 172.21.15.37:0/2676428974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fce30072050 con 0x55ad624cc9f0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce4ca26740 10 client.17427 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.757+0000 7fce4ca26740 1 -- 172.21.15.37:0/2676428974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad629406a0 con 0x55ad624cc9f0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce1f7fe640 1 -- 172.21.15.37:0/2676428974 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fce3005f020 con 0x55ad624cc9f0 2024-08-31T06:54:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce1f7fe640 1 -- 172.21.15.37:0/2676428974 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fce30048c20 con 0x55ad624cc9f0 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce4ca26740 10 client.17427 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce4ca26740 10 client.17427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce4ca26740 20 client.17427 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ad6250e070 0x55ad62942d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce4ca26740 4 client.17427 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce4ca26740 1 -- 172.21.15.37:0/2676428974 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad62828070 con 0x55ad6250e070 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.758+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ad6250e070 0x55ad62942d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce1f7fe640 10 client.17427 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce3f7fe640 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ad6250e070 0x55ad62942d10 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6124c58865b75d33 server_cookie=63f90757d4bf9495 in_seq=0 out_seq=0 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce1f7fe640 1 -- 172.21.15.37:0/2676428974 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad62828070 con 0x55ad6250e070 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce1f7fe640 10 client.17427 handle_command_reply: tid=0 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 client.17427 shutdown 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 -- 172.21.15.37:0/2676428974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 msgr2=0x55ad628c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628c9b60 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fce3002a450 tx=0x7fce30003ee0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 -- 172.21.15.37:0/2676428974 shutdown_connections 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55ad6250e070 0x55ad62942d10 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ad624ed390 0x55ad62937b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55ad624e51b0 0x55ad628ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 --2- 172.21.15.37:0/2676428974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ad624cc9f0 0x55ad628c9b60 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce1f7fe640 0 client.17427 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 -- 172.21.15.37:0/2676428974 >> 172.21.15.37:0/2676428974 conn(0x55ad62502460 msgr2=0x55ad628c4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 -- 172.21.15.37:0/2676428974 shutdown_connections 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 1 -- 172.21.15.37:0/2676428974 wait complete. 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.759+0000 7fce4ca26740 20 client.17427 trim_cache size 0 max 16384 2024-08-31T06:54:34.765 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 -- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fce280b4ca0 msgr2=0x7fce280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fce280b4ca0 0x7fce280b71b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fce30000c00 tx=0x7fce30009680 comp rx=0 tx=0).stop 2024-08-31T06:54:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 -- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40104f30 msgr2=0x7fce4019a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40104f30 0x7fce4019a740 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fce3400b450 tx=0x7fce3400b910 comp rx=0 tx=0).stop 2024-08-31T06:54:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 -- 172.21.15.37:0/4275397135 shutdown_connections 2024-08-31T06:54:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fce280b4ca0 0x7fce280b71b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce40104f30 0x7fce4019a740 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce40105880 0x7fce4019f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 --2- 172.21.15.37:0/4275397135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce40102f60 0x7fce4019a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 -- 172.21.15.37:0/4275397135 >> 172.21.15.37:0/4275397135 conn(0x7fce40077a00 msgr2=0x7fce40106e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 -- 172.21.15.37:0/4275397135 shutdown_connections 2024-08-31T06:54:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:34.760+0000 7fce464b1640 1 -- 172.21.15.37:0/4275397135 wait complete. 2024-08-31T06:54:36.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:35 smithi037 ceph-mon[18612]: pgmap v556: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:35 smithi066 ceph-mon[22244]: pgmap v556: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:36.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:35 smithi106 ceph-mon[22134]: pgmap v556: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:36.634 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:54:36.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:54:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 -- 172.21.15.37:0/4231097803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108a90 msgr2=0x7fbd7810f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/4231097803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108a90 0x7fbd7810f2c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009ca0 tx=0x7fbd7002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 -- 172.21.15.37:0/4231097803 shutdown_connections 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/4231097803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108a90 0x7fbd7810f2c0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/4231097803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd78108140 0x7fbd78108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/4231097803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd78102800 0x7fbd78102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 -- 172.21.15.37:0/4231097803 >> 172.21.15.37:0/4231097803 conn(0x7fbd780794d0 msgr2=0x7fbd780798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 -- 172.21.15.37:0/4231097803 shutdown_connections 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 -- 172.21.15.37:0/4231097803 wait complete. 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.338+0000 7fbd7e69c640 1 Processor -- start 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd7e69c640 1 -- start start 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd7e69c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd78102800 0x7fbd7819aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd7e69c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108140 0x7fbd7819b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd7e69c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd78108a90 0x7fbd7819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd7e69c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781125f0 con 0x7fbd78108140 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd7e69c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd78112470 con 0x7fbd78108a90 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd7e69c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd78112770 con 0x7fbd78102800 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108140 0x7fbd7819b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108140 0x7fbd7819b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35790/0 (socket says 172.21.15.37:35790) 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd6ffff640 1 -- 172.21.15.37:0/1275475688 learned_addr learned my addr 172.21.15.37:0/1275475688 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd7cc39640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd78108a90 0x7fbd7819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.339+0000 7fbd77fff640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd78102800 0x7fbd7819aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd6ffff640 1 -- 172.21.15.37:0/1275475688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd78102800 msgr2=0x7fbd7819aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd78102800 0x7fbd7819aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd6ffff640 1 -- 172.21.15.37:0/1275475688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd78108a90 msgr2=0x7fbd7819b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd78108a90 0x7fbd7819b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd6ffff640 1 -- 172.21.15.37:0/1275475688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd781a61f0 con 0x7fbd78108140 2024-08-31T06:54:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108140 0x7fbd7819b420 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000d770 tx=0x7fbd6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd75ffb640 1 -- 172.21.15.37:0/1275475688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd60017070 con 0x7fbd78108140 2024-08-31T06:54:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd7e69c640 1 -- 172.21.15.37:0/1275475688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd781a64e0 con 0x7fbd78108140 2024-08-31T06:54:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd75ffb640 1 -- 172.21.15.37:0/1275475688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd60009c30 con 0x7fbd78108140 2024-08-31T06:54:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd75ffb640 1 -- 172.21.15.37:0/1275475688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd6000f3c0 con 0x7fbd78108140 2024-08-31T06:54:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.340+0000 7fbd7e69c640 1 -- 172.21.15.37:0/1275475688 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd781a6a70 con 0x7fbd78108140 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd84c11740 1 Processor -- start 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd84c11740 1 -- start start 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d22780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d22cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d23200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd84c11740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e69c985f0 con 0x557e69953490 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd84c11740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557e69c87b80 con 0x557e6997c350 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd84c11740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557e69c8bb30 con 0x557e6995b670 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.343+0000 7fbd75ffb640 1 -- 172.21.15.37:0/1275475688 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fbd6001a070 con 0x7fbd78108140 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d22cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d22cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35796/0 (socket says 172.21.15.37:35796) 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 -- 172.21.15.37:0/335882984 learned_addr learned my addr 172.21.15.37:0/335882984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd7cc39640 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d22780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d23200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 -- 172.21.15.37:0/335882984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 msgr2=0x557e69d23200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d23200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 -- 172.21.15.37:0/335882984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 msgr2=0x557e69d22780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d22780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 -- 172.21.15.37:0/335882984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e699e7930 con 0x557e69953490 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d23200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.344+0000 7fbd77fff640 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d22cc0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800bc60 tx=0x7fbd6800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7592af020cb7fa server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.345+0000 7fbd6e7fc640 1 -- 172.21.15.37:0/335882984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68015070 con 0x557e69953490 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.345+0000 7fbd75ffb640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd640b4ca0 0x7fbd640b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.345+0000 7fbd6e7fc640 1 -- 172.21.15.37:0/335882984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd6801a8f0 con 0x557e69953490 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.345+0000 7fbd6e7fc640 1 -- 172.21.15.37:0/335882984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68011730 con 0x557e69953490 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.345+0000 7fbd7cc39640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd640b4ca0 0x7fbd640b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.345+0000 7fbd75ffb640 1 -- 172.21.15.37:0/1275475688 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbd600e5000 con 0x7fbd78108140 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 -- 172.21.15.37:0/335882984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 msgr2=0x557e69d22cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd7cc39640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd640b4ca0 0x7fbd640b71b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbd70004af0 tx=0x7fbd70009860 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d22cc0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800bc60 tx=0x7fbd6800f730 comp rx=0 tx=0).stop 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 -- 172.21.15.37:0/335882984 shutdown_connections 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d22cc0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d23200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 --2- 172.21.15.37:0/335882984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d22780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 -- 172.21.15.37:0/335882984 >> 172.21.15.37:0/335882984 conn(0x557e69970740 msgr2=0x557e69d20670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 -- 172.21.15.37:0/335882984 shutdown_connections 2024-08-31T06:54:37.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 -- 172.21.15.37:0/335882984 wait complete. 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 -- start start 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.346+0000 7fbd84c11740 1 Processor -- start 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d2df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d2e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d3a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd84c11740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e69aea890 con 0x557e69953490 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd84c11740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557e69c0e790 con 0x557e6997c350 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd84c11740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557e69d30f60 con 0x557e6995b670 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd84c11740 10 client.0 _ll_register_callbacks cb 0x557e69993ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d2df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d2df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35802/0 (socket says 172.21.15.37:35802) 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd77fff640 1 -- 172.21.15.37:0/607377987 learned_addr learned my addr 172.21.15.37:0/607377987 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d2e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd7cc39640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d3a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd77fff640 1 -- 172.21.15.37:0/607377987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 msgr2=0x557e69d2e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd77fff640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d2e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd77fff640 1 -- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 msgr2=0x557e69d3a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd77fff640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d3a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd77fff640 1 -- 172.21.15.37:0/607377987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e69c45f30 con 0x557e69953490 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd7cc39640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d3a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.347+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d2e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.348+0000 7fbd77fff640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d2df20 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fbd680058c0 tx=0x7fbd6801a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b54467a866d6c98 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.348+0000 7fbd577fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.348+0000 7fbd577fe640 1 -- 172.21.15.37:0/607377987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68028060 con 0x557e69953490 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.348+0000 7fbd577fe640 1 -- 172.21.15.37:0/607377987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbd6801acb0 con 0x557e69953490 2024-08-31T06:54:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.348+0000 7fbd84c11740 1 -- 172.21.15.37:0/607377987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd6801a8f0 con 0x557e69953490 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.348+0000 7fbd577fe640 1 -- 172.21.15.37:0/607377987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd68015070 con 0x557e69953490 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.348+0000 7fbd84c11740 10 client.17439 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.348+0000 7fbd84c11740 1 -- 172.21.15.37:0/607377987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557e69d3ccd0 con 0x557e69953490 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd577fe640 1 -- 172.21.15.37:0/607377987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd6801a8f0 con 0x557e69953490 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd577fe640 1 -- 172.21.15.37:0/607377987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd68004810 con 0x557e69953490 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd84c11740 10 client.17439 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd84c11740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd84c11740 20 client.17439 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd84c11740 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e6993acd0 0x557e69d40030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd84c11740 4 client.17439 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd84c11740 1 -- 172.21.15.37:0/607377987 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e69c9a540 con 0x557e6993acd0 2024-08-31T06:54:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.349+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e6993acd0 0x557e69d40030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.350+0000 7fbd577fe640 10 client.17439 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.350+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e6993acd0 0x557e69d40030 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61e0dc2e5bacdbf0 server_cookie=9be7edd1bfbfa02b in_seq=0 out_seq=0 2024-08-31T06:54:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd577fe640 1 -- 172.21.15.37:0/607377987 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e69c9a540 con 0x557e6993acd0 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd577fe640 10 client.17439 handle_command_reply: tid=0 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 client.17439 shutdown 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 -- 172.21.15.37:0/607377987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 msgr2=0x557e69d2df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d2df20 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fbd680058c0 tx=0x7fbd6801a690 comp rx=0 tx=0).stop 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 -- 172.21.15.37:0/607377987 shutdown_connections 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e6993acd0 0x557e69d40030 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d3a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d2e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 --2- 172.21.15.37:0/607377987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d2df20 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 -- 172.21.15.37:0/607377987 >> 172.21.15.37:0/607377987 conn(0x557e69970740 msgr2=0x557e69d25910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd577fe640 0 client.17439 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 -- 172.21.15.37:0/607377987 shutdown_connections 2024-08-31T06:54:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 1 -- 172.21.15.37:0/607377987 wait complete. 2024-08-31T06:54:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.351+0000 7fbd84c11740 20 client.17439 trim_cache size 0 max 16384 2024-08-31T06:54:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.369+0000 7fbd84c11740 1 Processor -- start 2024-08-31T06:54:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.369+0000 7fbd84c11740 1 -- start start 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.369+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d24170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.369+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d3a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.369+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d27fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd84c11740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781b1dc0 con 0x557e69953490 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd84c11740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781af690 con 0x557e6997c350 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd84c11740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781ad500 con 0x557e6995b670 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d24170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d24170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35810/0 (socket says 172.21.15.37:35810) 2024-08-31T06:54:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 -- 172.21.15.37:0/3781413349 learned_addr learned my addr 172.21.15.37:0/3781413349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d3a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd7cc39640 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d27fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 -- 172.21.15.37:0/3781413349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 msgr2=0x557e69d3a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d3a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 -- 172.21.15.37:0/3781413349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 msgr2=0x557e69d27fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d27fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 -- 172.21.15.37:0/3781413349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e69d2efc0 con 0x557e69953490 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d3a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd7cc39640 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d27fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.370+0000 7fbd77fff640 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d24170 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbd68004c10 tx=0x7fbd6800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb9b428a8e0d916 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.371+0000 7fbd6dffb640 1 -- 172.21.15.37:0/3781413349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68028070 con 0x557e69953490 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.371+0000 7fbd6dffb640 1 -- 172.21.15.37:0/3781413349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd6800be90 con 0x557e69953490 2024-08-31T06:54:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.371+0000 7fbd6dffb640 1 -- 172.21.15.37:0/3781413349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68032080 con 0x557e69953490 2024-08-31T06:54:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 -- 172.21.15.37:0/3781413349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 msgr2=0x557e69d24170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d24170 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fbd68004c10 tx=0x7fbd6800b9e0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 -- 172.21.15.37:0/3781413349 shutdown_connections 2024-08-31T06:54:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6997c350 0x557e69d27fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6995b670 0x557e69d3a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 --2- 172.21.15.37:0/3781413349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d24170 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 -- 172.21.15.37:0/3781413349 >> 172.21.15.37:0/3781413349 conn(0x557e69970740 msgr2=0x557e69d27890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 -- 172.21.15.37:0/3781413349 shutdown_connections 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 -- 172.21.15.37:0/3781413349 wait complete. 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.372+0000 7fbd84c11740 1 -- start start 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd84c11740 1 Processor -- start 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d41910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6995b670 0x557e69d41ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd84c11740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6997c350 0x557e69da3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd84c11740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781adb50 con 0x557e69953490 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd84c11740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781aefc0 con 0x557e6995b670 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd84c11740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbd781ae220 con 0x557e6997c350 2024-08-31T06:54:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd84c11740 10 client.0 _ll_register_callbacks cb 0x7fbd70009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d41910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d41910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35812/0 (socket says 172.21.15.37:35812) 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd77fff640 1 -- 172.21.15.37:0/143928781 learned_addr learned my addr 172.21.15.37:0/143928781 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.373+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6995b670 0x557e69d41ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd77fff640 1 -- 172.21.15.37:0/143928781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6997c350 msgr2=0x557e69da3780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd77fff640 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6997c350 0x557e69da3780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd77fff640 1 -- 172.21.15.37:0/143928781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6995b670 msgr2=0x557e69d41ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd77fff640 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6995b670 0x557e69d41ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd77fff640 1 -- 172.21.15.37:0/143928781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e69da3df0 con 0x557e69953490 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd77fff640 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d41910 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbd6801acf0 tx=0x7fbd68004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4635ad0fc6dee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd577fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd577fe640 1 -- 172.21.15.37:0/143928781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd68032070 con 0x557e69953490 2024-08-31T06:54:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd577fe640 1 -- 172.21.15.37:0/143928781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fbd68004020 con 0x557e69953490 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd84c11740 1 -- 172.21.15.37:0/143928781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd6800be90 con 0x557e69953490 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd577fe640 1 -- 172.21.15.37:0/143928781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd68028040 con 0x557e69953490 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd84c11740 10 client.17445 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.374+0000 7fbd84c11740 1 -- 172.21.15.37:0/143928781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557e69dab130 con 0x557e69953490 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd577fe640 1 -- 172.21.15.37:0/143928781 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbd6800be90 con 0x557e69953490 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd577fe640 1 -- 172.21.15.37:0/143928781 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd6803d030 con 0x557e69953490 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd84c11740 10 client.17445 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd84c11740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd84c11740 20 client.17445 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd84c11740 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e69910080 0x557e69dad830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd84c11740 4 client.17445 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd84c11740 1 -- 172.21.15.37:0/143928781 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557e69c95fe0 con 0x557e69910080 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.375+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e69910080 0x557e69dad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.376+0000 7fbd577fe640 10 client.17445 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:37.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.376+0000 7fbd6ffff640 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e69910080 0x557e69dad830 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ace47dc4e6905a server_cookie=44d03675f00f6d4b in_seq=0 out_seq=0 2024-08-31T06:54:37.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.377+0000 7fbd577fe640 1 -- 172.21.15.37:0/143928781 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557e69c95fe0 con 0x557e69910080 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.377+0000 7fbd577fe640 10 client.17445 handle_command_reply: tid=0 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.377+0000 7fbd84c11740 1 client.17445 shutdown 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 -- 172.21.15.37:0/143928781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 msgr2=0x557e69d41910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d41910 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbd6801acf0 tx=0x7fbd68004b40 comp rx=0 tx=0).stop 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 -- 172.21.15.37:0/143928781 shutdown_connections 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557e69910080 0x557e69dad830 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557e6997c350 0x557e69da3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557e6995b670 0x557e69d41ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 --2- 172.21.15.37:0/143928781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e69953490 0x557e69d41910 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 -- 172.21.15.37:0/143928781 >> 172.21.15.37:0/143928781 conn(0x557e69970740 msgr2=0x557e69d23f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd577fe640 0 client.17445 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 -- 172.21.15.37:0/143928781 shutdown_connections 2024-08-31T06:54:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 1 -- 172.21.15.37:0/143928781 wait complete. 2024-08-31T06:54:37.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.378+0000 7fbd84c11740 20 client.17445 trim_cache size 0 max 16384 2024-08-31T06:54:37.382 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:54:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "5fd7f13e-fd58-49db-8497-2a7be28cf588", 2024-08-31T06:54:37.382 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:54:37.382 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 -- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd640b4ca0 msgr2=0x7fbd640b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd640b4ca0 0x7fbd640b71b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fbd70004af0 tx=0x7fbd70009860 comp rx=0 tx=0).stop 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 -- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108140 msgr2=0x7fbd7819b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108140 0x7fbd7819b420 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000d770 tx=0x7fbd6000dc30 comp rx=0 tx=0).stop 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 -- 172.21.15.37:0/1275475688 shutdown_connections 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbd640b4ca0 0x7fbd640b71b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd78108140 0x7fbd7819b420 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd78108a90 0x7fbd7819b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 --2- 172.21.15.37:0/1275475688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd78102800 0x7fbd7819aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 -- 172.21.15.37:0/1275475688 >> 172.21.15.37:0/1275475688 conn(0x7fbd780794d0 msgr2=0x7fbd78105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:37.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 -- 172.21.15.37:0/1275475688 shutdown_connections 2024-08-31T06:54:37.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:37.379+0000 7fbd7e69c640 1 -- 172.21.15.37:0/1275475688 wait complete. 2024-08-31T06:54:38.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:37 smithi037 ceph-mon[18612]: pgmap v557: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:54:38.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:37 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:54:38.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:37 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:38.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:37 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:54:38.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:37 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:38.011 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:37 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:54:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:37 smithi066 ceph-mon[22244]: pgmap v557: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:54:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:37 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:54:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:37 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:37 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:54:38.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:37 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:38.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:37 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:54:38.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:54:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:37 smithi106 ceph-mon[22134]: pgmap v557: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:54:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:37 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:54:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:37 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:37 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:54:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:37 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:37 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:54:38.464 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 -- 172.21.15.37:0/1173553310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 msgr2=0x7fcd141103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 --2- 172.21.15.37:0/1173553310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 0x7fcd141103e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009900 tx=0x7fcd0c02a410 comp rx=0 tx=0).stop 2024-08-31T06:54:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 -- 172.21.15.37:0/1173553310 shutdown_connections 2024-08-31T06:54:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 --2- 172.21.15.37:0/1173553310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 0x7fcd141103e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 --2- 172.21.15.37:0/1173553310 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd14109260 0x7fcd14109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 --2- 172.21.15.37:0/1173553310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd14103920 0x7fcd14103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 -- 172.21.15.37:0/1173553310 >> 172.21.15.37:0/1173553310 conn(0x7fcd140ff370 msgr2=0x7fcd141017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 -- 172.21.15.37:0/1173553310 shutdown_connections 2024-08-31T06:54:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.987+0000 7fcd18812640 1 -- 172.21.15.37:0/1173553310 wait complete. 2024-08-31T06:54:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd18812640 1 Processor -- start 2024-08-31T06:54:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd18812640 1 -- start start 2024-08-31T06:54:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd18812640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd14103920 0x7fcd140754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd18812640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd14109260 0x7fcd140759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd18812640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 0x7fcd14075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd18812640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14113720 con 0x7fcd14109bb0 2024-08-31T06:54:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd18812640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141135a0 con 0x7fcd14103920 2024-08-31T06:54:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd18812640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141138a0 con 0x7fcd14109260 2024-08-31T06:54:39.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 0x7fcd14075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 0x7fcd14075f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35822/0 (socket says 172.21.15.37:35822) 2024-08-31T06:54:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd12d9d640 1 -- 172.21.15.37:0/820265271 learned_addr learned my addr 172.21.15.37:0/820265271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd1259c640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd14103920 0x7fcd140754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd14109260 0x7fcd140759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.988+0000 7fcd12d9d640 1 -- 172.21.15.37:0/820265271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd14109260 msgr2=0x7fcd140759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd14109260 0x7fcd140759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd12d9d640 1 -- 172.21.15.37:0/820265271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd14103920 msgr2=0x7fcd140754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd14103920 0x7fcd140754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd12d9d640 1 -- 172.21.15.37:0/820265271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd141a83b0 con 0x7fcd14109bb0 2024-08-31T06:54:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd14109260 0x7fcd140759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 0x7fcd14075f30 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c005ab0 tx=0x7fcd0c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd037fe640 1 -- 172.21.15.37:0/820265271 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c03f030 con 0x7fcd14109bb0 2024-08-31T06:54:39.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd037fe640 1 -- 172.21.15.37:0/820265271 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd0c003a80 con 0x7fcd14109bb0 2024-08-31T06:54:39.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd18812640 1 -- 172.21.15.37:0/820265271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd141a8640 con 0x7fcd14109bb0 2024-08-31T06:54:39.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd037fe640 1 -- 172.21.15.37:0/820265271 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c035070 con 0x7fcd14109bb0 2024-08-31T06:54:39.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.989+0000 7fcd18812640 1 -- 172.21.15.37:0/820265271 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd141a8b20 con 0x7fcd14109bb0 2024-08-31T06:54:39.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.992+0000 7fcd1ed87740 1 Processor -- start 2024-08-31T06:54:39.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.992+0000 7fcd037fe640 1 -- 172.21.15.37:0/820265271 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fcd0c042030 con 0x7fcd14109bb0 2024-08-31T06:54:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.992+0000 7fcd1ed87740 1 -- start start 2024-08-31T06:54:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634c2070 0x557663867300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663867840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634a1390 0x557663867d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5576637de630 con 0x5576634991b0 2024-08-31T06:54:39.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5576637cdbc0 con 0x5576634a1390 2024-08-31T06:54:39.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5576637d1b70 con 0x5576634c2070 2024-08-31T06:54:39.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663867840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663867840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35836/0 (socket says 172.21.15.37:35836) 2024-08-31T06:54:39.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 -- 172.21.15.37:0/879342716 learned_addr learned my addr 172.21.15.37:0/879342716 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:39.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634c2070 0x557663867300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 -- 172.21.15.37:0/879342716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634c2070 msgr2=0x557663867300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:39.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634a1390 0x557663867d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634c2070 0x557663867300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 -- 172.21.15.37:0/879342716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634a1390 msgr2=0x557663867d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:39.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634a1390 0x557663867d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 -- 172.21.15.37:0/879342716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55766352d650 con 0x5576634991b0 2024-08-31T06:54:39.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd037fe640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccfc0b4ca0 0x7fccfc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccfc0b4ca0 0x7fccfc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd1259c640 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663867840 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009fd0 tx=0x7fcd04003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b570becd245d255 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:39.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd037fe640 1 -- 172.21.15.37:0/820265271 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fcd0c105ac0 con 0x7fcd14109bb0 2024-08-31T06:54:39.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.993+0000 7fcd00ff9640 1 -- 172.21.15.37:0/879342716 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04012450 con 0x5576634991b0 2024-08-31T06:54:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd00ff9640 1 -- 172.21.15.37:0/879342716 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd04012a80 con 0x5576634991b0 2024-08-31T06:54:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd00ff9640 1 -- 172.21.15.37:0/879342716 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0401aa00 con 0x5576634991b0 2024-08-31T06:54:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd1ed87740 1 -- 172.21.15.37:0/879342716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 msgr2=0x557663867840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccfc0b4ca0 0x7fccfc0b71b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcd080058c0 tx=0x7fcd08005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663867840 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009fd0 tx=0x7fcd04003e80 comp rx=0 tx=0).stop 2024-08-31T06:54:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd1ed87740 1 -- 172.21.15.37:0/879342716 shutdown_connections 2024-08-31T06:54:39.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663867840 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634a1390 0x557663867d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/879342716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634c2070 0x557663867300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.994+0000 7fcd1ed87740 1 -- 172.21.15.37:0/879342716 >> 172.21.15.37:0/879342716 conn(0x5576634b6460 msgr2=0x5576638651f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:39.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 -- 172.21.15.37:0/879342716 shutdown_connections 2024-08-31T06:54:39.180 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:39.180 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:54:39.180 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:54:39.181 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:54:39.181 INFO:teuthology.orchestra.run.smithi037.stdout: "5235cd7a-0026-439c-bb69-023a1bfcedc7": { 2024-08-31T06:54:39.181 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:26.646033+0000", 2024-08-31T06:54:39.181 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.181 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.181 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.182 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.182 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.182 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:54:39.182 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:54:39.182 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.183 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.183 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.183 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.183 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.183 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:54:39.184 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:54:39.184 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.184 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.184 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.184 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.184 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.185 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:54:39.185 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:54:39.185 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.185 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.185 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.186 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.186 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.186 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:54:39.186 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:54:39.187 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.187 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.187 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.187 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.187 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.188 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:54:39.188 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:54:39.188 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.188 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.188 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.188 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.189 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.189 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:54:39.189 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:54:39.189 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.189 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.190 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.190 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.190 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.190 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:54:39.191 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:54:39.191 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.191 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.191 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.191 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.191 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.192 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:54:39.192 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:54:39.192 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.192 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.192 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.193 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.193 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.193 INFO:teuthology.orchestra.run.smithi037.stdout: "5fd7f13e-fd58-49db-8497-2a7be28cf588": { 2024-08-31T06:54:39.193 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:37.375943+0000", 2024-08-31T06:54:39.193 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.194 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.194 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.194 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.194 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.195 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:54:39.195 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:54:39.195 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.195 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.195 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.195 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.196 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.196 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:54:39.196 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:54:39.196 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.197 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.197 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.197 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.197 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.197 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:54:39.198 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:54:39.198 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.198 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.198 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.198 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.199 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.199 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:54:39.199 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:54:39.199 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.199 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.200 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.200 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.200 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:39.200 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:54:39.201 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:54:39.201 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:39.201 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:39.201 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:39.201 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:39.201 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:39.201 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:39.202 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:39.202 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:39.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 -- 172.21.15.37:0/879342716 wait complete. 2024-08-31T06:54:39.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 -- start start 2024-08-31T06:54:39.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 Processor -- start 2024-08-31T06:54:39.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 0x557663872a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663872fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766387edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557663630700 con 0x5576634a1390 2024-08-31T06:54:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x557663754700 con 0x5576634c2070 2024-08-31T06:54:39.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x557663875ae0 con 0x5576634991b0 2024-08-31T06:54:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.995+0000 7fcd1ed87740 10 client.0 _ll_register_callbacks cb 0x557663783dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663872fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663872fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35852/0 (socket says 172.21.15.37:35852) 2024-08-31T06:54:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 -- 172.21.15.37:0/1604016867 learned_addr learned my addr 172.21.15.37:0/1604016867 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd1259c640 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 0x557663872a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766387edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 -- 172.21.15.37:0/1604016867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 msgr2=0x557663872a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 0x557663872a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 -- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 msgr2=0x55766387edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766387edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 -- 172.21.15.37:0/1604016867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55766378d8b0 con 0x5576634a1390 2024-08-31T06:54:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766387edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663872fb0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fcd08011c00 tx=0x7fcd0800c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e9f149a019bc85 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fccf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fccf9ffb640 1 -- 172.21.15.37:0/1604016867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0800fe10 con 0x5576634a1390 2024-08-31T06:54:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd1ed87740 1 -- 172.21.15.37:0/1604016867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd04012a80 con 0x5576634a1390 2024-08-31T06:54:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fccf9ffb640 1 -- 172.21.15.37:0/1604016867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fcd08027400 con 0x5576634a1390 2024-08-31T06:54:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fccf9ffb640 1 -- 172.21.15.37:0/1604016867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcd08027600 con 0x5576634a1390 2024-08-31T06:54:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd1ed87740 10 client.17457 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.996+0000 7fcd1ed87740 1 -- 172.21.15.37:0/1604016867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557663881960 con 0x5576634a1390 2024-08-31T06:54:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fccf9ffb640 1 -- 172.21.15.37:0/1604016867 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd04012a80 con 0x5576634a1390 2024-08-31T06:54:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fccf9ffb640 1 -- 172.21.15.37:0/1604016867 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcd0802f4a0 con 0x5576634a1390 2024-08-31T06:54:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fcd1ed87740 10 client.17457 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fcd1ed87740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:39.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fcd1ed87740 20 client.17457 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:39.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576634809f0 0x557663884e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fcd1ed87740 4 client.17457 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:39.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fcd1ed87740 1 -- 172.21.15.37:0/1604016867 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576637e0580 con 0x5576634809f0 2024-08-31T06:54:39.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.997+0000 7fcd1259c640 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576634809f0 0x557663884e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.998+0000 7fcd1259c640 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576634809f0 0x557663884e60 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=624e34586f65d684 server_cookie=1cddb32bcac5adfb in_seq=0 out_seq=0 2024-08-31T06:54:39.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.998+0000 7fccf9ffb640 10 client.17457 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.998+0000 7fccf9ffb640 1 -- 172.21.15.37:0/1604016867 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576637e0580 con 0x5576634809f0 2024-08-31T06:54:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.998+0000 7fccf9ffb640 10 client.17457 handle_command_reply: tid=0 2024-08-31T06:54:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.998+0000 7fcd1ed87740 1 client.17457 shutdown 2024-08-31T06:54:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 -- 172.21.15.37:0/1604016867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 msgr2=0x557663872fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663872fb0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fcd08011c00 tx=0x7fcd0800c510 comp rx=0 tx=0).stop 2024-08-31T06:54:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 -- 172.21.15.37:0/1604016867 shutdown_connections 2024-08-31T06:54:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5576634809f0 0x557663884e60 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663872fb0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766387edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/1604016867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 0x557663872a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fccf9ffb640 0 client.17457 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:39.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 -- 172.21.15.37:0/1604016867 >> 172.21.15.37:0/1604016867 conn(0x5576634b6460 msgr2=0x55766386a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 -- 172.21.15.37:0/1604016867 shutdown_connections 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 1 -- 172.21.15.37:0/1604016867 wait complete. 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:38.999+0000 7fcd1ed87740 20 client.17457 trim_cache size 0 max 16384 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1ed87740 1 Processor -- start 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1ed87740 1 -- start start 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663868a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634a1390 0x55766387ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766386fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141b3e60 con 0x5576634991b0 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141b1730 con 0x5576634c2070 2024-08-31T06:54:39.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141af5a0 con 0x5576634a1390 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663868a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663868a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35864/0 (socket says 172.21.15.37:35864) 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.016+0000 7fcd1259c640 1 -- 172.21.15.37:0/3903644562 learned_addr learned my addr 172.21.15.37:0/3903644562 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634a1390 0x55766387ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766386fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd1259c640 1 -- 172.21.15.37:0/3903644562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634a1390 msgr2=0x55766387ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd1259c640 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634a1390 0x55766387ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd1259c640 1 -- 172.21.15.37:0/3903644562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 msgr2=0x55766386fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd1259c640 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766386fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd1259c640 1 -- 172.21.15.37:0/3903644562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557663865730 con 0x5576634991b0 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766386fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fcd1259c640 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663868a40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009fa0 tx=0x7fcd04005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b3d55f842ee349 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fccfbfff640 1 -- 172.21.15.37:0/3903644562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04004c50 con 0x5576634991b0 2024-08-31T06:54:39.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fccfbfff640 1 -- 172.21.15.37:0/3903644562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd04004df0 con 0x5576634991b0 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.017+0000 7fccfbfff640 1 -- 172.21.15.37:0/3903644562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd040054a0 con 0x5576634991b0 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 -- 172.21.15.37:0/3903644562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 msgr2=0x557663868a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663868a40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fcd04009fa0 tx=0x7fcd04005bd0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 -- 172.21.15.37:0/3903644562 shutdown_connections 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x55766386fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634a1390 0x55766387ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/3903644562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634991b0 0x557663868a40 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 -- 172.21.15.37:0/3903644562 >> 172.21.15.37:0/3903644562 conn(0x5576634b6460 msgr2=0x557663868330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 -- 172.21.15.37:0/3903644562 shutdown_connections 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 -- 172.21.15.37:0/3903644562 wait complete. 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.018+0000 7fcd1ed87740 1 -- start start 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1ed87740 1 Processor -- start 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 0x5576638770c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663877600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1ed87740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x5576638ee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141afbf0 con 0x5576634a1390 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141b1060 con 0x5576634c2070 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1ed87740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141b02c0 con 0x5576634991b0 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1ed87740 10 client.0 _ll_register_callbacks cb 0x7fcd0800cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663877600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663877600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35870/0 (socket says 172.21.15.37:35870) 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 -- 172.21.15.37:0/2061706257 learned_addr learned my addr 172.21.15.37:0/2061706257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd1259c640 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 0x5576638770c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 -- 172.21.15.37:0/2061706257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 msgr2=0x5576638770c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 0x5576638770c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 -- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 msgr2=0x5576638ee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x5576638ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x5576638ee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 -- 172.21.15.37:0/2061706257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557663869b90 con 0x5576634a1390 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd12d9d640 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x5576638ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fcd11d9b640 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663877600 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fcd0802f890 tx=0x7fcd0802f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be02c33656cd849 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.019+0000 7fccf9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fccf9ffb640 1 -- 172.21.15.37:0/2061706257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08034070 con 0x5576634a1390 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fccf9ffb640 1 -- 172.21.15.37:0/2061706257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fcd0802fd10 con 0x5576634a1390 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 1 -- 172.21.15.37:0/2061706257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd04004df0 con 0x5576634a1390 2024-08-31T06:54:39.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fccf9ffb640 1 -- 172.21.15.37:0/2061706257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcd08048050 con 0x5576634a1390 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 10 client.17463 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 1 -- 172.21.15.37:0/2061706257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5576638efc40 con 0x5576634a1390 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fccf9ffb640 1 -- 172.21.15.37:0/2061706257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd04004df0 con 0x5576634a1390 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fccf9ffb640 1 -- 172.21.15.37:0/2061706257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcd080279a0 con 0x5576634a1390 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 10 client.17463 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 20 client.17463 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557663455da0 0x5576638f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 4 client.17463 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:54:39.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.020+0000 7fcd1ed87740 1 -- 172.21.15.37:0/2061706257 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5576637dc020 con 0x557663455da0 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.021+0000 7fcd1259c640 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557663455da0 0x5576638f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.021+0000 7fcd1259c640 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557663455da0 0x5576638f23c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9203bce59ec06c28 server_cookie=d08f49831c0caf49 in_seq=0 out_seq=0 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.021+0000 7fccf9ffb640 10 client.17463 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.021+0000 7fccf9ffb640 1 -- 172.21.15.37:0/2061706257 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x5576637dc020 con 0x557663455da0 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.021+0000 7fccf9ffb640 10 client.17463 handle_command_reply: tid=0 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.021+0000 7fcd1ed87740 1 client.17463 shutdown 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 -- 172.21.15.37:0/2061706257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 msgr2=0x557663877600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663877600 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fcd0802f890 tx=0x7fcd0802f650 comp rx=0 tx=0).stop 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 -- 172.21.15.37:0/2061706257 shutdown_connections 2024-08-31T06:54:39.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x557663455da0 0x5576638f23c0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5576634a1390 0x557663877600 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5576634c2070 0x5576638ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 --2- 172.21.15.37:0/2061706257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5576634991b0 0x5576638770c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 -- 172.21.15.37:0/2061706257 >> 172.21.15.37:0/2061706257 conn(0x5576634b6460 msgr2=0x5576638712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fccf9ffb640 0 client.17463 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 -- 172.21.15.37:0/2061706257 shutdown_connections 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 1 -- 172.21.15.37:0/2061706257 wait complete. 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd1ed87740 20 client.17463 trim_cache size 0 max 16384 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 -- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccfc0b4ca0 msgr2=0x7fccfc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccfc0b4ca0 0x7fccfc0b71b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fcd080058c0 tx=0x7fcd08005850 comp rx=0 tx=0).stop 2024-08-31T06:54:39.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 -- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 msgr2=0x7fcd14075f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 0x7fcd14075f30 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c005ab0 tx=0x7fcd0c0040e0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 -- 172.21.15.37:0/820265271 shutdown_connections 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fccfc0b4ca0 0x7fccfc0b71b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd14109bb0 0x7fcd14075f30 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd14109260 0x7fcd140759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 --2- 172.21.15.37:0/820265271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd14103920 0x7fcd140754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 -- 172.21.15.37:0/820265271 >> 172.21.15.37:0/820265271 conn(0x7fcd140ff370 msgr2=0x7fcd14101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 -- 172.21.15.37:0/820265271 shutdown_connections 2024-08-31T06:54:39.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:39.022+0000 7fcd18812640 1 -- 172.21.15.37:0/820265271 wait complete. 2024-08-31T06:54:39.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:39 smithi037 ceph-mon[18612]: pgmap v558: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:54:40.042 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:54:40.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:54:40.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:39 smithi066 ceph-mon[22244]: pgmap v558: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:54:40.302 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:40.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:39 smithi106 ceph-mon[22134]: pgmap v558: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/1097684139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108160 msgr2=0x7f6e14108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/1097684139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108160 0x7f6e14108570 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009900 tx=0x7f6e0802a410 comp rx=0 tx=0).stop 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/1097684139 shutdown_connections 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/1097684139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108160 0x7f6e14108570 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/1097684139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e14108ab0 0x7f6e1410f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/1097684139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e14102820 0x7f6e14102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/1097684139 >> 172.21.15.37:0/1097684139 conn(0x7f6e140794e0 msgr2=0x7f6e140798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/1097684139 shutdown_connections 2024-08-31T06:54:40.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.744+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/1097684139 wait complete. 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e1ac7b640 1 Processor -- start 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e1ac7b640 1 -- start start 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e1ac7b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e14102820 0x7f6e140ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e1ac7b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e14108160 0x7f6e140ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e1ac7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108ab0 0x7f6e140ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e1ac7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14112590 con 0x7f6e14108ab0 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e1ac7b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14112410 con 0x7f6e14108160 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e1ac7b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6e14112710 con 0x7f6e14102820 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e19218640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108ab0 0x7f6e140ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e19218640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108ab0 0x7f6e140ffeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35884/0 (socket says 172.21.15.37:35884) 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e19218640 1 -- 172.21.15.37:0/441982406 learned_addr learned my addr 172.21.15.37:0/441982406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e13fff640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e14108160 0x7f6e140ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:40.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e18a17640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e14102820 0x7f6e140ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e19218640 1 -- 172.21.15.37:0/441982406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e14102820 msgr2=0x7f6e140ff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e19218640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e14102820 0x7f6e140ff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e19218640 1 -- 172.21.15.37:0/441982406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e14108160 msgr2=0x7f6e140ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.745+0000 7f6e19218640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e14108160 0x7f6e140ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.746+0000 7f6e19218640 1 -- 172.21.15.37:0/441982406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e141a83a0 con 0x7f6e14108ab0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.746+0000 7f6e19218640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108ab0 0x7f6e140ffeb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00cce0 tx=0x7f6e0c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.746+0000 7f6e11ffb640 1 -- 172.21.15.37:0/441982406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00f450 con 0x7f6e14108ab0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.746+0000 7f6e11ffb640 1 -- 172.21.15.37:0/441982406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e0c00fa80 con 0x7f6e14108ab0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.746+0000 7f6e11ffb640 1 -- 172.21.15.37:0/441982406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c018ad0 con 0x7f6e14108ab0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.746+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e141a8690 con 0x7f6e14108ab0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.746+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e141a8ba0 con 0x7f6e14108ab0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.747+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e14103aa0 con 0x7f6e14108ab0 2024-08-31T06:54:40.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.748+0000 7f6e11ffb640 1 -- 172.21.15.37:0/441982406 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f6e0c00f5f0 con 0x7f6e14108ab0 2024-08-31T06:54:40.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.749+0000 7f6e11ffb640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6dfc0b4d20 0x7f6dfc0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:40.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.749+0000 7f6e18a17640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6dfc0b4d20 0x7f6dfc0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:40.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.749+0000 7f6e11ffb640 1 -- 172.21.15.37:0/441982406 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f6e0c0e5cf0 con 0x7f6e14108ab0 2024-08-31T06:54:40.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.750+0000 7f6e18a17640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6dfc0b4d20 0x7f6dfc0b7230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6e04005fd0 tx=0x7f6e04005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:40.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.754+0000 7f6e11ffb640 1 -- 172.21.15.37:0/441982406 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6e0c014030 con 0x7f6e14108ab0 2024-08-31T06:54:40.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.977+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e14100730 con 0x7f6e14108ab0 2024-08-31T06:54:40.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.978+0000 7f6e11ffb640 1 -- 172.21.15.37:0/441982406 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f6e14100730 con 0x7f6e14108ab0 2024-08-31T06:54:40.979 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:54:40.979 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:54:40.980 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.980+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6dfc0b4d20 msgr2=0x7f6dfc0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.980+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6dfc0b4d20 0x7f6dfc0b7230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6e04005fd0 tx=0x7f6e04005850 comp rx=0 tx=0).stop 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.980+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108ab0 msgr2=0x7f6e140ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.980+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108ab0 0x7f6e140ffeb0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00cce0 tx=0x7f6e0c00a620 comp rx=0 tx=0).stop 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.981+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 shutdown_connections 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.981+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6dfc0b4d20 0x7f6dfc0b7230 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.981+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e14108ab0 0x7f6e140ffeb0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.981+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e14108160 0x7f6e140ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.981+0000 7f6e1ac7b640 1 --2- 172.21.15.37:0/441982406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e14102820 0x7f6e140ff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:40.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.981+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 >> 172.21.15.37:0/441982406 conn(0x7f6e140794e0 msgr2=0x7f6e1406bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:40.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.981+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 shutdown_connections 2024-08-31T06:54:40.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:40.981+0000 7f6e1ac7b640 1 -- 172.21.15.37:0/441982406 wait complete. 2024-08-31T06:54:41.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:54:42.056 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:42.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:41 smithi037 ceph-mon[18612]: pgmap v559: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:54:42.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:41 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/441982406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:42.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:41 smithi066 ceph-mon[22244]: pgmap v559: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:54:42.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:41 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/441982406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:41 smithi106 ceph-mon[22134]: pgmap v559: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:54:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:41 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/441982406' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:54:42.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 -- 172.21.15.37:0/1031590957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 msgr2=0x7f493c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 --2- 172.21.15.37:0/1031590957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 0x7f493c102c30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f492c009900 tx=0x7f492c02a410 comp rx=0 tx=0).stop 2024-08-31T06:54:42.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 -- 172.21.15.37:0/1031590957 shutdown_connections 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 --2- 172.21.15.37:0/1031590957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c108ab0 0x7f493c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 --2- 172.21.15.37:0/1031590957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f493c108160 0x7f493c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 --2- 172.21.15.37:0/1031590957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 0x7f493c102c30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 -- 172.21.15.37:0/1031590957 >> 172.21.15.37:0/1031590957 conn(0x7f493c0794e0 msgr2=0x7f493c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 -- 172.21.15.37:0/1031590957 shutdown_connections 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.529+0000 7f4941b7b640 1 -- 172.21.15.37:0/1031590957 wait complete. 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.530+0000 7f4941b7b640 1 Processor -- start 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.530+0000 7f4941b7b640 1 -- start start 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f4941b7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 0x7f493c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f4941b7b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f493c108160 0x7f493c199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f4941b7b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c108ab0 0x7f493c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f4941b7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1125e0 con 0x7f493c102820 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f4941b7b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f493c112460 con 0x7f493c108ab0 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f4941b7b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f493c112760 con 0x7f493c108160 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 0x7f493c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 0x7f493c1990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35904/0 (socket says 172.21.15.37:35904) 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 -- 172.21.15.37:0/803785446 learned_addr learned my addr 172.21.15.37:0/803785446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493bfff640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c108ab0 0x7f493c19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f4932ffd640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f493c108160 0x7f493c199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 -- 172.21.15.37:0/803785446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f493c108160 msgr2=0x7f493c199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f493c108160 0x7f493c199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 -- 172.21.15.37:0/803785446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c108ab0 msgr2=0x7f493c19e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c108ab0 0x7f493c19e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 -- 172.21.15.37:0/803785446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c19f020 con 0x7f493c102820 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f493b7fe640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 0x7f493c1990b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f492c009230 tx=0x7f492c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f49397fa640 1 -- 172.21.15.37:0/803785446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c03f030 con 0x7f493c102820 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f49397fa640 1 -- 172.21.15.37:0/803785446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f492c003a80 con 0x7f493c102820 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f49397fa640 1 -- 172.21.15.37:0/803785446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492c035070 con 0x7f493c102820 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.531+0000 7f4941b7b640 1 -- 172.21.15.37:0/803785446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c19f2b0 con 0x7f493c102820 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.532+0000 7f4941b7b640 1 -- 172.21.15.37:0/803785446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c1a5a70 con 0x7f493c102820 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49480f0740 1 Processor -- start 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49480f0740 1 -- start start 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49480f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c689df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49480f0740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 0x55bc7c687310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49480f0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 0x55bc7c6879a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49480f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c5fe680 con 0x55bc7c2e2070 2024-08-31T06:54:42.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49480f0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c5edc10 con 0x55bc7c2c1390 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49480f0740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c5f1bc0 con 0x55bc7c2b91b0 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f493bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c689df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f493bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c689df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35916/0 (socket says 172.21.15.37:35916) 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f493bfff640 1 -- 172.21.15.37:0/4019243096 learned_addr learned my addr 172.21.15.37:0/4019243096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f49397fa640 1 -- 172.21.15.37:0/803785446 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f492c042030 con 0x7f493c102820 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.534+0000 7f4932ffd640 1 --2- 172.21.15.37:0/4019243096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 0x55bc7c6879a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f493bfff640 1 -- 172.21.15.37:0/4019243096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 msgr2=0x55bc7c687310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f493bfff640 1 --2- 172.21.15.37:0/4019243096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 0x55bc7c687310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f493bfff640 1 -- 172.21.15.37:0/4019243096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 msgr2=0x55bc7c6879a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f493bfff640 1 --2- 172.21.15.37:0/4019243096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 0x55bc7c6879a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f493bfff640 1 -- 172.21.15.37:0/4019243096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc7c34d650 con 0x55bc7c2e2070 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f493bfff640 1 --2- 172.21.15.37:0/4019243096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c689df0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4934008dc0 tx=0x7f493400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1097d41a7f05f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f4931ffb640 1 -- 172.21.15.37:0/4019243096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934014070 con 0x55bc7c2e2070 2024-08-31T06:54:42.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f4931ffb640 1 -- 172.21.15.37:0/4019243096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4934004020 con 0x55bc7c2e2070 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f4931ffb640 1 -- 172.21.15.37:0/4019243096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934010690 con 0x55bc7c2e2070 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f49397fa640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49280b4ca0 0x7f49280b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.535+0000 7f493b7fe640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49280b4ca0 0x7f49280b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49397fa640 1 -- 172.21.15.37:0/803785446 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f492c105b80 con 0x7f493c102820 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 -- 172.21.15.37:0/4019243096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 msgr2=0x55bc7c689df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f493b7fe640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49280b4ca0 0x7f49280b71b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55bc7c685f90 tx=0x7f492c0953f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 --2- 172.21.15.37:0/4019243096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c689df0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4934008dc0 tx=0x7f493400e720 comp rx=0 tx=0).stop 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 -- 172.21.15.37:0/4019243096 shutdown_connections 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 --2- 172.21.15.37:0/4019243096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 0x55bc7c6879a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 --2- 172.21.15.37:0/4019243096 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 0x55bc7c687310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 --2- 172.21.15.37:0/4019243096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c689df0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 -- 172.21.15.37:0/4019243096 >> 172.21.15.37:0/4019243096 conn(0x55bc7c2d6460 msgr2=0x55bc7c685200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 -- 172.21.15.37:0/4019243096 shutdown_connections 2024-08-31T06:54:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.536+0000 7f49480f0740 1 -- 172.21.15.37:0/4019243096 wait complete. 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 1 -- start start 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 1 Processor -- start 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 0x55bc7c697020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 0x55bc7c697560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c6a3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c450700 con 0x55bc7c2e2070 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c574750 con 0x55bc7c2c1390 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bc7c699e40 con 0x55bc7c2b91b0 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f49480f0740 10 client.0 _ll_register_callbacks cb 0x55bc7c5a3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f493bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c6a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f493bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c6a3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35930/0 (socket says 172.21.15.37:35930) 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f493bfff640 1 -- 172.21.15.37:0/3148165927 learned_addr learned my addr 172.21.15.37:0/3148165927 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f493bfff640 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 0x55bc7c697020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.537+0000 7f4932ffd640 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 0x55bc7c697560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f493bfff640 1 -- 172.21.15.37:0/3148165927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 msgr2=0x55bc7c697020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:42.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f493bfff640 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 0x55bc7c697020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f493bfff640 1 -- 172.21.15.37:0/3148165927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 msgr2=0x55bc7c697560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f493bfff640 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 0x55bc7c697560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f493bfff640 1 -- 172.21.15.37:0/3148165927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc7c5ad900 con 0x55bc7c2e2070 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f493bfff640 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c6a3230 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4934010840 tx=0x7f4934004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525dae23bf321d7e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f491affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f491affd640 1 -- 172.21.15.37:0/3148165927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934014030 con 0x55bc7c2e2070 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f49480f0740 1 -- 172.21.15.37:0/3148165927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4934004020 con 0x55bc7c2e2070 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f491affd640 1 -- 172.21.15.37:0/3148165927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f4934003da0 con 0x55bc7c2e2070 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f491affd640 1 -- 172.21.15.37:0/3148165927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4934021040 con 0x55bc7c2e2070 2024-08-31T06:54:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f49480f0740 10 client.17481 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.538+0000 7f49480f0740 1 -- 172.21.15.37:0/3148165927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bc7c6a5cb0 con 0x55bc7c2e2070 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f491affd640 1 -- 172.21.15.37:0/3148165927 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4934004020 con 0x55bc7c2e2070 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f491affd640 1 -- 172.21.15.37:0/3148165927 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49340184c0 con 0x55bc7c2e2070 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f49480f0740 10 client.17481 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f49480f0740 10 client.17481 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f49480f0740 20 client.17481 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f49480f0740 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bc7c2a09f0 0x55bc7c6a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f49480f0740 4 client.17481 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f49480f0740 1 -- 172.21.15.37:0/3148165927 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc7c6005d0 con 0x55bc7c2a09f0 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.539+0000 7f4932ffd640 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bc7c2a09f0 0x55bc7c6a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.540+0000 7f491affd640 10 client.17481 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.540+0000 7f4932ffd640 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bc7c2a09f0 0x55bc7c6a90d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca0fdac00588db41 server_cookie=d8d887df7c221406 in_seq=0 out_seq=0 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.540+0000 7f491affd640 1 -- 172.21.15.37:0/3148165927 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc7c6005d0 con 0x55bc7c2a09f0 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.540+0000 7f491affd640 10 client.17481 handle_command_reply: tid=0 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.540+0000 7f49480f0740 1 client.17481 shutdown 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 -- 172.21.15.37:0/3148165927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 msgr2=0x55bc7c6a3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c6a3230 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4934010840 tx=0x7f4934004950 comp rx=0 tx=0).stop 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 -- 172.21.15.37:0/3148165927 shutdown_connections 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c6a3230 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bc7c2a09f0 0x55bc7c6a90d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2c1390 0x55bc7c697560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 --2- 172.21.15.37:0/3148165927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2b91b0 0x55bc7c697020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f491affd640 0 client.17481 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 -- 172.21.15.37:0/3148165927 >> 172.21.15.37:0/3148165927 conn(0x55bc7c2d6460 msgr2=0x55bc7c6837c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 -- 172.21.15.37:0/3148165927 shutdown_connections 2024-08-31T06:54:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 1 -- 172.21.15.37:0/3148165927 wait complete. 2024-08-31T06:54:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.541+0000 7f49480f0740 20 client.17481 trim_cache size 0 max 16384 2024-08-31T06:54:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.554+0000 7f49480f0740 1 Processor -- start 2024-08-31T06:54:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.554+0000 7f49480f0740 1 -- start start 2024-08-31T06:54:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f49480f0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 0x55bc7c68d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f49480f0740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 0x55bc7c698f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f49480f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c694370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f49480f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1afb00 con 0x55bc7c2e2070 2024-08-31T06:54:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f49480f0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1ad3d0 con 0x55bc7c2b91b0 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f49480f0740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1ab240 con 0x55bc7c2c1390 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c694370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c694370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35934/0 (socket says 172.21.15.37:35934) 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 -- 172.21.15.37:0/703181689 learned_addr learned my addr 172.21.15.37:0/703181689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f4932ffd640 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 0x55bc7c698f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 0x55bc7c68d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 -- 172.21.15.37:0/703181689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 msgr2=0x55bc7c698f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 0x55bc7c698f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 -- 172.21.15.37:0/703181689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 msgr2=0x55bc7c68d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 0x55bc7c68d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 -- 172.21.15.37:0/703181689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc7c699760 con 0x55bc7c2e2070 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.555+0000 7f493bfff640 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c694370 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f49340045a0 tx=0x7f4934005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82fb355a694b6d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49317fa640 1 -- 172.21.15.37:0/703181689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934014040 con 0x55bc7c2e2070 2024-08-31T06:54:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49317fa640 1 -- 172.21.15.37:0/703181689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4934004a00 con 0x55bc7c2e2070 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49317fa640 1 -- 172.21.15.37:0/703181689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934003f70 con 0x55bc7c2e2070 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49480f0740 1 -- 172.21.15.37:0/703181689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 msgr2=0x55bc7c694370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49480f0740 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c694370 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f49340045a0 tx=0x7f4934005d90 comp rx=0 tx=0).stop 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49480f0740 1 -- 172.21.15.37:0/703181689 shutdown_connections 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49480f0740 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c694370 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49480f0740 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 0x55bc7c698f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49480f0740 1 --2- 172.21.15.37:0/703181689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 0x55bc7c68d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.556+0000 7f49480f0740 1 -- 172.21.15.37:0/703181689 >> 172.21.15.37:0/703181689 conn(0x55bc7c2d6460 msgr2=0x55bc7c693c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.557+0000 7f49480f0740 1 -- 172.21.15.37:0/703181689 shutdown_connections 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.557+0000 7f49480f0740 1 -- 172.21.15.37:0/703181689 wait complete. 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.557+0000 7f49480f0740 1 -- start start 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.557+0000 7f49480f0740 1 Processor -- start 2024-08-31T06:54:42.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f49480f0740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 0x55bc7c69f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f49480f0740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 0x55bc7c69f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f49480f0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c69c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f49480f0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1ab890 con 0x55bc7c2e2070 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f49480f0740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1acd00 con 0x55bc7c2b91b0 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f49480f0740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f493c1abf60 con 0x55bc7c2c1390 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f49480f0740 10 client.0 _ll_register_callbacks cb 0x7f49240092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c69c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c69c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35938/0 (socket says 172.21.15.37:35938) 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 -- 172.21.15.37:0/311086027 learned_addr learned my addr 172.21.15.37:0/311086027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f4932ffd640 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 0x55bc7c69f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 0x55bc7c69f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 -- 172.21.15.37:0/311086027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 msgr2=0x55bc7c69f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 0x55bc7c69f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 -- 172.21.15.37:0/311086027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 msgr2=0x55bc7c69f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 0x55bc7c69f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 -- 172.21.15.37:0/311086027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc7c69c720 con 0x55bc7c2e2070 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f493bfff640 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c69c160 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f49340105b0 tx=0x7f4934004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60982edbcc30ed6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f491affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.558+0000 7f491affd640 1 -- 172.21.15.37:0/311086027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4934014040 con 0x55bc7c2e2070 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f491affd640 1 -- 172.21.15.37:0/311086027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f4934004730 con 0x55bc7c2e2070 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 1 -- 172.21.15.37:0/311086027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4934004a00 con 0x55bc7c2e2070 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f491affd640 1 -- 172.21.15.37:0/311086027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4934004dc0 con 0x55bc7c2e2070 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 10 client.17487 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 1 -- 172.21.15.37:0/311086027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bc7c714180 con 0x55bc7c2e2070 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f491affd640 1 -- 172.21.15.37:0/311086027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4934004a00 con 0x55bc7c2e2070 2024-08-31T06:54:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f491affd640 1 -- 172.21.15.37:0/311086027 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4934042450 con 0x55bc7c2e2070 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 10 client.17487 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 10 client.17487 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 20 client.17487 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bc7c275da0 0x55bc7c716920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 4 client.17487 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.559+0000 7f49480f0740 1 -- 172.21.15.37:0/311086027 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bc7c5fc070 con 0x55bc7c275da0 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f4932ffd640 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bc7c275da0 0x55bc7c716920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f4932ffd640 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bc7c275da0 0x55bc7c716920 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=758af5dd15fce9b2 server_cookie=c309c6fbe1a98fbf in_seq=0 out_seq=0 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f491affd640 10 client.17487 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f491affd640 1 -- 172.21.15.37:0/311086027 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bc7c5fc070 con 0x55bc7c275da0 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f491affd640 10 client.17487 handle_command_reply: tid=0 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f49480f0740 1 client.17487 shutdown 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f49480f0740 1 -- 172.21.15.37:0/311086027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 msgr2=0x55bc7c69c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f49480f0740 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c69c160 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f49340105b0 tx=0x7f4934004500 comp rx=0 tx=0).stop 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.560+0000 7f49480f0740 1 -- 172.21.15.37:0/311086027 shutdown_connections 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f49480f0740 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bc7c2e2070 0x55bc7c69c160 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f49480f0740 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x55bc7c275da0 0x55bc7c716920 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f49480f0740 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc7c2c1390 0x55bc7c69f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f49480f0740 1 --2- 172.21.15.37:0/311086027 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bc7c2b91b0 0x55bc7c69f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f49480f0740 1 -- 172.21.15.37:0/311086027 >> 172.21.15.37:0/311086027 conn(0x55bc7c2d6460 msgr2=0x55bc7c693c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f491affd640 0 client.17487 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f49480f0740 1 -- 172.21.15.37:0/311086027 shutdown_connections 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f49480f0740 1 -- 172.21.15.37:0/311086027 wait complete. 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f49480f0740 20 client.17487 trim_cache size 0 max 16384 2024-08-31T06:54:42.570 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 -- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49280b4ca0 msgr2=0x7f49280b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49280b4ca0 0x7f49280b71b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55bc7c685f90 tx=0x7f492c0953f0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 -- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 msgr2=0x7f493c1990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 0x7f493c1990b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f492c009230 tx=0x7f492c004270 comp rx=0 tx=0).stop 2024-08-31T06:54:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 -- 172.21.15.37:0/803785446 shutdown_connections 2024-08-31T06:54:42.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49280b4ca0 0x7f49280b71b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f493c108ab0 0x7f493c19e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f493c108160 0x7f493c199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 --2- 172.21.15.37:0/803785446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f493c102820 0x7f493c1990b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.561+0000 7f4941b7b640 1 -- 172.21.15.37:0/803785446 >> 172.21.15.37:0/803785446 conn(0x7f493c0794e0 msgr2=0x7f493c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.562+0000 7f4941b7b640 1 -- 172.21.15.37:0/803785446 shutdown_connections 2024-08-31T06:54:42.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:42.562+0000 7f4941b7b640 1 -- 172.21.15.37:0/803785446 wait complete. 2024-08-31T06:54:43.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:54:43.710 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:44.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:43 smithi037 ceph-mon[18612]: pgmap v560: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-08-31T06:54:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:43 smithi066 ceph-mon[22244]: pgmap v560: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-08-31T06:54:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 -- 172.21.15.37:0/1923677599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704102830 msgr2=0x7fb704102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 --2- 172.21.15.37:0/1923677599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704102830 0x7fb704102c40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009900 tx=0x7fb6f402a410 comp rx=0 tx=0).stop 2024-08-31T06:54:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 -- 172.21.15.37:0/1923677599 shutdown_connections 2024-08-31T06:54:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 --2- 172.21.15.37:0/1923677599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb704108ac0 0x7fb70410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 --2- 172.21.15.37:0/1923677599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb704108170 0x7fb704108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 --2- 172.21.15.37:0/1923677599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704102830 0x7fb704102c40 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 -- 172.21.15.37:0/1923677599 >> 172.21.15.37:0/1923677599 conn(0x7fb7040794f0 msgr2=0x7fb704079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 -- 172.21.15.37:0/1923677599 shutdown_connections 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.255+0000 7fb7092ed640 1 -- 172.21.15.37:0/1923677599 wait complete. 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.256+0000 7fb7092ed640 1 Processor -- start 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.256+0000 7fb7092ed640 1 -- start start 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb7092ed640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb704102830 0x7fb7041990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb7092ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704108170 0x7fb704199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb7092ed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb704108ac0 0x7fb70419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb7092ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041125f0 con 0x7fb704108170 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb7092ed640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb704112470 con 0x7fb704108ac0 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb7092ed640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb704112770 con 0x7fb704102830 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb6fa7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704108170 0x7fb704199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb6fa7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704108170 0x7fb704199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56420/0 (socket says 172.21.15.37:56420) 2024-08-31T06:54:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb6fa7fc640 1 -- 172.21.15.37:0/213451506 learned_addr learned my addr 172.21.15.37:0/213451506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb7037fe640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb704108ac0 0x7fb70419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb702ffd640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb704102830 0x7fb7041990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb6fa7fc640 1 -- 172.21.15.37:0/213451506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb704102830 msgr2=0x7fb7041990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb704102830 0x7fb7041990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb6fa7fc640 1 -- 172.21.15.37:0/213451506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb704108ac0 msgr2=0x7fb70419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb704108ac0 0x7fb70419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.257+0000 7fb6fa7fc640 1 -- 172.21.15.37:0/213451506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70419f050 con 0x7fb704108170 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.258+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704108170 0x7fb704199680 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00d740 tx=0x7fb6ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.258+0000 7fb700ff9640 1 -- 172.21.15.37:0/213451506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec017070 con 0x7fb704108170 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.258+0000 7fb700ff9640 1 -- 172.21.15.37:0/213451506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6ec00de50 con 0x7fb704108170 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.258+0000 7fb7092ed640 1 -- 172.21.15.37:0/213451506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70419f340 con 0x7fb704108170 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.258+0000 7fb700ff9640 1 -- 172.21.15.37:0/213451506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec004c60 con 0x7fb704108170 2024-08-31T06:54:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.258+0000 7fb7092ed640 1 -- 172.21.15.37:0/213451506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7041a5aa0 con 0x7fb704108170 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.260+0000 7fb70f862740 1 Processor -- start 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb70f862740 1 -- start start 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb700ff9640 1 -- 172.21.15.37:0/213451506 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fb6ec004e00 con 0x7fb704108170 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb70f862740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb70f862740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb70f862740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb70f862740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dee463e680 con 0x55dee4322070 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb70f862740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dee462dc10 con 0x55dee4301390 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb70f862740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dee4631bc0 con 0x55dee42f91b0 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb7037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb7037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56430/0 (socket says 172.21.15.37:56430) 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb7037fe640 1 -- 172.21.15.37:0/3950370002 learned_addr learned my addr 172.21.15.37:0/3950370002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb702ffd640 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb7037fe640 1 -- 172.21.15.37:0/3950370002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 msgr2=0x55dee46c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb7037fe640 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb7037fe640 1 -- 172.21.15.37:0/3950370002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 msgr2=0x55dee46c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.261+0000 7fb7037fe640 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb7037fe640 1 -- 172.21.15.37:0/3950370002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dee438d650 con 0x55dee4322070 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb7037fe640 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46cbff0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc008d40 tx=0x7fb6fc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e337dde1456e70 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb700ff9640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb6f00b4ca0 0x7fb6f00b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb702ffd640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb6f00b4ca0 0x7fb6f00b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb6f97fa640 1 -- 172.21.15.37:0/3950370002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc014070 con 0x55dee4322070 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb700ff9640 1 -- 172.21.15.37:0/213451506 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fb6ec0e4fa0 con 0x7fb704108170 2024-08-31T06:54:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb6f97fa640 1 -- 172.21.15.37:0/3950370002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6fc004020 con 0x55dee4322070 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.262+0000 7fb6f97fa640 1 -- 172.21.15.37:0/3950370002 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc010690 con 0x55dee4322070 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 -- 172.21.15.37:0/3950370002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 msgr2=0x55dee46cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb702ffd640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb6f00b4ca0 0x7fb6f00b71b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009230 tx=0x7fb6f40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46cbff0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc008d40 tx=0x7fb6fc00e720 comp rx=0 tx=0).stop 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 -- 172.21.15.37:0/3950370002 shutdown_connections 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 --2- 172.21.15.37:0/3950370002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46cbff0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 -- 172.21.15.37:0/3950370002 >> 172.21.15.37:0/3950370002 conn(0x55dee4316460 msgr2=0x55dee46c7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 -- 172.21.15.37:0/3950370002 shutdown_connections 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 -- 172.21.15.37:0/3950370002 wait complete. 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.263+0000 7fb70f862740 1 -- start start 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb70f862740 1 Processor -- start 2024-08-31T06:54:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb70f862740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee42f91b0 0x55dee46d7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb70f862740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee4301390 0x55dee46d7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb70f862740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb70f862740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dee4490700 con 0x55dee4322070 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb70f862740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dee45b4750 con 0x55dee42f91b0 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb70f862740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dee46d9e70 con 0x55dee4301390 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb70f862740 10 client.0 _ll_register_callbacks cb 0x55dee45e3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb7037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb7037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46e31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56442/0 (socket says 172.21.15.37:56442) 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb7037fe640 1 -- 172.21.15.37:0/2375034188 learned_addr learned my addr 172.21.15.37:0/2375034188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee4301390 0x55dee46d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb702ffd640 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee42f91b0 0x55dee46d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb7037fe640 1 -- 172.21.15.37:0/2375034188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee4301390 msgr2=0x55dee46d7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:44.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.264+0000 7fb7037fe640 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee4301390 0x55dee46d7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb7037fe640 1 -- 172.21.15.37:0/2375034188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee42f91b0 msgr2=0x55dee46d7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb7037fe640 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee42f91b0 0x55dee46d7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb7037fe640 1 -- 172.21.15.37:0/2375034188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dee45ed900 con 0x55dee4322070 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb7037fe640 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46e31d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000f80 tx=0x7fb6fc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4fa1b418c52fee server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb6ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/2375034188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc014070 con 0x55dee4322070 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/2375034188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fb6fc0039f0 con 0x55dee4322070 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb70f862740 1 -- 172.21.15.37:0/2375034188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6fc004020 con 0x55dee4322070 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/2375034188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb6fc003c30 con 0x55dee4322070 2024-08-31T06:54:44.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb70f862740 10 client.17499 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:44.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb70f862740 1 -- 172.21.15.37:0/2375034188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dee46e5c50 con 0x55dee4322070 2024-08-31T06:54:44.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/2375034188 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6fc004020 con 0x55dee4322070 2024-08-31T06:54:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.265+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/2375034188 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb6fc010430 con 0x55dee4322070 2024-08-31T06:54:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.266+0000 7fb70f862740 10 client.17499 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.266+0000 7fb70f862740 10 client.17499 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:54:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.266+0000 7fb70f862740 20 client.17499 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.266+0000 7fb70f862740 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dee42e09f0 0x55dee46e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.266+0000 7fb70f862740 4 client.17499 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.266+0000 7fb70f862740 1 -- 172.21.15.37:0/2375034188 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dee46405d0 con 0x55dee42e09f0 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.266+0000 7fb702ffd640 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dee42e09f0 0x55dee46e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.267+0000 7fb6ea7fc640 10 client.17499 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.267+0000 7fb702ffd640 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dee42e09f0 0x55dee46e9010 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2df626a5beee8ec8 server_cookie=cb1f20aaa4ba11a0 in_seq=0 out_seq=0 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.267+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/2375034188 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dee46405d0 con 0x55dee42e09f0 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.267+0000 7fb6ea7fc640 10 client.17499 handle_command_reply: tid=0 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.267+0000 7fb70f862740 1 client.17499 shutdown 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 -- 172.21.15.37:0/2375034188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 msgr2=0x55dee46e31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46e31d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc000f80 tx=0x7fb6fc0046d0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 -- 172.21.15.37:0/2375034188 shutdown_connections 2024-08-31T06:54:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dee42e09f0 0x55dee46e9010 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46e31d0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee4301390 0x55dee46d7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb6ea7fc640 0 client.17499 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 --2- 172.21.15.37:0/2375034188 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee42f91b0 0x55dee46d7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 -- 172.21.15.37:0/2375034188 >> 172.21.15.37:0/2375034188 conn(0x55dee4316460 msgr2=0x55dee46ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 -- 172.21.15.37:0/2375034188 shutdown_connections 2024-08-31T06:54:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 1 -- 172.21.15.37:0/2375034188 wait complete. 2024-08-31T06:54:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.268+0000 7fb70f862740 20 client.17499 trim_cache size 0 max 16384 2024-08-31T06:54:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb70f862740 1 Processor -- start 2024-08-31T06:54:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb70f862740 1 -- start start 2024-08-31T06:54:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb70f862740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb70f862740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46e3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb70f862740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb70f862740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041afb50 con 0x55dee4322070 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb70f862740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041ad420 con 0x55dee4301390 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb70f862740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041ab290 con 0x55dee42f91b0 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.281+0000 7fb7037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb7037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56458/0 (socket says 172.21.15.37:56458) 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb7037fe640 1 -- 172.21.15.37:0/1247995417 learned_addr learned my addr 172.21.15.37:0/1247995417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46e3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb702ffd640 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb7037fe640 1 -- 172.21.15.37:0/1247995417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 msgr2=0x55dee46c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:44.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb7037fe640 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb7037fe640 1 -- 172.21.15.37:0/1247995417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 msgr2=0x55dee46e3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb7037fe640 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46e3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb7037fe640 1 -- 172.21.15.37:0/1247995417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dee46d9db0 con 0x55dee4322070 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb7037fe640 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46c9450 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc010880 tx=0x7fb6fc003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91ce16a49b5735b server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb6f8ff9640 1 -- 172.21.15.37:0/1247995417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc039070 con 0x55dee4322070 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb6f8ff9640 1 -- 172.21.15.37:0/1247995417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6fc004740 con 0x55dee4322070 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.282+0000 7fb6f8ff9640 1 -- 172.21.15.37:0/1247995417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc014070 con 0x55dee4322070 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 -- 172.21.15.37:0/1247995417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 msgr2=0x55dee46c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46c9450 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc010880 tx=0x7fb6fc003b80 comp rx=0 tx=0).stop 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 -- 172.21.15.37:0/1247995417 shutdown_connections 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4322070 0x55dee46c9450 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4301390 0x55dee46e3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 --2- 172.21.15.37:0/1247995417 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 -- 172.21.15.37:0/1247995417 >> 172.21.15.37:0/1247995417 conn(0x55dee4316460 msgr2=0x55dee46d58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 -- 172.21.15.37:0/1247995417 shutdown_connections 2024-08-31T06:54:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.283+0000 7fb70f862740 1 -- 172.21.15.37:0/1247995417 wait complete. 2024-08-31T06:54:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 1 -- start start 2024-08-31T06:54:44.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 1 Processor -- start 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46ec800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4301390 0x55dee46e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4322070 0x55dee46e9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041ab8e0 con 0x55dee4301390 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041acd50 con 0x55dee4322070 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb7041abfb0 con 0x55dee42f91b0 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb70f862740 10 client.0 _ll_register_callbacks cb 0x7fb6f4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb6fa7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4301390 0x55dee46e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb6fa7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4301390 0x55dee46e9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56474/0 (socket says 172.21.15.37:56474) 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb6fa7fc640 1 -- 172.21.15.37:0/1393715186 learned_addr learned my addr 172.21.15.37:0/1393715186 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb702ffd640 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.284+0000 7fb7037fe640 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4322070 0x55dee46e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6fa7fc640 1 -- 172.21.15.37:0/1393715186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 msgr2=0x55dee46ec800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46ec800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6fa7fc640 1 -- 172.21.15.37:0/1393715186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4322070 msgr2=0x55dee46e9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4322070 0x55dee46e9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6fa7fc640 1 -- 172.21.15.37:0/1393715186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dee46e9c90 con 0x55dee4301390 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb7037fe640 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4322070 0x55dee46e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6fa7fc640 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4301390 0x55dee46e9010 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0ab3a0 tx=0x7fb6ec009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb401e3e90061a8a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/1393715186 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec020040 con 0x55dee4301390 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/1393715186 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7fb6ec0a7c90 con 0x55dee4301390 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb70f862740 1 -- 172.21.15.37:0/1393715186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6fc004740 con 0x55dee4301390 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/1393715186 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb6ec0abda0 con 0x55dee4301390 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb70f862740 10 client.17505 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb70f862740 1 -- 172.21.15.37:0/1393715186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dee4754660 con 0x55dee4301390 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/1393715186 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6fc004740 con 0x55dee4301390 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/1393715186 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb6ec05b1a0 con 0x55dee4301390 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.285+0000 7fb70f862740 10 client.17505 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb70f862740 10 client.17505 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb70f862740 20 client.17505 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb70f862740 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dee42b5da0 0x55dee4756da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb70f862740 4 client.17505 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb70f862740 1 -- 172.21.15.37:0/1393715186 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dee463c070 con 0x55dee42b5da0 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb702ffd640 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dee42b5da0 0x55dee4756da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb6ea7fc640 10 client.17505 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb702ffd640 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dee42b5da0 0x55dee4756da0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b6c8e34c226460a6 server_cookie=de47f00c10a53d9c in_seq=0 out_seq=0 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb6ea7fc640 1 -- 172.21.15.37:0/1393715186 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dee463c070 con 0x55dee42b5da0 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb6ea7fc640 10 client.17505 handle_command_reply: tid=0 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.286+0000 7fb70f862740 1 client.17505 shutdown 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 -- 172.21.15.37:0/1393715186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4301390 msgr2=0x55dee46e9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4301390 0x55dee46e9010 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec0ab3a0 tx=0x7fb6ec009e60 comp rx=0 tx=0).stop 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 -- 172.21.15.37:0/1393715186 shutdown_connections 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dee42b5da0 0x55dee4756da0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dee4301390 0x55dee46e9010 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb6ea7fc640 0 client.17505 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:54:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dee4322070 0x55dee46e9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 --2- 172.21.15.37:0/1393715186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dee42f91b0 0x55dee46ec800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 -- 172.21.15.37:0/1393715186 >> 172.21.15.37:0/1393715186 conn(0x55dee4316460 msgr2=0x55dee46c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 -- 172.21.15.37:0/1393715186 shutdown_connections 2024-08-31T06:54:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 1 -- 172.21.15.37:0/1393715186 wait complete. 2024-08-31T06:54:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb70f862740 20 client.17505 trim_cache size 0 max 16384 2024-08-31T06:54:44.293 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:44.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb7092ed640 1 -- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb6f00b4ca0 msgr2=0x7fb6f00b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb7092ed640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb6f00b4ca0 0x7fb6f00b71b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4009230 tx=0x7fb6f40058d0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb7092ed640 1 -- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704108170 msgr2=0x7fb704199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.287+0000 7fb7092ed640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704108170 0x7fb704199680 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00d740 tx=0x7fb6ec00dc00 comp rx=0 tx=0).stop 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.288+0000 7fb7092ed640 1 -- 172.21.15.37:0/213451506 shutdown_connections 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.288+0000 7fb7092ed640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb6f00b4ca0 0x7fb6f00b71b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.288+0000 7fb7092ed640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb704108170 0x7fb704199680 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.288+0000 7fb7092ed640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb704108ac0 0x7fb70419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.288+0000 7fb7092ed640 1 --2- 172.21.15.37:0/213451506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb704102830 0x7fb7041990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.288+0000 7fb7092ed640 1 -- 172.21.15.37:0/213451506 >> 172.21.15.37:0/213451506 conn(0x7fb7040794f0 msgr2=0x7fb704101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.288+0000 7fb7092ed640 1 -- 172.21.15.37:0/213451506 shutdown_connections 2024-08-31T06:54:44.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:44.288+0000 7fb7092ed640 1 -- 172.21.15.37:0/213451506 wait complete. 2024-08-31T06:54:44.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:43 smithi106 ceph-mon[22134]: pgmap v560: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-08-31T06:54:45.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:54:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 -- 172.21.15.37:0/485118404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c10dc00 msgr2=0x7f054c1100d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 --2- 172.21.15.37:0/485118404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c10dc00 0x7f054c1100d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f0544009ca0 tx=0x7f054402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 -- 172.21.15.37:0/485118404 shutdown_connections 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 --2- 172.21.15.37:0/485118404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c10dc00 0x7f054c1100d0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 --2- 172.21.15.37:0/485118404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f054c105120 0x7f054c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 --2- 172.21.15.37:0/485118404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c1047d0 0x7f054c104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 -- 172.21.15.37:0/485118404 >> 172.21.15.37:0/485118404 conn(0x7f054c079500 msgr2=0x7f054c079910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 -- 172.21.15.37:0/485118404 shutdown_connections 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 -- 172.21.15.37:0/485118404 wait complete. 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.856+0000 7f0553db1640 1 Processor -- start 2024-08-31T06:54:45.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0553db1640 1 -- start start 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0553db1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c1047d0 0x7f054c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0553db1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f054c105120 0x7f054c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0553db1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c10dc00 0x7f054c19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0553db1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f054c113740 con 0x7f054c1047d0 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0553db1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1135c0 con 0x7f054c10dc00 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0553db1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1138c0 con 0x7f054c105120 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c1047d0 0x7f054c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c1047d0 0x7f054c19a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56492/0 (socket says 172.21.15.37:56492) 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 -- 172.21.15.37:0/3975735584 learned_addr learned my addr 172.21.15.37:0/3975735584 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f055234e640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c10dc00 0x7f054c19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f055134c640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f054c105120 0x7f054c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 -- 172.21.15.37:0/3975735584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f054c105120 msgr2=0x7f054c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f054c105120 0x7f054c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 -- 172.21.15.37:0/3975735584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c10dc00 msgr2=0x7f054c19f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c10dc00 0x7f054c19f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 -- 172.21.15.37:0/3975735584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c1a0020 con 0x7f054c1047d0 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f055134c640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f054c105120 0x7f054c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.857+0000 7f0551b4d640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c1047d0 0x7f054c19a170 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f054800d770 tx=0x7f054800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.858+0000 7f0542ffd640 1 -- 172.21.15.37:0/3975735584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548017070 con 0x7f054c1047d0 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.858+0000 7f0542ffd640 1 -- 172.21.15.37:0/3975735584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0548009c30 con 0x7f054c1047d0 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.858+0000 7f0553db1640 1 -- 172.21.15.37:0/3975735584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c1a0310 con 0x7f054c1047d0 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.858+0000 7f0542ffd640 1 -- 172.21.15.37:0/3975735584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548003c50 con 0x7f054c1047d0 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.858+0000 7f0553db1640 1 -- 172.21.15.37:0/3975735584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c1a6b30 con 0x7f054c1047d0 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.860+0000 7f055a326740 1 Processor -- start 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.860+0000 7f055a326740 1 -- start start 2024-08-31T06:54:45.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.860+0000 7f0542ffd640 1 -- 172.21.15.37:0/3975735584 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f0548003df0 con 0x7f054c1047d0 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055a326740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c235070 0x55de6c5da310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055a326740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c20c1b0 0x55de6c5da850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055a326740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 0x55de6c5dad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055a326740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55de6c551680 con 0x55de6c235070 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055a326740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55de6c540c10 con 0x55de6c20c1b0 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055a326740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55de6c544bc0 con 0x55de6c214390 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c235070 0x55de6c5da310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c235070 0x55de6c5da310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56502/0 (socket says 172.21.15.37:56502) 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 -- 172.21.15.37:0/379898255 learned_addr learned my addr 172.21.15.37:0/379898255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f0551b4d640 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c20c1b0 0x55de6c5da850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055134c640 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 0x55de6c5dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 -- 172.21.15.37:0/379898255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 msgr2=0x55de6c5dad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 0x55de6c5dad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 -- 172.21.15.37:0/379898255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c20c1b0 msgr2=0x55de6c5da850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c20c1b0 0x55de6c5da850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 -- 172.21.15.37:0/379898255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6c2a0650 con 0x55de6c235070 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f0542ffd640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f05380b4d50 0x7f05380b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f0551b4d640 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c20c1b0 0x55de6c5da850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055134c640 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 0x55de6c5dad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f0551b4d640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f05380b4d50 0x7f05380b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.861+0000 7f055234e640 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c235070 0x55de6c5da310 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0544035000 tx=0x7f0544031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2455b3be5be8556 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.862+0000 7f0542ffd640 1 -- 172.21.15.37:0/3975735584 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f05480e4f30 con 0x7f054c1047d0 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.862+0000 7f0537fff640 1 -- 172.21.15.37:0/379898255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544031b80 con 0x55de6c235070 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.862+0000 7f0537fff640 1 -- 172.21.15.37:0/379898255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0544036040 con 0x55de6c235070 2024-08-31T06:54:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.862+0000 7f0537fff640 1 -- 172.21.15.37:0/379898255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544004540 con 0x55de6c235070 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 -- 172.21.15.37:0/379898255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c235070 msgr2=0x55de6c5da310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c235070 0x55de6c5da310 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f0544035000 tx=0x7f0544031580 comp rx=0 tx=0).stop 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f0551b4d640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f05380b4d50 0x7f05380b7260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05480e2740 tx=0x7f05480035f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 -- 172.21.15.37:0/379898255 shutdown_connections 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 0x55de6c5dad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c20c1b0 0x55de6c5da850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 --2- 172.21.15.37:0/379898255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c235070 0x55de6c5da310 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 -- 172.21.15.37:0/379898255 >> 172.21.15.37:0/379898255 conn(0x55de6c229460 msgr2=0x55de6c5d8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 -- 172.21.15.37:0/379898255 shutdown_connections 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 -- 172.21.15.37:0/379898255 wait complete. 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 -- start start 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.863+0000 7f055a326740 1 Processor -- start 2024-08-31T06:54:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055a326740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c5e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055a326740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c214390 0x55de6c5ea3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055a326740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c235070 0x55de6c5f6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055a326740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55de6c3a3700 con 0x55de6c20c1b0 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055a326740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55de6c4c7750 con 0x55de6c214390 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055a326740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55de6c5ecdf0 con 0x55de6c235070 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055a326740 10 client.0 _ll_register_callbacks cb 0x55de6c4f6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c5e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c5e9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56506/0 (socket says 172.21.15.37:56506) 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 -- 172.21.15.37:0/1749238546 learned_addr learned my addr 172.21.15.37:0/1749238546 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055134c640 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c214390 0x55de6c5ea3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 -- 172.21.15.37:0/1749238546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c235070 msgr2=0x55de6c5f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c235070 0x55de6c5f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 -- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c214390 msgr2=0x55de6c5ea3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c214390 0x55de6c5ea3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 -- 172.21.15.37:0/1749238546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6c500900 con 0x55de6c20c1b0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055134c640 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c214390 0x55de6c5ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f055234e640 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c5e9e70 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f054402a900 tx=0x7f05440318b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee83927a46320a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.864+0000 7f05357fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f05357fa640 1 -- 172.21.15.37:0/1749238546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544003970 con 0x55de6c20c1b0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f05357fa640 1 -- 172.21.15.37:0/1749238546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f0544003b10 con 0x55de6c20c1b0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 1 -- 172.21.15.37:0/1749238546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0544036040 con 0x55de6c20c1b0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f05357fa640 1 -- 172.21.15.37:0/1749238546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f054405d050 con 0x55de6c20c1b0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 10 client.17517 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 1 -- 172.21.15.37:0/1749238546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55de6c5f8b10 con 0x55de6c20c1b0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f05357fa640 1 -- 172.21.15.37:0/1749238546 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0544036040 con 0x55de6c20c1b0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f05357fa640 1 -- 172.21.15.37:0/1749238546 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0544058030 con 0x55de6c20c1b0 2024-08-31T06:54:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 10 client.17517 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 20 client.17517 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55de6c1f39f0 0x55de6c5fbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 4 client.17517 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.865+0000 7f055a326740 1 -- 172.21.15.37:0/1749238546 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de6c5535d0 con 0x55de6c1f39f0 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.866+0000 7f055134c640 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55de6c1f39f0 0x55de6c5fbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.866+0000 7f055134c640 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55de6c1f39f0 0x55de6c5fbe70 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=636dfe9d8717e043 server_cookie=bcab71e6c4daf07e in_seq=0 out_seq=0 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.866+0000 7f05357fa640 10 client.17517 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f05357fa640 1 -- 172.21.15.37:0/1749238546 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55de6c5535d0 con 0x55de6c1f39f0 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f05357fa640 10 client.17517 handle_command_reply: tid=0 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 client.17517 shutdown 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 -- 172.21.15.37:0/1749238546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 msgr2=0x55de6c5e9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c5e9e70 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f054402a900 tx=0x7f05440318b0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 -- 172.21.15.37:0/1749238546 shutdown_connections 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55de6c1f39f0 0x55de6c5fbe70 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c235070 0x55de6c5f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c214390 0x55de6c5ea3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f05357fa640 0 client.17517 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 --2- 172.21.15.37:0/1749238546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c5e9e70 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 -- 172.21.15.37:0/1749238546 >> 172.21.15.37:0/1749238546 conn(0x55de6c229460 msgr2=0x55de6c5dbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 -- 172.21.15.37:0/1749238546 shutdown_connections 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.867+0000 7f055a326740 1 -- 172.21.15.37:0/1749238546 wait complete. 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.868+0000 7f055a326740 20 client.17517 trim_cache size 0 max 16384 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055a326740 1 Processor -- start 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055a326740 1 -- start start 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055a326740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c20c1b0 0x55de6c5e5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055a326740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c214390 0x55de6c5ebd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055a326740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 0x55de6c5dba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055a326740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1af990 con 0x55de6c214390 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055a326740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ad260 con 0x55de6c235070 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055a326740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ab0d0 con 0x55de6c20c1b0 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055134c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c214390 0x55de6c5ebd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055134c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c214390 0x55de6c5ebd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56518/0 (socket says 172.21.15.37:56518) 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055134c640 1 -- 172.21.15.37:0/3287145202 learned_addr learned my addr 172.21.15.37:0/3287145202 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055234e640 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 0x55de6c5dba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055234e640 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c20c1b0 0x55de6c5e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055134c640 1 -- 172.21.15.37:0/3287145202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c20c1b0 msgr2=0x55de6c5e5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055134c640 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c20c1b0 0x55de6c5e5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055134c640 1 -- 172.21.15.37:0/3287145202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 msgr2=0x55de6c5dba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055134c640 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 0x55de6c5dba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055134c640 1 -- 172.21.15.37:0/3287145202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6c5db150 con 0x55de6c214390 2024-08-31T06:54:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.881+0000 7f055234e640 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c20c1b0 0x55de6c5e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.882+0000 7f055134c640 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c214390 0x55de6c5ebd50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f053c005ee0 tx=0x7f053c005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66488fcab28fe132 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.882+0000 7f05377fe640 1 -- 172.21.15.37:0/3287145202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c0049f0 con 0x55de6c214390 2024-08-31T06:54:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.882+0000 7f05377fe640 1 -- 172.21.15.37:0/3287145202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f053c01c030 con 0x55de6c214390 2024-08-31T06:54:45.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.882+0000 7f05377fe640 1 -- 172.21.15.37:0/3287145202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c00e410 con 0x55de6c214390 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 -- 172.21.15.37:0/3287145202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c214390 msgr2=0x55de6c5ebd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c214390 0x55de6c5ebd50 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f053c005ee0 tx=0x7f053c005e70 comp rx=0 tx=0).stop 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 -- 172.21.15.37:0/3287145202 shutdown_connections 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c214390 0x55de6c5ebd50 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 0x55de6c5dba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 --2- 172.21.15.37:0/3287145202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c20c1b0 0x55de6c5e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 -- 172.21.15.37:0/3287145202 >> 172.21.15.37:0/3287145202 conn(0x55de6c229460 msgr2=0x55de6c5db340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 -- 172.21.15.37:0/3287145202 shutdown_connections 2024-08-31T06:54:45.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 -- 172.21.15.37:0/3287145202 wait complete. 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 -- start start 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.883+0000 7f055a326740 1 Processor -- start 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055a326740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c65a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055a326740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 0x55de6c65acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055a326740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 0x55de6c665600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055a326740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1ab720 con 0x55de6c20c1b0 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055a326740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1acb90 con 0x55de6c235070 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055a326740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f054c1abdf0 con 0x55de6c214390 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055a326740 10 client.0 _ll_register_callbacks cb 0x7f0544031450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c65a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c65a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56534/0 (socket says 172.21.15.37:56534) 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 -- 172.21.15.37:0/412857208 learned_addr learned my addr 172.21.15.37:0/412857208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:45.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 -- 172.21.15.37:0/412857208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 msgr2=0x55de6c65acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 0x55de6c65acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 -- 172.21.15.37:0/412857208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 msgr2=0x55de6c665600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 0x55de6c665600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 -- 172.21.15.37:0/412857208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6c665b90 con 0x55de6c20c1b0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055234e640 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c65a780 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0544030690 tx=0x7f0544032d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87570cf0aacd32a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f05357fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f05357fa640 1 -- 172.21.15.37:0/412857208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544003b80 con 0x55de6c20c1b0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f055a326740 1 -- 172.21.15.37:0/412857208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f053c01c030 con 0x55de6c20c1b0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.884+0000 7f05357fa640 1 -- 172.21.15.37:0/412857208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f0544003d20 con 0x55de6c20c1b0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f05357fa640 1 -- 172.21.15.37:0/412857208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f054406e050 con 0x55de6c20c1b0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055a326740 10 client.17523 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055a326740 1 -- 172.21.15.37:0/412857208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55de6c666d80 con 0x55de6c20c1b0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f05357fa640 1 -- 172.21.15.37:0/412857208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f053c01c030 con 0x55de6c20c1b0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f05357fa640 1 -- 172.21.15.37:0/412857208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0544069030 con 0x55de6c20c1b0 2024-08-31T06:54:45.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055a326740 10 client.17523 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055a326740 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055a326740 20 client.17523 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055a326740 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55de6c1c8da0 0x55de6c6694e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055a326740 4 client.17523 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055a326740 1 -- 172.21.15.37:0/412857208 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55de6c54f070 con 0x55de6c1c8da0 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.885+0000 7f055134c640 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55de6c1c8da0 0x55de6c6694e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055134c640 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55de6c1c8da0 0x55de6c6694e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf3d278c3303855 server_cookie=bbfe32f46b90a633 in_seq=0 out_seq=0 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f05357fa640 10 client.17523 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f05357fa640 1 -- 172.21.15.37:0/412857208 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55de6c54f070 con 0x55de6c1c8da0 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f05357fa640 10 client.17523 handle_command_reply: tid=0 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 client.17523 shutdown 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 -- 172.21.15.37:0/412857208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 msgr2=0x55de6c65a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c65a780 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f0544030690 tx=0x7f0544032d90 comp rx=0 tx=0).stop 2024-08-31T06:54:45.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 -- 172.21.15.37:0/412857208 shutdown_connections 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55de6c1c8da0 0x55de6c6694e0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55de6c235070 0x55de6c665600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f05357fa640 0 client.17523 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55de6c214390 0x55de6c65acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 --2- 172.21.15.37:0/412857208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55de6c20c1b0 0x55de6c65a780 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 -- 172.21.15.37:0/412857208 >> 172.21.15.37:0/412857208 conn(0x55de6c229460 msgr2=0x55de6c5ebab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 -- 172.21.15.37:0/412857208 shutdown_connections 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 1 -- 172.21.15.37:0/412857208 wait complete. 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.886+0000 7f055a326740 20 client.17523 trim_cache size 0 max 16384 2024-08-31T06:54:45.901 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:54:45.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 -- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f05380b4d50 msgr2=0x7f05380b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f05380b4d50 0x7f05380b7260 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05480e2740 tx=0x7f05480035f0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 -- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c1047d0 msgr2=0x7f054c19a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c1047d0 0x7f054c19a170 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f054800d770 tx=0x7f054800dc30 comp rx=0 tx=0).stop 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 -- 172.21.15.37:0/3975735584 shutdown_connections 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f05380b4d50 0x7f05380b7260 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f054c10dc00 0x7f054c19f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f054c105120 0x7f054c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 --2- 172.21.15.37:0/3975735584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f054c1047d0 0x7f054c19a170 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 -- 172.21.15.37:0/3975735584 >> 172.21.15.37:0/3975735584 conn(0x7f054c079500 msgr2=0x7f054c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 -- 172.21.15.37:0/3975735584 shutdown_connections 2024-08-31T06:54:45.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:45.887+0000 7f0553db1640 1 -- 172.21.15.37:0/3975735584 wait complete. 2024-08-31T06:54:46.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:45 smithi037 ceph-mon[18612]: pgmap v561: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:46.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:45 smithi066 ceph-mon[22244]: pgmap v561: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:46.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:45 smithi106 ceph-mon[22134]: pgmap v561: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:47.598 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:54:47.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:54:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:47.986 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:47 smithi037 ceph-mon[18612]: pgmap v562: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:54:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:47 smithi066 ceph-mon[22244]: pgmap v562: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:54:48.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:47 smithi106 ceph-mon[22134]: pgmap v562: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:54:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 -- 172.21.15.37:0/1777117498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274102800 msgr2=0x7f0274102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 --2- 172.21.15.37:0/1777117498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274102800 0x7f0274102c10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0270009900 tx=0x7f027002a410 comp rx=0 tx=0).stop 2024-08-31T06:54:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 -- 172.21.15.37:0/1777117498 shutdown_connections 2024-08-31T06:54:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 --2- 172.21.15.37:0/1777117498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0274108a90 0x7f027410f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 --2- 172.21.15.37:0/1777117498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0274108140 0x7f0274108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 --2- 172.21.15.37:0/1777117498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274102800 0x7f0274102c10 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 -- 172.21.15.37:0/1777117498 >> 172.21.15.37:0/1777117498 conn(0x7f02740794d0 msgr2=0x7f02740798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 -- 172.21.15.37:0/1777117498 shutdown_connections 2024-08-31T06:54:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.367+0000 7f027bd41640 1 -- 172.21.15.37:0/1777117498 wait complete. 2024-08-31T06:54:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027bd41640 1 Processor -- start 2024-08-31T06:54:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027bd41640 1 -- start start 2024-08-31T06:54:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027bd41640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0274102800 0x7f027419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027bd41640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0274108140 0x7f027419a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027bd41640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274108a90 0x7f027419f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027bd41640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02741125a0 con 0x7f0274108a90 2024-08-31T06:54:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027bd41640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f0274112420 con 0x7f0274108140 2024-08-31T06:54:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027bd41640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f0274112720 con 0x7f0274102800 2024-08-31T06:54:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027a2de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274108a90 0x7f027419f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027a2de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274108a90 0x7f027419f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56542/0 (socket says 172.21.15.37:56542) 2024-08-31T06:54:48.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f027a2de640 1 -- 172.21.15.37:0/2884205352 learned_addr learned my addr 172.21.15.37:0/2884205352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f0279add640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0274102800 0x7f027419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.368+0000 7f02792dc640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0274108140 0x7f027419a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f027a2de640 1 -- 172.21.15.37:0/2884205352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0274102800 msgr2=0x7f027419a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f027a2de640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0274102800 0x7f027419a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f027a2de640 1 -- 172.21.15.37:0/2884205352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0274108140 msgr2=0x7f027419a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f027a2de640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0274108140 0x7f027419a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f027a2de640 1 -- 172.21.15.37:0/2884205352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027419ff70 con 0x7f0274108a90 2024-08-31T06:54:48.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f027a2de640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274108a90 0x7f027419f900 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f026c00cce0 tx=0x7f026c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f026affd640 1 -- 172.21.15.37:0/2884205352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c00f450 con 0x7f0274108a90 2024-08-31T06:54:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f027bd41640 1 -- 172.21.15.37:0/2884205352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02741a0260 con 0x7f0274108a90 2024-08-31T06:54:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f026affd640 1 -- 172.21.15.37:0/2884205352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f026c00fa80 con 0x7f0274108a90 2024-08-31T06:54:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f026affd640 1 -- 172.21.15.37:0/2884205352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c0189c0 con 0x7f0274108a90 2024-08-31T06:54:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.369+0000 7f027bd41640 1 -- 172.21.15.37:0/2884205352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02741a6a80 con 0x7f0274108a90 2024-08-31T06:54:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02822b6740 1 Processor -- start 2024-08-31T06:54:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f026affd640 1 -- 172.21.15.37:0/2884205352 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f026c00fc30 con 0x7f0274108a90 2024-08-31T06:54:48.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02822b6740 1 -- start start 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02822b6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b958350 0x56445bcfe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02822b6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b92f490 0x56445bcfecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02822b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bcff200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02822b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56445bc745f0 con 0x56445b937670 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02822b6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56445bc63b80 con 0x56445b92f490 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02822b6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56445bc67b30 con 0x56445b958350 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02792dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bcff200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02792dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bcff200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56546/0 (socket says 172.21.15.37:56546) 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.372+0000 7f02792dc640 1 -- 172.21.15.37:0/4084355742 learned_addr learned my addr 172.21.15.37:0/4084355742 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f0279add640 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b92f490 0x56445bcfecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f02792dc640 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b958350 0x56445bcfe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f026affd640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02600b4cd0 0x7f02600b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f02792dc640 1 -- 172.21.15.37:0/4084355742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b958350 msgr2=0x56445bcfe780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f02792dc640 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b958350 0x56445bcfe780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f02792dc640 1 -- 172.21.15.37:0/4084355742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b92f490 msgr2=0x56445bcfecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f02792dc640 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b92f490 0x56445bcfecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f02792dc640 1 -- 172.21.15.37:0/4084355742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445b9c3930 con 0x56445b937670 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f027a2de640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02600b4cd0 0x7f02600b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f02792dc640 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bcff200 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f026400afd0 tx=0x7f026400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef54f3b5a77be7a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f026affd640 1 -- 172.21.15.37:0/2884205352 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f026c0e58e0 con 0x7f0274108a90 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f025ffff640 1 -- 172.21.15.37:0/4084355742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264005220 con 0x56445b937670 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f025ffff640 1 -- 172.21.15.37:0/4084355742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02640047a0 con 0x56445b937670 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.373+0000 7f025ffff640 1 -- 172.21.15.37:0/4084355742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026400fa00 con 0x56445b937670 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 -- 172.21.15.37:0/4084355742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 msgr2=0x56445bcff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bcff200 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f026400afd0 tx=0x7f026400a7d0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f027a2de640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02600b4cd0 0x7f02600b71e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f026c0abf70 tx=0x7f026c079480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 -- 172.21.15.37:0/4084355742 shutdown_connections 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bcff200 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b92f490 0x56445bcfecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 --2- 172.21.15.37:0/4084355742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b958350 0x56445bcfe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 -- 172.21.15.37:0/4084355742 >> 172.21.15.37:0/4084355742 conn(0x56445b94c740 msgr2=0x56445bcfc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 -- 172.21.15.37:0/4084355742 shutdown_connections 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.374+0000 7f02822b6740 1 -- 172.21.15.37:0/4084355742 wait complete. 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 1 -- start start 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 1 Processor -- start 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd0e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd0e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd1a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56445bac6890 con 0x56445b937670 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x56445bbea790 con 0x56445b958350 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56445bd112c0 con 0x56445b92f490 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f02822b6740 10 client.0 _ll_register_callbacks cb 0x56445b96fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.375+0000 7f0279add640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd0e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f0279add640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd0e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56562/0 (socket says 172.21.15.37:56562) 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f0279add640 1 -- 172.21.15.37:0/2274108250 learned_addr learned my addr 172.21.15.37:0/2274108250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f02792dc640 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd0e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f02792dc640 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd1a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f0279add640 1 -- 172.21.15.37:0/2274108250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 msgr2=0x56445bd0e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f0279add640 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd0e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f0279add640 1 -- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 msgr2=0x56445bd1a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f0279add640 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd1a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f0279add640 1 -- 172.21.15.37:0/2274108250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445bc21f30 con 0x56445b937670 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f02792dc640 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd1a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f0279add640 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd0e8a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0270000c00 tx=0x7f0270031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbec4109b796bf70 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f025d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f025d7fa640 1 -- 172.21.15.37:0/2274108250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270035040 con 0x56445b937670 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f02822b6740 1 -- 172.21.15.37:0/2274108250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02640047a0 con 0x56445b937670 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f025d7fa640 1 -- 172.21.15.37:0/2274108250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f0270004250 con 0x56445b937670 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.376+0000 7f025d7fa640 1 -- 172.21.15.37:0/2274108250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0270004450 con 0x56445b937670 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02822b6740 10 client.17535 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02822b6740 1 -- 172.21.15.37:0/2274108250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56445bd1d150 con 0x56445b937670 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f025d7fa640 1 -- 172.21.15.37:0/2274108250 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02640047a0 con 0x56445b937670 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f025d7fa640 1 -- 172.21.15.37:0/2274108250 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f027004f670 con 0x56445b937670 2024-08-31T06:54:48.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02822b6740 10 client.17535 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02822b6740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02822b6740 20 client.17535 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02822b6740 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56445b916cd0 0x56445bd20630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02822b6740 4 client.17535 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02822b6740 1 -- 172.21.15.37:0/2274108250 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56445bc76540 con 0x56445b916cd0 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.377+0000 7f02792dc640 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56445b916cd0 0x56445bd20630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.378+0000 7f02792dc640 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56445b916cd0 0x56445bd20630 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf695efe404eb8d server_cookie=526814269466e1c1 in_seq=0 out_seq=0 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.378+0000 7f025d7fa640 10 client.17535 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.378+0000 7f025d7fa640 1 -- 172.21.15.37:0/2274108250 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56445bc76540 con 0x56445b916cd0 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.378+0000 7f025d7fa640 10 client.17535 handle_command_reply: tid=0 2024-08-31T06:54:48.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 client.17535 shutdown 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 -- 172.21.15.37:0/2274108250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 msgr2=0x56445bd0e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd0e8a0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0270000c00 tx=0x7f0270031630 comp rx=0 tx=0).stop 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 -- 172.21.15.37:0/2274108250 shutdown_connections 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56445b916cd0 0x56445bd20630 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd0e8a0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd1a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 --2- 172.21.15.37:0/2274108250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd0e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f025d7fa640 0 client.17535 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 -- 172.21.15.37:0/2274108250 >> 172.21.15.37:0/2274108250 conn(0x56445b94c740 msgr2=0x56445bcfac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 -- 172.21.15.37:0/2274108250 shutdown_connections 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 1 -- 172.21.15.37:0/2274108250 wait complete. 2024-08-31T06:54:48.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.379+0000 7f02822b6740 20 client.17535 trim_cache size 0 max 16384 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02822b6740 1 Processor -- start 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02822b6740 1 -- start start 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02822b6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd0ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02822b6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b937670 0x56445bd1a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02822b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b958350 0x56445bd1aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02822b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02741af8d0 con 0x56445b958350 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02822b6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f02741ad1a0 con 0x56445b937670 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02822b6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f02741ab010 con 0x56445b92f490 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02792dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b958350 0x56445bd1aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02792dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b958350 0x56445bd1aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56578/0 (socket says 172.21.15.37:56578) 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02792dc640 1 -- 172.21.15.37:0/3561378112 learned_addr learned my addr 172.21.15.37:0/3561378112 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:48.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f0279add640 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b937670 0x56445bd1a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.397+0000 7f02792dc640 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd0ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f02792dc640 1 -- 172.21.15.37:0/3561378112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 msgr2=0x56445bd0ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f02792dc640 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd0ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f02792dc640 1 -- 172.21.15.37:0/3561378112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b937670 msgr2=0x56445bd1a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f02792dc640 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b937670 0x56445bd1a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f02792dc640 1 -- 172.21.15.37:0/3561378112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56445bcff570 con 0x56445b958350 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f02792dc640 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b958350 0x56445bd1aa30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f0264011e80 tx=0x7f026400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c3ca789b34da5e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f025f7fe640 1 -- 172.21.15.37:0/3561378112 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264039070 con 0x56445b958350 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f025f7fe640 1 -- 172.21.15.37:0/3561378112 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0264020040 con 0x56445b958350 2024-08-31T06:54:48.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.398+0000 7f025f7fe640 1 -- 172.21.15.37:0/3561378112 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264032c10 con 0x56445b958350 2024-08-31T06:54:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 -- 172.21.15.37:0/3561378112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b958350 msgr2=0x56445bd1aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b958350 0x56445bd1aa30 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f0264011e80 tx=0x7f026400a7d0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 -- 172.21.15.37:0/3561378112 shutdown_connections 2024-08-31T06:54:48.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b958350 0x56445bd1aa30 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b937670 0x56445bd1a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 --2- 172.21.15.37:0/3561378112 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd0ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 -- 172.21.15.37:0/3561378112 >> 172.21.15.37:0/3561378112 conn(0x56445b94c740 msgr2=0x56445bd0f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 -- 172.21.15.37:0/3561378112 shutdown_connections 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 -- 172.21.15.37:0/3561378112 wait complete. 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 -- start start 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.399+0000 7f02822b6740 1 Processor -- start 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02822b6740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd13610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02822b6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd13b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02822b6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd14090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02822b6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f02741ab660 con 0x56445b937670 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02822b6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f02741acad0 con 0x56445b958350 2024-08-31T06:54:48.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02822b6740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f02741abd30 con 0x56445b92f490 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02822b6740 10 client.0 _ll_register_callbacks cb 0x7f0270009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f0279add640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd13b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f0279add640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd13b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56582/0 (socket says 172.21.15.37:56582) 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f0279add640 1 -- 172.21.15.37:0/1093677268 learned_addr learned my addr 172.21.15.37:0/1093677268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02792dc640 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd14090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f02792dc640 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd13610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f0279add640 1 -- 172.21.15.37:0/1093677268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 msgr2=0x56445bd13610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f0279add640 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd13610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f0279add640 1 -- 172.21.15.37:0/1093677268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 msgr2=0x56445bd14090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f0279add640 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd14090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.400+0000 7f0279add640 1 -- 172.21.15.37:0/1093677268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56445bd8b0b0 con 0x56445b937670 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f0279add640 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd13b50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f027004fc30 tx=0x7f02700318d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709ebacac7799b72 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f025d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f025d7fa640 1 -- 172.21.15.37:0/1093677268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0270035050 con 0x56445b937670 2024-08-31T06:54:48.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f025d7fa640 1 -- 172.21.15.37:0/1093677268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f02700035f0 con 0x56445b937670 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f02822b6740 1 -- 172.21.15.37:0/1093677268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0264020040 con 0x56445b937670 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f025d7fa640 1 -- 172.21.15.37:0/1093677268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0270060050 con 0x56445b937670 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f02822b6740 10 client.17541 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f02822b6740 1 -- 172.21.15.37:0/1093677268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56445bd8c370 con 0x56445b937670 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f025d7fa640 1 -- 172.21.15.37:0/1093677268 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0264020040 con 0x56445b937670 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f025d7fa640 1 -- 172.21.15.37:0/1093677268 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f027003c650 con 0x56445b937670 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f02822b6740 10 client.17541 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f02822b6740 10 client.17541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f02822b6740 20 client.17541 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.401+0000 7f02822b6740 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56445b8ec080 0x56445bd8eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.402+0000 7f02822b6740 4 client.17541 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.402+0000 7f02822b6740 1 -- 172.21.15.37:0/1093677268 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56445bc71fe0 con 0x56445b8ec080 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.402+0000 7f02792dc640 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56445b8ec080 0x56445bd8eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:48.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.402+0000 7f025d7fa640 10 client.17541 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:48.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.402+0000 7f02792dc640 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56445b8ec080 0x56445bd8eb60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b3c950d1fd0ab0 server_cookie=5efc1b84f6f66b79 in_seq=0 out_seq=0 2024-08-31T06:54:48.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f025d7fa640 1 -- 172.21.15.37:0/1093677268 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56445bc71fe0 con 0x56445b8ec080 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f025d7fa640 10 client.17541 handle_command_reply: tid=0 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 client.17541 shutdown 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 -- 172.21.15.37:0/1093677268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 msgr2=0x56445bd13b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd13b50 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f027004fc30 tx=0x7f02700318d0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 -- 172.21.15.37:0/1093677268 shutdown_connections 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56445b8ec080 0x56445bd8eb60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56445b937670 0x56445bd13b50 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56445b958350 0x56445bd14090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f025d7fa640 0 client.17541 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 --2- 172.21.15.37:0/1093677268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56445b92f490 0x56445bd13610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.404+0000 7f02822b6740 1 -- 172.21.15.37:0/1093677268 >> 172.21.15.37:0/1093677268 conn(0x56445b94c740 msgr2=0x56445bd0cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:48.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f02822b6740 1 -- 172.21.15.37:0/1093677268 shutdown_connections 2024-08-31T06:54:48.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f02822b6740 1 -- 172.21.15.37:0/1093677268 wait complete. 2024-08-31T06:54:48.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f02822b6740 20 client.17541 trim_cache size 0 max 16384 2024-08-31T06:54:48.409 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:48.409 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:54:48.409 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "232816fe-0f29-450c-bde6-cd0f5fca6fb1", 2024-08-31T06:54:48.409 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:54:48.409 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 -- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02600b4cd0 msgr2=0x7f02600b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02600b4cd0 0x7f02600b71e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f026c0abf70 tx=0x7f026c079480 comp rx=0 tx=0).stop 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 -- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274108a90 msgr2=0x7f027419f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274108a90 0x7f027419f900 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f026c00cce0 tx=0x7f026c00a620 comp rx=0 tx=0).stop 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 -- 172.21.15.37:0/2884205352 shutdown_connections 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f02600b4cd0 0x7f02600b71e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0274108a90 0x7f027419f900 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0274108140 0x7f027419a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 --2- 172.21.15.37:0/2884205352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0274102800 0x7f027419a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:48.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 -- 172.21.15.37:0/2884205352 >> 172.21.15.37:0/2884205352 conn(0x7f02740794d0 msgr2=0x7f0274101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:48.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 -- 172.21.15.37:0/2884205352 shutdown_connections 2024-08-31T06:54:48.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:48.405+0000 7f027bd41640 1 -- 172.21.15.37:0/2884205352 wait complete. 2024-08-31T06:54:49.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:48 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:54:49.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:48 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:49.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:48 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:54:49.077 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:48 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:49.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:54:49.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:48 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:54:49.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:48 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:49.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:48 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:54:49.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:48 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:49.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:48 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:54:49.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:48 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:49.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:48 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:54:49.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:48 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:54:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:54:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.796+0000 7f294ace2640 1 -- 172.21.15.37:0/3299729632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 msgr2=0x7f2944108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.796+0000 7f294ace2640 1 --2- 172.21.15.37:0/3299729632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 0x7f2944108590 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2934009900 tx=0x7f293402a410 comp rx=0 tx=0).stop 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.796+0000 7f294ace2640 1 -- 172.21.15.37:0/3299729632 shutdown_connections 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.796+0000 7f294ace2640 1 --2- 172.21.15.37:0/3299729632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 0x7f2944108590 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.796+0000 7f294ace2640 1 --2- 172.21.15.37:0/3299729632 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2944108ad0 0x7f294410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.796+0000 7f294ace2640 1 --2- 172.21.15.37:0/3299729632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2944102840 0x7f2944102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.796+0000 7f294ace2640 1 -- 172.21.15.37:0/3299729632 >> 172.21.15.37:0/3299729632 conn(0x7f29440794f0 msgr2=0x7f2944079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.796+0000 7f294ace2640 1 -- 172.21.15.37:0/3299729632 shutdown_connections 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.797+0000 7f294ace2640 1 -- 172.21.15.37:0/3299729632 wait complete. 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.797+0000 7f294ace2640 1 Processor -- start 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.797+0000 7f294ace2640 1 -- start start 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.797+0000 7f294ace2640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2944102840 0x7f294419a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.797+0000 7f294ace2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 0x7f294419a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.797+0000 7f294ace2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2944108ad0 0x7f294419fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f294ace2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2944113760 con 0x7f2944108180 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f294ace2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f29441135e0 con 0x7f2944108ad0 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f294ace2640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f29441138e0 con 0x7f2944102840 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 0x7f294419a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 0x7f294419a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56594/0 (socket says 172.21.15.37:56594) 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 -- 172.21.15.37:0/976291537 learned_addr learned my addr 172.21.15.37:0/976291537 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f2948a7e640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2944102840 0x7f294419a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f294927f640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2944108ad0 0x7f294419fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 -- 172.21.15.37:0/976291537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2944102840 msgr2=0x7f294419a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2944102840 0x7f294419a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 -- 172.21.15.37:0/976291537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2944108ad0 msgr2=0x7f294419fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2944108ad0 0x7f294419fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 -- 172.21.15.37:0/976291537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29441a0080 con 0x7f2944108180 2024-08-31T06:54:49.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f293bfff640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 0x7f294419a770 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2934005940 tx=0x7f29340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f2939ffb640 1 -- 172.21.15.37:0/976291537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293403f030 con 0x7f2944108180 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.798+0000 7f294ace2640 1 -- 172.21.15.37:0/976291537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29441a0310 con 0x7f2944108180 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.799+0000 7f2939ffb640 1 -- 172.21.15.37:0/976291537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2934003c90 con 0x7f2944108180 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.799+0000 7f2939ffb640 1 -- 172.21.15.37:0/976291537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934035070 con 0x7f2944108180 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.799+0000 7f294ace2640 1 -- 172.21.15.37:0/976291537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29441a0840 con 0x7f2944108180 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2951257740 1 Processor -- start 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2951257740 1 -- start start 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2939ffb640 1 -- 172.21.15.37:0/976291537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f2934042030 con 0x7f2944108180 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2951257740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e59300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2951257740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e59840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2951257740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e59d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2951257740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d4f8dd0630 con 0x55d4f8ab4070 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2951257740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d4f8dbfbc0 con 0x55d4f8a93390 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.801+0000 7f2951257740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55d4f8dc3b70 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e59300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e59300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56608/0 (socket says 172.21.15.37:56608) 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 -- 172.21.15.37:0/565066794 learned_addr learned my addr 172.21.15.37:0/565066794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f293bfff640 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e59d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f2948a7e640 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e59840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 -- 172.21.15.37:0/565066794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 msgr2=0x55d4f8e59840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e59840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 -- 172.21.15.37:0/565066794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 msgr2=0x55d4f8e59d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e59d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 -- 172.21.15.37:0/565066794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f8b1f650 con 0x55d4f8ab4070 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f2948a7e640 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e59840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f294927f640 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e59300 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f293c007f40 tx=0x7f293c00f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c948a7685cb6b31 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f2939ffb640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f292c0b4cd0 0x7f292c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f2948a7e640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f292c0b4cd0 0x7f292c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f2939ffb640 1 -- 172.21.15.37:0/976291537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f2934105a00 con 0x7f2944108180 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.802+0000 7f292affd640 1 -- 172.21.15.37:0/565066794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c010900 con 0x55d4f8ab4070 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f292affd640 1 -- 172.21.15.37:0/565066794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f293c0183f0 con 0x55d4f8ab4070 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f292affd640 1 -- 172.21.15.37:0/565066794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293c017600 con 0x55d4f8ab4070 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f2951257740 1 -- 172.21.15.37:0/565066794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 msgr2=0x55d4f8e59300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f2948a7e640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f292c0b4cd0 0x7f292c0b71e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55d4f8e57f80 tx=0x7f294000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f2951257740 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e59300 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f293c007f40 tx=0x7f293c00f850 comp rx=0 tx=0).stop 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f2951257740 1 -- 172.21.15.37:0/565066794 shutdown_connections 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f2951257740 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e59d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f2951257740 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e59840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f2951257740 1 --2- 172.21.15.37:0/565066794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e59300 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.803+0000 7f2951257740 1 -- 172.21.15.37:0/565066794 >> 172.21.15.37:0/565066794 conn(0x55d4f8aa8460 msgr2=0x55d4f8e571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 -- 172.21.15.37:0/565066794 shutdown_connections 2024-08-31T06:54:49.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 -- 172.21.15.37:0/565066794 wait complete. 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 -- start start 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 Processor -- start 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e68eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e693f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8ab4070 0x55d4f8e75140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d4f8c22700 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d4f8d46700 con 0x55d4f8a93390 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.804+0000 7f2951257740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55d4f8e6be10 con 0x55d4f8ab4070 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2951257740 10 client.0 _ll_register_callbacks cb 0x55d4f8d75dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e68eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e68eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56622/0 (socket says 172.21.15.37:56622) 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 -- 172.21.15.37:0/1719394532 learned_addr learned my addr 172.21.15.37:0/1719394532 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f294927f640 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8ab4070 0x55d4f8e75140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f293bfff640 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 -- 172.21.15.37:0/1719394532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8ab4070 msgr2=0x55d4f8e75140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8ab4070 0x55d4f8e75140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 -- 172.21.15.37:0/1719394532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 msgr2=0x55d4f8e693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 -- 172.21.15.37:0/1719394532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f8d7f8b0 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2948a7e640 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e68eb0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2940012a60 tx=0x7f29400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c752932ce0d578 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2923fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2923fff640 1 -- 172.21.15.37:0/1719394532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294000fce0 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2923fff640 1 -- 172.21.15.37:0/1719394532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f294001f420 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.805+0000 7f2951257740 1 -- 172.21.15.37:0/1719394532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f293c0183f0 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2923fff640 1 -- 172.21.15.37:0/1719394532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f294000fe80 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2951257740 10 client.17553 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2951257740 1 -- 172.21.15.37:0/1719394532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d4f8e77c20 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2923fff640 1 -- 172.21.15.37:0/1719394532 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f293c0183f0 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2923fff640 1 -- 172.21.15.37:0/1719394532 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f29400307a0 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2951257740 10 client.17553 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2951257740 10 client.17553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2951257740 20 client.17553 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2951257740 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4f8a729f0 0x55d4f8e7b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2951257740 4 client.17553 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f2951257740 1 -- 172.21.15.37:0/1719394532 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4f8dd2580 con 0x55d4f8a729f0 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.806+0000 7f293bfff640 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4f8a729f0 0x55d4f8e7b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.807+0000 7f2923fff640 10 client.17553 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.807+0000 7f293bfff640 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4f8a729f0 0x55d4f8e7b060 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae9ca36620e72dc8 server_cookie=3b786ac64f73312e in_seq=0 out_seq=0 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2923fff640 1 -- 172.21.15.37:0/1719394532 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4f8dd2580 con 0x55d4f8a729f0 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2923fff640 10 client.17553 handle_command_reply: tid=0 2024-08-31T06:54:49.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 client.17553 shutdown 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 -- 172.21.15.37:0/1719394532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a8b1b0 msgr2=0x55d4f8e68eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e68eb0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2940012a60 tx=0x7f29400046c0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 -- 172.21.15.37:0/1719394532 shutdown_connections 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4f8a729f0 0x55d4f8e7b060 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8ab4070 0x55d4f8e75140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2923fff640 0 client.17553 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 --2- 172.21.15.37:0/1719394532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e68eb0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 -- 172.21.15.37:0/1719394532 >> 172.21.15.37:0/1719394532 conn(0x55d4f8aa8460 msgr2=0x55d4f8e557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:49.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 -- 172.21.15.37:0/1719394532 shutdown_connections 2024-08-31T06:54:49.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 1 -- 172.21.15.37:0/1719394532 wait complete. 2024-08-31T06:54:49.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.808+0000 7f2951257740 20 client.17553 trim_cache size 0 max 16384 2024-08-31T06:54:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.826+0000 7f2951257740 1 Processor -- start 2024-08-31T06:54:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.826+0000 7f2951257740 1 -- start start 2024-08-31T06:54:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f2951257740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e5ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f2951257740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f2951257740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f2951257740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29441afb00 con 0x55d4f8ab4070 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f2951257740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f29441ad3d0 con 0x55d4f8a93390 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f2951257740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f29441ab240 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f294927f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f294927f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e665e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56626/0 (socket says 172.21.15.37:56626) 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f294927f640 1 -- 172.21.15.37:0/4291012786 learned_addr learned my addr 172.21.15.37:0/4291012786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f293bfff640 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f2948a7e640 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e5ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f293bfff640 1 -- 172.21.15.37:0/4291012786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 msgr2=0x55d4f8e5ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f293bfff640 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e5ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f293bfff640 1 -- 172.21.15.37:0/4291012786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 msgr2=0x55d4f8e665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f293bfff640 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f293bfff640 1 -- 172.21.15.37:0/4291012786 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f8e67e10 con 0x55d4f8a93390 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f294927f640 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.827+0000 7f2948a7e640 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e5ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.828+0000 7f293bfff640 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e660a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2934103160 tx=0x7f2934107f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e03f8c53d73102cb server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.828+0000 7f292a7fc640 1 -- 172.21.15.37:0/4291012786 <== mon.2 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934049040 con 0x55d4f8a93390 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.828+0000 7f292a7fc640 1 -- 172.21.15.37:0/4291012786 <== mon.2 v2:172.21.15.66:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2934003e40 con 0x55d4f8a93390 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.828+0000 7f292a7fc640 1 -- 172.21.15.37:0/4291012786 <== mon.2 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29341033e0 con 0x55d4f8a93390 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 -- 172.21.15.37:0/4291012786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 msgr2=0x55d4f8e660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e660a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2934103160 tx=0x7f2934107f10 comp rx=0 tx=0).stop 2024-08-31T06:54:49.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 -- 172.21.15.37:0/4291012786 shutdown_connections 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8ab4070 0x55d4f8e665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8a93390 0x55d4f8e660a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 --2- 172.21.15.37:0/4291012786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e5ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 -- 172.21.15.37:0/4291012786 >> 172.21.15.37:0/4291012786 conn(0x55d4f8aa8460 msgr2=0x55d4f8e5e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 -- 172.21.15.37:0/4291012786 shutdown_connections 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 -- 172.21.15.37:0/4291012786 wait complete. 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.829+0000 7f2951257740 1 -- start start 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2951257740 1 Processor -- start 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2951257740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2951257740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a93390 0x55d4f8e6dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2951257740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8ab4070 0x55d4f8e6e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2951257740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f29441ab890 con 0x55d4f8a93390 2024-08-31T06:54:49.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2951257740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f29441acd00 con 0x55d4f8ab4070 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2951257740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f29441abf60 con 0x55d4f8a8b1b0 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2951257740 10 client.0 _ll_register_callbacks cb 0x7f2940012730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f293bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a93390 0x55d4f8e6dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f293bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a93390 0x55d4f8e6dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56636/0 (socket says 172.21.15.37:56636) 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f293bfff640 1 -- 172.21.15.37:0/2079075599 learned_addr learned my addr 172.21.15.37:0/2079075599 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f294927f640 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8ab4070 0x55d4f8e6e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f2948a7e640 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.830+0000 7f293bfff640 1 -- 172.21.15.37:0/2079075599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 msgr2=0x55d4f8e716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f293bfff640 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f293bfff640 1 -- 172.21.15.37:0/2079075599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8ab4070 msgr2=0x55d4f8e6e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f293bfff640 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8ab4070 0x55d4f8e6e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f293bfff640 1 -- 172.21.15.37:0/2079075599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f8e6e6d0 con 0x55d4f8a93390 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2948a7e640 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:54:49.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f293bfff640 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a93390 0x55d4f8e6dba0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f29340cc140 tx=0x7f29340d5420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65958808e1d9ecf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2923fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2923fff640 1 -- 172.21.15.37:0/2079075599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f293410c030 con 0x55d4f8a93390 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2923fff640 1 -- 172.21.15.37:0/2079075599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8499+0+0 (secure 0 0 0) 0x7f29340c8440 con 0x55d4f8a93390 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2951257740 1 -- 172.21.15.37:0/2079075599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d4f8dce020 con 0x55d4f8a93390 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2923fff640 1 -- 172.21.15.37:0/2079075599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2934049030 con 0x55d4f8a93390 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2951257740 10 client.17559 fetch_fsmap learned FSMap version 25 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2951257740 1 -- 172.21.15.37:0/2079075599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d4f8ee67e0 con 0x55d4f8a93390 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.831+0000 7f2923fff640 1 -- 172.21.15.37:0/2079075599 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d4f8dce020 con 0x55d4f8a93390 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2923fff640 1 -- 172.21.15.37:0/2079075599 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f29340d4f90 con 0x55d4f8a93390 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2951257740 10 client.17559 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2951257740 10 client.17559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2951257740 20 client.17559 populate_metadata read hostname 'smithi037' 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2951257740 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4f8a47da0 0x55d4f8ee8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:54:49.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2951257740 4 client.17559 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2951257740 1 -- 172.21.15.37:0/2079075599 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d4f8dcb760 con 0x55d4f8a47da0 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2948a7e640 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4f8a47da0 0x55d4f8ee8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2923fff640 10 client.17559 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.832+0000 7f2948a7e640 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4f8a47da0 0x55d4f8ee8ea0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae9362ebe2903a server_cookie=225cb3a7debb4b76 in_seq=0 out_seq=0 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2923fff640 1 -- 172.21.15.37:0/2079075599 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x55d4f8dcb760 con 0x55d4f8a47da0 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2923fff640 10 client.17559 handle_command_reply: tid=0 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 client.17559 shutdown 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 -- 172.21.15.37:0/2079075599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a93390 msgr2=0x55d4f8e6dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a93390 0x55d4f8e6dba0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f29340cc140 tx=0x7f29340d5420 comp rx=0 tx=0).stop 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 -- 172.21.15.37:0/2079075599 shutdown_connections 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4f8a47da0 0x55d4f8ee8ea0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4f8a93390 0x55d4f8e6dba0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2923fff640 0 client.17559 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:54:49.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4f8ab4070 0x55d4f8e6e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 --2- 172.21.15.37:0/2079075599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4f8a8b1b0 0x55d4f8e716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 -- 172.21.15.37:0/2079075599 >> 172.21.15.37:0/2079075599 conn(0x55d4f8aa8460 msgr2=0x55d4f8e5a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 -- 172.21.15.37:0/2079075599 shutdown_connections 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 1 -- 172.21.15.37:0/2079075599 wait complete. 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.833+0000 7f2951257740 20 client.17559 trim_cache size 0 max 16384 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "232816fe-0f29-450c-bde6-cd0f5fca6fb1": { 2024-08-31T06:54:49.844 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "232816fe-0f29-450c-bde6-cd0f5fca6fb1", 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "232816fe-0f29-450c-bde6-cd0f5fca6fb1": { 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:48.402851+0000", 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.845 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "5235cd7a-0026-439c-bb69-023a1bfcedc7": { 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:26.646033+0000", 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.846 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.847 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.848 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.849 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.850 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.851 INFO:teuthology.orchestra.run.smithi037.stdout: "5fd7f13e-fd58-49db-8497-2a7be28cf588": { 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:37.375943+0000", 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.852 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.853 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.854 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:54:49.855 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:54:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 -- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f292c0b4cd0 msgr2=0x7f292c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f292c0b4cd0 0x7f292c0b71e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x55d4f8e57f80 tx=0x7f294000a2d0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 -- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 msgr2=0x7f294419a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:54:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 0x7f294419a770 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f2934005940 tx=0x7f29340042f0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 -- 172.21.15.37:0/976291537 shutdown_connections 2024-08-31T06:54:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f292c0b4cd0 0x7f292c0b71e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2944108180 0x7f294419a770 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2944108ad0 0x7f294419fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 --2- 172.21.15.37:0/976291537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2944102840 0x7f294419a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:54:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 -- 172.21.15.37:0/976291537 >> 172.21.15.37:0/976291537 conn(0x7f29440794f0 msgr2=0x7f2944104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:54:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 -- 172.21.15.37:0/976291537 shutdown_connections 2024-08-31T06:54:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:54:49.834+0000 7f294ace2640 1 -- 172.21.15.37:0/976291537 wait complete. 2024-08-31T06:54:50.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:49 smithi037 ceph-mon[18612]: pgmap v563: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:54:50.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:49 smithi066 ceph-mon[22244]: pgmap v563: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:54:50.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:49 smithi106 ceph-mon[22134]: pgmap v563: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:54:50.626 INFO:tasks.cephfs.filesystem:scrub status for tag:232816fe-0f29-450c-bde6-cd0f5fca6fb1 - {'path': '/', 'tag': '232816fe-0f29-450c-bde6-cd0f5fca6fb1', 'options': 'recursive,force'} 2024-08-31T06:54:52.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:51 smithi037 ceph-mon[18612]: pgmap v564: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6 op/s 2024-08-31T06:54:52.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:51 smithi066 ceph-mon[22244]: pgmap v564: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6 op/s 2024-08-31T06:54:52.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:51 smithi106 ceph-mon[22134]: pgmap v564: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 6 op/s 2024-08-31T06:54:53.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:52 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:54:53.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:52 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:54:53.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:52 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:54:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:53 smithi066 ceph-mon[22244]: pgmap v565: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-08-31T06:54:54.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:53 smithi106 ceph-mon[22134]: pgmap v565: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-08-31T06:54:54.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:53 smithi037 ceph-mon[18612]: pgmap v565: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 8 op/s 2024-08-31T06:54:56.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:55 smithi066 ceph-mon[22244]: pgmap v566: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:55 smithi106 ceph-mon[22134]: pgmap v566: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:56.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:55 smithi037 ceph-mon[18612]: pgmap v566: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5 op/s 2024-08-31T06:54:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:57 smithi066 ceph-mon[22244]: pgmap v567: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:54:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:57 smithi106 ceph-mon[22134]: pgmap v567: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:54:58.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:57 smithi037 ceph-mon[18612]: pgmap v567: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:55:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:59 smithi066 ceph-mon[22244]: pgmap v568: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:55:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:54:59 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:55:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:59 smithi106 ceph-mon[22134]: pgmap v568: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:55:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:54:59 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:55:00.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:59 smithi037 ceph-mon[18612]: pgmap v568: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:55:00.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:54:59 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:55:01.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:55:01.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:55:01.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:00 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:55:01.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:55:01.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:55:01.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:00 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:55:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:55:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:55:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:00 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:55:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:01 smithi066 ceph-mon[22244]: pgmap v569: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:55:02.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:01 smithi106 ceph-mon[22134]: pgmap v569: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:55:02.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:01 smithi037 ceph-mon[18612]: pgmap v569: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:55:04.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:03 smithi066 ceph-mon[22244]: pgmap v570: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:55:04.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:03 smithi106 ceph-mon[22134]: pgmap v570: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:55:04.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:03 smithi037 ceph-mon[18612]: pgmap v570: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:55:06.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:05 smithi066 ceph-mon[22244]: pgmap v571: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:55:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:05 smithi106 ceph-mon[22134]: pgmap v571: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:55:06.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:05 smithi037 ceph-mon[18612]: pgmap v571: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:55:08.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:07 smithi066 ceph-mon[22244]: pgmap v572: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:55:08.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:07 smithi106 ceph-mon[22134]: pgmap v572: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:55:08.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:07 smithi037 ceph-mon[18612]: pgmap v572: 97 pgs: 97 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:55:09.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:08 smithi106 ceph-mon[22134]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T06:55:09.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:08 smithi037 ceph-mon[18612]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T06:55:09.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:08 smithi066 ceph-mon[22244]: osdmap e81: 12 total, 12 up, 12 in 2024-08-31T06:55:10.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:09 smithi106 ceph-mon[22134]: pgmap v574: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:55:10.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:09 smithi037 ceph-mon[18612]: pgmap v574: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:55:10.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:09 smithi066 ceph-mon[22244]: pgmap v574: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 260 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:55:12.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:11 smithi106 ceph-mon[22134]: pgmap v575: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 232 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:55:12.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:11 smithi037 ceph-mon[18612]: pgmap v575: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 232 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:55:12.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:11 smithi066 ceph-mon[22244]: pgmap v575: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 232 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:55:14.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:13 smithi106 ceph-mon[22134]: pgmap v576: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 168 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:55:14.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:13 smithi037 ceph-mon[18612]: pgmap v576: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 168 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:55:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:13 smithi066 ceph-mon[22244]: pgmap v576: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 168 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:55:16.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:15 smithi106 ceph-mon[22134]: pgmap v577: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 152 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:55:16.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:15 smithi037 ceph-mon[18612]: pgmap v577: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 152 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:55:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:15 smithi066 ceph-mon[22244]: pgmap v577: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 152 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:55:17.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:16 smithi106 ceph-mon[22134]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-31T06:55:17.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:16 smithi037 ceph-mon[18612]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-31T06:55:17.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:16 smithi066 ceph-mon[22244]: Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-31T06:55:18.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:17 smithi106 ceph-mon[22134]: pgmap v578: 97 pgs: 12 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 61 active+clean; 87 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 5 op/s 2024-08-31T06:55:18.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:17 smithi037 ceph-mon[18612]: pgmap v578: 97 pgs: 12 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 61 active+clean; 87 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 5 op/s 2024-08-31T06:55:18.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:17 smithi066 ceph-mon[22244]: pgmap v578: 97 pgs: 12 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 61 active+clean; 87 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 204 B/s wr, 5 op/s 2024-08-31T06:55:20.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:19 smithi106 ceph-mon[22134]: pgmap v579: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 15 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 194 B/s wr, 5 op/s 2024-08-31T06:55:20.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:19 smithi037 ceph-mon[18612]: pgmap v579: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 15 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 194 B/s wr, 5 op/s 2024-08-31T06:55:20.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:19 smithi066 ceph-mon[22244]: pgmap v579: 97 pgs: 4 active+clean+snaptrim, 5 active+clean+snaptrim_wait, 88 active+clean; 15 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 194 B/s wr, 5 op/s 2024-08-31T06:55:20.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:55:20.896 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:55:21.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 -- 172.21.15.37:0/4179711786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30001023f0 msgr2=0x7f3000102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 --2- 172.21.15.37:0/4179711786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30001023f0 0x7f3000102800 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009900 tx=0x7f2ff002a480 comp rx=0 tx=0).stop 2024-08-31T06:55:21.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 -- 172.21.15.37:0/4179711786 shutdown_connections 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 --2- 172.21.15.37:0/4179711786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f300010ffa0 0x7f30001123c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 --2- 172.21.15.37:0/4179711786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3000102d40 0x7f300010fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 --2- 172.21.15.37:0/4179711786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30001023f0 0x7f3000102800 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 -- 172.21.15.37:0/4179711786 >> 172.21.15.37:0/4179711786 conn(0x7f30000794d0 msgr2=0x7f30000798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 -- 172.21.15.37:0/4179711786 shutdown_connections 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.376+0000 7f3004d0a640 1 -- 172.21.15.37:0/4179711786 wait complete. 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f3004d0a640 1 Processor -- start 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f3004d0a640 1 -- start start 2024-08-31T06:55:21.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f3004d0a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30001023f0 0x7f300019c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f3004d0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3000102d40 0x7f300019c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f3004d0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300010ffa0 0x7f30001a1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f3004d0a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30001158c0 con 0x7f300010ffa0 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f3004d0a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3000115740 con 0x7f3000102d40 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f3004d0a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3000115a40 con 0x7f30001023f0 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.377+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300010ffa0 0x7f30001a1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300010ffa0 0x7f30001a1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41560/0 (socket says 172.21.15.37:41560) 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffed9d640 1 -- 172.21.15.37:0/3646567241 learned_addr learned my addr 172.21.15.37:0/3646567241 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30001023f0 0x7f300019c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3000102d40 0x7f300019c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffed9d640 1 -- 172.21.15.37:0/3646567241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30001023f0 msgr2=0x7f300019c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffed9d640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30001023f0 0x7f300019c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffed9d640 1 -- 172.21.15.37:0/3646567241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3000102d40 msgr2=0x7f300019c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffed9d640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3000102d40 0x7f300019c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffed9d640 1 -- 172.21.15.37:0/3646567241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30001a2280 con 0x7f300010ffa0 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3000102d40 0x7f300019c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2ffed9d640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300010ffa0 0x7f30001a1b50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800eaa0 tx=0x7f2ff800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2fef7fe640 1 -- 172.21.15.37:0/3646567241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff800cdb0 con 0x7f300010ffa0 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f3004d0a640 1 -- 172.21.15.37:0/3646567241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30001a2570 con 0x7f300010ffa0 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2fef7fe640 1 -- 172.21.15.37:0/3646567241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff8005020 con 0x7f300010ffa0 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f2fef7fe640 1 -- 172.21.15.37:0/3646567241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80116d0 con 0x7f300010ffa0 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.378+0000 7f3004d0a640 1 -- 172.21.15.37:0/3646567241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30001a8cd0 con 0x7f300010ffa0 2024-08-31T06:55:21.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.381+0000 7f2fef7fe640 1 -- 172.21.15.37:0/3646567241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f2ff80051d0 con 0x7f300010ffa0 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.381+0000 7f300b27f740 1 Processor -- start 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.381+0000 7f300b27f740 1 -- start start 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f300b27f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x5563407d4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f300b27f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 0x5563407d4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f300b27f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f300b27f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55634074b630 con 0x55634040e390 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f300b27f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55634073abc0 con 0x55634042f070 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f300b27f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55634073eb70 con 0x5563404061b0 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407d4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407d4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41566/0 (socket says 172.21.15.37:41566) 2024-08-31T06:55:21.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 -- 172.21.15.37:0/961932393 learned_addr learned my addr 172.21.15.37:0/961932393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x5563407d4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 0x5563407d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2fef7fe640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2fe80b4ca0 0x7f2fe80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffed9d640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2fe80b4ca0 0x7f2fe80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 -- 172.21.15.37:0/961932393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 msgr2=0x5563407d4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 0x5563407d4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2fef7fe640 1 -- 172.21.15.37:0/3646567241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8543+0+0 (secure 0 0 0) 0x7f2ff80e56d0 con 0x7f300010ffa0 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 -- 172.21.15.37:0/961932393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 msgr2=0x5563407d4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x5563407d4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.382+0000 7f2ffdd9b640 1 -- 172.21.15.37:0/961932393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55634049a650 con 0x55634040e390 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.383+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407d4d80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4005bc0 tx=0x7f2ff400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6fea8cdb6055a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.383+0000 7f2ffed9d640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2fe80b4ca0 0x7f2fe80b71b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80e2ec0 tx=0x7f2ff8005b20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:21.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.383+0000 7f2fecff9640 1 -- 172.21.15.37:0/961932393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004030 con 0x55634040e390 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.383+0000 7f2fecff9640 1 -- 172.21.15.37:0/961932393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff4005020 con 0x55634040e390 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.383+0000 7f2fecff9640 1 -- 172.21.15.37:0/961932393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004a00 con 0x55634040e390 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 -- 172.21.15.37:0/961932393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 msgr2=0x5563407d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407d4d80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4005bc0 tx=0x7f2ff400b5b0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 -- 172.21.15.37:0/961932393 shutdown_connections 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407d4d80 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 0x5563407d4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 --2- 172.21.15.37:0/961932393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x5563407d4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 -- 172.21.15.37:0/961932393 >> 172.21.15.37:0/961932393 conn(0x556340423460 msgr2=0x5563407d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 -- 172.21.15.37:0/961932393 shutdown_connections 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 -- 172.21.15.37:0/961932393 wait complete. 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 -- start start 2024-08-31T06:55:21.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.384+0000 7f300b27f740 1 Processor -- start 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f300b27f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 0x5563407df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f300b27f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407dff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f300b27f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634042f070 0x5563407ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f300b27f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55634059d700 con 0x55634040e390 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f300b27f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5563406c1700 con 0x5563404061b0 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f300b27f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5563407e2ae0 con 0x55634042f070 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f300b27f740 10 client.0 _ll_register_callbacks cb 0x5563406f0dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407dff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41574/0 (socket says 172.21.15.37:41574) 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 -- 172.21.15.37:0/2488671577 learned_addr learned my addr 172.21.15.37:0/2488671577 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634042f070 0x5563407ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 0x5563407df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 -- 172.21.15.37:0/2488671577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634042f070 msgr2=0x5563407ebdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634042f070 0x5563407ebdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 -- 172.21.15.37:0/2488671577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 msgr2=0x5563407df9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 0x5563407df9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 -- 172.21.15.37:0/2488671577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563406fa8b0 con 0x55634040e390 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407dff30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f2ff002a9a0 tx=0x7f2ff0031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a1b49b1e2a84d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2fe5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.385+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/2488671577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0035040 con 0x55634040e390 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/2488671577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8543+0+0 (secure 0 0 0) 0x7f2ff0004240 con 0x55634040e390 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 1 -- 172.21.15.37:0/2488671577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff4005020 con 0x55634040e390 2024-08-31T06:55:21.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/2488671577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ff0031850 con 0x55634040e390 2024-08-31T06:55:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 10 client.17571 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 1 -- 172.21.15.37:0/2488671577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5563407ee820 con 0x55634040e390 2024-08-31T06:55:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/2488671577 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff4005020 con 0x55634040e390 2024-08-31T06:55:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/2488671577 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2ff003c440 con 0x55634040e390 2024-08-31T06:55:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 10 client.17571 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:55:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 20 client.17571 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:21.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5563403ed9f0 0x5563407f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 4 client.17571 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:55:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.386+0000 7f300b27f740 1 -- 172.21.15.37:0/2488671577 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55634074d580 con 0x5563403ed9f0 2024-08-31T06:55:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.387+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5563403ed9f0 0x5563407f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.387+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5563403ed9f0 0x5563407f1dc0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5c704b8c31d443 server_cookie=60b3d57ffa3da0ca in_seq=0 out_seq=0 2024-08-31T06:55:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.387+0000 7f2fe5ffb640 10 client.17571 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/2488671577 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55634074d580 con 0x5563403ed9f0 2024-08-31T06:55:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f2fe5ffb640 10 client.17571 handle_command_reply: tid=0 2024-08-31T06:55:21.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 client.17571 shutdown 2024-08-31T06:55:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 -- 172.21.15.37:0/2488671577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 msgr2=0x5563407dff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407dff30 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f2ff002a9a0 tx=0x7f2ff0031f20 comp rx=0 tx=0).stop 2024-08-31T06:55:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 -- 172.21.15.37:0/2488671577 shutdown_connections 2024-08-31T06:55:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5563403ed9f0 0x5563407f1dc0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407dff30 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f2fe5ffb640 0 client.17571 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634042f070 0x5563407ebdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 --2- 172.21.15.37:0/2488671577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 0x5563407df9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 -- 172.21.15.37:0/2488671577 >> 172.21.15.37:0/2488671577 conn(0x556340423460 msgr2=0x5563407d74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 -- 172.21.15.37:0/2488671577 shutdown_connections 2024-08-31T06:55:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 1 -- 172.21.15.37:0/2488671577 wait complete. 2024-08-31T06:55:21.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.388+0000 7f300b27f740 20 client.17571 trim_cache size 0 max 16384 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.406+0000 7f300b27f740 1 Processor -- start 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.406+0000 7f300b27f740 1 -- start start 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f300b27f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 0x5563407e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f300b27f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634040e390 0x5563407d5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f300b27f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634042f070 0x5563407ebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f300b27f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b3e20 con 0x55634042f070 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f300b27f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b16f0 con 0x5563404061b0 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f300b27f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f30001af560 con 0x55634040e390 2024-08-31T06:55:21.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634042f070 0x5563407ebcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634042f070 0x5563407ebcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41576/0 (socket says 172.21.15.37:41576) 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 -- 172.21.15.37:0/2669482189 learned_addr learned my addr 172.21.15.37:0/2669482189 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634040e390 0x5563407d5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 0x5563407e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 -- 172.21.15.37:0/2669482189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634040e390 msgr2=0x5563407d5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634040e390 0x5563407d5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 -- 172.21.15.37:0/2669482189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 msgr2=0x5563407e18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 0x5563407e18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 -- 172.21.15.37:0/2669482189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563407ddef0 con 0x55634042f070 2024-08-31T06:55:21.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.407+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634042f070 0x5563407ebcd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4014440 tx=0x7f2ff400b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4905c93011a10960 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f2fe7fff640 1 -- 172.21.15.37:0/2669482189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400bcb0 con 0x55634042f070 2024-08-31T06:55:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f2fe7fff640 1 -- 172.21.15.37:0/2669482189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff402f070 con 0x55634042f070 2024-08-31T06:55:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f2fe7fff640 1 -- 172.21.15.37:0/2669482189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400fc20 con 0x55634042f070 2024-08-31T06:55:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f300b27f740 1 -- 172.21.15.37:0/2669482189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634042f070 msgr2=0x5563407ebcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f300b27f740 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634042f070 0x5563407ebcd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4014440 tx=0x7f2ff400b510 comp rx=0 tx=0).stop 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f300b27f740 1 -- 172.21.15.37:0/2669482189 shutdown_connections 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f300b27f740 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634042f070 0x5563407ebcd0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f300b27f740 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55634040e390 0x5563407d5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f300b27f740 1 --2- 172.21.15.37:0/2669482189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5563404061b0 0x5563407e18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.408+0000 7f300b27f740 1 -- 172.21.15.37:0/2669482189 >> 172.21.15.37:0/2669482189 conn(0x556340423460 msgr2=0x5563407d7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 -- 172.21.15.37:0/2669482189 shutdown_connections 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 -- 172.21.15.37:0/2669482189 wait complete. 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 -- start start 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 Processor -- start 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 0x5563407e47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407e4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x556340855850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f30001afbb0 con 0x55634040e390 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b1020 con 0x55634042f070 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f30001b0280 con 0x5563404061b0 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.409+0000 7f300b27f740 10 client.0 _ll_register_callbacks cb 0x7f2ff0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407e4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407e4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41590/0 (socket says 172.21.15.37:41590) 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 -- 172.21.15.37:0/481058521 learned_addr learned my addr 172.21.15.37:0/481058521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 0x5563407e47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x556340855850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 -- 172.21.15.37:0/481058521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 msgr2=0x5563407e47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 0x5563407e47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 -- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 msgr2=0x556340855850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x556340855850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 -- 172.21.15.37:0/481058521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556340855ec0 con 0x55634040e390 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x556340855850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2ffe59c640 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407e4da0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009850 tx=0x7f2ff003c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00b5dd4b44f9eb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2fe5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/481058521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0052070 con 0x55634040e390 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/481058521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8543+0+0 (secure 0 0 0) 0x7f2ff003ccb0 con 0x55634040e390 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f300b27f740 1 -- 172.21.15.37:0/481058521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff402f070 con 0x55634040e390 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/481058521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2ff005b050 con 0x55634040e390 2024-08-31T06:55:21.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f300b27f740 10 client.17577 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.410+0000 7f300b27f740 1 -- 172.21.15.37:0/481058521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55634085d2c0 con 0x55634040e390 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/481058521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff402f070 con 0x55634040e390 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/481058521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2ff0055020 con 0x55634040e390 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f300b27f740 10 client.17577 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f300b27f740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f300b27f740 20 client.17577 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f300b27f740 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5563403c2da0 0x55634085fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f300b27f740 4 client.17577 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f300b27f740 1 -- 172.21.15.37:0/481058521 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556340749020 con 0x5563403c2da0 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.411+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5563403c2da0 0x55634085fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:21.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f2ffdd9b640 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5563403c2da0 0x55634085fab0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f902f020fbbe1e19 server_cookie=f4e2f6fd6e02eb1b in_seq=0 out_seq=0 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f2fe5ffb640 10 client.17577 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f2fe5ffb640 1 -- 172.21.15.37:0/481058521 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x556340749020 con 0x5563403c2da0 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f2fe5ffb640 10 client.17577 handle_command_reply: tid=0 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 client.17577 shutdown 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 -- 172.21.15.37:0/481058521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 msgr2=0x5563407e4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407e4da0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009850 tx=0x7f2ff003c670 comp rx=0 tx=0).stop 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 -- 172.21.15.37:0/481058521 shutdown_connections 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5563403c2da0 0x55634085fab0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55634040e390 0x5563407e4da0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55634042f070 0x556340855850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 --2- 172.21.15.37:0/481058521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5563404061b0 0x5563407e47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 -- 172.21.15.37:0/481058521 >> 172.21.15.37:0/481058521 conn(0x556340423460 msgr2=0x5563407d73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f2fe5ffb640 0 client.17577 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:21.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 -- 172.21.15.37:0/481058521 shutdown_connections 2024-08-31T06:55:21.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 1 -- 172.21.15.37:0/481058521 wait complete. 2024-08-31T06:55:21.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.412+0000 7f300b27f740 20 client.17577 trim_cache size 0 max 16384 2024-08-31T06:55:21.419 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:55:21.419 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:55:21.419 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:55:21.419 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:55:21.419 INFO:teuthology.orchestra.run.smithi037.stdout: "232816fe-0f29-450c-bde6-cd0f5fca6fb1": { 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:48.402851+0000", 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "5235cd7a-0026-439c-bb69-023a1bfcedc7": { 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:26.646033+0000", 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.420 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.421 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:55:21.422 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.424 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: "5fd7f13e-fd58-49db-8497-2a7be28cf588": { 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:37.375943+0000", 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:55:21.428 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:55:21.429 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:21.429 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:21.429 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:21.429 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:21.429 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:21.429 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:55:21.429 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:55:21.429 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:55:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 -- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2fe80b4ca0 msgr2=0x7f2fe80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2fe80b4ca0 0x7f2fe80b71b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80e2ec0 tx=0x7f2ff8005b20 comp rx=0 tx=0).stop 2024-08-31T06:55:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 -- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300010ffa0 msgr2=0x7f30001a1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300010ffa0 0x7f30001a1b50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800eaa0 tx=0x7f2ff800ef60 comp rx=0 tx=0).stop 2024-08-31T06:55:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 -- 172.21.15.37:0/3646567241 shutdown_connections 2024-08-31T06:55:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2fe80b4ca0 0x7f2fe80b71b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f300010ffa0 0x7f30001a1b50 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3000102d40 0x7f300019c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 --2- 172.21.15.37:0/3646567241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30001023f0 0x7f300019c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 -- 172.21.15.37:0/3646567241 >> 172.21.15.37:0/3646567241 conn(0x7f30000794d0 msgr2=0x7f30001114b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 -- 172.21.15.37:0/3646567241 shutdown_connections 2024-08-31T06:55:21.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:21.413+0000 7f3004d0a640 1 -- 172.21.15.37:0/3646567241 wait complete. 2024-08-31T06:55:22.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:21 smithi106 ceph-mon[22134]: pgmap v580: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:55:22.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:21 smithi106 ceph-mon[22134]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T06:55:22.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:21 smithi037 ceph-mon[18612]: pgmap v580: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:55:22.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:22 smithi037 ceph-mon[18612]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T06:55:22.352 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:55:22.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:55:22.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:21 smithi066 ceph-mon[22244]: pgmap v580: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-31T06:55:22.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:21 smithi066 ceph-mon[22244]: osdmap e82: 12 total, 12 up, 12 in 2024-08-31T06:55:22.609 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:55:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 -- 172.21.15.37:0/1307076439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc109240 msgr2=0x7f7cdc109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/1307076439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc109240 0x7f7cdc109650 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009900 tx=0x7f7ccc02a410 comp rx=0 tx=0).stop 2024-08-31T06:55:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 -- 172.21.15.37:0/1307076439 shutdown_connections 2024-08-31T06:55:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/1307076439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc109240 0x7f7cdc109650 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/1307076439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cdc109b90 0x7f7cdc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/1307076439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cdc103900 0x7f7cdc103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 -- 172.21.15.37:0/1307076439 >> 172.21.15.37:0/1307076439 conn(0x7f7cdc07b5f0 msgr2=0x7f7cdc07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 -- 172.21.15.37:0/1307076439 shutdown_connections 2024-08-31T06:55:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 -- 172.21.15.37:0/1307076439 wait complete. 2024-08-31T06:55:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.099+0000 7f7ce37f6640 1 Processor -- start 2024-08-31T06:55:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce37f6640 1 -- start start 2024-08-31T06:55:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce37f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc103900 0x7f7cdc19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce37f6640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cdc109240 0x7f7cdc19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce37f6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cdc109b90 0x7f7cdc19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce37f6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc113700 con 0x7f7cdc103900 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce37f6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc113580 con 0x7f7cdc109b90 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce37f6640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc113880 con 0x7f7cdc109240 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc103900 0x7f7cdc19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc103900 0x7f7cdc19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41614/0 (socket says 172.21.15.37:41614) 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 -- 172.21.15.37:0/623843492 learned_addr learned my addr 172.21.15.37:0/623843492 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce0d91640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cdc109240 0x7f7cdc19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1d93640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cdc109b90 0x7f7cdc19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 -- 172.21.15.37:0/623843492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cdc109240 msgr2=0x7f7cdc19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cdc109240 0x7f7cdc19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 -- 172.21.15.37:0/623843492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cdc109b90 msgr2=0x7f7cdc19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cdc109b90 0x7f7cdc19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 -- 172.21.15.37:0/623843492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc1a00e0 con 0x7f7cdc103900 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.100+0000 7f7ce1592640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc103900 0x7f7cdc19a230 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c920 tx=0x7f7cd800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.101+0000 7f7cd27fc640 1 -- 172.21.15.37:0/623843492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8007c70 con 0x7f7cdc103900 2024-08-31T06:55:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.101+0000 7f7cd27fc640 1 -- 172.21.15.37:0/623843492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7cd8007e10 con 0x7f7cdc103900 2024-08-31T06:55:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.101+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc1a03d0 con 0x7f7cdc103900 2024-08-31T06:55:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.101+0000 7f7cd27fc640 1 -- 172.21.15.37:0/623843492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8018710 con 0x7f7cdc103900 2024-08-31T06:55:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.101+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc1a6bf0 con 0x7f7cdc103900 2024-08-31T06:55:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.102+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cdc103d10 con 0x7f7cdc103900 2024-08-31T06:55:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.103+0000 7f7cd27fc640 1 -- 172.21.15.37:0/623843492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f7cd800f450 con 0x7f7cdc103900 2024-08-31T06:55:23.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.104+0000 7f7cd27fc640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7cc80b4d50 0x7f7cc80b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.104+0000 7f7ce0d91640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7cc80b4d50 0x7f7cc80b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.104+0000 7f7cd27fc640 1 -- 172.21.15.37:0/623843492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f7cd80e5740 con 0x7f7cdc103900 2024-08-31T06:55:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.105+0000 7f7ce0d91640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7cc80b4d50 0x7f7cc80b7260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0057c0 tx=0x7f7ccc000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:23.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.109+0000 7f7cd27fc640 1 -- 172.21.15.37:0/623843492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7cd8014030 con 0x7f7cdc103900 2024-08-31T06:55:23.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.331+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cdc19b360 con 0x7f7cdc103900 2024-08-31T06:55:23.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.332+0000 7f7cd27fc640 1 -- 172.21.15.37:0/623843492 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f7cd80ac540 con 0x7f7cdc103900 2024-08-31T06:55:23.333 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:55:23.333 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:55:23.333 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:55:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7cc80b4d50 msgr2=0x7f7cc80b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7cc80b4d50 0x7f7cc80b7260 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0057c0 tx=0x7f7ccc000bc0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc103900 msgr2=0x7f7cdc19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc103900 0x7f7cdc19a230 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c920 tx=0x7f7cd800cde0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 shutdown_connections 2024-08-31T06:55:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f7cc80b4d50 0x7f7cc80b7260 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7cdc109b90 0x7f7cdc19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cdc109240 0x7f7cdc19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 --2- 172.21.15.37:0/623843492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc103900 0x7f7cdc19a230 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 >> 172.21.15.37:0/623843492 conn(0x7f7cdc07b5f0 msgr2=0x7f7cdc107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 shutdown_connections 2024-08-31T06:55:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:23.334+0000 7f7ce37f6640 1 -- 172.21.15.37:0/623843492 wait complete. 2024-08-31T06:55:24.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:55:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:23 smithi106 ceph-mon[22134]: pgmap v582: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-08-31T06:55:24.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:23 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/623843492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:55:24.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:23 smithi037 ceph-mon[18612]: pgmap v582: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-08-31T06:55:24.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:23 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/623843492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:55:24.370 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:55:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:23 smithi066 ceph-mon[22244]: pgmap v582: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-08-31T06:55:24.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:23 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/623843492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:55:24.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.842+0000 7f45c01e4640 1 -- 172.21.15.37:0/2027129988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8109be0 msgr2=0x7f45b8110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.842+0000 7f45c01e4640 1 --2- 172.21.15.37:0/2027129988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8109be0 0x7f45b8110410 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009ca0 tx=0x7f45b002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.842+0000 7f45c01e4640 1 -- 172.21.15.37:0/2027129988 shutdown_connections 2024-08-31T06:55:24.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.843+0000 7f45c01e4640 1 --2- 172.21.15.37:0/2027129988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8109be0 0x7f45b8110410 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.843+0000 7f45c01e4640 1 --2- 172.21.15.37:0/2027129988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45b8109290 0x7f45b81096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.843+0000 7f45c01e4640 1 --2- 172.21.15.37:0/2027129988 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45b8103950 0x7f45b8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.843+0000 7f45c01e4640 1 -- 172.21.15.37:0/2027129988 >> 172.21.15.37:0/2027129988 conn(0x7f45b80ff3a0 msgr2=0x7f45b81017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.843+0000 7f45c01e4640 1 -- 172.21.15.37:0/2027129988 shutdown_connections 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.843+0000 7f45c01e4640 1 -- 172.21.15.37:0/2027129988 wait complete. 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.843+0000 7f45c01e4640 1 Processor -- start 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.843+0000 7f45c01e4640 1 -- start start 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45c01e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8103950 0x7f45b819a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45c01e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45b8109290 0x7f45b819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45c01e4640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45b8109be0 0x7f45b819f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45c01e4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81137a0 con 0x7f45b8103950 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45c01e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8113620 con 0x7f45b8109290 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45c01e4640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8113920 con 0x7f45b8109be0 2024-08-31T06:55:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8103950 0x7f45b819a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8103950 0x7f45b819a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44670/0 (socket says 172.21.15.37:44670) 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 -- 172.21.15.37:0/815773220 learned_addr learned my addr 172.21.15.37:0/815773220 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bd77f640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45b8109290 0x7f45b819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45be781640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45b8109be0 0x7f45b819f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 -- 172.21.15.37:0/815773220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45b8109be0 msgr2=0x7f45b819f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45b8109be0 0x7f45b819f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 -- 172.21.15.37:0/815773220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45b8109290 msgr2=0x7f45b819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45b8109290 0x7f45b819a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 -- 172.21.15.37:0/815773220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b81a00c0 con 0x7f45b8103950 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45be781640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45b8109be0 0x7f45b819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45bdf80640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8103950 0x7f45b819a150 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f45b400d950 tx=0x7f45b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.844+0000 7f45aeffd640 1 -- 172.21.15.37:0/815773220 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4017070 con 0x7f45b8103950 2024-08-31T06:55:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.845+0000 7f45c01e4640 1 -- 172.21.15.37:0/815773220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b81a03b0 con 0x7f45b8103950 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.845+0000 7f45aeffd640 1 -- 172.21.15.37:0/815773220 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45b4009c30 con 0x7f45b8103950 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.845+0000 7f45aeffd640 1 -- 172.21.15.37:0/815773220 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b400f620 con 0x7f45b8103950 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.845+0000 7f45c01e4640 1 -- 172.21.15.37:0/815773220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b81a6b10 con 0x7f45b8103950 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45c6759740 1 Processor -- start 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45c6759740 1 -- start start 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45aeffd640 1 -- 172.21.15.37:0/815773220 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f45b4010460 con 0x7f45b8103950 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45c6759740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda874310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45c6759740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda874850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45c6759740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 0x558cda874d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45c6759740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558cda7eb680 con 0x558cda4cf070 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45c6759740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558cda7dac10 con 0x558cda4a61b0 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.847+0000 7f45c6759740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558cda7debc0 con 0x558cda4ae390 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda874310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda874310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44686/0 (socket says 172.21.15.37:44686) 2024-08-31T06:55:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 -- 172.21.15.37:0/1272834155 learned_addr learned my addr 172.21.15.37:0/1272834155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45bdf80640 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda874850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45bd77f640 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 0x558cda874d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 -- 172.21.15.37:0/1272834155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 msgr2=0x558cda874d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 0x558cda874d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 -- 172.21.15.37:0/1272834155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 msgr2=0x558cda874850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda874850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 -- 172.21.15.37:0/1272834155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cda53a650 con 0x558cda4cf070 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45bdf80640 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda874850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45be781640 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda874310 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f45b00094e0 tx=0x7f45b0009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ea2842c64cf8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45aeffd640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45a40b4ca0 0x7f45a40b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.848+0000 7f45a3fff640 1 -- 172.21.15.37:0/1272834155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0031980 con 0x558cda4cf070 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.849+0000 7f45a3fff640 1 -- 172.21.15.37:0/1272834155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45b0036040 con 0x558cda4cf070 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.849+0000 7f45bdf80640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45a40b4ca0 0x7f45a40b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.849+0000 7f45a3fff640 1 -- 172.21.15.37:0/1272834155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0004480 con 0x558cda4cf070 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.849+0000 7f45aeffd640 1 -- 172.21.15.37:0/815773220 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f45b40e50e0 con 0x7f45b8103950 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 -- 172.21.15.37:0/1272834155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 msgr2=0x558cda874310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda874310 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f45b00094e0 tx=0x7f45b0009a20 comp rx=0 tx=0).stop 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45bdf80640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45a40b4ca0 0x7f45a40b71b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f45b40e2990 tx=0x7f45b4005880 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 -- 172.21.15.37:0/1272834155 shutdown_connections 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 0x558cda874d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda874850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 --2- 172.21.15.37:0/1272834155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda874310 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 -- 172.21.15.37:0/1272834155 >> 172.21.15.37:0/1272834155 conn(0x558cda4c3460 msgr2=0x558cda872200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 -- 172.21.15.37:0/1272834155 shutdown_connections 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 -- 172.21.15.37:0/1272834155 wait complete. 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 -- start start 2024-08-31T06:55:24.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.850+0000 7f45c6759740 1 Processor -- start 2024-08-31T06:55:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45c6759740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4a61b0 0x558cda883e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45c6759740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4ae390 0x558cda8843b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45c6759740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 0x558cda890120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45c6759740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558cda63d700 con 0x558cda4a61b0 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45c6759740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558cda761750 con 0x558cda4ae390 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45c6759740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558cda886df0 con 0x558cda4cf070 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45c6759740 10 client.0 _ll_register_callbacks cb 0x558cda790e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45be781640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4a61b0 0x558cda883e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45be781640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4a61b0 0x558cda883e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44694/0 (socket says 172.21.15.37:44694) 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45be781640 1 -- 172.21.15.37:0/1122708537 learned_addr learned my addr 172.21.15.37:0/1122708537 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45bd77f640 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4ae390 0x558cda8843b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45be781640 1 -- 172.21.15.37:0/1122708537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 msgr2=0x558cda890120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45be781640 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 0x558cda890120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45be781640 1 -- 172.21.15.37:0/1122708537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4ae390 msgr2=0x558cda8843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45be781640 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4ae390 0x558cda8843b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.851+0000 7f45be781640 1 -- 172.21.15.37:0/1122708537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cda79a900 con 0x558cda4a61b0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45be781640 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4a61b0 0x558cda883e70 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f45b002ade0 tx=0x7f45b00318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9667a5da86a635 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45a17fa640 1 -- 172.21.15.37:0/1122708537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0031dd0 con 0x558cda4a61b0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45a17fa640 1 -- 172.21.15.37:0/1122708537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f45b0003970 con 0x558cda4a61b0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45c6759740 1 -- 172.21.15.37:0/1122708537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b0036040 con 0x558cda4a61b0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45a17fa640 1 -- 172.21.15.37:0/1122708537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f45b0003b70 con 0x558cda4a61b0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45c6759740 10 client.17595 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45c6759740 1 -- 172.21.15.37:0/1122708537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558cda892ba0 con 0x558cda4a61b0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45a17fa640 1 -- 172.21.15.37:0/1122708537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45b0036040 con 0x558cda4a61b0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45a17fa640 1 -- 172.21.15.37:0/1122708537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f45b0058030 con 0x558cda4a61b0 2024-08-31T06:55:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45c6759740 10 client.17595 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.852+0000 7f45c6759740 10 client.17595 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.853+0000 7f45c6759740 20 client.17595 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.853+0000 7f45c6759740 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558cda48d9f0 0x558cda895f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.853+0000 7f45c6759740 4 client.17595 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.853+0000 7f45c6759740 1 -- 172.21.15.37:0/1122708537 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cda7ed5d0 con 0x558cda48d9f0 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.853+0000 7f45bd77f640 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558cda48d9f0 0x558cda895f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.853+0000 7f45bd77f640 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558cda48d9f0 0x558cda895f00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af649d69afa53e18 server_cookie=69b8ba0516980922 in_seq=0 out_seq=0 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.853+0000 7f45a17fa640 10 client.17595 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45a17fa640 1 -- 172.21.15.37:0/1122708537 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558cda7ed5d0 con 0x558cda48d9f0 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45a17fa640 10 client.17595 handle_command_reply: tid=0 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 client.17595 shutdown 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 -- 172.21.15.37:0/1122708537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4a61b0 msgr2=0x558cda883e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4a61b0 0x558cda883e70 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f45b002ade0 tx=0x7f45b00318c0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 -- 172.21.15.37:0/1122708537 shutdown_connections 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558cda48d9f0 0x558cda895f00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 0x558cda890120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4ae390 0x558cda8843b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 --2- 172.21.15.37:0/1122708537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4a61b0 0x558cda883e70 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45a17fa640 0 client.17595 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 -- 172.21.15.37:0/1122708537 >> 172.21.15.37:0/1122708537 conn(0x558cda4c3460 msgr2=0x558cda875d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 -- 172.21.15.37:0/1122708537 shutdown_connections 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 1 -- 172.21.15.37:0/1122708537 wait complete. 2024-08-31T06:55:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.854+0000 7f45c6759740 20 client.17595 trim_cache size 0 max 16384 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45c6759740 1 Processor -- start 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45c6759740 1 -- start start 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45c6759740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda87f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45c6759740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 0x558cda885d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45c6759740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda875a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45c6759740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81afa90 con 0x558cda4cf070 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45c6759740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81ad360 con 0x558cda4a61b0 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45c6759740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81ab1d0 con 0x558cda4ae390 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda875a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda875a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44704/0 (socket says 172.21.15.37:44704) 2024-08-31T06:55:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 -- 172.21.15.37:0/2689776685 learned_addr learned my addr 172.21.15.37:0/2689776685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:24.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 -- 172.21.15.37:0/2689776685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 msgr2=0x558cda885d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:24.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 --2- 172.21.15.37:0/2689776685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 0x558cda885d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 -- 172.21.15.37:0/2689776685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 msgr2=0x558cda87f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:24.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 --2- 172.21.15.37:0/2689776685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda87f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 -- 172.21.15.37:0/2689776685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cda875150 con 0x558cda4cf070 2024-08-31T06:55:24.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.868+0000 7f45be781640 1 --2- 172.21.15.37:0/2689776685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda875a50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f45b00306d0 tx=0x7f45b00098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158de5875779076e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45a37fe640 1 -- 172.21.15.37:0/2689776685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0066070 con 0x558cda4cf070 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45a37fe640 1 -- 172.21.15.37:0/2689776685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45b0036040 con 0x558cda4cf070 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45a37fe640 1 -- 172.21.15.37:0/2689776685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0061450 con 0x558cda4cf070 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45c6759740 1 -- 172.21.15.37:0/2689776685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 msgr2=0x558cda875a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45c6759740 1 --2- 172.21.15.37:0/2689776685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda875a50 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f45b00306d0 tx=0x7f45b00098b0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45c6759740 1 -- 172.21.15.37:0/2689776685 shutdown_connections 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45c6759740 1 --2- 172.21.15.37:0/2689776685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4cf070 0x558cda875a50 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45c6759740 1 --2- 172.21.15.37:0/2689776685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4ae390 0x558cda885d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45c6759740 1 --2- 172.21.15.37:0/2689776685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda87f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45c6759740 1 -- 172.21.15.37:0/2689776685 >> 172.21.15.37:0/2689776685 conn(0x558cda4c3460 msgr2=0x558cda875340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.869+0000 7f45c6759740 1 -- 172.21.15.37:0/2689776685 shutdown_connections 2024-08-31T06:55:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.870+0000 7f45c6759740 1 -- 172.21.15.37:0/2689776685 wait complete. 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.870+0000 7f45c6759740 1 -- start start 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.870+0000 7f45c6759740 1 Processor -- start 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45c6759740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda8f4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45c6759740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4ae390 0x558cda8f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45c6759740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 0x558cda8ff690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45c6759740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81ab820 con 0x558cda4ae390 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45c6759740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81acc90 con 0x558cda4a61b0 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45c6759740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81abef0 con 0x558cda4cf070 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45c6759740 10 client.0 _ll_register_callbacks cb 0x7f45b0009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4ae390 0x558cda8f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4ae390 0x558cda8f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44712/0 (socket says 172.21.15.37:44712) 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 -- 172.21.15.37:0/1459627694 learned_addr learned my addr 172.21.15.37:0/1459627694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45be781640 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda8f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45be781640 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 0x558cda8ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 -- 172.21.15.37:0/1459627694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 msgr2=0x558cda8ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 0x558cda8ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 -- 172.21.15.37:0/1459627694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 msgr2=0x558cda8f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda8f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 -- 172.21.15.37:0/1459627694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cda8ffbd0 con 0x558cda4ae390 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45be781640 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 0x558cda8ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45bd77f640 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4ae390 0x558cda8f4bf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f45a8004160 tx=0x7f45a800bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a2a37adaac3eef server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45a17fa640 1 -- 172.21.15.37:0/1459627694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a8003df0 con 0x558cda4ae390 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.871+0000 7f45a17fa640 1 -- 172.21.15.37:0/1459627694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f45a8005020 con 0x558cda4ae390 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 1 -- 172.21.15.37:0/1459627694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b0036040 con 0x558cda4ae390 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45a17fa640 1 -- 172.21.15.37:0/1459627694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f45a8005220 con 0x558cda4ae390 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 10 client.17601 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 1 -- 172.21.15.37:0/1459627694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558cda900de0 con 0x558cda4ae390 2024-08-31T06:55:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45a17fa640 1 -- 172.21.15.37:0/1459627694 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45b0036040 con 0x558cda4ae390 2024-08-31T06:55:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45a17fa640 1 -- 172.21.15.37:0/1459627694 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f45a8012450 con 0x558cda4ae390 2024-08-31T06:55:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 10 client.17601 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 10 client.17601 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:55:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 20 client.17601 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558cda462da0 0x558cda9035d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 4 client.17601 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:55:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.872+0000 7f45c6759740 1 -- 172.21.15.37:0/1459627694 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558cda7e9070 con 0x558cda462da0 2024-08-31T06:55:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45be781640 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558cda462da0 0x558cda9035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45be781640 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558cda462da0 0x558cda9035d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=71256caf5b70f589 server_cookie=d5d17ab8805d4ea5 in_seq=0 out_seq=0 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45a17fa640 10 client.17601 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45a17fa640 1 -- 172.21.15.37:0/1459627694 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558cda7e9070 con 0x558cda462da0 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45a17fa640 10 client.17601 handle_command_reply: tid=0 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 client.17601 shutdown 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 -- 172.21.15.37:0/1459627694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4ae390 msgr2=0x558cda8f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4ae390 0x558cda8f4bf0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f45a8004160 tx=0x7f45a800bd20 comp rx=0 tx=0).stop 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 -- 172.21.15.37:0/1459627694 shutdown_connections 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cda4ae390 0x558cda8f4bf0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x558cda462da0 0x558cda9035d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558cda4cf070 0x558cda8ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 --2- 172.21.15.37:0/1459627694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558cda4a61b0 0x558cda8f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45a17fa640 0 client.17601 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.873+0000 7f45c6759740 1 -- 172.21.15.37:0/1459627694 >> 172.21.15.37:0/1459627694 conn(0x558cda4c3460 msgr2=0x558cda885ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c6759740 1 -- 172.21.15.37:0/1459627694 shutdown_connections 2024-08-31T06:55:24.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c6759740 1 -- 172.21.15.37:0/1459627694 wait complete. 2024-08-31T06:55:24.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c6759740 20 client.17601 trim_cache size 0 max 16384 2024-08-31T06:55:24.879 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:55:24.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 -- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45a40b4ca0 msgr2=0x7f45a40b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45a40b4ca0 0x7f45a40b71b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f45b40e2990 tx=0x7f45b4005880 comp rx=0 tx=0).stop 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 -- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8103950 msgr2=0x7f45b819a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8103950 0x7f45b819a150 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f45b400d950 tx=0x7f45b400de10 comp rx=0 tx=0).stop 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 -- 172.21.15.37:0/815773220 shutdown_connections 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f45a40b4ca0 0x7f45a40b71b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45b8109be0 0x7f45b819f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45b8109290 0x7f45b819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 --2- 172.21.15.37:0/815773220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45b8103950 0x7f45b819a150 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 -- 172.21.15.37:0/815773220 >> 172.21.15.37:0/815773220 conn(0x7f45b80ff3a0 msgr2=0x7f45b81017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 -- 172.21.15.37:0/815773220 shutdown_connections 2024-08-31T06:55:24.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:24.874+0000 7f45c01e4640 1 -- 172.21.15.37:0/815773220 wait complete. 2024-08-31T06:55:25.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:55:26.060 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:55:26.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:25 smithi106 ceph-mon[22134]: pgmap v583: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-08-31T06:55:26.326 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:25 smithi037 ceph-mon[18612]: pgmap v583: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-08-31T06:55:26.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:25 smithi066 ceph-mon[22244]: pgmap v583: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-08-31T06:55:26.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.550+0000 7f9016c0f640 1 -- 172.21.15.37:0/1305989874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109b90 msgr2=0x7f90101103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.550+0000 7f9016c0f640 1 --2- 172.21.15.37:0/1305989874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109b90 0x7f90101103c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f9008009ca0 tx=0x7f900802a8c0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 -- 172.21.15.37:0/1305989874 shutdown_connections 2024-08-31T06:55:26.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 --2- 172.21.15.37:0/1305989874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109b90 0x7f90101103c0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 --2- 172.21.15.37:0/1305989874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9010109240 0x7f9010109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 --2- 172.21.15.37:0/1305989874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9010103900 0x7f9010103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 -- 172.21.15.37:0/1305989874 >> 172.21.15.37:0/1305989874 conn(0x7f901007b5f0 msgr2=0x7f901007ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 -- 172.21.15.37:0/1305989874 shutdown_connections 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 -- 172.21.15.37:0/1305989874 wait complete. 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 Processor -- start 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.551+0000 7f9016c0f640 1 -- start start 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f9016c0f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9010103900 0x7f90100754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f9016c0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109240 0x7f90100759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f9016c0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9010109b90 0x7f9010075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f9016c0f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9010113750 con 0x7f9010109240 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f9016c0f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f90101135d0 con 0x7f9010109b90 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f9016c0f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f90101138d0 con 0x7f9010103900 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109240 0x7f90100759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109240 0x7f90100759f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44724/0 (socket says 172.21.15.37:44724) 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 -- 172.21.15.37:0/414767177 learned_addr learned my addr 172.21.15.37:0/414767177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f90149ab640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9010103900 0x7f90100754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f90151ac640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9010109b90 0x7f9010075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 -- 172.21.15.37:0/414767177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9010103900 msgr2=0x7f90100754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9010103900 0x7f90100754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 -- 172.21.15.37:0/414767177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9010109b90 msgr2=0x7f9010075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9010109b90 0x7f9010075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 -- 172.21.15.37:0/414767177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90101a8470 con 0x7f9010109240 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f90151ac640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9010109b90 0x7f9010075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f90149ab640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9010103900 0x7f90100754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900ffff640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109240 0x7f90100759f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c8c0 tx=0x7f8ffc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900dffb640 1 -- 172.21.15.37:0/414767177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc007bb0 con 0x7f9010109240 2024-08-31T06:55:26.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f900dffb640 1 -- 172.21.15.37:0/414767177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ffc007d50 con 0x7f9010109240 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.552+0000 7f9016c0f640 1 -- 172.21.15.37:0/414767177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90101a8760 con 0x7f9010109240 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.553+0000 7f900dffb640 1 -- 172.21.15.37:0/414767177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0186a0 con 0x7f9010109240 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.553+0000 7f9016c0f640 1 -- 172.21.15.37:0/414767177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90101a8ca0 con 0x7f9010109240 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.555+0000 7f900dffb640 1 -- 172.21.15.37:0/414767177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f8ffc00fa00 con 0x7f9010109240 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.555+0000 7f901d184740 1 Processor -- start 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.555+0000 7f901d184740 1 -- start start 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f901d184740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef1b8070 0x5606ef55d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f901d184740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef55d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f901d184740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef197390 0x5606ef55ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f901d184740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5606ef4d4680 con 0x5606ef1b8070 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f901d184740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5606ef4c3c10 con 0x5606ef197390 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f901d184740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5606ef4c7bc0 con 0x5606ef18f1b0 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef1b8070 0x5606ef55d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef1b8070 0x5606ef55d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44730/0 (socket says 172.21.15.37:44730) 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 -- 172.21.15.37:0/2100877041 learned_addr learned my addr 172.21.15.37:0/2100877041 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f900dffb640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90000b4ca0 0x7f90000b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90149ab640 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef55d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f900ffff640 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef197390 0x5606ef55ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 -- 172.21.15.37:0/2100877041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 msgr2=0x5606ef55d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef55d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 -- 172.21.15.37:0/2100877041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef197390 msgr2=0x5606ef55ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef197390 0x5606ef55ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 -- 172.21.15.37:0/2100877041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ef223650 con 0x5606ef1b8070 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f90151ac640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90000b4ca0 0x7f90000b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.556+0000 7f900dffb640 1 -- 172.21.15.37:0/414767177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f8ffc0e5650 con 0x7f9010109240 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.557+0000 7f90151ac640 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef1b8070 0x5606ef55d350 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f9008031610 tx=0x7f9008031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b0c3e29958e23e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:26.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.557+0000 7f8ffaffd640 1 -- 172.21.15.37:0/2100877041 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008031d20 con 0x5606ef1b8070 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.557+0000 7f8ffaffd640 1 -- 172.21.15.37:0/2100877041 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9008036070 con 0x5606ef1b8070 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.557+0000 7f8ffaffd640 1 -- 172.21.15.37:0/2100877041 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008030c10 con 0x5606ef1b8070 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 -- 172.21.15.37:0/2100877041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef1b8070 msgr2=0x5606ef55d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef1b8070 0x5606ef55d350 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f9008031610 tx=0x7f9008031640 comp rx=0 tx=0).stop 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f90151ac640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90000b4ca0 0x7f90000b71b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f900804b000 tx=0x7f9008048000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 -- 172.21.15.37:0/2100877041 shutdown_connections 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef197390 0x5606ef55ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef55d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 --2- 172.21.15.37:0/2100877041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef1b8070 0x5606ef55d350 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 -- 172.21.15.37:0/2100877041 >> 172.21.15.37:0/2100877041 conn(0x5606ef1ac460 msgr2=0x5606ef55b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 -- 172.21.15.37:0/2100877041 shutdown_connections 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 -- 172.21.15.37:0/2100877041 wait complete. 2024-08-31T06:55:26.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 -- start start 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.558+0000 7f901d184740 1 Processor -- start 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f901d184740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef568b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f901d184740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef569050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f901d184740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 0x5606ef574ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f901d184740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5606ef326700 con 0x5606ef197390 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f901d184740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5606ef44a750 con 0x5606ef1b8070 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f901d184740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5606ef56b9b0 con 0x5606ef18f1b0 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f901d184740 10 client.0 _ll_register_callbacks cb 0x5606ef479e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef569050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef569050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44744/0 (socket says 172.21.15.37:44744) 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 -- 172.21.15.37:0/1934667619 learned_addr learned my addr 172.21.15.37:0/1934667619 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f90149ab640 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef568b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f90151ac640 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 0x5606ef574ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 -- 172.21.15.37:0/1934667619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 msgr2=0x5606ef568b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef568b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 -- 172.21.15.37:0/1934667619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 msgr2=0x5606ef574ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 0x5606ef574ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 -- 172.21.15.37:0/1934667619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606ef483900 con 0x5606ef197390 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f900ffff640 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef569050 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0e2e10 tx=0x7f8ffc0abc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790ae0d18e31f576 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.559+0000 7f8feffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f8feffff640 1 -- 172.21.15.37:0/1934667619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0ac450 con 0x5606ef197390 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f8feffff640 1 -- 172.21.15.37:0/1934667619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f8ffc0abfb0 con 0x5606ef197390 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 1 -- 172.21.15.37:0/1934667619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9008036070 con 0x5606ef197390 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f8feffff640 1 -- 172.21.15.37:0/1934667619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ffc0abd50 con 0x5606ef197390 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 10 client.17613 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 1 -- 172.21.15.37:0/1934667619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5606ef577840 con 0x5606ef197390 2024-08-31T06:55:26.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f8feffff640 1 -- 172.21.15.37:0/1934667619 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9008036070 con 0x5606ef197390 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f8feffff640 1 -- 172.21.15.37:0/1934667619 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ffc0b4be0 con 0x5606ef197390 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 10 client.17613 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 10 client.17613 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 20 client.17613 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5606ef1769f0 0x5606ef57ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 4 client.17613 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f901d184740 1 -- 172.21.15.37:0/1934667619 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5606ef4d65d0 con 0x5606ef1769f0 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.560+0000 7f90149ab640 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5606ef1769f0 0x5606ef57ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.561+0000 7f90149ab640 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5606ef1769f0 0x5606ef57ad50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66bd8ed832e58411 server_cookie=d4bdabe00dcab975 in_seq=0 out_seq=0 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.561+0000 7f8feffff640 10 client.17613 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f8feffff640 1 -- 172.21.15.37:0/1934667619 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5606ef4d65d0 con 0x5606ef1769f0 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f8feffff640 10 client.17613 handle_command_reply: tid=0 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 client.17613 shutdown 2024-08-31T06:55:26.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 -- 172.21.15.37:0/1934667619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 msgr2=0x5606ef569050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef569050 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0e2e10 tx=0x7f8ffc0abc50 comp rx=0 tx=0).stop 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 -- 172.21.15.37:0/1934667619 shutdown_connections 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5606ef1769f0 0x5606ef57ad50 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef569050 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f8feffff640 0 client.17613 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 0x5606ef574ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 --2- 172.21.15.37:0/1934667619 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef568b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 -- 172.21.15.37:0/1934667619 >> 172.21.15.37:0/1934667619 conn(0x5606ef1ac460 msgr2=0x5606ef560530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:26.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 -- 172.21.15.37:0/1934667619 shutdown_connections 2024-08-31T06:55:26.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 1 -- 172.21.15.37:0/1934667619 wait complete. 2024-08-31T06:55:26.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.562+0000 7f901d184740 20 client.17613 trim_cache size 0 max 16384 2024-08-31T06:55:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f901d184740 1 Processor -- start 2024-08-31T06:55:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f901d184740 1 -- start start 2024-08-31T06:55:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f901d184740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef18f1b0 0x5606ef567a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f901d184740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef560b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f901d184740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef1b8070 0x5606ef565d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f901d184740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90101b3e80 con 0x5606ef197390 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f901d184740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f90101b1750 con 0x5606ef18f1b0 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f901d184740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f90101af5c0 con 0x5606ef1b8070 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f900ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef560b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f900ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef560b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44752/0 (socket says 172.21.15.37:44752) 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f900ffff640 1 -- 172.21.15.37:0/608026163 learned_addr learned my addr 172.21.15.37:0/608026163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f90149ab640 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef18f1b0 0x5606ef567a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f90151ac640 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef1b8070 0x5606ef565d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f900ffff640 1 -- 172.21.15.37:0/608026163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef1b8070 msgr2=0x5606ef565d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.576+0000 7f900ffff640 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef1b8070 0x5606ef565d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f900ffff640 1 -- 172.21.15.37:0/608026163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef18f1b0 msgr2=0x5606ef567a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f900ffff640 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef18f1b0 0x5606ef567a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f900ffff640 1 -- 172.21.15.37:0/608026163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606ef5601b0 con 0x5606ef197390 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f90149ab640 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef18f1b0 0x5606ef567a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f90151ac640 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef1b8070 0x5606ef565d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f900ffff640 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef560b60 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0e33b0 tx=0x7f8ffc00a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636d0a3189bdf50a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f8ffa7fc640 1 -- 172.21.15.37:0/608026163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0ac450 con 0x5606ef197390 2024-08-31T06:55:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f8ffa7fc640 1 -- 172.21.15.37:0/608026163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ffc0b05c0 con 0x5606ef197390 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.577+0000 7f8ffa7fc640 1 -- 172.21.15.37:0/608026163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0b01d0 con 0x5606ef197390 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 -- 172.21.15.37:0/608026163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 msgr2=0x5606ef560b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef560b60 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0e33b0 tx=0x7f8ffc00a410 comp rx=0 tx=0).stop 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 -- 172.21.15.37:0/608026163 shutdown_connections 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef560b60 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef1b8070 0x5606ef565d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 --2- 172.21.15.37:0/608026163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef18f1b0 0x5606ef567a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 -- 172.21.15.37:0/608026163 >> 172.21.15.37:0/608026163 conn(0x5606ef1ac460 msgr2=0x5606ef560450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 -- 172.21.15.37:0/608026163 shutdown_connections 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 -- 172.21.15.37:0/608026163 wait complete. 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 -- start start 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.578+0000 7f901d184740 1 Processor -- start 2024-08-31T06:55:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f901d184740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef56cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f901d184740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef56d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f901d184740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 0x5606ef56d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f901d184740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90101afc10 con 0x5606ef197390 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f901d184740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f90101b1080 con 0x5606ef1b8070 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f901d184740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f90101b02e0 con 0x5606ef18f1b0 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f901d184740 10 client.0 _ll_register_callbacks cb 0x7f8ffc0a8470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f900ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef56d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f900ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef56d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44764/0 (socket says 172.21.15.37:44764) 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f900ffff640 1 -- 172.21.15.37:0/2016976512 learned_addr learned my addr 172.21.15.37:0/2016976512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f90149ab640 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef56cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f90151ac640 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 0x5606ef56d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f900ffff640 1 -- 172.21.15.37:0/2016976512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 msgr2=0x5606ef56cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.579+0000 7f900ffff640 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef56cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f900ffff640 1 -- 172.21.15.37:0/2016976512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 msgr2=0x5606ef56d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f900ffff640 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 0x5606ef56d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f900ffff640 1 -- 172.21.15.37:0/2016976512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606ef5ed0d0 con 0x5606ef197390 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f900ffff640 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef56d2c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0abf10 tx=0x7f8ffc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadd6de273400b8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f8feffff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f8feffff640 1 -- 172.21.15.37:0/2016976512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc0ac450 con 0x5606ef197390 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f8feffff640 1 -- 172.21.15.37:0/2016976512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f8ffc091d40 con 0x5606ef197390 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f901d184740 1 -- 172.21.15.37:0/2016976512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ffc0b05c0 con 0x5606ef197390 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f8feffff640 1 -- 172.21.15.37:0/2016976512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ffc0b5070 con 0x5606ef197390 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f901d184740 10 client.17619 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f901d184740 1 -- 172.21.15.37:0/2016976512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5606ef5ed0d0 con 0x5606ef197390 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f8feffff640 1 -- 172.21.15.37:0/2016976512 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ffc0b05c0 con 0x5606ef197390 2024-08-31T06:55:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.580+0000 7f8feffff640 1 -- 172.21.15.37:0/2016976512 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ffc0e5110 con 0x5606ef197390 2024-08-31T06:55:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f901d184740 10 client.17619 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f901d184740 10 client.17619 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:55:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f901d184740 20 client.17619 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f901d184740 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5606ef14bda0 0x5606ef5f0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f901d184740 4 client.17619 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:55:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f901d184740 1 -- 172.21.15.37:0/2016976512 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606ef4d2070 con 0x5606ef14bda0 2024-08-31T06:55:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f90149ab640 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5606ef14bda0 0x5606ef5f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f90149ab640 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5606ef14bda0 0x5606ef5f0530 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55ba37171209a75 server_cookie=a5b71878187531dc in_seq=0 out_seq=0 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.581+0000 7f8feffff640 10 client.17619 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f8feffff640 1 -- 172.21.15.37:0/2016976512 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606ef4d2070 con 0x5606ef14bda0 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f8feffff640 10 client.17619 handle_command_reply: tid=0 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 client.17619 shutdown 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 -- 172.21.15.37:0/2016976512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 msgr2=0x5606ef56d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef56d2c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0abf10 tx=0x7f8ffc000bc0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 -- 172.21.15.37:0/2016976512 shutdown_connections 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x5606ef14bda0 0x5606ef5f0530 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606ef197390 0x5606ef56d2c0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5606ef1b8070 0x5606ef56d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 --2- 172.21.15.37:0/2016976512 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5606ef18f1b0 0x5606ef56cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 -- 172.21.15.37:0/2016976512 >> 172.21.15.37:0/2016976512 conn(0x5606ef1ac460 msgr2=0x5606ef569dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f8feffff640 0 client.17619 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:55:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 -- 172.21.15.37:0/2016976512 shutdown_connections 2024-08-31T06:55:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 1 -- 172.21.15.37:0/2016976512 wait complete. 2024-08-31T06:55:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.582+0000 7f901d184740 20 client.17619 trim_cache size 0 max 16384 2024-08-31T06:55:26.591 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:55:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 -- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90000b4ca0 msgr2=0x7f90000b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90000b4ca0 0x7f90000b71b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f900804b000 tx=0x7f9008048000 comp rx=0 tx=0).stop 2024-08-31T06:55:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 -- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109240 msgr2=0x7f90100759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109240 0x7f90100759f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c8c0 tx=0x7f8ffc00cd80 comp rx=0 tx=0).stop 2024-08-31T06:55:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 -- 172.21.15.37:0/414767177 shutdown_connections 2024-08-31T06:55:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f90000b4ca0 0x7f90000b71b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9010109240 0x7f90100759f0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9010109b90 0x7f9010075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 --2- 172.21.15.37:0/414767177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9010103900 0x7f90100754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 -- 172.21.15.37:0/414767177 >> 172.21.15.37:0/414767177 conn(0x7f901007b5f0 msgr2=0x7f90101053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 -- 172.21.15.37:0/414767177 shutdown_connections 2024-08-31T06:55:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:26.583+0000 7f9016c0f640 1 -- 172.21.15.37:0/414767177 wait complete. 2024-08-31T06:55:27.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:26 smithi106 ceph-mon[22134]: Health check update: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-31T06:55:27.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:26 smithi037 ceph-mon[18612]: Health check update: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-31T06:55:27.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:26 smithi066 ceph-mon[22244]: Health check update: 2 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-31T06:55:27.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:55:27.642 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:55:28.086 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:27 smithi037 ceph-mon[18612]: pgmap v584: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 -- 172.21.15.37:0/605102554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c102820 msgr2=0x7fc44c102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 --2- 172.21.15.37:0/605102554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c102820 0x7fc44c102c30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009900 tx=0x7fc43c02a410 comp rx=0 tx=0).stop 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 -- 172.21.15.37:0/605102554 shutdown_connections 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 --2- 172.21.15.37:0/605102554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc44c108ab0 0x7fc44c10f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 --2- 172.21.15.37:0/605102554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc44c108160 0x7fc44c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 --2- 172.21.15.37:0/605102554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c102820 0x7fc44c102c30 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 -- 172.21.15.37:0/605102554 >> 172.21.15.37:0/605102554 conn(0x7fc44c0794e0 msgr2=0x7fc44c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 -- 172.21.15.37:0/605102554 shutdown_connections 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.085+0000 7fc451f3a640 1 -- 172.21.15.37:0/605102554 wait complete. 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.086+0000 7fc451f3a640 1 Processor -- start 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.086+0000 7fc451f3a640 1 -- start start 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.086+0000 7fc451f3a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc44c102820 0x7fc44c19a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc451f3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c108160 0x7fc44c19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc451f3a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc44c108ab0 0x7fc44c19f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc451f3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c113730 con 0x7fc44c108160 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc451f3a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1135b0 con 0x7fc44c108ab0 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc451f3a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1138b0 con 0x7fc44c102820 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c108160 0x7fc44c19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c108160 0x7fc44c19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44784/0 (socket says 172.21.15.37:44784) 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 -- 172.21.15.37:0/3121020254 learned_addr learned my addr 172.21.15.37:0/3121020254 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc44c102820 0x7fc44c19a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc44c108ab0 0x7fc44c19f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 -- 172.21.15.37:0/3121020254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc44c102820 msgr2=0x7fc44c19a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc44c102820 0x7fc44c19a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 -- 172.21.15.37:0/3121020254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc44c108ab0 msgr2=0x7fc44c19f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc44c108ab0 0x7fc44c19f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 -- 172.21.15.37:0/3121020254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c1a00f0 con 0x7fc44c108160 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc442ffd640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c108160 0x7fc44c19a720 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc43400d770 tx=0x7fc43400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.087+0000 7fc4497fa640 1 -- 172.21.15.37:0/3121020254 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434017070 con 0x7fc44c108160 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.088+0000 7fc451f3a640 1 -- 172.21.15.37:0/3121020254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c1a03e0 con 0x7fc44c108160 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.088+0000 7fc4497fa640 1 -- 172.21.15.37:0/3121020254 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc434009c30 con 0x7fc44c108160 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.088+0000 7fc4497fa640 1 -- 172.21.15.37:0/3121020254 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43400f620 con 0x7fc44c108160 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.088+0000 7fc451f3a640 1 -- 172.21.15.37:0/3121020254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c1a6bc0 con 0x7fc44c108160 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4584af740 1 Processor -- start 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4584af740 1 -- start start 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4584af740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c08350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4497fa640 1 -- 172.21.15.37:0/3121020254 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fc43401a070 con 0x7fc44c108160 2024-08-31T06:55:28.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4584af740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c08890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4584af740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c08dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4584af740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bbd0b7f680 con 0x55bbd0863070 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4584af740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bbd0b6ec10 con 0x55bbd0842390 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.090+0000 7fc4584af740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bbd0b72bc0 con 0x55bbd083a1b0 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c08350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c08350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44786/0 (socket says 172.21.15.37:44786) 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 -- 172.21.15.37:0/3255258026 learned_addr learned my addr 172.21.15.37:0/3255258026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc442ffd640 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c08dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c08890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 -- 172.21.15.37:0/3255258026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 msgr2=0x55bbd0c08890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c08890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 -- 172.21.15.37:0/3255258026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 msgr2=0x55bbd0c08dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c08dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 -- 172.21.15.37:0/3255258026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd08ce650 con 0x55bbd0863070 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c08350 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc444009f20 tx=0x7fc44400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183d7259f3477688 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc4497fa640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4380b4ca0 0x7fc4380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc441ffb640 1 -- 172.21.15.37:0/3255258026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44401a070 con 0x55bbd0863070 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4380b4ca0 0x7fc4380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc441ffb640 1 -- 172.21.15.37:0/3255258026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4440158a0 con 0x55bbd0863070 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.091+0000 7fc441ffb640 1 -- 172.21.15.37:0/3255258026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44400a740 con 0x55bbd0863070 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.092+0000 7fc4497fa640 1 -- 172.21.15.37:0/3121020254 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7fc4340e50c0 con 0x7fc44c108160 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.092+0000 7fc4584af740 1 -- 172.21.15.37:0/3255258026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 msgr2=0x55bbd0c08350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.092+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4380b4ca0 0x7fc4380b71b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0057c0 tx=0x7fc43c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.092+0000 7fc4584af740 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c08350 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc444009f20 tx=0x7fc44400c8b0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 -- 172.21.15.37:0/3255258026 shutdown_connections 2024-08-31T06:55:28.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c08dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c08890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 --2- 172.21.15.37:0/3255258026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c08350 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 -- 172.21.15.37:0/3255258026 >> 172.21.15.37:0/3255258026 conn(0x55bbd0857460 msgr2=0x55bbd0c06240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:28.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 -- 172.21.15.37:0/3255258026 shutdown_connections 2024-08-31T06:55:28.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 -- 172.21.15.37:0/3255258026 wait complete. 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 -- start start 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.093+0000 7fc4584af740 1 Processor -- start 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc4584af740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c13b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc4584af740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c140d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc4584af740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c1fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc4584af740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bbd09d1700 con 0x55bbd0863070 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc4584af740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55bbd0af5750 con 0x55bbd0842390 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc4584af740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55bbd0c16b30 con 0x55bbd083a1b0 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc4584af740 10 client.0 _ll_register_callbacks cb 0x55bbd0b24e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c1fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c1fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44788/0 (socket says 172.21.15.37:44788) 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 -- 172.21.15.37:0/3261716876 learned_addr learned my addr 172.21.15.37:0/3261716876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:28.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c13b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc442ffd640 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 -- 172.21.15.37:0/3261716876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 msgr2=0x55bbd0c13b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c13b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 -- 172.21.15.37:0/3261716876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 msgr2=0x55bbd0c140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 -- 172.21.15.37:0/3261716876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd0b2e900 con 0x55bbd0863070 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c1fe20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc44400a440 tx=0x7fc444015c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b865cced654d8f7d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.094+0000 7fc42affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc42affd640 1 -- 172.21.15.37:0/3261716876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44401a040 con 0x55bbd0863070 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc42affd640 1 -- 172.21.15.37:0/3261716876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7fc44400a4e0 con 0x55bbd0863070 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 1 -- 172.21.15.37:0/3261716876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4440158a0 con 0x55bbd0863070 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc42affd640 1 -- 172.21.15.37:0/3261716876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc44400a6e0 con 0x55bbd0863070 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 10 client.17631 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:28.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 1 -- 172.21.15.37:0/3261716876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bbd0c22990 con 0x55bbd0863070 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc42affd640 1 -- 172.21.15.37:0/3261716876 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4440158a0 con 0x55bbd0863070 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc42affd640 1 -- 172.21.15.37:0/3261716876 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc444028030 con 0x55bbd0863070 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 10 client.17631 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 10 client.17631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 20 client.17631 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bbd08219f0 0x55bbd0c25d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 4 client.17631 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.095+0000 7fc4584af740 1 -- 172.21.15.37:0/3261716876 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbd0b815d0 con 0x55bbd08219f0 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.096+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bbd08219f0 0x55bbd0c25d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.096+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bbd08219f0 0x55bbd0c25d50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4062cbefaaebca5f server_cookie=3e8805fa2e61ad5a in_seq=0 out_seq=0 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.096+0000 7fc42affd640 10 client.17631 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:28.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc42affd640 1 -- 172.21.15.37:0/3261716876 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bbd0b815d0 con 0x55bbd08219f0 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc42affd640 10 client.17631 handle_command_reply: tid=0 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 client.17631 shutdown 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 -- 172.21.15.37:0/3261716876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 msgr2=0x55bbd0c1fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c1fe20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc44400a440 tx=0x7fc444015c80 comp rx=0 tx=0).stop 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 -- 172.21.15.37:0/3261716876 shutdown_connections 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bbd08219f0 0x55bbd0c25d50 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c1fe20 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 --2- 172.21.15.37:0/3261716876 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c13b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 -- 172.21.15.37:0/3261716876 >> 172.21.15.37:0/3261716876 conn(0x55bbd0857460 msgr2=0x55bbd0c0b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc42affd640 0 client.17631 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 -- 172.21.15.37:0/3261716876 shutdown_connections 2024-08-31T06:55:28.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.097+0000 7fc4584af740 1 -- 172.21.15.37:0/3261716876 wait complete. 2024-08-31T06:55:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.098+0000 7fc4584af740 20 client.17631 trim_cache size 0 max 16384 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc4584af740 1 Processor -- start 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc4584af740 1 -- start start 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc4584af740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c09a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc4584af740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0842390 0x55bbd0c1fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc4584af740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0863070 0x55bbd0c202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc4584af740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1b1d90 con 0x55bbd0842390 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc4584af740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1af660 con 0x55bbd0863070 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc4584af740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1ad4d0 con 0x55bbd083a1b0 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc442ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0842390 0x55bbd0c1fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc442ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0842390 0x55bbd0c1fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44802/0 (socket says 172.21.15.37:44802) 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc442ffd640 1 -- 172.21.15.37:0/1952646944 learned_addr learned my addr 172.21.15.37:0/1952646944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c09a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.111+0000 7fc44bfff640 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0863070 0x55bbd0c202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc442ffd640 1 -- 172.21.15.37:0/1952646944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 msgr2=0x55bbd0c09a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc442ffd640 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c09a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc442ffd640 1 -- 172.21.15.37:0/1952646944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0863070 msgr2=0x55bbd0c202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc442ffd640 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0863070 0x55bbd0c202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc442ffd640 1 -- 172.21.15.37:0/1952646944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbd0c0a640 con 0x55bbd0842390 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c09a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc44bfff640 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0863070 0x55bbd0c202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc442ffd640 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0842390 0x55bbd0c1fd90 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc4340a8a30 tx=0x7fc4340a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89421982802b7f8f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc4417fa640 1 -- 172.21.15.37:0/1952646944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434021070 con 0x55bbd0842390 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc4417fa640 1 -- 172.21.15.37:0/1952646944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4340b4420 con 0x55bbd0842390 2024-08-31T06:55:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.112+0000 7fc4417fa640 1 -- 172.21.15.37:0/1952646944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340ab7c0 con 0x55bbd0842390 2024-08-31T06:55:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 -- 172.21.15.37:0/1952646944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0842390 msgr2=0x55bbd0c1fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0842390 0x55bbd0c1fd90 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc4340a8a30 tx=0x7fc4340a7040 comp rx=0 tx=0).stop 2024-08-31T06:55:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 -- 172.21.15.37:0/1952646944 shutdown_connections 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0842390 0x55bbd0c1fd90 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0863070 0x55bbd0c202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 --2- 172.21.15.37:0/1952646944 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c09a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 -- 172.21.15.37:0/1952646944 >> 172.21.15.37:0/1952646944 conn(0x55bbd0857460 msgr2=0x55bbd0c09380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 -- 172.21.15.37:0/1952646944 shutdown_connections 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 -- 172.21.15.37:0/1952646944 wait complete. 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 -- start start 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.113+0000 7fc4584af740 1 Processor -- start 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc4584af740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c27430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc4584af740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c27970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc4584af740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c8f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc4584af740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1adb20 con 0x55bbd0863070 2024-08-31T06:55:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc4584af740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1aef90 con 0x55bbd0842390 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc4584af740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c1ae1f0 con 0x55bbd083a1b0 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c8f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c8f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44810/0 (socket says 172.21.15.37:44810) 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 -- 172.21.15.37:0/3646886331 learned_addr learned my addr 172.21.15.37:0/3646886331 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc4584af740 10 client.0 _ll_register_callbacks cb 0x7fc444018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c27430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc442ffd640 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c27970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 -- 172.21.15.37:0/3646886331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 msgr2=0x55bbd0c27430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c27430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 -- 172.21.15.37:0/3646886331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 msgr2=0x55bbd0c27970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c27970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 -- 172.21.15.37:0/3646886331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbd0c8fa10 con 0x55bbd0863070 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc44bfff640 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c8f4d0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc444002230 tx=0x7fc44400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e016e86d7f92ae80 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.114+0000 7fc42affd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc42affd640 1 -- 172.21.15.37:0/3646886331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44401a070 con 0x55bbd0863070 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc42affd640 1 -- 172.21.15.37:0/3646886331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7fc444009df0 con 0x55bbd0863070 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 1 -- 172.21.15.37:0/3646886331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bbd0b7d070 con 0x55bbd0863070 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc42affd640 1 -- 172.21.15.37:0/3646886331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc44400a470 con 0x55bbd0863070 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 10 client.17637 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 1 -- 172.21.15.37:0/3646886331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bbd0c94f30 con 0x55bbd0863070 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc42affd640 1 -- 172.21.15.37:0/3646886331 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55bbd0b7d070 con 0x55bbd0863070 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc42affd640 1 -- 172.21.15.37:0/3646886331 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc444028040 con 0x55bbd0863070 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 10 client.17637 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:28.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 10 client.17637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 20 client.17637 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bbd07f6da0 0x55bbd0c97720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 4 client.17637 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.115+0000 7fc4584af740 1 -- 172.21.15.37:0/3646886331 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bbd0b7a7b0 con 0x55bbd07f6da0 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.116+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bbd07f6da0 0x55bbd0c97720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.116+0000 7fc42affd640 10 client.17637 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.116+0000 7fc44b7fe640 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bbd07f6da0 0x55bbd0c97720 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae9d0af1d601c041 server_cookie=eb5a4b8ebcc7863d in_seq=0 out_seq=0 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.116+0000 7fc42affd640 1 -- 172.21.15.37:0/3646886331 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bbd0b7a7b0 con 0x55bbd07f6da0 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.116+0000 7fc42affd640 10 client.17637 handle_command_reply: tid=0 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.116+0000 7fc4584af740 1 client.17637 shutdown 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.116+0000 7fc4584af740 1 -- 172.21.15.37:0/3646886331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 msgr2=0x55bbd0c8f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.116+0000 7fc4584af740 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c8f4d0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc444002230 tx=0x7fc44400ce30 comp rx=0 tx=0).stop 2024-08-31T06:55:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 1 -- 172.21.15.37:0/3646886331 shutdown_connections 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55bbd07f6da0 0x55bbd0c97720 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bbd0863070 0x55bbd0c8f4d0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55bbd0842390 0x55bbd0c27970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 1 --2- 172.21.15.37:0/3646886331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bbd083a1b0 0x55bbd0c27430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 1 -- 172.21.15.37:0/3646886331 >> 172.21.15.37:0/3646886331 conn(0x55bbd0857460 msgr2=0x55bbd0c0bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc42affd640 0 client.17637 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 1 -- 172.21.15.37:0/3646886331 shutdown_connections 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 1 -- 172.21.15.37:0/3646886331 wait complete. 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc4584af740 20 client.17637 trim_cache size 0 max 16384 2024-08-31T06:55:28.123 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:55:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc451f3a640 1 -- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4380b4ca0 msgr2=0x7fc4380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc451f3a640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4380b4ca0 0x7fc4380b71b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc43c0057c0 tx=0x7fc43c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc451f3a640 1 -- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c108160 msgr2=0x7fc44c19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.117+0000 7fc451f3a640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c108160 0x7fc44c19a720 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc43400d770 tx=0x7fc43400dc30 comp rx=0 tx=0).stop 2024-08-31T06:55:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.118+0000 7fc451f3a640 1 -- 172.21.15.37:0/3121020254 shutdown_connections 2024-08-31T06:55:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.118+0000 7fc451f3a640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc4380b4ca0 0x7fc4380b71b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.118+0000 7fc451f3a640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc44c108160 0x7fc44c19a720 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.118+0000 7fc451f3a640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc44c108ab0 0x7fc44c19f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.118+0000 7fc451f3a640 1 --2- 172.21.15.37:0/3121020254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc44c102820 0x7fc44c19a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.118+0000 7fc451f3a640 1 -- 172.21.15.37:0/3121020254 >> 172.21.15.37:0/3121020254 conn(0x7fc44c0794e0 msgr2=0x7fc44c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.118+0000 7fc451f3a640 1 -- 172.21.15.37:0/3121020254 shutdown_connections 2024-08-31T06:55:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:28.118+0000 7fc451f3a640 1 -- 172.21.15.37:0/3121020254 wait complete. 2024-08-31T06:55:28.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:28 smithi106 ceph-mon[22134]: pgmap v584: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:28.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:28 smithi066 ceph-mon[22244]: pgmap v584: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:29.813 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:55:29.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:55:30.078 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:55:30.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:30 smithi037 ceph-mon[18612]: pgmap v585: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:30.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:30 smithi106 ceph-mon[22134]: pgmap v585: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:30.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:30 smithi066 ceph-mon[22244]: pgmap v585: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.545+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2740367202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8104600 msgr2=0x7fbbf8104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.545+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2740367202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8104600 0x7fbbf8104a10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fbbf4009900 tx=0x7fbbf402a410 comp rx=0 tx=0).stop 2024-08-31T06:55:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.545+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2740367202 shutdown_connections 2024-08-31T06:55:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.545+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2740367202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf810dbb0 0x7fbbf81100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.545+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2740367202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf8105030 0x7fbbf810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.545+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2740367202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8104600 0x7fbbf8104a10 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.545+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2740367202 >> 172.21.15.37:0/2740367202 conn(0x7fbbf80794e0 msgr2=0x7fbbf80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.546+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2740367202 shutdown_connections 2024-08-31T06:55:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.546+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2740367202 wait complete. 2024-08-31T06:55:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.546+0000 7fbbff2dd640 1 Processor -- start 2024-08-31T06:55:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.546+0000 7fbbff2dd640 1 -- start start 2024-08-31T06:55:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbff2dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf8104600 0x7fbbf819a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbff2dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8105030 0x7fbbf819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbff2dd640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf810dbb0 0x7fbbf819f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbff2dd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf8113730 con 0x7fbbf8105030 2024-08-31T06:55:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbff2dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf81135b0 con 0x7fbbf8104600 2024-08-31T06:55:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbff2dd640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf81138b0 con 0x7fbbf810dbb0 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8105030 0x7fbbf819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8105030 0x7fbbf819a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44820/0 (socket says 172.21.15.37:44820) 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 -- 172.21.15.37:0/2241669032 learned_addr learned my addr 172.21.15.37:0/2241669032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfd079640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf8104600 0x7fbbf819a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf810dbb0 0x7fbbf819f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 -- 172.21.15.37:0/2241669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf810dbb0 msgr2=0x7fbbf819f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf810dbb0 0x7fbbf819f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 -- 172.21.15.37:0/2241669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf8104600 msgr2=0x7fbbf819a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf8104600 0x7fbbf819a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 -- 172.21.15.37:0/2241669032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf81a0030 con 0x7fbbf8105030 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf810dbb0 0x7fbbf819f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfd079640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf8104600 0x7fbbf819a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbfc878640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8105030 0x7fbbf819a720 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00c8c0 tx=0x7fbbec00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.547+0000 7fbbea7fc640 1 -- 172.21.15.37:0/2241669032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec007bb0 con 0x7fbbf8105030 2024-08-31T06:55:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.548+0000 7fbbea7fc640 1 -- 172.21.15.37:0/2241669032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbec007d50 con 0x7fbbf8105030 2024-08-31T06:55:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.548+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2241669032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf81a0320 con 0x7fbbf8105030 2024-08-31T06:55:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.548+0000 7fbbea7fc640 1 -- 172.21.15.37:0/2241669032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0186a0 con 0x7fbbf8105030 2024-08-31T06:55:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.548+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2241669032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf81a6b40 con 0x7fbbf8105030 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.550+0000 7fbbea7fc640 1 -- 172.21.15.37:0/2241669032 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fbbec00fa00 con 0x7fbbf8105030 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.550+0000 7fbc05852740 1 Processor -- start 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbc05852740 1 -- start start 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbc05852740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 0x55e249444780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbc05852740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249444cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbc05852740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e249445200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbc05852740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e2493ba5f0 con 0x55e249075490 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbc05852740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e2493a9b80 con 0x55e24907d670 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbc05852740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e2493adb30 con 0x55e24909e350 2024-08-31T06:55:30.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbbfd079640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249444cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbbfd079640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249444cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44822/0 (socket says 172.21.15.37:44822) 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbbfd079640 1 -- 172.21.15.37:0/2761927719 learned_addr learned my addr 172.21.15.37:0/2761927719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbbea7fc640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbe40b4cd0 0x7fbbe40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 0x55e249444780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbbfc878640 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e249445200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbe40b4cd0 0x7fbbe40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.551+0000 7fbbea7fc640 1 -- 172.21.15.37:0/2241669032 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7fbbec0e5690 con 0x7fbbf8105030 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbfd079640 1 -- 172.21.15.37:0/2761927719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 msgr2=0x55e249444780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbfd079640 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 0x55e249444780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbfd079640 1 -- 172.21.15.37:0/2761927719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 msgr2=0x55e249445200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbfd079640 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e249445200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbfd079640 1 -- 172.21.15.37:0/2761927719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e249109930 con 0x55e249075490 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbfd079640 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249444cc0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fbbf402a930 tx=0x7fbbf40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7be4f4b7fcad63 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:30.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbe40b4cd0 0x7fbbe40b71e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009270 tx=0x7fbbf0005bd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:30.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2761927719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf403f070 con 0x55e249075490 2024-08-31T06:55:30.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2761927719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbf40046c0 con 0x55e249075490 2024-08-31T06:55:30.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.552+0000 7fbbe37fe640 1 -- 172.21.15.37:0/2761927719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4035030 con 0x55e249075490 2024-08-31T06:55:30.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 -- 172.21.15.37:0/2761927719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 msgr2=0x55e249444cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249444cc0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fbbf402a930 tx=0x7fbbf40043b0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 -- 172.21.15.37:0/2761927719 shutdown_connections 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249444cc0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e249445200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 --2- 172.21.15.37:0/2761927719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 0x55e249444780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 -- 172.21.15.37:0/2761927719 >> 172.21.15.37:0/2761927719 conn(0x55e249092740 msgr2=0x55e249442670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 -- 172.21.15.37:0/2761927719 shutdown_connections 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.553+0000 7fbc05852740 1 -- 172.21.15.37:0/2761927719 wait complete. 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 1 -- start start 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 1 Processor -- start 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e249075490 0x55e249454250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24907d670 0x55e249454790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 0x55e2494605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e24920c890 con 0x55e24907d670 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55e249330790 con 0x55e249075490 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55e249457260 con 0x55e24909e350 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbc05852740 10 client.0 _ll_register_callbacks cb 0x55e2490b5ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbbfc878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24907d670 0x55e249454790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbbfc878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24907d670 0x55e249454790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44838/0 (socket says 172.21.15.37:44838) 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbbfc878640 1 -- 172.21.15.37:0/1466150769 learned_addr learned my addr 172.21.15.37:0/1466150769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.554+0000 7fbbfd079640 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e249075490 0x55e249454250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 0x55e2494605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbfc878640 1 -- 172.21.15.37:0/1466150769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 msgr2=0x55e2494605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbfc878640 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 0x55e2494605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbfc878640 1 -- 172.21.15.37:0/1466150769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e249075490 msgr2=0x55e249454250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbfc878640 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e249075490 0x55e249454250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbfc878640 1 -- 172.21.15.37:0/1466150769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e249367f30 con 0x55e24907d670 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbfc878640 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24907d670 0x55e249454790 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0a7e10 tx=0x7fbbec01d640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0154bb5abe8745c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbe0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/1466150769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0ac490 con 0x55e24907d670 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/1466150769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7fbbec01d250 con 0x55e24907d670 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbc05852740 1 -- 172.21.15.37:0/1466150769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbf40046c0 con 0x55e24907d670 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/1466150769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbbec0abd90 con 0x55e24907d670 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbc05852740 10 client.17649 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbc05852740 1 -- 172.21.15.37:0/1466150769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e249463010 con 0x55e24907d670 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.555+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/1466150769 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbf40046c0 con 0x55e24907d670 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.556+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/1466150769 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbbec0ac080 con 0x55e24907d670 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.556+0000 7fbc05852740 10 client.17649 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.556+0000 7fbc05852740 10 client.17649 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.556+0000 7fbc05852740 20 client.17649 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:30.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.556+0000 7fbc05852740 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e24905ccd0 0x55e249466420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.556+0000 7fbc05852740 4 client.17649 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.556+0000 7fbc05852740 1 -- 172.21.15.37:0/1466150769 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2493bc540 con 0x55e24905ccd0 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.556+0000 7fbbfd079640 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e24905ccd0 0x55e249466420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.557+0000 7fbbfd079640 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e24905ccd0 0x55e249466420 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf58e2d24bc619d0 server_cookie=62f2f209ec1680fc in_seq=0 out_seq=0 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.557+0000 7fbbe0ff9640 10 client.17649 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.557+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/1466150769 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e2493bc540 con 0x55e24905ccd0 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.557+0000 7fbbe0ff9640 10 client.17649 handle_command_reply: tid=0 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.557+0000 7fbc05852740 1 client.17649 shutdown 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 -- 172.21.15.37:0/1466150769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24907d670 msgr2=0x55e249454790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24907d670 0x55e249454790 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0a7e10 tx=0x7fbbec01d640 comp rx=0 tx=0).stop 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 -- 172.21.15.37:0/1466150769 shutdown_connections 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e24905ccd0 0x55e249466420 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e24907d670 0x55e249454790 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbbe0ff9640 0 client.17649 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:30.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24909e350 0x55e2494605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 --2- 172.21.15.37:0/1466150769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e249075490 0x55e249454250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 -- 172.21.15.37:0/1466150769 >> 172.21.15.37:0/1466150769 conn(0x55e249092740 msgr2=0x55e249440c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:30.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 -- 172.21.15.37:0/1466150769 shutdown_connections 2024-08-31T06:55:30.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 1 -- 172.21.15.37:0/1466150769 wait complete. 2024-08-31T06:55:30.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.558+0000 7fbc05852740 20 client.17649 trim_cache size 0 max 16384 2024-08-31T06:55:30.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.575+0000 7fbc05852740 1 Processor -- start 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.575+0000 7fbc05852740 1 -- start start 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbc05852740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e249446170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbc05852740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249451440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbc05852740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e249451980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbc05852740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf81afa30 con 0x55e249075490 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbc05852740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf81ad300 con 0x55e24907d670 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbc05852740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf81ab170 con 0x55e24905ccd0 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249451440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249451440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44854/0 (socket says 172.21.15.37:44854) 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 -- 172.21.15.37:0/1375865966 learned_addr learned my addr 172.21.15.37:0/1375865966 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e249451980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfd079640 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e249446170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 -- 172.21.15.37:0/1375865966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 msgr2=0x55e249446170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e249446170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 -- 172.21.15.37:0/1375865966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 msgr2=0x55e249451980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e249451980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 -- 172.21.15.37:0/1375865966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e249445570 con 0x55e249075490 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfd079640 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e249446170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbfc878640 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249451440 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e2ea0 tx=0x7fbbec0e33b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6855b15e02b0cb6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.576+0000 7fbbe2ffd640 1 -- 172.21.15.37:0/1375865966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0ab500 con 0x55e249075490 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbbe2ffd640 1 -- 172.21.15.37:0/1375865966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbec0ac490 con 0x55e249075490 2024-08-31T06:55:30.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbbe2ffd640 1 -- 172.21.15.37:0/1375865966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec01b120 con 0x55e249075490 2024-08-31T06:55:30.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 -- 172.21.15.37:0/1375865966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 msgr2=0x55e249451440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249451440 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0e2ea0 tx=0x7fbbec0e33b0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 -- 172.21.15.37:0/1375865966 shutdown_connections 2024-08-31T06:55:30.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e249451440 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e249451980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 --2- 172.21.15.37:0/1375865966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e249446170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 -- 172.21.15.37:0/1375865966 >> 172.21.15.37:0/1375865966 conn(0x55e249092740 msgr2=0x55e249449f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 -- 172.21.15.37:0/1375865966 shutdown_connections 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.577+0000 7fbc05852740 1 -- 172.21.15.37:0/1375865966 wait complete. 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 1 -- start start 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 1 Processor -- start 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e24945cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e24945b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e24945b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf81ab7c0 con 0x55e249075490 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf81acc30 con 0x55e24907d670 2024-08-31T06:55:30.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf81abe90 con 0x55e24905ccd0 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbc05852740 10 client.0 _ll_register_callbacks cb 0x7fbbec00c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbbfc878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e24945b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.578+0000 7fbbfc878640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e24945b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44870/0 (socket says 172.21.15.37:44870) 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfc878640 1 -- 172.21.15.37:0/2630564579 learned_addr learned my addr 172.21.15.37:0/2630564579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfd079640 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e24945cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e24945b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfc878640 1 -- 172.21.15.37:0/2630564579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 msgr2=0x55e24945cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfc878640 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e24945cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfc878640 1 -- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 msgr2=0x55e24945b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfc878640 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e24945b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfc878640 1 -- 172.21.15.37:0/2630564579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e24945bb00 con 0x55e249075490 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfd87a640 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e24945b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbfc878640 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e24945b000 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00cfd0 tx=0x7fbbec0b5130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d1f9b1df7c14d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:30.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbe0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/2630564579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbec0a8380 con 0x55e249075490 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/2630564579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7fbbec0b0210 con 0x55e249075490 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbc05852740 1 -- 172.21.15.37:0/2630564579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbbec0ac490 con 0x55e249075490 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/2630564579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbbec06abc0 con 0x55e249075490 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbc05852740 10 client.17655 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.579+0000 7fbc05852740 1 -- 172.21.15.37:0/2630564579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e2494d1ad0 con 0x55e249075490 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/2630564579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbec0ac490 con 0x55e249075490 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/2630564579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbbec0aaa60 con 0x55e249075490 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbc05852740 10 client.17655 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbc05852740 10 client.17655 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbc05852740 20 client.17655 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbc05852740 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e24909e350 0x55e2494d3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbc05852740 4 client.17655 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:55:30.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbc05852740 1 -- 172.21.15.37:0/2630564579 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e2493b7fe0 con 0x55e24909e350 2024-08-31T06:55:30.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.580+0000 7fbbfd079640 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e24909e350 0x55e2494d3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:30.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.581+0000 7fbbfd079640 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e24909e350 0x55e2494d3f60 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2ab2365f898d611 server_cookie=6be76ea69e86e68e in_seq=0 out_seq=0 2024-08-31T06:55:30.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.581+0000 7fbbe0ff9640 10 client.17655 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbbe0ff9640 1 -- 172.21.15.37:0/2630564579 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e2493b7fe0 con 0x55e24909e350 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbbe0ff9640 10 client.17655 handle_command_reply: tid=0 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 client.17655 shutdown 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 -- 172.21.15.37:0/2630564579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 msgr2=0x55e24945b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e24945b000 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00cfd0 tx=0x7fbbec0b5130 comp rx=0 tx=0).stop 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 -- 172.21.15.37:0/2630564579 shutdown_connections 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55e24909e350 0x55e2494d3f60 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e249075490 0x55e24945b000 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55e24907d670 0x55e24945b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbbe0ff9640 0 client.17655 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 --2- 172.21.15.37:0/2630564579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e24905ccd0 0x55e24945cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 -- 172.21.15.37:0/2630564579 >> 172.21.15.37:0/2630564579 conn(0x55e249092740 msgr2=0x55e249455700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:30.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 -- 172.21.15.37:0/2630564579 shutdown_connections 2024-08-31T06:55:30.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 1 -- 172.21.15.37:0/2630564579 wait complete. 2024-08-31T06:55:30.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.583+0000 7fbc05852740 20 client.17655 trim_cache size 0 max 16384 2024-08-31T06:55:30.588 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:55:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:55:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "c2e4ff93-1d74-48df-8d5d-598d76d0993b", 2024-08-31T06:55:30.588 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:55:30.588 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:55:30.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbe40b4cd0 msgr2=0x7fbbe40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbe40b4cd0 0x7fbbe40b71e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009270 tx=0x7fbbf0005bd0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8105030 msgr2=0x7fbbf819a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:30.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8105030 0x7fbbf819a720 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00c8c0 tx=0x7fbbec00cd80 comp rx=0 tx=0).stop 2024-08-31T06:55:30.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2241669032 shutdown_connections 2024-08-31T06:55:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fbbe40b4cd0 0x7fbbe40b71e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf8105030 0x7fbbf819a720 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf810dbb0 0x7fbbf819f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 --2- 172.21.15.37:0/2241669032 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf8104600 0x7fbbf819a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2241669032 >> 172.21.15.37:0/2241669032 conn(0x7fbbf80794e0 msgr2=0x7fbbf8100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2241669032 shutdown_connections 2024-08-31T06:55:30.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:30.584+0000 7fbbff2dd640 1 -- 172.21.15.37:0/2241669032 wait complete. 2024-08-31T06:55:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:31 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:55:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:31 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:55:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:31 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:55:31.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:31 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:55:31.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:31 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:55:31.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:31 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:55:31.322 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:31 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:55:31.323 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:31 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:55:31.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:31 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:55:31.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:31 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:55:31.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:31 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:55:31.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:31 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:55:31.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:55:31.701 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:55:32.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:32 smithi037 ceph-mon[18612]: pgmap v586: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.110+0000 7f49a0be5640 1 -- 172.21.15.37:0/3645383657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 msgr2=0x7f499c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.110+0000 7f49a0be5640 1 --2- 172.21.15.37:0/3645383657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 0x7f499c10d5f0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f4984009900 tx=0x7f498402a410 comp rx=0 tx=0).stop 2024-08-31T06:55:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.110+0000 7f49a0be5640 1 -- 172.21.15.37:0/3645383657 shutdown_connections 2024-08-31T06:55:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.110+0000 7f49a0be5640 1 --2- 172.21.15.37:0/3645383657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 0x7f499c10d5f0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.110+0000 7f49a0be5640 1 --2- 172.21.15.37:0/3645383657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c10dbb0 0x7f499c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.110+0000 7f49a0be5640 1 --2- 172.21.15.37:0/3645383657 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f499c104750 0x7f499c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.110+0000 7f49a0be5640 1 -- 172.21.15.37:0/3645383657 >> 172.21.15.37:0/3645383657 conn(0x7f499c0794d0 msgr2=0x7f499c0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.111+0000 7f49a0be5640 1 -- 172.21.15.37:0/3645383657 shutdown_connections 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.111+0000 7f49a0be5640 1 -- 172.21.15.37:0/3645383657 wait complete. 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.111+0000 7f49a0be5640 1 Processor -- start 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.111+0000 7f49a0be5640 1 -- start start 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f49a0be5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c104750 0x7f499c19a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f49a0be5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 0x7f499c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f49a0be5640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f499c10dbb0 0x7f499c19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f49a0be5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f499c113680 con 0x7f499c1050a0 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f49a0be5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f499c113500 con 0x7f499c104750 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f49a0be5640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f499c113800 con 0x7f499c10dbb0 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 0x7f499c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 0x7f499c19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44898/0 (socket says 172.21.15.37:44898) 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 -- 172.21.15.37:0/773813420 learned_addr learned my addr 172.21.15.37:0/773813420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f499a59c640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c104750 0x7f499c19a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f499ad9d640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f499c10dbb0 0x7f499c19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 -- 172.21.15.37:0/773813420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f499c10dbb0 msgr2=0x7f499c19f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f499c10dbb0 0x7f499c19f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 -- 172.21.15.37:0/773813420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c104750 msgr2=0x7f499c19a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c104750 0x7f499c19a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 -- 172.21.15.37:0/773813420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499c1a00e0 con 0x7f499c1050a0 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f499ad9d640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f499c10dbb0 0x7f499c19f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.112+0000 7f4993fff640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 0x7f499c19a710 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f4984005940 tx=0x7f49840040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.113+0000 7f49937fe640 1 -- 172.21.15.37:0/773813420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498403f030 con 0x7f499c1050a0 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.113+0000 7f49a0be5640 1 -- 172.21.15.37:0/773813420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499c1a0370 con 0x7f499c1050a0 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.113+0000 7f49937fe640 1 -- 172.21.15.37:0/773813420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4984003a80 con 0x7f499c1050a0 2024-08-31T06:55:32.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.113+0000 7f49937fe640 1 -- 172.21.15.37:0/773813420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984035070 con 0x7f499c1050a0 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.113+0000 7f49a0be5640 1 -- 172.21.15.37:0/773813420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499c1a6b30 con 0x7f499c1050a0 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.115+0000 7f49a715a740 1 Processor -- start 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f49a715a740 1 -- start start 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f49937fe640 1 -- 172.21.15.37:0/773813420 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f4984042030 con 0x7f499c1050a0 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f49a715a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44074c070 0x55d440af12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f49a715a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440af1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f49a715a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440af1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f49a715a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d440a68630 con 0x55d44072b390 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f49a715a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d440a57bc0 con 0x55d44074c070 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f49a715a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55d440a5bb70 con 0x55d4407231b0 2024-08-31T06:55:32.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f4993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440af1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f4993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440af1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44900/0 (socket says 172.21.15.37:44900) 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f4993fff640 1 -- 172.21.15.37:0/1151500048 learned_addr learned my addr 172.21.15.37:0/1151500048 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f499ad9d640 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44074c070 0x55d440af12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f499a59c640 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440af1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f4993fff640 1 -- 172.21.15.37:0/1151500048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 msgr2=0x55d440af1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f4993fff640 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440af1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f4993fff640 1 -- 172.21.15.37:0/1151500048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44074c070 msgr2=0x55d440af12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f4993fff640 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44074c070 0x55d440af12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.116+0000 7f4993fff640 1 -- 172.21.15.37:0/1151500048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4407b7650 con 0x55d44072b390 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.117+0000 7f49937fe640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49880b4ca0 0x7f49880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.117+0000 7f4993fff640 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440af1d40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f4984103180 tx=0x7f4984109d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de737511e24b81df server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.117+0000 7f499ad9d640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49880b4ca0 0x7f49880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.117+0000 7f49937fe640 1 -- 172.21.15.37:0/773813420 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f4984105ab0 con 0x7f499c1050a0 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.117+0000 7f4990ff9640 1 -- 172.21.15.37:0/1151500048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49840c8070 con 0x55d44072b390 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.117+0000 7f4990ff9640 1 -- 172.21.15.37:0/1151500048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f498410b050 con 0x55d44072b390 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.117+0000 7f4990ff9640 1 -- 172.21.15.37:0/1151500048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49840cb920 con 0x55d44072b390 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 -- 172.21.15.37:0/1151500048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 msgr2=0x55d440af1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f499ad9d640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49880b4ca0 0x7f49880b71b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4994009370 tx=0x7f4994009720 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440af1d40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f4984103180 tx=0x7f4984109d80 comp rx=0 tx=0).stop 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 -- 172.21.15.37:0/1151500048 shutdown_connections 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440af1d40 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440af1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 --2- 172.21.15.37:0/1151500048 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44074c070 0x55d440af12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 -- 172.21.15.37:0/1151500048 >> 172.21.15.37:0/1151500048 conn(0x55d440740460 msgr2=0x55d440aef1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 -- 172.21.15.37:0/1151500048 shutdown_connections 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 -- 172.21.15.37:0/1151500048 wait complete. 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 -- start start 2024-08-31T06:55:32.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.118+0000 7f49a715a740 1 Processor -- start 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f49a715a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4407231b0 0x55d440b00e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f49a715a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b01390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f49a715a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b0ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f49a715a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d4408ba700 con 0x55d4407231b0 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f49a715a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55d4409de700 con 0x55d44072b390 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f49a715a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55d440b03bc0 con 0x55d44074c070 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f49a715a740 10 client.0 _ll_register_callbacks cb 0x55d440a0ddc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4407231b0 0x55d440b00e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4407231b0 0x55d440b00e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44910/0 (socket says 172.21.15.37:44910) 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 -- 172.21.15.37:0/3725955259 learned_addr learned my addr 172.21.15.37:0/3725955259 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f4993fff640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b01390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499ad9d640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b0ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 -- 172.21.15.37:0/3725955259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 msgr2=0x55d440b0ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b0ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 -- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 msgr2=0x55d440b01390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b01390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 -- 172.21.15.37:0/3725955259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440a178b0 con 0x55d4407231b0 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499ad9d640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b0ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f4993fff640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b01390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.119+0000 7f499a59c640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4407231b0 0x55d440b00e50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f498c00ba00 tx=0x7f498c00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19ced5124d0d662 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f4981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f4981ffb640 1 -- 172.21.15.37:0/3725955259 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498c003ea0 con 0x55d4407231b0 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f4981ffb640 1 -- 172.21.15.37:0/3725955259 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f498c011640 con 0x55d4407231b0 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 1 -- 172.21.15.37:0/3725955259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f498410b050 con 0x55d4407231b0 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f4981ffb640 1 -- 172.21.15.37:0/3725955259 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f498c011840 con 0x55d4407231b0 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 10 client.17667 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:32.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 1 -- 172.21.15.37:0/3725955259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d440b0f9d0 con 0x55d4407231b0 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f4981ffb640 1 -- 172.21.15.37:0/3725955259 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f498410b050 con 0x55d4407231b0 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f4981ffb640 1 -- 172.21.15.37:0/3725955259 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f498c024b50 con 0x55d4407231b0 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 10 client.17667 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 10 client.17667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 20 client.17667 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d44070a9f0 0x55d440b12fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 4 client.17667 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.120+0000 7f49a715a740 1 -- 172.21.15.37:0/3725955259 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d440a6a580 con 0x55d44070a9f0 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.121+0000 7f4993fff640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d44070a9f0 0x55d440b12fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.121+0000 7f4981ffb640 10 client.17667 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.121+0000 7f4993fff640 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d44070a9f0 0x55d440b12fc0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e1081c6232e775f server_cookie=81ddc2d204ce1775 in_seq=0 out_seq=0 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f4981ffb640 1 -- 172.21.15.37:0/3725955259 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d440a6a580 con 0x55d44070a9f0 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f4981ffb640 10 client.17667 handle_command_reply: tid=0 2024-08-31T06:55:32.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 client.17667 shutdown 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 -- 172.21.15.37:0/3725955259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4407231b0 msgr2=0x55d440b00e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4407231b0 0x55d440b00e50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f498c00ba00 tx=0x7f498c00bec0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 -- 172.21.15.37:0/3725955259 shutdown_connections 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d44070a9f0 0x55d440b12fc0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b0ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b01390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 --2- 172.21.15.37:0/3725955259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d4407231b0 0x55d440b00e50 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f4981ffb640 0 client.17667 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 -- 172.21.15.37:0/3725955259 >> 172.21.15.37:0/3725955259 conn(0x55d440740460 msgr2=0x55d440aed770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 -- 172.21.15.37:0/3725955259 shutdown_connections 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 1 -- 172.21.15.37:0/3725955259 wait complete. 2024-08-31T06:55:32.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.122+0000 7f49a715a740 20 client.17667 trim_cache size 0 max 16384 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f49a715a740 1 Processor -- start 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f49a715a740 1 -- start start 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f49a715a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440b0cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f49a715a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b0d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f49a715a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44074c070 0x55d440aeeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f49a715a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1afaa0 con 0x55d44074c070 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f49a715a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1ad370 con 0x55d44072b390 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f49a715a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1ab1e0 con 0x55d4407231b0 2024-08-31T06:55:32.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f499ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44074c070 0x55d440aeeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f499ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44074c070 0x55d440aeeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44924/0 (socket says 172.21.15.37:44924) 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.140+0000 7f499ad9d640 1 -- 172.21.15.37:0/3590026204 learned_addr learned my addr 172.21.15.37:0/3590026204 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f4993fff640 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b0d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f499a59c640 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440b0cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f499ad9d640 1 -- 172.21.15.37:0/3590026204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 msgr2=0x55d440b0cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f499ad9d640 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440b0cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f499ad9d640 1 -- 172.21.15.37:0/3590026204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 msgr2=0x55d440b0d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f499ad9d640 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b0d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f499ad9d640 1 -- 172.21.15.37:0/3590026204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d440aff350 con 0x55d44074c070 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f499a59c640 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440b0cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f499ad9d640 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44074c070 0x55d440aeeaf0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f49940128d0 tx=0x7f4994014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f3acf11df0b17a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f4983fff640 1 -- 172.21.15.37:0/3590026204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4994004d20 con 0x55d44074c070 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f4983fff640 1 -- 172.21.15.37:0/3590026204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f499401fdd0 con 0x55d44074c070 2024-08-31T06:55:32.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.141+0000 7f4983fff640 1 -- 172.21.15.37:0/3590026204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49940058c0 con 0x55d44074c070 2024-08-31T06:55:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 -- 172.21.15.37:0/3590026204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44074c070 msgr2=0x55d440aeeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44074c070 0x55d440aeeaf0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f49940128d0 tx=0x7f4994014000 comp rx=0 tx=0).stop 2024-08-31T06:55:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 -- 172.21.15.37:0/3590026204 shutdown_connections 2024-08-31T06:55:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44074c070 0x55d440aeeaf0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d44072b390 0x55d440b0d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 --2- 172.21.15.37:0/3590026204 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d4407231b0 0x55d440b0cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 -- 172.21.15.37:0/3590026204 >> 172.21.15.37:0/3590026204 conn(0x55d440740460 msgr2=0x55d440aff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 -- 172.21.15.37:0/3590026204 shutdown_connections 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 -- 172.21.15.37:0/3590026204 wait complete. 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 -- start start 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.142+0000 7f49a715a740 1 Processor -- start 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f49a715a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4407231b0 0x55d440b055d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f49a715a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440b05b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f49a715a740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b7c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f49a715a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1ab830 con 0x55d44072b390 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f49a715a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1acca0 con 0x55d4407231b0 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f49a715a740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f499c1abf00 con 0x55d44074c070 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f49a715a740 10 client.0 _ll_register_callbacks cb 0x7f498c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:55:32.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440b05b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440b05b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44940/0 (socket says 172.21.15.37:44940) 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 -- 172.21.15.37:0/585822443 learned_addr learned my addr 172.21.15.37:0/585822443 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f499ad9d640 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b7c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f499a59c640 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4407231b0 0x55d440b055d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 -- 172.21.15.37:0/585822443 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 msgr2=0x55d440b7c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b7c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 -- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4407231b0 msgr2=0x55d440b055d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4407231b0 0x55d440b055d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 -- 172.21.15.37:0/585822443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d440b7cec0 con 0x55d44072b390 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f499a59c640 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4407231b0 0x55d440b055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:55:32.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4993fff640 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440b05b10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f49841032c0 tx=0x7f4984009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9403aaaaa99e5d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.143+0000 7f4981ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f4981ffb640 1 -- 172.21.15.37:0/585822443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4984049040 con 0x55d44072b390 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f4981ffb640 1 -- 172.21.15.37:0/585822443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f49841097e0 con 0x55d44072b390 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 1 -- 172.21.15.37:0/585822443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499401fdd0 con 0x55d44072b390 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f4981ffb640 1 -- 172.21.15.37:0/585822443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49840cbb00 con 0x55d44072b390 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 10 client.17673 fetch_fsmap learned FSMap version 25 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 1 -- 172.21.15.37:0/585822443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d440b7e0c0 con 0x55d44072b390 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f4981ffb640 1 -- 172.21.15.37:0/585822443 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49840af020 con 0x55d44072b390 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f4981ffb640 1 -- 172.21.15.37:0/585822443 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49840f1070 con 0x55d44072b390 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 10 client.17673 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 10 client.17673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 20 client.17673 populate_metadata read hostname 'smithi037' 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4406dfda0 0x55d440b804c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:55:32.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 4 client.17673 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:55:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.144+0000 7f49a715a740 1 -- 172.21.15.37:0/585822443 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d440b01dc0 con 0x55d4406dfda0 2024-08-31T06:55:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.145+0000 7f499a59c640 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4406dfda0 0x55d440b804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:55:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.145+0000 7f4981ffb640 10 client.17673 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.145+0000 7f499a59c640 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4406dfda0 0x55d440b804c0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cce132edf62be571 server_cookie=ca0c5846b8c3468 in_seq=0 out_seq=0 2024-08-31T06:55:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.145+0000 7f4981ffb640 1 -- 172.21.15.37:0/585822443 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x55d440b01dc0 con 0x55d4406dfda0 2024-08-31T06:55:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.145+0000 7f4981ffb640 10 client.17673 handle_command_reply: tid=0 2024-08-31T06:55:32.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.145+0000 7f49a715a740 1 client.17673 shutdown 2024-08-31T06:55:32.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 -- 172.21.15.37:0/585822443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 msgr2=0x55d440b05b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440b05b10 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f49841032c0 tx=0x7f4984009260 comp rx=0 tx=0).stop 2024-08-31T06:55:32.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 -- 172.21.15.37:0/585822443 shutdown_connections 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55d4406dfda0 0x55d440b804c0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44072b390 0x55d440b05b10 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d44074c070 0x55d440b7c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 --2- 172.21.15.37:0/585822443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55d4407231b0 0x55d440b055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 -- 172.21.15.37:0/585822443 >> 172.21.15.37:0/585822443 conn(0x55d440740460 msgr2=0x55d440aeeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f4981ffb640 0 client.17673 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 -- 172.21.15.37:0/585822443 shutdown_connections 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 1 -- 172.21.15.37:0/585822443 wait complete. 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a715a740 20 client.17673 trim_cache size 0 max 16384 2024-08-31T06:55:32.152 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "c2e4ff93-1d74-48df-8d5d-598d76d0993b": { 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "c2e4ff93-1d74-48df-8d5d-598d76d0993b", 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "c2e4ff93-1d74-48df-8d5d-598d76d0993b": { 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:55:30.580499+0000", 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.153 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "232816fe-0f29-450c-bde6-cd0f5fca6fb1": { 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:48.402851+0000", 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "5235cd7a-0026-439c-bb69-023a1bfcedc7": { 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:26.646033+0000", 2024-08-31T06:55:32.154 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.156 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.157 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:55:32.158 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.159 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "5fd7f13e-fd58-49db-8497-2a7be28cf588": { 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:37.375943+0000", 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:55:32.160 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:55:32.161 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:55:32.163 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:55:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.146+0000 7f49a0be5640 1 -- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49880b4ca0 msgr2=0x7f49880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49880b4ca0 0x7f49880b71b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4994009370 tx=0x7f4994009720 comp rx=0 tx=0).stop 2024-08-31T06:55:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 -- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 msgr2=0x7f499c19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:55:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 0x7f499c19a710 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f4984005940 tx=0x7f49840040e0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 -- 172.21.15.37:0/773813420 shutdown_connections 2024-08-31T06:55:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49880b4ca0 0x7f49880b71b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c1050a0 0x7f499c19a710 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f499c10dbb0 0x7f499c19f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 --2- 172.21.15.37:0/773813420 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c104750 0x7f499c19a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:55:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 -- 172.21.15.37:0/773813420 >> 172.21.15.37:0/773813420 conn(0x7f499c0794d0 msgr2=0x7f499c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:55:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 -- 172.21.15.37:0/773813420 shutdown_connections 2024-08-31T06:55:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:55:32.147+0000 7f49a0be5640 1 -- 172.21.15.37:0/773813420 wait complete. 2024-08-31T06:55:32.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:32 smithi106 ceph-mon[22134]: pgmap v586: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:32.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:32 smithi066 ceph-mon[22244]: pgmap v586: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-31T06:55:32.919 INFO:tasks.cephfs.filesystem:scrub status for tag:c2e4ff93-1d74-48df-8d5d-598d76d0993b - {'path': '/', 'tag': 'c2e4ff93-1d74-48df-8d5d-598d76d0993b', 'options': 'recursive,force'} 2024-08-31T06:55:33.288 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:33 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:55:33.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:33 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:55:33.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:33 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:55:34.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:34 smithi106 ceph-mon[22134]: pgmap v587: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-08-31T06:55:34.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:34 smithi037 ceph-mon[18612]: pgmap v587: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-08-31T06:55:34.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:34 smithi066 ceph-mon[22244]: pgmap v587: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-08-31T06:55:36.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:36 smithi106 ceph-mon[22134]: pgmap v588: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-08-31T06:55:36.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:36 smithi037 ceph-mon[18612]: pgmap v588: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-08-31T06:55:36.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:36 smithi066 ceph-mon[22244]: pgmap v588: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 5 op/s 2024-08-31T06:55:38.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:38 smithi106 ceph-mon[22134]: pgmap v589: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:55:38.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:38 smithi037 ceph-mon[18612]: pgmap v589: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:55:38.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:38 smithi066 ceph-mon[22244]: pgmap v589: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7 op/s 2024-08-31T06:55:40.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:40 smithi106 ceph-mon[22134]: pgmap v590: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:55:40.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:40 smithi037 ceph-mon[18612]: pgmap v590: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:55:40.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:40 smithi066 ceph-mon[22244]: pgmap v590: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:55:42.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:42 smithi106 ceph-mon[22134]: pgmap v591: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:55:42.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:42 smithi037 ceph-mon[18612]: pgmap v591: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:55:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:42 smithi066 ceph-mon[22244]: pgmap v591: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 6 op/s 2024-08-31T06:55:44.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:44 smithi106 ceph-mon[22134]: pgmap v592: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T06:55:44.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:44 smithi037 ceph-mon[18612]: pgmap v592: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T06:55:44.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:44 smithi066 ceph-mon[22244]: pgmap v592: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-08-31T06:55:46.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:46 smithi106 ceph-mon[22134]: pgmap v593: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:55:46.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:46 smithi037 ceph-mon[18612]: pgmap v593: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:55:46.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:46 smithi066 ceph-mon[22244]: pgmap v593: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:55:48.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:48 smithi106 ceph-mon[22134]: pgmap v594: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-08-31T06:55:48.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:48 smithi037 ceph-mon[18612]: pgmap v594: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-08-31T06:55:48.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:48 smithi066 ceph-mon[22244]: pgmap v594: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-08-31T06:55:50.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:50 smithi106 ceph-mon[22134]: pgmap v595: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:55:50.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:50 smithi037 ceph-mon[18612]: pgmap v595: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:55:50.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:50 smithi066 ceph-mon[22244]: pgmap v595: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:55:52.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:52 smithi106 ceph-mon[22134]: pgmap v596: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:55:52.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:52 smithi037 ceph-mon[18612]: pgmap v596: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:55:52.388 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:52 smithi066 ceph-mon[22244]: pgmap v596: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:55:54.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:54 smithi106 ceph-mon[22134]: pgmap v597: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:55:54.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:54 smithi037 ceph-mon[18612]: pgmap v597: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:55:54.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:54 smithi066 ceph-mon[22244]: pgmap v597: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:55:56.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:56 smithi106 ceph-mon[22134]: pgmap v598: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:55:56.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:56 smithi037 ceph-mon[18612]: pgmap v598: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:55:56.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:56 smithi066 ceph-mon[22244]: pgmap v598: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:55:58.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:55:58 smithi106 ceph-mon[22134]: pgmap v599: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:55:58.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:55:58 smithi037 ceph-mon[18612]: pgmap v599: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:55:58.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:55:58 smithi066 ceph-mon[22244]: pgmap v599: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:56:00.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:00 smithi106 ceph-mon[22134]: pgmap v600: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:56:00.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:00 smithi037 ceph-mon[18612]: pgmap v600: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:56:00.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:00 smithi066 ceph-mon[22244]: pgmap v600: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:56:01.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:56:01.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:56:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:56:01.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:56:01.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:56:01.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:56:01.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:56:01.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:56:01.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:56:01.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:56:01.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:56:01.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:56:02.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:02 smithi037 ceph-mon[18612]: pgmap v601: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:02.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:02 smithi066 ceph-mon[22244]: pgmap v601: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:02.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:02 smithi106 ceph-mon[22134]: pgmap v601: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:02.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:56:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:03.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 -- 172.21.15.37:0/882882975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 msgr2=0x7ff0d0103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 --2- 172.21.15.37:0/882882975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 0x7ff0d0103d30 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009900 tx=0x7ff0c002a410 comp rx=0 tx=0).stop 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 -- 172.21.15.37:0/882882975 shutdown_connections 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 --2- 172.21.15.37:0/882882975 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d0109bb0 0x7ff0d01103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 --2- 172.21.15.37:0/882882975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0d0109260 0x7ff0d0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 --2- 172.21.15.37:0/882882975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 0x7ff0d0103d30 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 -- 172.21.15.37:0/882882975 >> 172.21.15.37:0/882882975 conn(0x7ff0d00ff3b0 msgr2=0x7ff0d0101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 -- 172.21.15.37:0/882882975 shutdown_connections 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.723+0000 7ff0d609c640 1 -- 172.21.15.37:0/882882975 wait complete. 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0d609c640 1 Processor -- start 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0d609c640 1 -- start start 2024-08-31T06:56:03.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0d609c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 0x7ff0d019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0d609c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0d0109260 0x7ff0d019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0d609c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d0109bb0 0x7ff0d019f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0d609c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d0113720 con 0x7ff0d0103920 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0d609c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01135a0 con 0x7ff0d0109260 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0d609c640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01138a0 con 0x7ff0d0109bb0 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 0x7ff0d019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 0x7ff0d019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40526/0 (socket says 172.21.15.37:40526) 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0cf7fe640 1 -- 172.21.15.37:0/1017318679 learned_addr learned my addr 172.21.15.37:0/1017318679 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0d0109260 0x7ff0d019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.724+0000 7ff0cffff640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d0109bb0 0x7ff0d019f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0cf7fe640 1 -- 172.21.15.37:0/1017318679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d0109bb0 msgr2=0x7ff0d019f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0cf7fe640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d0109bb0 0x7ff0d019f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0cf7fe640 1 -- 172.21.15.37:0/1017318679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0d0109260 msgr2=0x7ff0d019a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0cf7fe640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0d0109260 0x7ff0d019a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0cf7fe640 1 -- 172.21.15.37:0/1017318679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d01a00e0 con 0x7ff0d0103920 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0d0109260 0x7ff0d019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0cffff640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d0109bb0 0x7ff0d019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0cf7fe640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 0x7ff0d019a170 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009230 tx=0x7ff0c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0ccff9640 1 -- 172.21.15.37:0/1017318679 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c003f030 con 0x7ff0d0103920 2024-08-31T06:56:03.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0d609c640 1 -- 172.21.15.37:0/1017318679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d01a0370 con 0x7ff0d0103920 2024-08-31T06:56:03.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0ccff9640 1 -- 172.21.15.37:0/1017318679 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c0003a80 con 0x7ff0d0103920 2024-08-31T06:56:03.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0ccff9640 1 -- 172.21.15.37:0/1017318679 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0035070 con 0x7ff0d0103920 2024-08-31T06:56:03.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.725+0000 7ff0d609c640 1 -- 172.21.15.37:0/1017318679 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d01a6b30 con 0x7ff0d0103920 2024-08-31T06:56:03.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0dc611740 1 Processor -- start 2024-08-31T06:56:03.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0dc611740 1 -- start start 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x5632314032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231403800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 0x563231403d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0dc611740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56323137a630 con 0x56323105e070 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0dc611740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x563231369bc0 con 0x5632310351b0 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0dc611740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x56323136db70 con 0x56323103d390 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x5632314032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x5632314032c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40530/0 (socket says 172.21.15.37:40530) 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.728+0000 7ff0cffff640 1 -- 172.21.15.37:0/2271042664 learned_addr learned my addr 172.21.15.37:0/2271042664 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/2271042664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 0x563231403d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0cffff640 1 -- 172.21.15.37:0/2271042664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 msgr2=0x563231403d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0cffff640 1 --2- 172.21.15.37:0/2271042664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 0x563231403d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0cffff640 1 -- 172.21.15.37:0/2271042664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 msgr2=0x563231403800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0cffff640 1 --2- 172.21.15.37:0/2271042664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231403800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0cffff640 1 -- 172.21.15.37:0/2271042664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632310c9650 con 0x56323105e070 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0cffff640 1 --2- 172.21.15.37:0/2271042664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x5632314032c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8010370 tx=0x7ff0c8010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c395a2cb9b928a6f server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0ccff9640 1 -- 172.21.15.37:0/1017318679 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7ff0c0042030 con 0x7ff0d0103920 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0b5ffb640 1 -- 172.21.15.37:0/2271042664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8016070 con 0x56323105e070 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0b5ffb640 1 -- 172.21.15.37:0/2271042664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c8012ba0 con 0x56323105e070 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.729+0000 7ff0b5ffb640 1 -- 172.21.15.37:0/2271042664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c801bbe0 con 0x56323105e070 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0ccff9640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0b80b4ca0 0x7ff0b80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0cf7fe640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0b80b4ca0 0x7ff0b80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0ccff9640 1 -- 172.21.15.37:0/1017318679 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7ff0c0105e40 con 0x7ff0d0103920 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0dc611740 1 -- 172.21.15.37:0/2271042664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 msgr2=0x5632314032c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0dc611740 1 --2- 172.21.15.37:0/2271042664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x5632314032c0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8010370 tx=0x7ff0c8010830 comp rx=0 tx=0).stop 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0dc611740 1 -- 172.21.15.37:0/2271042664 shutdown_connections 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0dc611740 1 --2- 172.21.15.37:0/2271042664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 0x563231403d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0dc611740 1 --2- 172.21.15.37:0/2271042664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231403800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0dc611740 1 --2- 172.21.15.37:0/2271042664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x5632314032c0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0dc611740 1 -- 172.21.15.37:0/2271042664 >> 172.21.15.37:0/2271042664 conn(0x563231052460 msgr2=0x5632314011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.730+0000 7ff0dc611740 1 -- 172.21.15.37:0/2271042664 shutdown_connections 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.731+0000 7ff0cf7fe640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0b80b4ca0 0x7ff0b80b71b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0003fd0 tx=0x7ff0c0040000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.731+0000 7ff0dc611740 1 -- 172.21.15.37:0/2271042664 wait complete. 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.731+0000 7ff0dc611740 1 -- start start 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.731+0000 7ff0dc611740 1 Processor -- start 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231412ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231413440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323105e070 0x56323141f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0dc611740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5632311cc700 con 0x56323103d390 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0dc611740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5632312f0700 con 0x5632310351b0 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0dc611740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x563231415dd0 con 0x56323105e070 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0dc611740 10 client.0 _ll_register_callbacks cb 0x56323131fdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:03.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231413440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231413440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40546/0 (socket says 172.21.15.37:40546) 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 -- 172.21.15.37:0/3256243972 learned_addr learned my addr 172.21.15.37:0/3256243972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0cffff640 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231412ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0cffff640 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323105e070 0x56323141f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 -- 172.21.15.37:0/3256243972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323105e070 msgr2=0x56323141f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323105e070 0x56323141f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 -- 172.21.15.37:0/3256243972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 msgr2=0x563231412ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231412ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 -- 172.21.15.37:0/3256243972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632313298b0 con 0x56323103d390 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0cffff640 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323105e070 0x56323141f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231413440 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4013790 tx=0x7ff0c4013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91caa338561b78ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.732+0000 7ff0aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:03.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0aeffd640 1 -- 172.21.15.37:0/3256243972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4020060 con 0x56323103d390 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 1 -- 172.21.15.37:0/3256243972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0c8012ba0 con 0x56323103d390 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0aeffd640 1 -- 172.21.15.37:0/3256243972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7ff0c4011dd0 con 0x56323103d390 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0aeffd640 1 -- 172.21.15.37:0/3256243972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff0c400f450 con 0x56323103d390 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 10 client.17685 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 1 -- 172.21.15.37:0/3256243972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563231421cd0 con 0x56323103d390 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0aeffd640 1 -- 172.21.15.37:0/3256243972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c8012ba0 con 0x56323103d390 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0aeffd640 1 -- 172.21.15.37:0/3256243972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff0c401a030 con 0x56323103d390 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 10 client.17685 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 20 client.17685 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56323101c9f0 0x563231425220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 4 client.17685 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:03.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.733+0000 7ff0dc611740 1 -- 172.21.15.37:0/3256243972 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56323137c580 con 0x56323101c9f0 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.734+0000 7ff0cffff640 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56323101c9f0 0x563231425220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.734+0000 7ff0cffff640 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56323101c9f0 0x563231425220 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8579e1b973bf8094 server_cookie=c005b118eb481009 in_seq=0 out_seq=0 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.734+0000 7ff0aeffd640 10 client.17685 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0aeffd640 1 -- 172.21.15.37:0/3256243972 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56323137c580 con 0x56323101c9f0 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0aeffd640 10 client.17685 handle_command_reply: tid=0 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 client.17685 shutdown 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 -- 172.21.15.37:0/3256243972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 msgr2=0x563231413440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231413440 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4013790 tx=0x7ff0c4013c50 comp rx=0 tx=0).stop 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 -- 172.21.15.37:0/3256243972 shutdown_connections 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x56323101c9f0 0x563231425220 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231413440 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323105e070 0x56323141f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 --2- 172.21.15.37:0/3256243972 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231412ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 -- 172.21.15.37:0/3256243972 >> 172.21.15.37:0/3256243972 conn(0x563231052460 msgr2=0x563231406450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:03.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0aeffd640 0 client.17685 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:03.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 -- 172.21.15.37:0/3256243972 shutdown_connections 2024-08-31T06:56:03.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 1 -- 172.21.15.37:0/3256243972 wait complete. 2024-08-31T06:56:03.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.735+0000 7ff0dc611740 20 client.17685 trim_cache size 0 max 16384 2024-08-31T06:56:03.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0dc611740 1 Processor -- start 2024-08-31T06:56:03.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0dc611740 1 -- start start 2024-08-31T06:56:03.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231414af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 0x56323141f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x56323141f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0dc611740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01afac0 con 0x56323105e070 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0dc611740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01ad390 con 0x5632310351b0 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0dc611740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01ab200 con 0x56323103d390 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x56323141f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x56323141f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40548/0 (socket says 172.21.15.37:40548) 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.753+0000 7ff0cffff640 1 -- 172.21.15.37:0/1162713984 learned_addr learned my addr 172.21.15.37:0/1162713984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 0x56323141f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0cffff640 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231414af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0cffff640 1 -- 172.21.15.37:0/1162713984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 msgr2=0x56323141f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0cffff640 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 0x56323141f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0cffff640 1 -- 172.21.15.37:0/1162713984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 msgr2=0x563231414af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0cffff640 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231414af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0cffff640 1 -- 172.21.15.37:0/1162713984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563231407070 con 0x56323105e070 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0cffff640 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x56323141f540 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80099a0 tx=0x7ff0c8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651b1ce1199f2bfe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0b57fa640 1 -- 172.21.15.37:0/1162713984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8035070 con 0x56323105e070 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0b57fa640 1 -- 172.21.15.37:0/1162713984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c801b8f0 con 0x56323105e070 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.754+0000 7ff0b57fa640 1 -- 172.21.15.37:0/1162713984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8016070 con 0x56323105e070 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 -- 172.21.15.37:0/1162713984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 msgr2=0x56323141f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x56323141f540 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7ff0c80099a0 tx=0x7ff0c8009b80 comp rx=0 tx=0).stop 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 -- 172.21.15.37:0/1162713984 shutdown_connections 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323105e070 0x56323141f540 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56323103d390 0x56323141f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 --2- 172.21.15.37:0/1162713984 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5632310351b0 0x563231414af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 -- 172.21.15.37:0/1162713984 >> 172.21.15.37:0/1162713984 conn(0x563231052460 msgr2=0x5632314143e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 -- 172.21.15.37:0/1162713984 shutdown_connections 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.755+0000 7ff0dc611740 1 -- 172.21.15.37:0/1162713984 wait complete. 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 1 -- start start 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 1 Processor -- start 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5632310351b0 0x563231417150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231417690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56323105e070 0x563231417bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01ab850 con 0x56323103d390 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01accc0 con 0x56323105e070 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d01abf20 con 0x5632310351b0 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0dc611740 10 client.0 _ll_register_callbacks cb 0x7ff0c4009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:03.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231417690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0ceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231417690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40554/0 (socket says 172.21.15.37:40554) 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0ceffd640 1 -- 172.21.15.37:0/4224870801 learned_addr learned my addr 172.21.15.37:0/4224870801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.756+0000 7ff0cffff640 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5632310351b0 0x563231417150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0cffff640 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56323105e070 0x563231417bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0ceffd640 1 -- 172.21.15.37:0/4224870801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5632310351b0 msgr2=0x563231417150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5632310351b0 0x563231417150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0ceffd640 1 -- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56323105e070 msgr2=0x563231417bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56323105e070 0x563231417bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0ceffd640 1 -- 172.21.15.37:0/4224870801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56323148ed10 con 0x56323103d390 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0cffff640 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56323105e070 0x563231417bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0ceffd640 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231417690 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x5632313fb3c0 tx=0x7ff0c401b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fddee4a272ff14 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0aeffd640 1 -- 172.21.15.37:0/4224870801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4032060 con 0x56323103d390 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0aeffd640 1 -- 172.21.15.37:0/4224870801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7ff0c401bd90 con 0x56323103d390 2024-08-31T06:56:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0dc611740 1 -- 172.21.15.37:0/4224870801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0c801b8f0 con 0x56323103d390 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0aeffd640 1 -- 172.21.15.37:0/4224870801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff0c4005110 con 0x56323103d390 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0dc611740 10 client.17691 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.757+0000 7ff0dc611740 1 -- 172.21.15.37:0/4224870801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56323148ff80 con 0x56323103d390 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0aeffd640 1 -- 172.21.15.37:0/4224870801 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0c801b8f0 con 0x56323103d390 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0aeffd640 1 -- 172.21.15.37:0/4224870801 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff0c401a040 con 0x56323103d390 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0dc611740 10 client.17691 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0dc611740 10 client.17691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0dc611740 20 client.17691 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0dc611740 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563230ff1da0 0x563231492770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0dc611740 4 client.17691 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0dc611740 1 -- 172.21.15.37:0/4224870801 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563231378020 con 0x563230ff1da0 2024-08-31T06:56:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.758+0000 7ff0cffff640 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563230ff1da0 0x563231492770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0aeffd640 10 client.17691 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0cffff640 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563230ff1da0 0x563231492770 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0f4b07e3d11863 server_cookie=55014446384f2dac in_seq=0 out_seq=0 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0aeffd640 1 -- 172.21.15.37:0/4224870801 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x563231378020 con 0x563230ff1da0 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0aeffd640 10 client.17691 handle_command_reply: tid=0 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 client.17691 shutdown 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 -- 172.21.15.37:0/4224870801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 msgr2=0x563231417690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231417690 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x5632313fb3c0 tx=0x7ff0c401b620 comp rx=0 tx=0).stop 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 -- 172.21.15.37:0/4224870801 shutdown_connections 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x563230ff1da0 0x563231492770 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56323103d390 0x563231417690 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56323105e070 0x563231417bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 --2- 172.21.15.37:0/4224870801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5632310351b0 0x563231417150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0dc611740 1 -- 172.21.15.37:0/4224870801 >> 172.21.15.37:0/4224870801 conn(0x563231052460 msgr2=0x563231414180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.759+0000 7ff0aeffd640 0 client.17691 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0dc611740 1 -- 172.21.15.37:0/4224870801 shutdown_connections 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0dc611740 1 -- 172.21.15.37:0/4224870801 wait complete. 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0dc611740 20 client.17691 trim_cache size 0 max 16384 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:56:03.765 INFO:teuthology.orchestra.run.smithi037.stdout: "c2e4ff93-1d74-48df-8d5d-598d76d0993b": { 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:55:30.580499+0000", 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "232816fe-0f29-450c-bde6-cd0f5fca6fb1": { 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:48.402851+0000", 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.766 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "5235cd7a-0026-439c-bb69-023a1bfcedc7": { 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:26.646033+0000", 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.767 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.768 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:56:03.769 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:56:03.771 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.772 INFO:teuthology.orchestra.run.smithi037.stdout: "5fd7f13e-fd58-49db-8497-2a7be28cf588": { 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:37.375943+0000", 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.774 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:03.775 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:03.776 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:03.776 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:03.776 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:03.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:03.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:03.776 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:56:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 -- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0b80b4ca0 msgr2=0x7ff0b80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0b80b4ca0 0x7ff0b80b71b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0003fd0 tx=0x7ff0c0040000 comp rx=0 tx=0).stop 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 -- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 msgr2=0x7ff0d019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 0x7ff0d019a170 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009230 tx=0x7ff0c0004270 comp rx=0 tx=0).stop 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 -- 172.21.15.37:0/1017318679 shutdown_connections 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7ff0b80b4ca0 0x7ff0b80b71b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0d0109bb0 0x7ff0d019f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0d0109260 0x7ff0d019a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 --2- 172.21.15.37:0/1017318679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d0103920 0x7ff0d019a170 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 -- 172.21.15.37:0/1017318679 >> 172.21.15.37:0/1017318679 conn(0x7ff0d00ff3b0 msgr2=0x7ff0d01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 -- 172.21.15.37:0/1017318679 shutdown_connections 2024-08-31T06:56:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:03.760+0000 7ff0d609c640 1 -- 172.21.15.37:0/1017318679 wait complete. 2024-08-31T06:56:04.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:04 smithi037 ceph-mon[18612]: pgmap v602: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:56:04.367 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:04 smithi106 ceph-mon[22134]: pgmap v602: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:56:04.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:04 smithi066 ceph-mon[22244]: pgmap v602: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:56:04.535 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:56:04.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:56:04.791 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 -- 172.21.15.37:0/3845301538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c103900 msgr2=0x7f488c103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 --2- 172.21.15.37:0/3845301538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c103900 0x7f488c103d10 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f487c009900 tx=0x7f487c02a410 comp rx=0 tx=0).stop 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 -- 172.21.15.37:0/3845301538 shutdown_connections 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 --2- 172.21.15.37:0/3845301538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f488c109b90 0x7f488c1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 --2- 172.21.15.37:0/3845301538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c109240 0x7f488c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 --2- 172.21.15.37:0/3845301538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c103900 0x7f488c103d10 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 -- 172.21.15.37:0/3845301538 >> 172.21.15.37:0/3845301538 conn(0x7f488c07b5f0 msgr2=0x7f488c07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 -- 172.21.15.37:0/3845301538 shutdown_connections 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.297+0000 7f4891557640 1 -- 172.21.15.37:0/3845301538 wait complete. 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f4891557640 1 Processor -- start 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f4891557640 1 -- start start 2024-08-31T06:56:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f4891557640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c103900 0x7f488c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f4891557640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c109240 0x7f488c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f4891557640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f488c109b90 0x7f488c19f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f4891557640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113700 con 0x7f488c109240 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f4891557640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113580 con 0x7f488c109b90 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f4891557640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113880 con 0x7f488c103900 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c109240 0x7f488c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c109240 0x7f488c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43762/0 (socket says 172.21.15.37:43762) 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488a7fc640 1 -- 172.21.15.37:0/2723674019 learned_addr learned my addr 172.21.15.37:0/2723674019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488affd640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c103900 0x7f488c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488b7fe640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f488c109b90 0x7f488c19f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488a7fc640 1 -- 172.21.15.37:0/2723674019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c103900 msgr2=0x7f488c19a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488a7fc640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c103900 0x7f488c19a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488a7fc640 1 -- 172.21.15.37:0/2723674019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f488c109b90 msgr2=0x7f488c19f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488a7fc640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f488c109b90 0x7f488c19f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488a7fc640 1 -- 172.21.15.37:0/2723674019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c1a00c0 con 0x7f488c109240 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.298+0000 7f488b7fe640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f488c109b90 0x7f488c19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.299+0000 7f488a7fc640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c109240 0x7f488c19a6f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f487400e9c0 tx=0x7f487400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.299+0000 7f4883fff640 1 -- 172.21.15.37:0/2723674019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487400ccc0 con 0x7f488c109240 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.299+0000 7f4883fff640 1 -- 172.21.15.37:0/2723674019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48740054b0 con 0x7f488c109240 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.299+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c1a03b0 con 0x7f488c109240 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.299+0000 7f4883fff640 1 -- 172.21.15.37:0/2723674019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874010430 con 0x7f488c109240 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.299+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1a6b10 con 0x7f488c109240 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.300+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c103d10 con 0x7f488c109240 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.302+0000 7f4883fff640 1 -- 172.21.15.37:0/2723674019 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f4874004f00 con 0x7f488c109240 2024-08-31T06:56:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.302+0000 7f4883fff640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48780b4ca0 0x7f48780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.303+0000 7f4883fff640 1 -- 172.21.15.37:0/2723674019 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f48740e5bb0 con 0x7f488c109240 2024-08-31T06:56:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.303+0000 7f488affd640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48780b4ca0 0x7f48780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.303+0000 7f488affd640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48780b4ca0 0x7f48780b71b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f487c000c00 tx=0x7f487c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.306+0000 7f4883fff640 1 -- 172.21.15.37:0/2723674019 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f4874056130 con 0x7f488c109240 2024-08-31T06:56:05.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.528+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f488c19b280 con 0x7f488c109240 2024-08-31T06:56:05.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.529+0000 7f4883fff640 1 -- 172.21.15.37:0/2723674019 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f488c19b280 con 0x7f488c109240 2024-08-31T06:56:05.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:56:05.530 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:56:05.531 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48780b4ca0 msgr2=0x7f48780b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48780b4ca0 0x7f48780b71b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f487c000c00 tx=0x7f487c009680 comp rx=0 tx=0).stop 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c109240 msgr2=0x7f488c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c109240 0x7f488c19a6f0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f487400e9c0 tx=0x7f487400ee80 comp rx=0 tx=0).stop 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 shutdown_connections 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f48780b4ca0 0x7f48780b71b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f488c109240 0x7f488c19a6f0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f488c109b90 0x7f488c19f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 --2- 172.21.15.37:0/2723674019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488c103900 0x7f488c19a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 >> 172.21.15.37:0/2723674019 conn(0x7f488c07b5f0 msgr2=0x7f488c107340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 shutdown_connections 2024-08-31T06:56:05.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:05.532+0000 7f4891557640 1 -- 172.21.15.37:0/2723674019 wait complete. 2024-08-31T06:56:06.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:06 smithi037 ceph-mon[18612]: pgmap v603: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:56:06.317 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:06 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2723674019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:56:06.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:56:06.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:06 smithi066 ceph-mon[22244]: pgmap v603: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:56:06.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:06 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2723674019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:56:06.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:06 smithi106 ceph-mon[22134]: pgmap v603: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:56:06.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:06 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2723674019' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:56:06.596 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 -- 172.21.15.37:0/2864511069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 msgr2=0x7f8380102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 --2- 172.21.15.37:0/2864511069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 0x7f8380102c10 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f837c009900 tx=0x7f837c02a410 comp rx=0 tx=0).stop 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 -- 172.21.15.37:0/2864511069 shutdown_connections 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 --2- 172.21.15.37:0/2864511069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380108a90 0x7f838010f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 --2- 172.21.15.37:0/2864511069 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380108140 0x7f8380108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 --2- 172.21.15.37:0/2864511069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 0x7f8380102c10 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 -- 172.21.15.37:0/2864511069 >> 172.21.15.37:0/2864511069 conn(0x7f83800794d0 msgr2=0x7f83800798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 -- 172.21.15.37:0/2864511069 shutdown_connections 2024-08-31T06:56:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.071+0000 7f8387982640 1 -- 172.21.15.37:0/2864511069 wait complete. 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f8387982640 1 Processor -- start 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f8387982640 1 -- start start 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f8387982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 0x7f838010fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f8387982640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380108140 0x7f8380110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f8387982640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380108a90 0x7f83801107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f8387982640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83801136d0 con 0x7f8380102800 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f8387982640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f8380113550 con 0x7f8380108140 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f8387982640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f8380113850 con 0x7f8380108a90 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f838571e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 0x7f838010fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f838571e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 0x7f838010fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43780/0 (socket says 172.21.15.37:43780) 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.072+0000 7f838571e640 1 -- 172.21.15.37:0/3579706719 learned_addr learned my addr 172.21.15.37:0/3579706719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.073+0000 7f8385f1f640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380108a90 0x7f83801107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.073+0000 7f8384f1d640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380108140 0x7f8380110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.073+0000 7f838571e640 1 -- 172.21.15.37:0/3579706719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380108a90 msgr2=0x7f83801107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.073+0000 7f838571e640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380108a90 0x7f83801107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.073+0000 7f838571e640 1 -- 172.21.15.37:0/3579706719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380108140 msgr2=0x7f8380110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.073+0000 7f838571e640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380108140 0x7f8380110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.073+0000 7f838571e640 1 -- 172.21.15.37:0/3579706719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83801a8310 con 0x7f8380102800 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.073+0000 7f838571e640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 0x7f838010fd50 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f837c009a20 tx=0x7f837c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.075+0000 7f83767fc640 1 -- 172.21.15.37:0/3579706719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c03f030 con 0x7f8380102800 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.075+0000 7f8387982640 1 -- 172.21.15.37:0/3579706719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83801a85a0 con 0x7f8380102800 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.075+0000 7f83767fc640 1 -- 172.21.15.37:0/3579706719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f837c0035f0 con 0x7f8380102800 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.075+0000 7f83767fc640 1 -- 172.21.15.37:0/3579706719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c035070 con 0x7f8380102800 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.075+0000 7f8387982640 1 -- 172.21.15.37:0/3579706719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83801a8ad0 con 0x7f8380102800 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.077+0000 7f838def7740 1 Processor -- start 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.077+0000 7f83767fc640 1 -- 172.21.15.37:0/3579706719 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f837c032260 con 0x7f8380102800 2024-08-31T06:56:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838def7740 1 -- start start 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838def7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 0x564ecb174310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838def7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb174850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838def7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb174d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838def7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564ecb0eb680 con 0x564ecada61b0 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838def7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564ecb0dac10 con 0x564ecadae390 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838def7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564ecb0debc0 con 0x564ecadcf070 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838571e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb174850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838571e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb174850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43784/0 (socket says 172.21.15.37:43784) 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838571e640 1 -- 172.21.15.37:0/836680866 learned_addr learned my addr 172.21.15.37:0/836680866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f8385f1f640 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 0x564ecb174310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f8384f1d640 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb174d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838571e640 1 -- 172.21.15.37:0/836680866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 msgr2=0x564ecb174310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838571e640 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 0x564ecb174310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838571e640 1 -- 172.21.15.37:0/836680866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 msgr2=0x564ecb174d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838571e640 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb174d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f838571e640 1 -- 172.21.15.37:0/836680866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ecae3a650 con 0x564ecada61b0 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.078+0000 7f8384f1d640 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb174d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.079+0000 7f83767fc640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f836c0b4ca0 0x7f836c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.079+0000 7f838571e640 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb174850 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f837c1034d0 tx=0x7f837c10e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6148ca925edebcf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.079+0000 7f8385f1f640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f836c0b4ca0 0x7f836c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.079+0000 7f83767fc640 1 -- 172.21.15.37:0/3579706719 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f837c105e00 con 0x7f8380102800 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.079+0000 7f836b7fe640 1 -- 172.21.15.37:0/836680866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c0c83c0 con 0x564ecada61b0 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.079+0000 7f836b7fe640 1 -- 172.21.15.37:0/836680866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f837c0cc010 con 0x564ecada61b0 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.079+0000 7f836b7fe640 1 -- 172.21.15.37:0/836680866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c0cbc70 con 0x564ecada61b0 2024-08-31T06:56:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 -- 172.21.15.37:0/836680866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 msgr2=0x564ecb174850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f8385f1f640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f836c0b4ca0 0x7f836c0b71b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f837800af10 tx=0x7f837800a4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb174850 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f837c1034d0 tx=0x7f837c10e330 comp rx=0 tx=0).stop 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 -- 172.21.15.37:0/836680866 shutdown_connections 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb174850 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb174d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 --2- 172.21.15.37:0/836680866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 0x564ecb174310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 -- 172.21.15.37:0/836680866 >> 172.21.15.37:0/836680866 conn(0x564ecadc3460 msgr2=0x564ecb172200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 -- 172.21.15.37:0/836680866 shutdown_connections 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 -- 172.21.15.37:0/836680866 wait complete. 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 -- start start 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.080+0000 7f838def7740 1 Processor -- start 2024-08-31T06:56:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f838def7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecada61b0 0x564ecb17fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f838def7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb180040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f838def7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb18bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f838def7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564ecaf3d700 con 0x564ecadcf070 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f838def7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x564ecb061750 con 0x564ecadae390 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f838def7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x564ecb1828b0 con 0x564ecada61b0 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f838def7740 10 client.0 _ll_register_callbacks cb 0x564ecb090e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f8385f1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb18bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f8385f1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb18bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43796/0 (socket says 172.21.15.37:43796) 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f8385f1f640 1 -- 172.21.15.37:0/2395947552 learned_addr learned my addr 172.21.15.37:0/2395947552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f838571e640 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecada61b0 0x564ecb17fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f8384f1d640 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb180040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f8385f1f640 1 -- 172.21.15.37:0/2395947552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecada61b0 msgr2=0x564ecb17fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f8385f1f640 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecada61b0 0x564ecb17fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f8385f1f640 1 -- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 msgr2=0x564ecb180040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.081+0000 7f8385f1f640 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb180040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f8385f1f640 1 -- 172.21.15.37:0/2395947552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ecb09a900 con 0x564ecadcf070 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f8384f1d640 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb180040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f8385f1f640 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb18bb10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f837801cbe0 tx=0x7f8378004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a3ba6e91bfdc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f8368ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f8368ff9640 1 -- 172.21.15.37:0/2395947552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837801cd90 con 0x564ecadcf070 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f8368ff9640 1 -- 172.21.15.37:0/2395947552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f8378016030 con 0x564ecadcf070 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f838def7740 1 -- 172.21.15.37:0/2395947552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f837c0cc010 con 0x564ecadcf070 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f8368ff9640 1 -- 172.21.15.37:0/2395947552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f837800f8a0 con 0x564ecadcf070 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f838def7740 10 client.17709 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f838def7740 1 -- 172.21.15.37:0/2395947552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ecb18e650 con 0x564ecadcf070 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.082+0000 7f8368ff9640 1 -- 172.21.15.37:0/2395947552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f837c0cc010 con 0x564ecadcf070 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f8368ff9640 1 -- 172.21.15.37:0/2395947552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8378027ab0 con 0x564ecadcf070 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f838def7740 10 client.17709 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f838def7740 10 client.17709 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f838def7740 20 client.17709 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f838def7740 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x564ecad8d9f0 0x564ecb191c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f838def7740 4 client.17709 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f838def7740 1 -- 172.21.15.37:0/2395947552 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ecb0ed5d0 con 0x564ecad8d9f0 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f838571e640 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x564ecad8d9f0 0x564ecb191c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f838571e640 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x564ecad8d9f0 0x564ecb191c40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dfc578153b8b2cbd server_cookie=6c0ecae74e1c92db in_seq=0 out_seq=0 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.083+0000 7f8368ff9640 10 client.17709 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f8368ff9640 1 -- 172.21.15.37:0/2395947552 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ecb0ed5d0 con 0x564ecad8d9f0 2024-08-31T06:56:07.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f8368ff9640 10 client.17709 handle_command_reply: tid=0 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 client.17709 shutdown 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 -- 172.21.15.37:0/2395947552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 msgr2=0x564ecb18bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb18bb10 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f837801cbe0 tx=0x7f8378004ab0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 -- 172.21.15.37:0/2395947552 shutdown_connections 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb18bb10 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x564ecad8d9f0 0x564ecb191c40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb180040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 --2- 172.21.15.37:0/2395947552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecada61b0 0x564ecb17fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f838def7740 1 -- 172.21.15.37:0/2395947552 >> 172.21.15.37:0/2395947552 conn(0x564ecadc3460 msgr2=0x564ecb1774a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.084+0000 7f8368ff9640 0 client.17709 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.085+0000 7f838def7740 1 -- 172.21.15.37:0/2395947552 shutdown_connections 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.085+0000 7f838def7740 1 -- 172.21.15.37:0/2395947552 wait complete. 2024-08-31T06:56:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.085+0000 7f838def7740 20 client.17709 trim_cache size 0 max 16384 2024-08-31T06:56:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838def7740 1 Processor -- start 2024-08-31T06:56:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838def7740 1 -- start start 2024-08-31T06:56:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838def7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecada61b0 0x564ecb18b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838def7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadae390 0x564ecb18bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838def7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb177410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838def7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83801b3e20 con 0x564ecadcf070 2024-08-31T06:56:07.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838def7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83801b16f0 con 0x564ecada61b0 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838def7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f83801af560 con 0x564ecadae390 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f8385f1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb177410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f8385f1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb177410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43812/0 (socket says 172.21.15.37:43812) 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f8385f1f640 1 -- 172.21.15.37:0/3294495471 learned_addr learned my addr 172.21.15.37:0/3294495471 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.098+0000 7f838571e640 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecada61b0 0x564ecb18b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f8384f1d640 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadae390 0x564ecb18bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f8385f1f640 1 -- 172.21.15.37:0/3294495471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadae390 msgr2=0x564ecb18bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f8385f1f640 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadae390 0x564ecb18bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f8385f1f640 1 -- 172.21.15.37:0/3294495471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecada61b0 msgr2=0x564ecb18b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f8385f1f640 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecada61b0 0x564ecb18b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f8385f1f640 1 -- 172.21.15.37:0/3294495471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ecb180dc0 con 0x564ecadcf070 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f8384f1d640 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadae390 0x564ecb18bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:07.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f8385f1f640 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb177410 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f8378010bd0 tx=0x7f837801cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a70d72962ee23 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f836affd640 1 -- 172.21.15.37:0/3294495471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837803e070 con 0x564ecadcf070 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f836affd640 1 -- 172.21.15.37:0/3294495471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8378027420 con 0x564ecadcf070 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.099+0000 7f836affd640 1 -- 172.21.15.37:0/3294495471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780396c0 con 0x564ecadcf070 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 -- 172.21.15.37:0/3294495471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 msgr2=0x564ecb177410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb177410 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f8378010bd0 tx=0x7f837801cf20 comp rx=0 tx=0).stop 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 -- 172.21.15.37:0/3294495471 shutdown_connections 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecadcf070 0x564ecb177410 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadae390 0x564ecb18bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 --2- 172.21.15.37:0/3294495471 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecada61b0 0x564ecb18b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 -- 172.21.15.37:0/3294495471 >> 172.21.15.37:0/3294495471 conn(0x564ecadc3460 msgr2=0x564ecb17e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 -- 172.21.15.37:0/3294495471 shutdown_connections 2024-08-31T06:56:07.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 -- 172.21.15.37:0/3294495471 wait complete. 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 -- start start 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.100+0000 7f838def7740 1 Processor -- start 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838def7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb184180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838def7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb1846c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838def7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 0x564ecb1fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838def7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83801afbb0 con 0x564ecada61b0 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838def7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f83801b1020 con 0x564ecadae390 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838def7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f83801b0280 con 0x564ecadcf070 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838def7740 10 client.0 _ll_register_callbacks cb 0x7f837801c890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838571e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb184180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838571e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb184180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43814/0 (socket says 172.21.15.37:43814) 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838571e640 1 -- 172.21.15.37:0/769586003 learned_addr learned my addr 172.21.15.37:0/769586003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f8384f1d640 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb1846c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838571e640 1 -- 172.21.15.37:0/769586003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 msgr2=0x564ecb1fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838571e640 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 0x564ecb1fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838571e640 1 -- 172.21.15.37:0/769586003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 msgr2=0x564ecb1846c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838571e640 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb1846c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.101+0000 7f838571e640 1 -- 172.21.15.37:0/769586003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ecb1fbb40 con 0x564ecada61b0 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838571e640 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb184180 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f837c103610 tx=0x7f837c105040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e49c9fa83d45cc server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f8368ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f8368ff9640 1 -- 172.21.15.37:0/769586003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c049040 con 0x564ecada61b0 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f8368ff9640 1 -- 172.21.15.37:0/769586003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8499+0+0 (secure 0 0 0) 0x7f837c0037a0 con 0x564ecada61b0 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 1 -- 172.21.15.37:0/769586003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8378027420 con 0x564ecada61b0 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f8368ff9640 1 -- 172.21.15.37:0/769586003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f837c0cbe50 con 0x564ecada61b0 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 10 client.17715 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 1 -- 172.21.15.37:0/769586003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ecb1fcd10 con 0x564ecada61b0 2024-08-31T06:56:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f8368ff9640 1 -- 172.21.15.37:0/769586003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8378027420 con 0x564ecada61b0 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f8368ff9640 1 -- 172.21.15.37:0/769586003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f837c0b3030 con 0x564ecada61b0 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 10 client.17715 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 10 client.17715 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 20 client.17715 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x564ecad62da0 0x564ecb1ff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 4 client.17715 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.102+0000 7f838def7740 1 -- 172.21.15.37:0/769586003 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ecb0e9070 con 0x564ecad62da0 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f8384f1d640 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x564ecad62da0 0x564ecb1ff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f8384f1d640 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x564ecad62da0 0x564ecb1ff2e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=88a3c0514ac1621d server_cookie=776f892b19706a2f in_seq=0 out_seq=0 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f8368ff9640 10 client.17715 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f8368ff9640 1 -- 172.21.15.37:0/769586003 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ecb0e9070 con 0x564ecad62da0 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f8368ff9640 10 client.17715 handle_command_reply: tid=0 2024-08-31T06:56:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f838def7740 1 client.17715 shutdown 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f838def7740 1 -- 172.21.15.37:0/769586003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 msgr2=0x564ecb184180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f838def7740 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb184180 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f837c103610 tx=0x7f837c105040 comp rx=0 tx=0).stop 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.103+0000 7f838def7740 1 -- 172.21.15.37:0/769586003 shutdown_connections 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f838def7740 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x564ecad62da0 0x564ecb1ff2e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f838def7740 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564ecadcf070 0x564ecb1fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f838def7740 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x564ecadae390 0x564ecb1846c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f838def7740 1 --2- 172.21.15.37:0/769586003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ecada61b0 0x564ecb184180 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f838def7740 1 -- 172.21.15.37:0/769586003 >> 172.21.15.37:0/769586003 conn(0x564ecadc3460 msgr2=0x564ecb177410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8368ff9640 0 client.17715 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f838def7740 1 -- 172.21.15.37:0/769586003 shutdown_connections 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f838def7740 1 -- 172.21.15.37:0/769586003 wait complete. 2024-08-31T06:56:07.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f838def7740 20 client.17715 trim_cache size 0 max 16384 2024-08-31T06:56:07.118 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:56:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 -- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f836c0b4ca0 msgr2=0x7f836c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f836c0b4ca0 0x7f836c0b71b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f837800af10 tx=0x7f837800a4d0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 -- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 msgr2=0x7f838010fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 0x7f838010fd50 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f837c009a20 tx=0x7f837c004270 comp rx=0 tx=0).stop 2024-08-31T06:56:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 -- 172.21.15.37:0/3579706719 shutdown_connections 2024-08-31T06:56:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f836c0b4ca0 0x7f836c0b71b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8380108a90 0x7f83801107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8380108140 0x7f8380110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 --2- 172.21.15.37:0/3579706719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8380102800 0x7f838010fd50 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.104+0000 7f8387982640 1 -- 172.21.15.37:0/3579706719 >> 172.21.15.37:0/3579706719 conn(0x7f83800794d0 msgr2=0x7f8380101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.105+0000 7f8387982640 1 -- 172.21.15.37:0/3579706719 shutdown_connections 2024-08-31T06:56:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:07.105+0000 7f8387982640 1 -- 172.21.15.37:0/3579706719 wait complete. 2024-08-31T06:56:07.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:56:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:08.282 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:08 smithi037 ceph-mon[18612]: pgmap v604: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:56:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:08 smithi066 ceph-mon[22244]: pgmap v604: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:56:08.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:08 smithi106 ceph-mon[22134]: pgmap v604: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/50418797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b581081a0 msgr2=0x7f6b581085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/50418797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b581081a0 0x7f6b581085b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009900 tx=0x7f6b4002a410 comp rx=0 tx=0).stop 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/50418797 shutdown_connections 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/50418797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b581081a0 0x7f6b581085b0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/50418797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b58108af0 0x7f6b5810f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/50418797 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b58102f30 0x7f6b58103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/50418797 >> 172.21.15.37:0/50418797 conn(0x7f6b58079d30 msgr2=0x7f6b5807a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/50418797 shutdown_connections 2024-08-31T06:56:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.705+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/50418797 wait complete. 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b5d5ea640 1 Processor -- start 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b5d5ea640 1 -- start start 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b5d5ea640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b58102f30 0x7f6b58199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b5d5ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b581081a0 0x7f6b581996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b5d5ea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b58108af0 0x7f6b5819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b5d5ea640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58112680 con 0x7f6b58108af0 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b5d5ea640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58112500 con 0x7f6b581081a0 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b5d5ea640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58112800 con 0x7f6b58102f30 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b58108af0 0x7f6b5819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b58108af0 0x7f6b5819e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43824/0 (socket says 172.21.15.37:43824) 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b577fe640 1 -- 172.21.15.37:0/1805304315 learned_addr learned my addr 172.21.15.37:0/1805304315 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.706+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b58102f30 0x7f6b58199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b567fc640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b581081a0 0x7f6b581996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b577fe640 1 -- 172.21.15.37:0/1805304315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b58102f30 msgr2=0x7f6b58199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b577fe640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b58102f30 0x7f6b58199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b577fe640 1 -- 172.21.15.37:0/1805304315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b581081a0 msgr2=0x7f6b581996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b577fe640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b581081a0 0x7f6b581996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b577fe640 1 -- 172.21.15.37:0/1805304315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5819efe0 con 0x7f6b58108af0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b577fe640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b58108af0 0x7f6b5819e970 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000cce0 tx=0x7f6b5000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b4ffff640 1 -- 172.21.15.37:0/1805304315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5000f450 con 0x7f6b58108af0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/1805304315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5819f2d0 con 0x7f6b58108af0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b4ffff640 1 -- 172.21.15.37:0/1805304315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b5000fa80 con 0x7f6b58108af0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b4ffff640 1 -- 172.21.15.37:0/1805304315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b500189c0 con 0x7f6b58108af0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.707+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/1805304315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b581a5af0 con 0x7f6b58108af0 2024-08-31T06:56:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.710+0000 7f6b63b5f740 1 Processor -- start 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.710+0000 7f6b4ffff640 1 -- 172.21.15.37:0/1805304315 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f6b5000fc30 con 0x7f6b58108af0 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.710+0000 7f6b63b5f740 1 -- start start 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac74c7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 0x55dac74c7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dac743e680 con 0x55dac7122070 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dac742dc10 con 0x55dac70f91b0 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dac7431bc0 con 0x55dac7101390 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac74c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac74c7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43830/0 (socket says 172.21.15.37:43830) 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 -- 172.21.15.37:0/4185040699 learned_addr learned my addr 172.21.15.37:0/4185040699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 0x55dac74c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b4ffff640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b440b4cd0 0x7f6b440b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 -- 172.21.15.37:0/4185040699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 msgr2=0x55dac74c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 -- 172.21.15.37:0/4185040699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 msgr2=0x55dac74c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 0x55dac74c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.711+0000 7f6b567fc640 1 -- 172.21.15.37:0/4185040699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac718d650 con 0x55dac7122070 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.712+0000 7f6b567fc640 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac74c7310 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6b40000c00 tx=0x7f6b40009660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debdaa45f0f87f33 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.712+0000 7f6b4d7fa640 1 -- 172.21.15.37:0/4185040699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40035070 con 0x55dac7122070 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.712+0000 7f6b4d7fa640 1 -- 172.21.15.37:0/4185040699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b40045070 con 0x55dac7122070 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.712+0000 7f6b577fe640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b440b4cd0 0x7f6b440b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.712+0000 7f6b4d7fa640 1 -- 172.21.15.37:0/4185040699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40003ae0 con 0x55dac7122070 2024-08-31T06:56:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.712+0000 7f6b4ffff640 1 -- 172.21.15.37:0/1805304315 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f6b500e59a0 con 0x7f6b58108af0 2024-08-31T06:56:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4185040699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 msgr2=0x55dac74c7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b577fe640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b440b4cd0 0x7f6b440b71e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6b500e3190 tx=0x7f6b500e5ca0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac74c7310 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f6b40000c00 tx=0x7f6b40009660 comp rx=0 tx=0).stop 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4185040699 shutdown_connections 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 0x55dac74c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/4185040699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac74c7310 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4185040699 >> 172.21.15.37:0/4185040699 conn(0x55dac7116460 msgr2=0x55dac74c5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4185040699 shutdown_connections 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.713+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4185040699 wait complete. 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.714+0000 7f6b63b5f740 1 -- start start 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.714+0000 7f6b63b5f740 1 Processor -- start 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.714+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74d5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.714+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74d6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.714+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac7122070 0x55dac74e0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.714+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dac7290700 con 0x55dac70f91b0 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.714+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55dac73b4750 con 0x55dac7122070 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.714+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55dac74d5a90 con 0x55dac7101390 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b63b5f740 10 client.0 _ll_register_callbacks cb 0x55dac73e3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74d5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74d5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43836/0 (socket says 172.21.15.37:43836) 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 -- 172.21.15.37:0/3077649535 learned_addr learned my addr 172.21.15.37:0/3077649535 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 -- 172.21.15.37:0/3077649535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 msgr2=0x55dac74d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74d6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 -- 172.21.15.37:0/3077649535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac7122070 msgr2=0x55dac74e0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac7122070 0x55dac74e0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 -- 172.21.15.37:0/3077649535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac73ed900 con 0x55dac70f91b0 2024-08-31T06:56:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b567fc640 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74d5f20 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f6b400092a0 tx=0x7f6b400035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b8536c61fc64bd server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/3077649535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4004f020 con 0x55dac70f91b0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b63b5f740 1 -- 172.21.15.37:0/3077649535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b40045070 con 0x55dac70f91b0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.715+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/3077649535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f6b4004b640 con 0x55dac70f91b0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/3077649535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b4005a050 con 0x55dac70f91b0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b63b5f740 10 client.17727 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b63b5f740 1 -- 172.21.15.37:0/3077649535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dac74e3af0 con 0x55dac70f91b0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/3077649535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b40045070 con 0x55dac70f91b0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/3077649535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b400498f0 con 0x55dac70f91b0 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b63b5f740 10 client.17727 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b63b5f740 10 client.17727 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b63b5f740 20 client.17727 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dac70e09f0 0x55dac74e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b63b5f740 4 client.17727 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b63b5f740 1 -- 172.21.15.37:0/3077649535 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dac74405d0 con 0x55dac70e09f0 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.716+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dac70e09f0 0x55dac74e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.717+0000 7f6b3e7fc640 10 client.17727 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.717+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dac70e09f0 0x55dac74e6e50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7abc7ddceee63f06 server_cookie=3a822f0487b1a41d in_seq=0 out_seq=0 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/3077649535 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dac74405d0 con 0x55dac70e09f0 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b3e7fc640 10 client.17727 handle_command_reply: tid=0 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 client.17727 shutdown 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 -- 172.21.15.37:0/3077649535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 msgr2=0x55dac74d5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74d5f20 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f6b400092a0 tx=0x7f6b400035f0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 -- 172.21.15.37:0/3077649535 shutdown_connections 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dac70e09f0 0x55dac74e6e50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac7122070 0x55dac74e0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74d6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/3077649535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74d5f20 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 -- 172.21.15.37:0/3077649535 >> 172.21.15.37:0/3077649535 conn(0x55dac7116460 msgr2=0x55dac74ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b3e7fc640 0 client.17727 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:56:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 -- 172.21.15.37:0/3077649535 shutdown_connections 2024-08-31T06:56:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 1 -- 172.21.15.37:0/3077649535 wait complete. 2024-08-31T06:56:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.718+0000 7f6b63b5f740 20 client.17727 trim_cache size 0 max 16384 2024-08-31T06:56:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.731+0000 7f6b63b5f740 1 Processor -- start 2024-08-31T06:56:08.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.731+0000 7f6b63b5f740 1 -- start start 2024-08-31T06:56:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac7122070 0x55dac74d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581afb40 con 0x55dac70f91b0 2024-08-31T06:56:08.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581ad410 con 0x55dac7122070 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581ab280 con 0x55dac7101390 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43852/0 (socket says 172.21.15.37:43852) 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 -- 172.21.15.37:0/4120150717 learned_addr learned my addr 172.21.15.37:0/4120150717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 -- 172.21.15.37:0/4120150717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 msgr2=0x55dac74cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/4120150717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 --2- 172.21.15.37:0/4120150717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 -- 172.21.15.37:0/4120150717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac7122070 msgr2=0x55dac74d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 --2- 172.21.15.37:0/4120150717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac7122070 0x55dac74d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 -- 172.21.15.37:0/4120150717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dac74d5020 con 0x55dac70f91b0 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b567fc640 1 --2- 172.21.15.37:0/4120150717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74cab20 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6b400057c0 tx=0x7f6b4002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee91b68d86c6e8d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.732+0000 7f6b4cff9640 1 -- 172.21.15.37:0/4120150717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4004f040 con 0x55dac70f91b0 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b4cff9640 1 -- 172.21.15.37:0/4120150717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b40045040 con 0x55dac70f91b0 2024-08-31T06:56:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b4cff9640 1 -- 172.21.15.37:0/4120150717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40035040 con 0x55dac70f91b0 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4120150717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 msgr2=0x55dac74cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/4120150717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74cab20 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6b400057c0 tx=0x7f6b4002a410 comp rx=0 tx=0).stop 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4120150717 shutdown_connections 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/4120150717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac7122070 0x55dac74d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/4120150717 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/4120150717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac70f91b0 0x55dac74cab20 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4120150717 >> 172.21.15.37:0/4120150717 conn(0x55dac7116460 msgr2=0x55dac74ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4120150717 shutdown_connections 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.733+0000 7f6b63b5f740 1 -- 172.21.15.37:0/4120150717 wait complete. 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 1 -- start start 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 1 Processor -- start 2024-08-31T06:56:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 0x55dac74e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74ea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac7546730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581ab8d0 con 0x55dac7122070 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581acd40 con 0x55dac70f91b0 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581abfa0 con 0x55dac7101390 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b63b5f740 10 client.0 _ll_register_callbacks cb 0x7f6b40031f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac7546730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b567fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac7546730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43858/0 (socket says 172.21.15.37:43858) 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b567fc640 1 -- 172.21.15.37:0/1978255521 learned_addr learned my addr 172.21.15.37:0/1978255521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.734+0000 7f6b567fc640 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 0x55dac74e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74ea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b567fc640 1 -- 172.21.15.37:0/1978255521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 msgr2=0x55dac74ea1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b567fc640 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74ea1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b567fc640 1 -- 172.21.15.37:0/1978255521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 msgr2=0x55dac74e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b567fc640 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 0x55dac74e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b567fc640 1 -- 172.21.15.37:0/1978255521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dac7546da0 con 0x55dac7122070 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b567fc640 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac7546730 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6b40031ef0 tx=0x7f6b4003a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e397c9aa761b676 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b3e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/1978255521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40035020 con 0x55dac7122070 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/1978255521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f6b40004260 con 0x55dac7122070 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b63b5f740 1 -- 172.21.15.37:0/1978255521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b40045040 con 0x55dac7122070 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/1978255521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b40004460 con 0x55dac7122070 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b63b5f740 10 client.17733 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.735+0000 7f6b63b5f740 1 -- 172.21.15.37:0/1978255521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dac75513b0 con 0x55dac7122070 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/1978255521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b40045040 con 0x55dac7122070 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/1978255521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b4003aa60 con 0x55dac7122070 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b63b5f740 10 client.17733 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b63b5f740 10 client.17733 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b63b5f740 20 client.17733 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dac70b5da0 0x55dac75538d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b63b5f740 4 client.17733 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b63b5f740 1 -- 172.21.15.37:0/1978255521 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dac743c070 con 0x55dac70b5da0 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dac70b5da0 0x55dac75538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b56ffd640 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dac70b5da0 0x55dac75538d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=268f77c28fc1d093 server_cookie=2915a60df43bd77d in_seq=0 out_seq=0 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.736+0000 7f6b3e7fc640 10 client.17733 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b3e7fc640 1 -- 172.21.15.37:0/1978255521 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dac743c070 con 0x55dac70b5da0 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b3e7fc640 10 client.17733 handle_command_reply: tid=0 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 client.17733 shutdown 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 -- 172.21.15.37:0/1978255521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 msgr2=0x55dac7546730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac7546730 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6b40031ef0 tx=0x7f6b4003a470 comp rx=0 tx=0).stop 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 -- 172.21.15.37:0/1978255521 shutdown_connections 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x55dac70b5da0 0x55dac75538d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dac7122070 0x55dac7546730 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55dac7101390 0x55dac74ea1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 --2- 172.21.15.37:0/1978255521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55dac70f91b0 0x55dac74e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 -- 172.21.15.37:0/1978255521 >> 172.21.15.37:0/1978255521 conn(0x55dac7116460 msgr2=0x55dac74d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b3e7fc640 0 client.17733 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:56:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 -- 172.21.15.37:0/1978255521 shutdown_connections 2024-08-31T06:56:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 1 -- 172.21.15.37:0/1978255521 wait complete. 2024-08-31T06:56:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.737+0000 7f6b63b5f740 20 client.17733 trim_cache size 0 max 16384 2024-08-31T06:56:08.743 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b440b4cd0 msgr2=0x7f6b440b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b440b4cd0 0x7f6b440b71e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6b500e3190 tx=0x7f6b500e5ca0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b58108af0 msgr2=0x7f6b5819e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b58108af0 0x7f6b5819e970 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000cce0 tx=0x7f6b5000a620 comp rx=0 tx=0).stop 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/1805304315 shutdown_connections 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6b440b4cd0 0x7f6b440b71e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b58108af0 0x7f6b5819e970 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b581081a0 0x7f6b581996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 --2- 172.21.15.37:0/1805304315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b58102f30 0x7f6b58199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/1805304315 >> 172.21.15.37:0/1805304315 conn(0x7f6b58079d30 msgr2=0x7f6b581062b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/1805304315 shutdown_connections 2024-08-31T06:56:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:08.738+0000 7f6b5d5ea640 1 -- 172.21.15.37:0/1805304315 wait complete. 2024-08-31T06:56:09.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:09 smithi037 ceph-mon[18612]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T06:56:09.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:09 smithi066 ceph-mon[22244]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T06:56:09.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:09 smithi106 ceph-mon[22134]: osdmap e83: 12 total, 12 up, 12 in 2024-08-31T06:56:09.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:56:09.842 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:10.214 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:10 smithi037 ceph-mon[18612]: pgmap v606: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:56:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 -- 172.21.15.37:0/493344248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 msgr2=0x7f69ec103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 --2- 172.21.15.37:0/493344248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 0x7f69ec103d10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009900 tx=0x7f69dc02a410 comp rx=0 tx=0).stop 2024-08-31T06:56:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 -- 172.21.15.37:0/493344248 shutdown_connections 2024-08-31T06:56:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 --2- 172.21.15.37:0/493344248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec109b90 0x7f69ec1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 --2- 172.21.15.37:0/493344248 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec109240 0x7f69ec109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 --2- 172.21.15.37:0/493344248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 0x7f69ec103d10 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 -- 172.21.15.37:0/493344248 >> 172.21.15.37:0/493344248 conn(0x7f69ec07b5f0 msgr2=0x7f69ec07ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 -- 172.21.15.37:0/493344248 shutdown_connections 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 -- 172.21.15.37:0/493344248 wait complete. 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 Processor -- start 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.305+0000 7f69f3acc640 1 -- start start 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f3acc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 0x7f69ec19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f3acc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec109240 0x7f69ec19a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f3acc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec109b90 0x7f69ec19fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f3acc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec113740 con 0x7f69ec103900 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f3acc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1135c0 con 0x7f69ec109b90 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f3acc640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1138c0 con 0x7f69ec109240 2024-08-31T06:56:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 0x7f69ec19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 0x7f69ec19a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43870/0 (socket says 172.21.15.37:43870) 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 -- 172.21.15.37:0/3084447746 learned_addr learned my addr 172.21.15.37:0/3084447746 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1067640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec109240 0x7f69ec19a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f2069640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec109b90 0x7f69ec19fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 -- 172.21.15.37:0/3084447746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec109240 msgr2=0x7f69ec19a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec109240 0x7f69ec19a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 -- 172.21.15.37:0/3084447746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec109b90 msgr2=0x7f69ec19fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec109b90 0x7f69ec19fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 -- 172.21.15.37:0/3084447746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec1a00c0 con 0x7f69ec103900 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f2069640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec109b90 0x7f69ec19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.306+0000 7f69f1868640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 0x7f69ec19a210 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009a20 tx=0x7f69dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.307+0000 7f69eaffd640 1 -- 172.21.15.37:0/3084447746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc03f030 con 0x7f69ec103900 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.307+0000 7f69eaffd640 1 -- 172.21.15.37:0/3084447746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69dc0035f0 con 0x7f69ec103900 2024-08-31T06:56:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.307+0000 7f69eaffd640 1 -- 172.21.15.37:0/3084447746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc035070 con 0x7f69ec103900 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.307+0000 7f69f3acc640 1 -- 172.21.15.37:0/3084447746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ec1a0350 con 0x7f69ec103900 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.307+0000 7f69f3acc640 1 -- 172.21.15.37:0/3084447746 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ec1a6bd0 con 0x7f69ec103900 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.309+0000 7f69fa041740 1 Processor -- start 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.309+0000 7f69fa041740 1 -- start start 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.309+0000 7f69eaffd640 1 -- 172.21.15.37:0/3084447746 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f69dc003a60 con 0x7f69ec103900 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69fa041740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbda1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69fa041740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9d31b0 0x5644fbda1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69fa041740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9db390 0x5644fbda1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69fa041740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5644fbd18680 con 0x5644fb9db390 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69fa041740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5644fbd07c10 con 0x5644fb9fc070 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69fa041740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5644fbd0bbc0 con 0x5644fb9d31b0 2024-08-31T06:56:10.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9db390 0x5644fbda1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9db390 0x5644fbda1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43882/0 (socket says 172.21.15.37:43882) 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 -- 172.21.15.37:0/854964795 learned_addr learned my addr 172.21.15.37:0/854964795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1868640 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9d31b0 0x5644fbda1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f2069640 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbda1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 -- 172.21.15.37:0/854964795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9d31b0 msgr2=0x5644fbda1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9d31b0 0x5644fbda1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 -- 172.21.15.37:0/854964795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 msgr2=0x5644fbda1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbda1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 -- 172.21.15.37:0/854964795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644fba67650 con 0x5644fb9db390 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69eaffd640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69d40b4cd0 0x7f69d40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f1067640 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9db390 0x5644fbda1dd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099d0 tx=0x7f69e0009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a310a99aada158 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.310+0000 7f69f2069640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69d40b4cd0 0x7f69d40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.311+0000 7f69eaffd640 1 -- 172.21.15.37:0/3084447746 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f69dc1060d0 con 0x7f69ec103900 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.311+0000 7f69d3fff640 1 -- 172.21.15.37:0/854964795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0017070 con 0x5644fb9db390 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.311+0000 7f69d3fff640 1 -- 172.21.15.37:0/854964795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69e0013470 con 0x5644fb9db390 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.311+0000 7f69d3fff640 1 -- 172.21.15.37:0/854964795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0012630 con 0x5644fb9db390 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 -- 172.21.15.37:0/854964795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9db390 msgr2=0x5644fbda1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69f2069640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69d40b4cd0 0x7f69d40b71e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007ef0 tx=0x7f69e40074a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9db390 0x5644fbda1dd0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099d0 tx=0x7f69e0009e90 comp rx=0 tx=0).stop 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 -- 172.21.15.37:0/854964795 shutdown_connections 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9db390 0x5644fbda1dd0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9d31b0 0x5644fbda1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 --2- 172.21.15.37:0/854964795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbda1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 -- 172.21.15.37:0/854964795 >> 172.21.15.37:0/854964795 conn(0x5644fb9f0460 msgr2=0x5644fbd9f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 -- 172.21.15.37:0/854964795 shutdown_connections 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 -- 172.21.15.37:0/854964795 wait complete. 2024-08-31T06:56:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 -- start start 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.312+0000 7f69fa041740 1 Processor -- start 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69fa041740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69fa041740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9db390 0x5644fbdb13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69fa041740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9fc070 0x5644fbdbd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69fa041740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5644fbb6a700 con 0x5644fb9d31b0 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69fa041740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5644fbc8e750 con 0x5644fb9db390 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69fa041740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5644fbdb3e90 con 0x5644fb9fc070 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69fa041740 10 client.0 _ll_register_callbacks cb 0x5644fbcbde10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43886/0 (socket says 172.21.15.37:43886) 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f1868640 1 -- 172.21.15.37:0/2409275773 learned_addr learned my addr 172.21.15.37:0/2409275773 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f1067640 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9db390 0x5644fbdb13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f2069640 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9fc070 0x5644fbdbd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f1868640 1 -- 172.21.15.37:0/2409275773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9fc070 msgr2=0x5644fbdbd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f1868640 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9fc070 0x5644fbdbd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f1868640 1 -- 172.21.15.37:0/2409275773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9db390 msgr2=0x5644fbdb13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.313+0000 7f69f1868640 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9db390 0x5644fbdb13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69f1868640 1 -- 172.21.15.37:0/2409275773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644fbcc7900 con 0x5644fb9d31b0 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69f1868640 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb0e80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f69dc103e10 tx=0x7f69dc0cc640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28c3b67def32efe server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69d17fa640 1 -- 172.21.15.37:0/2409275773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc049040 con 0x5644fb9d31b0 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69fa041740 1 -- 172.21.15.37:0/2409275773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e0013470 con 0x5644fb9d31b0 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69d17fa640 1 -- 172.21.15.37:0/2409275773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f69dc0c8a40 con 0x5644fb9d31b0 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69d17fa640 1 -- 172.21.15.37:0/2409275773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69dc0cc2c0 con 0x5644fb9d31b0 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69fa041740 10 client.17745 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:10.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69fa041740 1 -- 172.21.15.37:0/2409275773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5644fbdbfc10 con 0x5644fb9d31b0 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69d17fa640 1 -- 172.21.15.37:0/2409275773 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69e0013470 con 0x5644fb9d31b0 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.314+0000 7f69d17fa640 1 -- 172.21.15.37:0/2409275773 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f69dc0cca10 con 0x5644fb9d31b0 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.315+0000 7f69fa041740 10 client.17745 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.315+0000 7f69fa041740 10 client.17745 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.315+0000 7f69fa041740 20 client.17745 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.315+0000 7f69fa041740 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5644fb9ba9f0 0x5644fbdc3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.315+0000 7f69fa041740 4 client.17745 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.315+0000 7f69fa041740 1 -- 172.21.15.37:0/2409275773 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644fbd1a5d0 con 0x5644fb9ba9f0 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.315+0000 7f69f1067640 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5644fb9ba9f0 0x5644fbdc3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.316+0000 7f69f1067640 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5644fb9ba9f0 0x5644fbdc3050 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d67a0d9a75f28b server_cookie=939eb0ed606b101e in_seq=0 out_seq=0 2024-08-31T06:56:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.316+0000 7f69d17fa640 10 client.17745 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.316+0000 7f69d17fa640 1 -- 172.21.15.37:0/2409275773 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644fbd1a5d0 con 0x5644fb9ba9f0 2024-08-31T06:56:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.316+0000 7f69d17fa640 10 client.17745 handle_command_reply: tid=0 2024-08-31T06:56:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.316+0000 7f69fa041740 1 client.17745 shutdown 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.316+0000 7f69fa041740 1 -- 172.21.15.37:0/2409275773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 msgr2=0x5644fbdb0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.316+0000 7f69fa041740 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb0e80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f69dc103e10 tx=0x7f69dc0cc640 comp rx=0 tx=0).stop 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 1 -- 172.21.15.37:0/2409275773 shutdown_connections 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5644fb9ba9f0 0x5644fbdc3050 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9fc070 0x5644fbdbd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9db390 0x5644fbdb13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 1 --2- 172.21.15.37:0/2409275773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb0e80 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69d17fa640 0 client.17745 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 1 -- 172.21.15.37:0/2409275773 >> 172.21.15.37:0/2409275773 conn(0x5644fb9f0460 msgr2=0x5644fbda2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 1 -- 172.21.15.37:0/2409275773 shutdown_connections 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 1 -- 172.21.15.37:0/2409275773 wait complete. 2024-08-31T06:56:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.317+0000 7f69fa041740 20 client.17745 trim_cache size 0 max 16384 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69fa041740 1 Processor -- start 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69fa041740 1 -- start start 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69fa041740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdbd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69fa041740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdaf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69fa041740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbdafc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69fa041740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1afa80 con 0x5644fb9d31b0 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69fa041740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1ad350 con 0x5644fb9fc070 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69fa041740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1ab1c0 con 0x5644fb9db390 2024-08-31T06:56:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69f1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdbd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69f1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdbd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43898/0 (socket says 172.21.15.37:43898) 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.330+0000 7f69f1868640 1 -- 172.21.15.37:0/3766192315 learned_addr learned my addr 172.21.15.37:0/3766192315 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f1067640 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdaf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f2069640 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbdafc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f1868640 1 -- 172.21.15.37:0/3766192315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 msgr2=0x5644fbdaf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f1868640 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdaf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f1868640 1 -- 172.21.15.37:0/3766192315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 msgr2=0x5644fbdafc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f1868640 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbdafc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f1868640 1 -- 172.21.15.37:0/3766192315 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644fbdac760 con 0x5644fb9d31b0 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f2069640 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbdafc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f1067640 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdaf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69f1868640 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdbd0c0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0c8830 tx=0x7f69dc0ccdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd656ab7a519df0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69d37fe640 1 -- 172.21.15.37:0/3766192315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc049070 con 0x5644fb9d31b0 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69d37fe640 1 -- 172.21.15.37:0/3766192315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69dc0cc7b0 con 0x5644fb9d31b0 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.331+0000 7f69d37fe640 1 -- 172.21.15.37:0/3766192315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0c8a40 con 0x5644fb9d31b0 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 -- 172.21.15.37:0/3766192315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 msgr2=0x5644fbdbd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdbd0c0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0c8830 tx=0x7f69dc0ccdd0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 -- 172.21.15.37:0/3766192315 shutdown_connections 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbdafc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdaf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 --2- 172.21.15.37:0/3766192315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdbd0c0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 -- 172.21.15.37:0/3766192315 >> 172.21.15.37:0/3766192315 conn(0x5644fb9f0460 msgr2=0x5644fbdac050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 -- 172.21.15.37:0/3766192315 shutdown_connections 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 -- 172.21.15.37:0/3766192315 wait complete. 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 -- start start 2024-08-31T06:56:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.332+0000 7f69fa041740 1 Processor -- start 2024-08-31T06:56:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69fa041740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69fa041740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdb5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69fa041740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbe269e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69fa041740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1ab810 con 0x5644fb9d31b0 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69fa041740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1acc80 con 0x5644fb9fc070 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69fa041740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec1abee0 con 0x5644fb9db390 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69fa041740 10 client.0 _ll_register_callbacks cb 0x7f69dc009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43902/0 (socket says 172.21.15.37:43902) 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1868640 1 -- 172.21.15.37:0/670819203 learned_addr learned my addr 172.21.15.37:0/670819203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1067640 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdb5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f2069640 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbe269e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1868640 1 -- 172.21.15.37:0/670819203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 msgr2=0x5644fbdb5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1868640 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdb5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1868640 1 -- 172.21.15.37:0/670819203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 msgr2=0x5644fbe269e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1868640 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbe269e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.333+0000 7f69f1868640 1 -- 172.21.15.37:0/670819203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644fbe27050 con 0x5644fb9d31b0 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69f1868640 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb59f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0c8010 tx=0x7f69dc0d5c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2552c64fa568ab10 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69d17fa640 1 -- 172.21.15.37:0/670819203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0b7070 con 0x5644fb9d31b0 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69d17fa640 1 -- 172.21.15.37:0/670819203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f69dc0d5850 con 0x5644fb9d31b0 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 1 -- 172.21.15.37:0/670819203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69dc0cc7b0 con 0x5644fb9d31b0 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69d17fa640 1 -- 172.21.15.37:0/670819203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f69dc049050 con 0x5644fb9d31b0 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 10 client.17751 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 1 -- 172.21.15.37:0/670819203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5644fbe27050 con 0x5644fb9d31b0 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69d17fa640 1 -- 172.21.15.37:0/670819203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69dc0cc7b0 con 0x5644fb9d31b0 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69d17fa640 1 -- 172.21.15.37:0/670819203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f69dc0f3170 con 0x5644fb9d31b0 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 10 client.17751 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 10 client.17751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 20 client.17751 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5644fb98fda0 0x5644fbe305a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 4 client.17751 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.334+0000 7f69fa041740 1 -- 172.21.15.37:0/670819203 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5644fbda7420 con 0x5644fb98fda0 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69f1067640 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5644fb98fda0 0x5644fbe305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69f1067640 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5644fb98fda0 0x5644fbe305a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=710b9a359d45b02a server_cookie=97d8c5c051dd1272 in_seq=0 out_seq=0 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69d17fa640 10 client.17751 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69d17fa640 1 -- 172.21.15.37:0/670819203 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644fbda7420 con 0x5644fb98fda0 2024-08-31T06:56:10.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69d17fa640 10 client.17751 handle_command_reply: tid=0 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 client.17751 shutdown 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 -- 172.21.15.37:0/670819203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 msgr2=0x5644fbdb59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb59f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0c8010 tx=0x7f69dc0d5c10 comp rx=0 tx=0).stop 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 -- 172.21.15.37:0/670819203 shutdown_connections 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5644fb98fda0 0x5644fbe305a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5644fb9fc070 0x5644fbe269e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5644fb9db390 0x5644fbdb5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69d17fa640 0 client.17751 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 --2- 172.21.15.37:0/670819203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644fb9d31b0 0x5644fbdb59f0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.335+0000 7f69fa041740 1 -- 172.21.15.37:0/670819203 >> 172.21.15.37:0/670819203 conn(0x5644fb9f0460 msgr2=0x5644fbdac050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69fa041740 1 -- 172.21.15.37:0/670819203 shutdown_connections 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69fa041740 1 -- 172.21.15.37:0/670819203 wait complete. 2024-08-31T06:56:10.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69fa041740 20 client.17751 trim_cache size 0 max 16384 2024-08-31T06:56:10.344 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:56:10.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 -- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69d40b4cd0 msgr2=0x7f69d40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69d40b4cd0 0x7f69d40b71e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f69e4007ef0 tx=0x7f69e40074a0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 -- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 msgr2=0x7f69ec19a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 0x7f69ec19a210 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009a20 tx=0x7f69dc004270 comp rx=0 tx=0).stop 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 -- 172.21.15.37:0/3084447746 shutdown_connections 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69d40b4cd0 0x7f69d40b71e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec109b90 0x7f69ec19fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69ec109240 0x7f69ec19a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 --2- 172.21.15.37:0/3084447746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69ec103900 0x7f69ec19a210 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 -- 172.21.15.37:0/3084447746 >> 172.21.15.37:0/3084447746 conn(0x7f69ec07b5f0 msgr2=0x7f69ec107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 -- 172.21.15.37:0/3084447746 shutdown_connections 2024-08-31T06:56:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:10.336+0000 7f69f3acc640 1 -- 172.21.15.37:0/3084447746 wait complete. 2024-08-31T06:56:10.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:10 smithi066 ceph-mon[22244]: pgmap v606: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:56:10.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:10 smithi106 ceph-mon[22134]: pgmap v606: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:56:12.178 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-31T06:56:12.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-31T06:56:12.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:12 smithi037 ceph-mon[18612]: pgmap v607: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:56:12.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:12 smithi066 ceph-mon[22244]: pgmap v607: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:56:12.443 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:12.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:12 smithi106 ceph-mon[22134]: pgmap v607: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:56:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.907+0000 7f595e326640 1 -- 172.21.15.37:0/1021729008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958108180 msgr2=0x7f5958108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.907+0000 7f595e326640 1 --2- 172.21.15.37:0/1021729008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958108180 0x7f5958108590 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f5940009900 tx=0x7f594002a410 comp rx=0 tx=0).stop 2024-08-31T06:56:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 -- 172.21.15.37:0/1021729008 shutdown_connections 2024-08-31T06:56:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 --2- 172.21.15.37:0/1021729008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958108180 0x7f5958108590 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 --2- 172.21.15.37:0/1021729008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5958108ad0 0x7f595810f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 --2- 172.21.15.37:0/1021729008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5958102840 0x7f5958102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 -- 172.21.15.37:0/1021729008 >> 172.21.15.37:0/1021729008 conn(0x7f59580794f0 msgr2=0x7f5958079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:12.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 -- 172.21.15.37:0/1021729008 shutdown_connections 2024-08-31T06:56:12.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 -- 172.21.15.37:0/1021729008 wait complete. 2024-08-31T06:56:12.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 Processor -- start 2024-08-31T06:56:12.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.908+0000 7f595e326640 1 -- start start 2024-08-31T06:56:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f595e326640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958102840 0x7f595819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f595e326640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5958108180 0x7f595819a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f595e326640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5958108ad0 0x7f595819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f595e326640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5958112660 con 0x7f5958102840 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f595e326640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59581124e0 con 0x7f5958108ad0 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f595e326640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f59581127e0 con 0x7f5958108180 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958102840 0x7f595819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958102840 0x7f595819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43920/0 (socket says 172.21.15.37:43920) 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 -- 172.21.15.37:0/1567230260 learned_addr learned my addr 172.21.15.37:0/1567230260 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f594ffff640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5958108180 0x7f595819a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f595c8c3640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5958108ad0 0x7f595819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 -- 172.21.15.37:0/1567230260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5958108180 msgr2=0x7f595819a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5958108180 0x7f595819a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 -- 172.21.15.37:0/1567230260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5958108ad0 msgr2=0x7f595819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5958108ad0 0x7f595819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 -- 172.21.15.37:0/1567230260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59581a01b0 con 0x7f5958102840 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f595c8c3640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5958108ad0 0x7f595819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.909+0000 7f5957fff640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958102840 0x7f595819a240 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f594800b4a0 tx=0x7f594800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.910+0000 7f5955ffb640 1 -- 172.21.15.37:0/1567230260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948014070 con 0x7f5958102840 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.910+0000 7f595e326640 1 -- 172.21.15.37:0/1567230260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59581a04a0 con 0x7f5958102840 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.910+0000 7f5955ffb640 1 -- 172.21.15.37:0/1567230260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5948010aa0 con 0x7f5958102840 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.910+0000 7f5955ffb640 1 -- 172.21.15.37:0/1567230260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5948017b70 con 0x7f5958102840 2024-08-31T06:56:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.910+0000 7f595e326640 1 -- 172.21.15.37:0/1567230260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59581a6c00 con 0x7f5958102840 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.912+0000 7f596489b740 1 Processor -- start 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.912+0000 7f596489b740 1 -- start start 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.912+0000 7f5955ffb640 1 -- 172.21.15.37:0/1567230260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f5948017070 con 0x7f5958102840 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f596489b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f596489b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f596489b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 0x5584166cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f596489b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584166445f0 con 0x5584162ff490 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f596489b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558416633b80 con 0x558416307670 2024-08-31T06:56:12.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f596489b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558416637b30 con 0x558416328350 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43926/0 (socket says 172.21.15.37:43926) 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 -- 172.21.15.37:0/3554947929 learned_addr learned my addr 172.21.15.37:0/3554947929 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f594ffff640 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 0x5584166cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f595c8c3640 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 -- 172.21.15.37:0/3554947929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 msgr2=0x5584166ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 -- 172.21.15.37:0/3554947929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 msgr2=0x5584166cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 0x5584166cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 -- 172.21.15.37:0/3554947929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558416393930 con 0x5584162ff490 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f595c8c3640 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5955ffb640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f59440b4ca0 0x7f59440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.913+0000 7f5957fff640 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166cecc0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f59480e21b0 tx=0x7f59480e8c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bba621e64535ec server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.914+0000 7f595c8c3640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f59440b4ca0 0x7f59440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.914+0000 7f5955ffb640 1 -- 172.21.15.37:0/1567230260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f59480e4b00 con 0x7f5958102840 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.914+0000 7f594e7fc640 1 -- 172.21.15.37:0/3554947929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59480a70a0 con 0x5584162ff490 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.914+0000 7f594e7fc640 1 -- 172.21.15.37:0/3554947929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5948017360 con 0x5584162ff490 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.914+0000 7f594e7fc640 1 -- 172.21.15.37:0/3554947929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59480aa950 con 0x5584162ff490 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 -- 172.21.15.37:0/3554947929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 msgr2=0x5584166cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f595c8c3640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f59440b4ca0 0x7f59440b71b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5950005fd0 tx=0x7f59500084d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166cecc0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f59480e21b0 tx=0x7f59480e8c40 comp rx=0 tx=0).stop 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 -- 172.21.15.37:0/3554947929 shutdown_connections 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166cecc0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 0x5584166cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 --2- 172.21.15.37:0/3554947929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 -- 172.21.15.37:0/3554947929 >> 172.21.15.37:0/3554947929 conn(0x55841631c740 msgr2=0x5584166cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 -- 172.21.15.37:0/3554947929 shutdown_connections 2024-08-31T06:56:12.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 -- 172.21.15.37:0/3554947929 wait complete. 2024-08-31T06:56:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.915+0000 7f596489b740 1 -- start start 2024-08-31T06:56:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f596489b740 1 Processor -- start 2024-08-31T06:56:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f596489b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f596489b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416307670 0x5584166da530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f596489b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416328350 0x5584166ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f596489b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558416496890 con 0x5584162ff490 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f596489b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5584165ba790 con 0x558416328350 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f596489b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5584166e1370 con 0x558416307670 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f596489b740 10 client.0 _ll_register_callbacks cb 0x55841633fba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f5957fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f5957fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43928/0 (socket says 172.21.15.37:43928) 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f5957fff640 1 -- 172.21.15.37:0/4223998467 learned_addr learned my addr 172.21.15.37:0/4223998467 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f595c8c3640 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416328350 0x5584166ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f594ffff640 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416307670 0x5584166da530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f5957fff640 1 -- 172.21.15.37:0/4223998467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416307670 msgr2=0x5584166da530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f5957fff640 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416307670 0x5584166da530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f5957fff640 1 -- 172.21.15.37:0/4223998467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416328350 msgr2=0x5584166ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.916+0000 7f5957fff640 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416328350 0x5584166ea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f5957fff640 1 -- 172.21.15.37:0/4223998467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584165f1f30 con 0x5584162ff490 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f594ffff640 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416307670 0x5584166da530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f5957fff640 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d9fb0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f594800bfd0 tx=0x7f5948017550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f270273f7c09c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f59377fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f59377fe640 1 -- 172.21.15.37:0/4223998467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594801e030 con 0x5584162ff490 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f59377fe640 1 -- 172.21.15.37:0/4223998467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f59480e24c0 con 0x5584162ff490 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f596489b740 1 -- 172.21.15.37:0/4223998467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558416646540 con 0x5584162ff490 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f59377fe640 1 -- 172.21.15.37:0/4223998467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f59480aab30 con 0x5584162ff490 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f596489b740 10 client.17763 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f596489b740 1 -- 172.21.15.37:0/4223998467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5584166ed230 con 0x5584162ff490 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f59377fe640 1 -- 172.21.15.37:0/4223998467 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558416646540 con 0x5584162ff490 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.917+0000 7f59377fe640 1 -- 172.21.15.37:0/4223998467 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f59480ab440 con 0x5584162ff490 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f596489b740 10 client.17763 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f596489b740 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f596489b740 20 client.17763 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f596489b740 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5584162e6cd0 0x5584166f0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f596489b740 4 client.17763 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f596489b740 1 -- 172.21.15.37:0/4223998467 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558416641fe0 con 0x5584162e6cd0 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f594ffff640 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5584162e6cd0 0x5584166f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f594ffff640 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5584162e6cd0 0x5584166f0590 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f9a488cd5b9e44c server_cookie=4cddad4427bf3719 in_seq=0 out_seq=0 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.918+0000 7f59377fe640 10 client.17763 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.919+0000 7f59377fe640 1 -- 172.21.15.37:0/4223998467 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558416641fe0 con 0x5584162e6cd0 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.919+0000 7f59377fe640 10 client.17763 handle_command_reply: tid=0 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.919+0000 7f596489b740 1 client.17763 shutdown 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 -- 172.21.15.37:0/4223998467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 msgr2=0x5584166d9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d9fb0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f594800bfd0 tx=0x7f5948017550 comp rx=0 tx=0).stop 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 -- 172.21.15.37:0/4223998467 shutdown_connections 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5584162e6cd0 0x5584166f0590 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416328350 0x5584166ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416307670 0x5584166da530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 --2- 172.21.15.37:0/4223998467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d9fb0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 -- 172.21.15.37:0/4223998467 >> 172.21.15.37:0/4223998467 conn(0x55841631c740 msgr2=0x5584166d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f59377fe640 0 client.17763 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 -- 172.21.15.37:0/4223998467 shutdown_connections 2024-08-31T06:56:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 1 -- 172.21.15.37:0/4223998467 wait complete. 2024-08-31T06:56:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.920+0000 7f596489b740 20 client.17763 trim_cache size 0 max 16384 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f596489b740 1 Processor -- start 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f596489b740 1 -- start start 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f596489b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f596489b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 0x5584166ea630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f596489b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166eab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f596489b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59581afc80 con 0x5584162ff490 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f596489b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ad550 con 0x558416307670 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f596489b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ab3c0 con 0x558416328350 2024-08-31T06:56:12.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f5957fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f5957fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43932/0 (socket says 172.21.15.37:43932) 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f5957fff640 1 -- 172.21.15.37:0/1211221269 learned_addr learned my addr 172.21.15.37:0/1211221269 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f594ffff640 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 0x5584166ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f595c8c3640 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166eab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f5957fff640 1 -- 172.21.15.37:0/1211221269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 msgr2=0x5584166eab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f5957fff640 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166eab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f5957fff640 1 -- 172.21.15.37:0/1211221269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 msgr2=0x5584166ea630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f5957fff640 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 0x5584166ea630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.938+0000 7f5957fff640 1 -- 172.21.15.37:0/1211221269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584166c7d90 con 0x5584162ff490 2024-08-31T06:56:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.939+0000 7f5957fff640 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d1f90 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f59480a8450 tx=0x7f59480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add1ec212a85e406 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.939+0000 7f594dffb640 1 -- 172.21.15.37:0/1211221269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594801e070 con 0x5584162ff490 2024-08-31T06:56:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.939+0000 7f594dffb640 1 -- 172.21.15.37:0/1211221269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59480e8420 con 0x5584162ff490 2024-08-31T06:56:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.939+0000 7f594dffb640 1 -- 172.21.15.37:0/1211221269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59480aafb0 con 0x5584162ff490 2024-08-31T06:56:12.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 -- 172.21.15.37:0/1211221269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 msgr2=0x5584166d1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d1f90 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f59480a8450 tx=0x7f59480046c0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 -- 172.21.15.37:0/1211221269 shutdown_connections 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x5584166eab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558416307670 0x5584166ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 --2- 172.21.15.37:0/1211221269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584162ff490 0x5584166d1f90 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 -- 172.21.15.37:0/1211221269 >> 172.21.15.37:0/1211221269 conn(0x55841631c740 msgr2=0x5584166d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 -- 172.21.15.37:0/1211221269 shutdown_connections 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 -- 172.21.15.37:0/1211221269 wait complete. 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.940+0000 7f596489b740 1 -- start start 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f596489b740 1 Processor -- start 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f596489b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584162ff490 0x5584166f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f596489b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558416307670 0x5584166f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f596489b740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x558416759d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f596489b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59581aba10 con 0x558416307670 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f596489b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ace80 con 0x5584162ff490 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f596489b740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f59581ac0e0 con 0x558416328350 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f596489b740 10 client.0 _ll_register_callbacks cb 0x7f5940009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f594ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558416307670 0x5584166f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f594ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558416307670 0x5584166f1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43934/0 (socket says 172.21.15.37:43934) 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f594ffff640 1 -- 172.21.15.37:0/1360962395 learned_addr learned my addr 172.21.15.37:0/1360962395 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f5957fff640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584162ff490 0x5584166f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f594ffff640 1 -- 172.21.15.37:0/1360962395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 msgr2=0x558416759d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f595c8c3640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x558416759d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f594ffff640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x558416759d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f594ffff640 1 -- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584162ff490 msgr2=0x5584166f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f594ffff640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584162ff490 0x5584166f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f594ffff640 1 -- 172.21.15.37:0/1360962395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841675a250 con 0x558416307670 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f5957fff640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584162ff490 0x5584166f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.941+0000 7f595c8c3640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x558416759d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:12.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f594ffff640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558416307670 0x5584166f1f50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5940005940 tx=0x7f59400058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b18e47ab23bacf server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f59377fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f59377fe640 1 -- 172.21.15.37:0/1360962395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5940035040 con 0x558416307670 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f59377fe640 1 -- 172.21.15.37:0/1360962395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7f5940004220 con 0x558416307670 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f596489b740 1 -- 172.21.15.37:0/1360962395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59480e8420 con 0x558416307670 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f59377fe640 1 -- 172.21.15.37:0/1360962395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5940054050 con 0x558416307670 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f596489b740 10 client.17769 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f596489b740 1 -- 172.21.15.37:0/1360962395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55841675b440 con 0x558416307670 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f59377fe640 1 -- 172.21.15.37:0/1360962395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59480e8420 con 0x558416307670 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f59377fe640 1 -- 172.21.15.37:0/1360962395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5940004930 con 0x558416307670 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f596489b740 10 client.17769 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.942+0000 7f596489b740 10 client.17769 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.943+0000 7f596489b740 20 client.17769 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.943+0000 7f596489b740 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5584162bc080 0x55841675db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.943+0000 7f596489b740 4 client.17769 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-31T06:56:12.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.943+0000 7f596489b740 1 -- 172.21.15.37:0/1360962395 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55841663f720 con 0x5584162bc080 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.943+0000 7f5957fff640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5584162bc080 0x55841675db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.943+0000 7f5957fff640 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5584162bc080 0x55841675db20 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=381866cbb3a8d7cf server_cookie=6f71770146b3e57e in_seq=0 out_seq=0 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.943+0000 7f59377fe640 10 client.17769 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.945+0000 7f59377fe640 1 -- 172.21.15.37:0/1360962395 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55841663f720 con 0x5584162bc080 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.945+0000 7f59377fe640 10 client.17769 handle_command_reply: tid=0 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.945+0000 7f596489b740 1 client.17769 shutdown 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 -- 172.21.15.37:0/1360962395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558416307670 msgr2=0x5584166f1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558416307670 0x5584166f1f50 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5940005940 tx=0x7f59400058d0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 -- 172.21.15.37:0/1360962395 shutdown_connections 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x5584162bc080 0x55841675db20 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558416307670 0x5584166f1f50 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558416328350 0x558416759d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 --2- 172.21.15.37:0/1360962395 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5584162ff490 0x5584166f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 -- 172.21.15.37:0/1360962395 >> 172.21.15.37:0/1360962395 conn(0x55841631c740 msgr2=0x5584166d2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f59377fe640 0 client.17769 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 -- 172.21.15.37:0/1360962395 shutdown_connections 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 1 -- 172.21.15.37:0/1360962395 wait complete. 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f596489b740 20 client.17769 trim_cache size 0 max 16384 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "cc6a7d83-5667-4571-aa01-e0b61c8b8b4e", 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-31T06:56:12.950 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f595e326640 1 -- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f59440b4ca0 msgr2=0x7f59440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f595e326640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f59440b4ca0 0x7f59440b71b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5950005fd0 tx=0x7f59500084d0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f595e326640 1 -- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958102840 msgr2=0x7f595819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.946+0000 7f595e326640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958102840 0x7f595819a240 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f594800b4a0 tx=0x7f594800b960 comp rx=0 tx=0).stop 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.947+0000 7f595e326640 1 -- 172.21.15.37:0/1567230260 shutdown_connections 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.947+0000 7f595e326640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f59440b4ca0 0x7f59440b71b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.947+0000 7f595e326640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5958108ad0 0x7f595819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.947+0000 7f595e326640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5958108180 0x7f595819a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.947+0000 7f595e326640 1 --2- 172.21.15.37:0/1567230260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5958102840 0x7f595819a240 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.947+0000 7f595e326640 1 -- 172.21.15.37:0/1567230260 >> 172.21.15.37:0/1567230260 conn(0x7f59580794f0 msgr2=0x7f5958101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.947+0000 7f595e326640 1 -- 172.21.15.37:0/1567230260 shutdown_connections 2024-08-31T06:56:12.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:12.947+0000 7f595e326640 1 -- 172.21.15.37:0/1567230260 wait complete. 2024-08-31T06:56:13.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:56:14.125 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:14.245 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:14 smithi037 ceph-mon[18612]: pgmap v608: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:56:14.245 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:14 smithi037 ceph-mon[18612]: scrub queued for path: / 2024-08-31T06:56:14.245 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:14 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:56:14.245 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:14 smithi037 ceph-mon[18612]: scrub summary: active paths [/] 2024-08-31T06:56:14.245 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:14 smithi037 ceph-mon[18612]: scrub summary: idle+waiting paths [/] 2024-08-31T06:56:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:14 smithi066 ceph-mon[22244]: pgmap v608: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:56:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:14 smithi066 ceph-mon[22244]: scrub queued for path: / 2024-08-31T06:56:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:14 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:56:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:14 smithi066 ceph-mon[22244]: scrub summary: active paths [/] 2024-08-31T06:56:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:14 smithi066 ceph-mon[22244]: scrub summary: idle+waiting paths [/] 2024-08-31T06:56:14.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:14 smithi106 ceph-mon[22134]: pgmap v608: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:56:14.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:14 smithi106 ceph-mon[22134]: scrub queued for path: / 2024-08-31T06:56:14.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:14 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:56:14.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:14 smithi106 ceph-mon[22134]: scrub summary: active paths [/] 2024-08-31T06:56:14.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:14 smithi106 ceph-mon[22134]: scrub summary: idle+waiting paths [/] 2024-08-31T06:56:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 -- 172.21.15.37:0/1226459097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a01050a0 msgr2=0x7fa2a010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1226459097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a01050a0 0x7fa2a010d5f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa294009900 tx=0x7fa29402a410 comp rx=0 tx=0).stop 2024-08-31T06:56:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 -- 172.21.15.37:0/1226459097 shutdown_connections 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1226459097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a01050a0 0x7fa2a010d5f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1226459097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2a010dbb0 0x7fa2a01100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1226459097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a0104750 0x7fa2a0104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 -- 172.21.15.37:0/1226459097 >> 172.21.15.37:0/1226459097 conn(0x7fa2a00794d0 msgr2=0x7fa2a00798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 -- 172.21.15.37:0/1226459097 shutdown_connections 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.615+0000 7fa2a527a640 1 -- 172.21.15.37:0/1226459097 wait complete. 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa2a527a640 1 Processor -- start 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa2a527a640 1 -- start start 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa2a527a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a0104750 0x7fa2a0102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa2a527a640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2a01050a0 0x7fa2a01029d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa2a527a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a010dbb0 0x7fa2a0102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa2a527a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01136a0 con 0x7fa2a010dbb0 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa2a527a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0113520 con 0x7fa2a0104750 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa2a527a640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a0113820 con 0x7fa2a01050a0 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a010dbb0 0x7fa2a0102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa29f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a010dbb0 0x7fa2a0102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47194/0 (socket says 172.21.15.37:47194) 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa29e7fc640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2a01050a0 0x7fa2a01029d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.616+0000 7fa29f7fe640 1 -- 172.21.15.37:0/1366881645 learned_addr learned my addr 172.21.15.37:0/1366881645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa29effd640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a0104750 0x7fa2a0102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa29f7fe640 1 -- 172.21.15.37:0/1366881645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2a01050a0 msgr2=0x7fa2a01029d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa29f7fe640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2a01050a0 0x7fa2a01029d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa29f7fe640 1 -- 172.21.15.37:0/1366881645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a0104750 msgr2=0x7fa2a0102490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa29f7fe640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a0104750 0x7fa2a0102490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa29f7fe640 1 -- 172.21.15.37:0/1366881645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a01a8490 con 0x7fa2a010dbb0 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa29effd640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a0104750 0x7fa2a0102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa29f7fe640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a010dbb0 0x7fa2a0102f10 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa29800eaa0 tx=0x7fa29800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa287fff640 1 -- 172.21.15.37:0/1366881645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29800cdb0 con 0x7fa2a010dbb0 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa2a527a640 1 -- 172.21.15.37:0/1366881645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a01a8780 con 0x7fa2a010dbb0 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa287fff640 1 -- 172.21.15.37:0/1366881645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa298005020 con 0x7fa2a010dbb0 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa287fff640 1 -- 172.21.15.37:0/1366881645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2980116d0 con 0x7fa2a010dbb0 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.617+0000 7fa2a527a640 1 -- 172.21.15.37:0/1366881645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a01a8ce0 con 0x7fa2a010dbb0 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.620+0000 7fa2ab7ef740 1 Processor -- start 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa287fff640 1 -- 172.21.15.37:0/1366881645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa298004a40 con 0x7fa2a010dbb0 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa2ab7ef740 1 -- start start 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c78a070 0x558a3cb2f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c7611b0 0x558a3cb2f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c769390 0x558a3cb2fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a3caa6630 con 0x558a3c78a070 2024-08-31T06:56:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558a3ca95bc0 con 0x558a3c7611b0 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558a3ca99b70 con 0x558a3c769390 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa29e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c78a070 0x558a3cb2f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa29e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c78a070 0x558a3cb2f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47204/0 (socket says 172.21.15.37:47204) 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa29e7fc640 1 -- 172.21.15.37:0/2302444950 learned_addr learned my addr 172.21.15.37:0/2302444950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.621+0000 7fa29effd640 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c7611b0 0x558a3cb2f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa287fff640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2880b4ca0 0x7fa2880b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c769390 0x558a3cb2fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29f7fe640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2880b4ca0 0x7fa2880b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29e7fc640 1 -- 172.21.15.37:0/2302444950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c769390 msgr2=0x558a3cb2fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c769390 0x558a3cb2fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29e7fc640 1 -- 172.21.15.37:0/2302444950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c7611b0 msgr2=0x558a3cb2f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c7611b0 0x558a3cb2f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29e7fc640 1 -- 172.21.15.37:0/2302444950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a3c7f5650 con 0x558a3c78a070 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa287fff640 1 -- 172.21.15.37:0/1366881645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7fa2980e5700 con 0x7fa2a010dbb0 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c78a070 0x558a3cb2f2c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa2940057c0 tx=0x7fa294005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6c605e20a75966 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa2857fa640 1 -- 172.21.15.37:0/2302444950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294044020 con 0x558a3c78a070 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa29f7fe640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2880b4ca0 0x7fa2880b71b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa2980e2ef0 tx=0x7fa298000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa2857fa640 1 -- 172.21.15.37:0/2302444950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2940044c0 con 0x558a3c78a070 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.622+0000 7fa2857fa640 1 -- 172.21.15.37:0/2302444950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294035040 con 0x558a3c78a070 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/2302444950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c78a070 msgr2=0x558a3cb2f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c78a070 0x558a3cb2f2c0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa2940057c0 tx=0x7fa294005fd0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/2302444950 shutdown_connections 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c769390 0x558a3cb2fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c7611b0 0x558a3cb2f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/2302444950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c78a070 0x558a3cb2f2c0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/2302444950 >> 172.21.15.37:0/2302444950 conn(0x558a3c77e460 msgr2=0x558a3cb2d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/2302444950 shutdown_connections 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.623+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/2302444950 wait complete. 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 1 -- start start 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 1 Processor -- start 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c769390 0x558a3cb3af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c78a070 0x558a3cb46d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a3c8f8700 con 0x558a3c769390 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x558a3ca1c700 con 0x558a3c78a070 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x558a3cb3da40 con 0x558a3c7611b0 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa2ab7ef740 10 client.0 _ll_register_callbacks cb 0x558a3ca4bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa29effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c769390 0x558a3cb3af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa29effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c769390 0x558a3cb3af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47220/0 (socket says 172.21.15.37:47220) 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa29effd640 1 -- 172.21.15.37:0/3656311374 learned_addr learned my addr 172.21.15.37:0/3656311374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.624+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c78a070 0x558a3cb46d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa29effd640 1 -- 172.21.15.37:0/3656311374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 msgr2=0x558a3cb3aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa29effd640 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa29effd640 1 -- 172.21.15.37:0/3656311374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c78a070 msgr2=0x558a3cb46d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa29effd640 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c78a070 0x558a3cb46d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa29effd640 1 -- 172.21.15.37:0/3656311374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a3ca558b0 con 0x558a3c769390 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa29effd640 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c769390 0x558a3cb3af60 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa290011830 tx=0x7fa290011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00acc47e9abad2c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa282ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa282ff5640 1 -- 172.21.15.37:0/3656311374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29000fdb0 con 0x558a3c769390 2024-08-31T06:56:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa282ff5640 1 -- 172.21.15.37:0/3656311374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7fa2900193f0 con 0x558a3c769390 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3656311374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558a3caa8580 con 0x558a3c769390 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa282ff5640 1 -- 172.21.15.37:0/3656311374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa290019630 con 0x558a3c769390 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa2ab7ef740 10 client.17781 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3656311374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558a3cb49860 con 0x558a3c769390 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa282ff5640 1 -- 172.21.15.37:0/3656311374 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x558a3caa8580 con 0x558a3c769390 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.625+0000 7fa282ff5640 1 -- 172.21.15.37:0/3656311374 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa290018030 con 0x558a3c769390 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa2ab7ef740 10 client.17781 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa2ab7ef740 10 client.17781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa2ab7ef740 20 client.17781 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a3c7489f0 0x558a3cb4ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa2ab7ef740 4 client.17781 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3656311374 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a3caa4020 con 0x558a3c7489f0 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a3c7489f0 0x558a3cb4ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a3c7489f0 0x558a3cb4ce50 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8dc77e34116dd13 server_cookie=db359656496f29d9 in_seq=0 out_seq=0 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.626+0000 7fa282ff5640 10 client.17781 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa282ff5640 1 -- 172.21.15.37:0/3656311374 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558a3caa4020 con 0x558a3c7489f0 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa282ff5640 10 client.17781 handle_command_reply: tid=0 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 client.17781 shutdown 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3656311374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c769390 msgr2=0x558a3cb3af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c769390 0x558a3cb3af60 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa290011830 tx=0x7fa290011cf0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3656311374 shutdown_connections 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a3c7489f0 0x558a3cb4ce50 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c769390 0x558a3cb3af60 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c78a070 0x558a3cb46d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa282ff5640 0 client.17781 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3656311374 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3656311374 >> 172.21.15.37:0/3656311374 conn(0x558a3c77e460 msgr2=0x558a3cb324a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3656311374 shutdown_connections 2024-08-31T06:56:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.627+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3656311374 wait complete. 2024-08-31T06:56:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.628+0000 7fa2ab7ef740 20 client.17781 trim_cache size 0 max 16384 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa2ab7ef740 1 Processor -- start 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa2ab7ef740 1 -- start start 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb2d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb46c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 0x558a3cb323c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01b3f20 con 0x558a3c7489f0 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01b17f0 con 0x558a3c769390 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01af660 con 0x558a3c7611b0 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa29e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb2d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa29e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb2d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47234/0 (socket says 172.21.15.37:47234) 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.645+0000 7fa29e7fc640 1 -- 172.21.15.37:0/3761944798 learned_addr learned my addr 172.21.15.37:0/3761944798 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa29effd640 1 --2- 172.21.15.37:0/3761944798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb46c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa29e7fc640 1 -- 172.21.15.37:0/3761944798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 msgr2=0x558a3cb46c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/3761944798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb46c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa29e7fc640 1 -- 172.21.15.37:0/3761944798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 msgr2=0x558a3cb323c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/3761944798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 0x558a3cb323c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa29e7fc640 1 -- 172.21.15.37:0/3761944798 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a3cb3bce0 con 0x558a3c7489f0 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/3761944798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb2d220 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa2940057c0 tx=0x7fa29402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743ff061527f202c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa284ff9640 1 -- 172.21.15.37:0/3761944798 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294044040 con 0x558a3c7489f0 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa284ff9640 1 -- 172.21.15.37:0/3761944798 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa29404a8c0 con 0x558a3c7489f0 2024-08-31T06:56:14.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.646+0000 7fa284ff9640 1 -- 172.21.15.37:0/3761944798 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294035040 con 0x558a3c7489f0 2024-08-31T06:56:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3761944798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 msgr2=0x558a3cb2d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3761944798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb2d220 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa2940057c0 tx=0x7fa29402a410 comp rx=0 tx=0).stop 2024-08-31T06:56:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3761944798 shutdown_connections 2024-08-31T06:56:14.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3761944798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 0x558a3cb323c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3761944798 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb46c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/3761944798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb2d220 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3761944798 >> 172.21.15.37:0/3761944798 conn(0x558a3c77e460 msgr2=0x558a3cb2cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3761944798 shutdown_connections 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/3761944798 wait complete. 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.647+0000 7fa2ab7ef740 1 -- start start 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa2ab7ef740 1 Processor -- start 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb3ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa2ab7ef740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 0x558a3cb3f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01afcb0 con 0x558a3c7489f0 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01b1120 con 0x558a3c769390 2024-08-31T06:56:14.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa2ab7ef740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a01b0380 con 0x558a3c7611b0 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa2ab7ef740 10 client.0 _ll_register_callbacks cb 0x7fa29000c820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb3ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb3ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47242/0 (socket says 172.21.15.37:47242) 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 -- 172.21.15.37:0/1420578788 learned_addr learned my addr 172.21.15.37:0/1420578788 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 0x558a3cb3f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29effd640 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 -- 172.21.15.37:0/1420578788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 msgr2=0x558a3cb3f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 -- 172.21.15.37:0/1420578788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 msgr2=0x558a3cb3f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 0x558a3cb3f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29e7fc640 1 -- 172.21.15.37:0/1420578788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a3cbb6810 con 0x558a3c7489f0 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.648+0000 7fa29effd640 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa29e7fc640 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb3ec90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa294000c00 tx=0x7fa294005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70752c647797fe26 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:14.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa282ff5640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa282ff5640 1 -- 172.21.15.37:0/1420578788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294044070 con 0x558a3c7489f0 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa282ff5640 1 -- 172.21.15.37:0/1420578788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8543+0+0 (secure 0 0 0) 0x7fa29404a640 con 0x558a3c7489f0 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/1420578788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa29404a8c0 con 0x558a3c7489f0 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa282ff5640 1 -- 172.21.15.37:0/1420578788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa294035040 con 0x558a3c7489f0 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa2ab7ef740 10 client.17787 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/1420578788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558a3cbb7aa0 con 0x558a3c7489f0 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa282ff5640 1 -- 172.21.15.37:0/1420578788 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa29404a8c0 con 0x558a3c7489f0 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa282ff5640 1 -- 172.21.15.37:0/1420578788 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa29403a890 con 0x558a3c7489f0 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa2ab7ef740 10 client.17787 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa2ab7ef740 10 client.17787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa2ab7ef740 20 client.17787 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a3c78a070 0x558a3cbb9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:14.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.649+0000 7fa2ab7ef740 4 client.17787 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.650+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/1420578788 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558a3caa1760 con 0x558a3c78a070 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.650+0000 7fa29effd640 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a3c78a070 0x558a3cbb9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.650+0000 7fa29effd640 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a3c78a070 0x558a3cbb9c80 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb324c7bf9b0f0c3 server_cookie=27d2cf5c630e3ab in_seq=0 out_seq=0 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.650+0000 7fa282ff5640 10 client.17787 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa282ff5640 1 -- 172.21.15.37:0/1420578788 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5398 (crc 0 0 0) 0x558a3caa1760 con 0x558a3c78a070 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa282ff5640 10 client.17787 handle_command_reply: tid=0 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 client.17787 shutdown 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/1420578788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 msgr2=0x558a3cb3ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb3ec90 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa294000c00 tx=0x7fa294005850 comp rx=0 tx=0).stop 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/1420578788 shutdown_connections 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x558a3c78a070 0x558a3cbb9c80 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x558a3c769390 0x558a3cb3f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a3c7611b0 0x558a3cb3f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 --2- 172.21.15.37:0/1420578788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c7489f0 0x558a3cb3ec90 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/1420578788 >> 172.21.15.37:0/1420578788 conn(0x558a3c77e460 msgr2=0x558a3cb2c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa282ff5640 0 client.17787 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/1420578788 shutdown_connections 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 1 -- 172.21.15.37:0/1420578788 wait complete. 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.651+0000 7fa2ab7ef740 20 client.17787 trim_cache size 0 max 16384 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stdout: "cc6a7d83-5667-4571-aa01-e0b61c8b8b4e": { 2024-08-31T06:56:14.658 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "cc6a7d83-5667-4571-aa01-e0b61c8b8b4e", 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "c2e4ff93-1d74-48df-8d5d-598d76d0993b": { 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:55:30.580499+0000", 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "232816fe-0f29-450c-bde6-cd0f5fca6fb1": { 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:48.402851+0000", 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "5235cd7a-0026-439c-bb69-023a1bfcedc7": { 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:26.646033+0000", 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.660 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.662 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.663 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:56:14.664 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "cc6a7d83-5667-4571-aa01-e0b61c8b8b4e": { 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:56:12.945146+0000", 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.665 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "5fd7f13e-fd58-49db-8497-2a7be28cf588": { 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:37.375943+0000", 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.666 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:56:14.667 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:14.669 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:14.670 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:14.670 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:56:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 -- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2880b4ca0 msgr2=0x7fa2880b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2880b4ca0 0x7fa2880b71b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa2980e2ef0 tx=0x7fa298000f40 comp rx=0 tx=0).stop 2024-08-31T06:56:14.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 -- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a010dbb0 msgr2=0x7fa2a0102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a010dbb0 0x7fa2a0102f10 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa29800eaa0 tx=0x7fa29800ef60 comp rx=0 tx=0).stop 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 -- 172.21.15.37:0/1366881645 shutdown_connections 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa2880b4ca0 0x7fa2880b71b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a010dbb0 0x7fa2a0102f10 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa2a01050a0 0x7fa2a01029d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 --2- 172.21.15.37:0/1366881645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2a0104750 0x7fa2a0102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 -- 172.21.15.37:0/1366881645 >> 172.21.15.37:0/1366881645 conn(0x7fa2a00794d0 msgr2=0x7fa2a0100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 -- 172.21.15.37:0/1366881645 shutdown_connections 2024-08-31T06:56:14.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:14.652+0000 7fa2a527a640 1 -- 172.21.15.37:0/1366881645 wait complete. 2024-08-31T06:56:15.568 INFO:tasks.cephfs.filesystem:scrub status for tag:cc6a7d83-5667-4571-aa01-e0b61c8b8b4e - {'path': '/', 'tag': 'cc6a7d83-5667-4571-aa01-e0b61c8b8b4e', 'options': 'recursive,force'} 2024-08-31T06:56:16.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:16 smithi037 ceph-mon[18612]: pgmap v609: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:56:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:16 smithi066 ceph-mon[22244]: pgmap v609: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:56:16.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:16 smithi106 ceph-mon[22134]: pgmap v609: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:56:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:17 smithi106 ceph-mon[22134]: pgmap v610: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:17 smithi106 ceph-mon[22134]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T06:56:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:17 smithi106 ceph-mon[22134]: scrub summary: idle 2024-08-31T06:56:18.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:17 smithi037 ceph-mon[18612]: pgmap v610: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:18.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:17 smithi037 ceph-mon[18612]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T06:56:18.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:17 smithi037 ceph-mon[18612]: scrub summary: idle 2024-08-31T06:56:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:17 smithi066 ceph-mon[22244]: pgmap v610: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:17 smithi066 ceph-mon[22244]: osdmap e84: 12 total, 12 up, 12 in 2024-08-31T06:56:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:17 smithi066 ceph-mon[22244]: scrub summary: idle 2024-08-31T06:56:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:19 smithi106 ceph-mon[22134]: pgmap v612: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:20.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:19 smithi037 ceph-mon[18612]: pgmap v612: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:19 smithi066 ceph-mon[22244]: pgmap v612: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:22.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:21 smithi106 ceph-mon[22134]: pgmap v613: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:22.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:21 smithi037 ceph-mon[18612]: pgmap v613: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:22.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:21 smithi066 ceph-mon[22244]: pgmap v613: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 204 B/s wr, 7 op/s 2024-08-31T06:56:24.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:23 smithi106 ceph-mon[22134]: pgmap v614: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:56:24.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:23 smithi037 ceph-mon[18612]: pgmap v614: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:56:24.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:23 smithi066 ceph-mon[22244]: pgmap v614: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:56:26.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:25 smithi106 ceph-mon[22134]: pgmap v615: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:56:26.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:25 smithi037 ceph-mon[18612]: pgmap v615: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:56:26.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:25 smithi066 ceph-mon[22244]: pgmap v615: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 102 B/s wr, 7 op/s 2024-08-31T06:56:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:27 smithi106 ceph-mon[22134]: pgmap v616: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T06:56:28.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:27 smithi037 ceph-mon[18612]: pgmap v616: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T06:56:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:27 smithi066 ceph-mon[22244]: pgmap v616: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-31T06:56:30.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:29 smithi106 ceph-mon[22134]: pgmap v617: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-08-31T06:56:30.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:29 smithi037 ceph-mon[18612]: pgmap v617: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-08-31T06:56:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:29 smithi066 ceph-mon[22244]: pgmap v617: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-08-31T06:56:32.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:31 smithi106 ceph-mon[22134]: pgmap v618: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:32.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:31 smithi037 ceph-mon[18612]: pgmap v618: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:31 smithi066 ceph-mon[22244]: pgmap v618: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:33 smithi106 ceph-mon[22134]: pgmap v619: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:56:34.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:33 smithi037 ceph-mon[18612]: pgmap v619: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:56:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:33 smithi066 ceph-mon[22244]: pgmap v619: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-31T06:56:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:35 smithi106 ceph-mon[22134]: pgmap v620: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:56:36.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:35 smithi037 ceph-mon[18612]: pgmap v620: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:56:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:35 smithi066 ceph-mon[22244]: pgmap v620: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-31T06:56:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:37 smithi106 ceph-mon[22134]: pgmap v621: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:56:38.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:37 smithi037 ceph-mon[18612]: pgmap v621: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:56:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:37 smithi066 ceph-mon[22244]: pgmap v621: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-08-31T06:56:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:39 smithi106 ceph-mon[22134]: pgmap v622: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:56:40.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:39 smithi037 ceph-mon[18612]: pgmap v622: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:56:40.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:39 smithi066 ceph-mon[22244]: pgmap v622: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-31T06:56:42.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:41 smithi106 ceph-mon[22134]: pgmap v623: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:42.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:41 smithi037 ceph-mon[18612]: pgmap v623: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:42.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:41 smithi066 ceph-mon[22244]: pgmap v623: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:56:42.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-31T06:56:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 -- 172.21.15.37:0/691136291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 msgr2=0x7fc4201032a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 --2- 172.21.15.37:0/691136291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 0x7fc4201032a0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc410009900 tx=0x7fc41002a3f0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 -- 172.21.15.37:0/691136291 shutdown_connections 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 --2- 172.21.15.37:0/691136291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4201057e0 0x7fc42010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 --2- 172.21.15.37:0/691136291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc420104e90 0x7fc4201052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 --2- 172.21.15.37:0/691136291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 0x7fc4201032a0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 -- 172.21.15.37:0/691136291 >> 172.21.15.37:0/691136291 conn(0x7fc420077870 msgr2=0x7fc420077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 -- 172.21.15.37:0/691136291 shutdown_connections 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.653+0000 7fc425e6b640 1 -- 172.21.15.37:0/691136291 wait complete. 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc425e6b640 1 Processor -- start 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc425e6b640 1 -- start start 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc425e6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 0x7fc420199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc425e6b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc420104e90 0x7fc420199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc425e6b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4201057e0 0x7fc42019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc425e6b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc420112580 con 0x7fc420102e90 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc425e6b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc420112400 con 0x7fc420104e90 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc425e6b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc420112700 con 0x7fc4201057e0 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc41f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 0x7fc420199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc41f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 0x7fc420199060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47024/0 (socket says 172.21.15.37:47024) 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc41f7fe640 1 -- 172.21.15.37:0/709796177 learned_addr learned my addr 172.21.15.37:0/709796177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc41ffff640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4201057e0 0x7fc42019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.654+0000 7fc417fff640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc420104e90 0x7fc420199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc41f7fe640 1 -- 172.21.15.37:0/709796177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4201057e0 msgr2=0x7fc42019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc41f7fe640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4201057e0 0x7fc42019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc41f7fe640 1 -- 172.21.15.37:0/709796177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc420104e90 msgr2=0x7fc420199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc41f7fe640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc420104e90 0x7fc420199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc41f7fe640 1 -- 172.21.15.37:0/709796177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42019ef90 con 0x7fc420102e90 2024-08-31T06:56:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc41f7fe640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 0x7fc420199060 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fc410009230 tx=0x7fc410004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc41d7fa640 1 -- 172.21.15.37:0/709796177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410046070 con 0x7fc420102e90 2024-08-31T06:56:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42019f220 con 0x7fc420102e90 2024-08-31T06:56:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc420101ae0 con 0x7fc420102e90 2024-08-31T06:56:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.655+0000 7fc41d7fa640 1 -- 172.21.15.37:0/709796177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc410003a80 con 0x7fc420102e90 2024-08-31T06:56:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.656+0000 7fc41d7fa640 1 -- 172.21.15.37:0/709796177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc410035050 con 0x7fc420102e90 2024-08-31T06:56:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.657+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc420103c00 con 0x7fc420102e90 2024-08-31T06:56:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.658+0000 7fc41d7fa640 1 -- 172.21.15.37:0/709796177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fc410049070 con 0x7fc420102e90 2024-08-31T06:56:42.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.659+0000 7fc41d7fa640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc40c0b4d20 0x7fc40c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:42.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.660+0000 7fc417fff640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc40c0b4d20 0x7fc40c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:42.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.660+0000 7fc41d7fa640 1 -- 172.21.15.37:0/709796177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fc4101073b0 con 0x7fc420102e90 2024-08-31T06:56:42.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.660+0000 7fc417fff640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc40c0b4d20 0x7fc40c0b7230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc420106240 tx=0x7fc40800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:42.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.663+0000 7fc41d7fa640 1 -- 172.21.15.37:0/709796177 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc410050020 con 0x7fc420102e90 2024-08-31T06:56:42.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.872+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fc420101d90 con 0x7fc40c0b4d20 2024-08-31T06:56:42.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.880+0000 7fc41d7fa640 1 -- 172.21.15.37:0/709796177 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fc420101d90 con 0x7fc40c0b4d20 2024-08-31T06:56:42.880 INFO:teuthology.orchestra.run.smithi037.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-31T00:00:00", "created": "2024-08-31T06:46:40", "first": "2024-08-31T06:47:00", "last": "2024-08-31T06:56:00", "last_pruned": "2024-08-31T06:56:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-08-31T06:56:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc40c0b4d20 msgr2=0x7fc40c0b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc40c0b4d20 0x7fc40c0b7230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc420106240 tx=0x7fc40800b390 comp rx=0 tx=0).stop 2024-08-31T06:56:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 msgr2=0x7fc420199060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 0x7fc420199060 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fc410009230 tx=0x7fc410004270 comp rx=0 tx=0).stop 2024-08-31T06:56:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 shutdown_connections 2024-08-31T06:56:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc40c0b4d20 0x7fc40c0b7230 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4201057e0 0x7fc42019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc420104e90 0x7fc420199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 --2- 172.21.15.37:0/709796177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc420102e90 0x7fc420199060 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 >> 172.21.15.37:0/709796177 conn(0x7fc420077870 msgr2=0x7fc420106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 shutdown_connections 2024-08-31T06:56:42.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:42.882+0000 7fc425e6b640 1 -- 172.21.15.37:0/709796177 wait complete. 2024-08-31T06:56:42.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-31T06:56:43.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 -- 172.21.15.37:0/2255455766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8581080a0 msgr2=0x7fa8581084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:43.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 --2- 172.21.15.37:0/2255455766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8581080a0 0x7fa8581084b0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa840009900 tx=0x7fa84002a410 comp rx=0 tx=0).stop 2024-08-31T06:56:43.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 -- 172.21.15.37:0/2255455766 shutdown_connections 2024-08-31T06:56:43.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 --2- 172.21.15.37:0/2255455766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8581080a0 0x7fa8581084b0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 --2- 172.21.15.37:0/2255455766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8581089f0 0x7fa85810f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 --2- 172.21.15.37:0/2255455766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa858102770 0x7fa858102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 -- 172.21.15.37:0/2255455766 >> 172.21.15.37:0/2255455766 conn(0x7fa8580fe190 msgr2=0x7fa8581005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:43.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 -- 172.21.15.37:0/2255455766 shutdown_connections 2024-08-31T06:56:43.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.006+0000 7fa85ccde640 1 -- 172.21.15.37:0/2255455766 wait complete. 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85ccde640 1 Processor -- start 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85ccde640 1 -- start start 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85ccde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa858102770 0x7fa858199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85ccde640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8581080a0 0x7fa858199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85ccde640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8581089f0 0x7fa85819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85ccde640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa858112600 con 0x7fa858102770 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85ccde640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa858112480 con 0x7fa8581080a0 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85ccde640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa858112780 con 0x7fa8581089f0 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa858102770 0x7fa858199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa858102770 0x7fa858199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47034/0 (socket says 172.21.15.37:47034) 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa85659c640 1 -- 172.21.15.37:0/1226014552 learned_addr learned my addr 172.21.15.37:0/1226014552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.007+0000 7fa855d9b640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8581080a0 0x7fa858199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa85659c640 1 -- 172.21.15.37:0/1226014552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8581089f0 msgr2=0x7fa85819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa85659c640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8581089f0 0x7fa85819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa85659c640 1 -- 172.21.15.37:0/1226014552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8581080a0 msgr2=0x7fa858199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa85659c640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8581080a0 0x7fa858199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa85659c640 1 -- 172.21.15.37:0/1226014552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85819f0b0 con 0x7fa858102770 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa85659c640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa858102770 0x7fa858199180 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa84800ba50 tx=0x7fa84800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa84f7fe640 1 -- 172.21.15.37:0/1226014552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa848019070 con 0x7fa858102770 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa84f7fe640 1 -- 172.21.15.37:0/1226014552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa84800cbe0 con 0x7fa858102770 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85819f3a0 con 0x7fa858102770 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa84f7fe640 1 -- 172.21.15.37:0/1226014552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8480075d0 con 0x7fa858102770 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.008+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8581a5b30 con 0x7fa858102770 2024-08-31T06:56:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.009+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa858102c00 con 0x7fa858102770 2024-08-31T06:56:43.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.011+0000 7fa84f7fe640 1 -- 172.21.15.37:0/1226014552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa84801c070 con 0x7fa858102770 2024-08-31T06:56:43.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.011+0000 7fa84f7fe640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa8440b4ca0 0x7fa8440b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:43.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.011+0000 7fa855d9b640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa8440b4ca0 0x7fa8440b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:43.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.011+0000 7fa84f7fe640 1 -- 172.21.15.37:0/1226014552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fa8480e5330 con 0x7fa858102770 2024-08-31T06:56:43.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.012+0000 7fa855d9b640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa8440b4ca0 0x7fa8440b71b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa840005940 tx=0x7fa8400058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.014+0000 7fa84f7fe640 1 -- 172.21.15.37:0/1226014552 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa848023070 con 0x7fa858102770 2024-08-31T06:56:43.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.220+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 --> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fa8580635a0 con 0x7fa8440b4ca0 2024-08-31T06:56:43.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.227+0000 7fa84f7fe640 1 -- 172.21.15.37:0/1226014552 <== mgr.14223 v2:172.21.15.37:6800/1776458941 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fa8580635a0 con 0x7fa8440b4ca0 2024-08-31T06:56:43.228 INFO:teuthology.orchestra.run.smithi037.stdout:/ 1m 6m3h 2024-08-31T06:56:43.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa8440b4ca0 msgr2=0x7fa8440b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:43.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa8440b4ca0 0x7fa8440b71b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa840005940 tx=0x7fa8400058d0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa858102770 msgr2=0x7fa858199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:43.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa858102770 0x7fa858199180 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa84800ba50 tx=0x7fa84800bf10 comp rx=0 tx=0).stop 2024-08-31T06:56:43.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 shutdown_connections 2024-08-31T06:56:43.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa8440b4ca0 0x7fa8440b71b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8581089f0 0x7fa85819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8581080a0 0x7fa858199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 --2- 172.21.15.37:0/1226014552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa858102770 0x7fa858199180 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:43.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 >> 172.21.15.37:0/1226014552 conn(0x7fa8580fe190 msgr2=0x7fa8581005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:43.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 shutdown_connections 2024-08-31T06:56:43.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:43.229+0000 7fa85ccde640 1 -- 172.21.15.37:0/1226014552 wait complete. 2024-08-31T06:56:43.242 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-31T06:56:43.253 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-31T06:56:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:43 smithi106 ceph-mon[22134]: pgmap v624: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-08-31T06:56:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:43 smithi106 ceph-mon[22134]: from='client.17793 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:44.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:43 smithi106 ceph-mon[22134]: from='client.17799 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:44.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:43 smithi037 ceph-mon[18612]: pgmap v624: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-08-31T06:56:44.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:43 smithi037 ceph-mon[18612]: from='client.17793 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:44.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:43 smithi037 ceph-mon[18612]: from='client.17799 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:43 smithi066 ceph-mon[22244]: pgmap v624: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-08-31T06:56:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:43 smithi066 ceph-mon[22244]: from='client.17793 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:44.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:43 smithi066 ceph-mon[22244]: from='client.17799 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-31T06:56:45.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-31T06:56:45.836 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:45.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:45 smithi037 ceph-mon[18612]: pgmap v625: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:56:46.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:45 smithi106 ceph-mon[22134]: pgmap v625: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:56:46.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:45 smithi066 ceph-mon[22244]: pgmap v625: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-31T06:56:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/2573583947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f0106070 msgr2=0x7fa1f0106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/2573583947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f0106070 0x7fa1f0106480 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009900 tx=0x7fa1d802a410 comp rx=0 tx=0).stop 2024-08-31T06:56:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/2573583947 shutdown_connections 2024-08-31T06:56:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/2573583947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f0106070 0x7fa1f0106480 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/2573583947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f01069c0 0x7fa1f0110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/2573583947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1f0101e20 0x7fa1f0102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/2573583947 >> 172.21.15.37:0/2573583947 conn(0x7fa1f0079d30 msgr2=0x7fa1f007a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/2573583947 shutdown_connections 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.319+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/2573583947 wait complete. 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.320+0000 7fa1f5ba7640 1 Processor -- start 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.320+0000 7fa1f5ba7640 1 -- start start 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.320+0000 7fa1f5ba7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1f0101e20 0x7fa1f019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1f5ba7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f0106070 0x7fa1f019a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1f5ba7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f01069c0 0x7fa1f019fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1f5ba7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0113740 con 0x7fa1f01069c0 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1f5ba7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01135c0 con 0x7fa1f0101e20 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1f5ba7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01138c0 con 0x7fa1f0106070 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f01069c0 0x7fa1f019fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f01069c0 0x7fa1f019fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36110/0 (socket says 172.21.15.37:36110) 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 -- 172.21.15.37:0/1912174867 learned_addr learned my addr 172.21.15.37:0/1912174867 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1f0101e20 0x7fa1f019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f0106070 0x7fa1f019a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 -- 172.21.15.37:0/1912174867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f0106070 msgr2=0x7fa1f019a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f0106070 0x7fa1f019a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 -- 172.21.15.37:0/1912174867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1f0101e20 msgr2=0x7fa1f019a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1f0101e20 0x7fa1f019a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 -- 172.21.15.37:0/1912174867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f01a00a0 con 0x7fa1f01069c0 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f0106070 0x7fa1f019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1effff640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f01069c0 0x7fa1f019fa30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800cce0 tx=0x7fa1e800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1ed7fa640 1 -- 172.21.15.37:0/1912174867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800f450 con 0x7fa1f01069c0 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.321+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/1912174867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f01a0390 con 0x7fa1f01069c0 2024-08-31T06:56:46.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.322+0000 7fa1ed7fa640 1 -- 172.21.15.37:0/1912174867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1e800fa80 con 0x7fa1f01069c0 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.322+0000 7fa1ed7fa640 1 -- 172.21.15.37:0/1912174867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8018ad0 con 0x7fa1f01069c0 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.322+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/1912174867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f01a6bb0 con 0x7fa1f01069c0 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.324+0000 7fa1fc11c740 1 Processor -- start 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.324+0000 7fa1ed7fa640 1 -- 172.21.15.37:0/1912174867 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa1e80213f0 con 0x7fa1f01069c0 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.324+0000 7fa1fc11c740 1 -- start start 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.324+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d550070 0x55fe7d8f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d52f390 0x55fe7d8f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe7d86c630 con 0x55fe7d52f390 2024-08-31T06:56:46.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fe7d85bbc0 con 0x55fe7d550070 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55fe7d85fb70 con 0x55fe7d5271b0 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d52f390 0x55fe7d8f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d52f390 0x55fe7d8f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36126/0 (socket says 172.21.15.37:36126) 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/2572925134 learned_addr learned my addr 172.21.15.37:0/2572925134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d550070 0x55fe7d8f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1ed7fa640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa1dc0b4cd0 0x7fa1dc0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/2572925134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 msgr2=0x55fe7d8f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/2572925134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d550070 msgr2=0x55fe7d8f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d550070 0x55fe7d8f52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/2572925134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7d5bb650 con 0x55fe7d52f390 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1effff640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa1dc0b4cd0 0x7fa1dc0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d52f390 0x55fe7d8f5d40 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009900 tx=0x7fa1d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1429380e6b99f606 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.325+0000 7fa1ed7fa640 1 -- 172.21.15.37:0/1912174867 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fa1e80e5d60 con 0x7fa1f01069c0 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.326+0000 7fa1e5ffb640 1 -- 172.21.15.37:0/2572925134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8045070 con 0x55fe7d52f390 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.326+0000 7fa1e5ffb640 1 -- 172.21.15.37:0/2572925134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1d80044c0 con 0x55fe7d52f390 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.326+0000 7fa1e5ffb640 1 -- 172.21.15.37:0/2572925134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8035040 con 0x55fe7d52f390 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.326+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2572925134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d52f390 msgr2=0x55fe7d8f5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.326+0000 7fa1effff640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa1dc0b4cd0 0x7fa1dc0b71e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80ac160 tx=0x7fa1e8092050 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.326+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d52f390 0x55fe7d8f5d40 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8009900 tx=0x7fa1d8000bc0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2572925134 shutdown_connections 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d52f390 0x55fe7d8f5d40 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/2572925134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d550070 0x55fe7d8f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2572925134 >> 172.21.15.37:0/2572925134 conn(0x55fe7d544460 msgr2=0x55fe7d8f31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2572925134 shutdown_connections 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2572925134 wait complete. 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 -- start start 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 Processor -- start 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d5271b0 0x55fe7d900a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 0x55fe7d900fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.327+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d550070 0x55fe7d90cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fe7d6be700 con 0x55fe7d550070 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55fe7d7e2700 con 0x55fe7d5271b0 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55fe7d903a40 con 0x55fe7d52f390 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1fc11c740 10 client.0 _ll_register_callbacks cb 0x55fe7d811dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:46.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d550070 0x55fe7d90cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d550070 0x55fe7d90cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36136/0 (socket says 172.21.15.37:36136) 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/1177058342 learned_addr learned my addr 172.21.15.37:0/1177058342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d5271b0 0x55fe7d900a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 0x55fe7d900fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/1177058342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 msgr2=0x55fe7d900fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 0x55fe7d900fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/1177058342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d5271b0 msgr2=0x55fe7d900a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d5271b0 0x55fe7d900a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/1177058342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7d81b8b0 con 0x55fe7d550070 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d550070 0x55fe7d90cd60 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8032c40 tx=0x7fa1d80039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c787752e01c8c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1ceffd640 1 -- 172.21.15.37:0/1177058342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8045070 con 0x55fe7d550070 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1ceffd640 1 -- 172.21.15.37:0/1177058342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fa1d8031df0 con 0x55fe7d550070 2024-08-31T06:56:46.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.328+0000 7fa1fc11c740 1 -- 172.21.15.37:0/1177058342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fe7d86e580 con 0x55fe7d550070 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1ceffd640 1 -- 172.21.15.37:0/1177058342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1d8035040 con 0x55fe7d550070 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1fc11c740 10 client.17811 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1fc11c740 1 -- 172.21.15.37:0/1177058342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fe7d90f870 con 0x55fe7d550070 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1ceffd640 1 -- 172.21.15.37:0/1177058342 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55fe7d86e580 con 0x55fe7d550070 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1ceffd640 1 -- 172.21.15.37:0/1177058342 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa1d803a040 con 0x55fe7d550070 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1fc11c740 10 client.17811 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1fc11c740 10 client.17811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1fc11c740 20 client.17811 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55fe7d50e9f0 0x55fe7d912bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1fc11c740 4 client.17811 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1fc11c740 1 -- 172.21.15.37:0/1177058342 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe7d86a020 con 0x55fe7d50e9f0 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.329+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55fe7d50e9f0 0x55fe7d912bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.330+0000 7fa1ceffd640 10 client.17811 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:46.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.330+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55fe7d50e9f0 0x55fe7d912bd0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2daa3ad1cf4f28d8 server_cookie=dc0bd88a2b3ee9bd in_seq=0 out_seq=0 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1ceffd640 1 -- 172.21.15.37:0/1177058342 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe7d86a020 con 0x55fe7d50e9f0 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1ceffd640 10 client.17811 handle_command_reply: tid=0 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 client.17811 shutdown 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 -- 172.21.15.37:0/1177058342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d550070 msgr2=0x55fe7d90cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d550070 0x55fe7d90cd60 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8032c40 tx=0x7fa1d80039d0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 -- 172.21.15.37:0/1177058342 shutdown_connections 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55fe7d50e9f0 0x55fe7d912bd0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d550070 0x55fe7d90cd60 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 0x55fe7d900fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1ceffd640 0 client.17811 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/1177058342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d5271b0 0x55fe7d900a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 -- 172.21.15.37:0/1177058342 >> 172.21.15.37:0/1177058342 conn(0x55fe7d544460 msgr2=0x55fe7d8f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:46.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 -- 172.21.15.37:0/1177058342 shutdown_connections 2024-08-31T06:56:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 1 -- 172.21.15.37:0/1177058342 wait complete. 2024-08-31T06:56:46.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.331+0000 7fa1fc11c740 20 client.17811 trim_cache size 0 max 16384 2024-08-31T06:56:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.349+0000 7fa1fc11c740 1 Processor -- start 2024-08-31T06:56:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.349+0000 7fa1fc11c740 1 -- start start 2024-08-31T06:56:46.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.349+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d50e9f0 0x55fe7d8ff960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.349+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.349+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 0x55fe7d915fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.349+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01b1c50 con 0x55fe7d5271b0 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.349+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01af520 con 0x55fe7d50e9f0 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.349+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ad390 con 0x55fe7d52f390 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36148/0 (socket says 172.21.15.37:36148) 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 -- 172.21.15.37:0/2466985650 learned_addr learned my addr 172.21.15.37:0/2466985650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 0x55fe7d915fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d50e9f0 0x55fe7d8ff960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 -- 172.21.15.37:0/2466985650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 msgr2=0x55fe7d915fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:46.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 0x55fe7d915fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 -- 172.21.15.37:0/2466985650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d50e9f0 msgr2=0x55fe7d8ff960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d50e9f0 0x55fe7d8ff960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 -- 172.21.15.37:0/2466985650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe7d8f9010 con 0x55fe7d5271b0 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d50e9f0 0x55fe7d8ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f8ad0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000abd0 tx=0x7fa1e000a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220751bd14f1fdd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1e57fa640 1 -- 172.21.15.37:0/2466985650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0004230 con 0x55fe7d5271b0 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1e57fa640 1 -- 172.21.15.37:0/2466985650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1e00043d0 con 0x55fe7d5271b0 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.350+0000 7fa1e57fa640 1 -- 172.21.15.37:0/2466985650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00035f0 con 0x55fe7d5271b0 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2466985650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d5271b0 msgr2=0x55fe7d8f8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f8ad0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000abd0 tx=0x7fa1e000a2d0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2466985650 shutdown_connections 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d5271b0 0x55fe7d8f8ad0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d52f390 0x55fe7d915fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/2466985650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d50e9f0 0x55fe7d8ff960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2466985650 >> 172.21.15.37:0/2466985650 conn(0x55fe7d544460 msgr2=0x55fe7d8f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2466985650 shutdown_connections 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.351+0000 7fa1fc11c740 1 -- 172.21.15.37:0/2466985650 wait complete. 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.352+0000 7fa1fc11c740 1 -- start start 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.352+0000 7fa1fc11c740 1 Processor -- start 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.352+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d50e9f0 0x55fe7d974790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.352+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 0x55fe7d974d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.352+0000 7fa1fc11c740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d52f390 0x55fe7d979d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.352+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ad9e0 con 0x55fe7d50e9f0 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.352+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01aee50 con 0x55fe7d52f390 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.352+0000 7fa1fc11c740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ae0b0 con 0x55fe7d5271b0 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1fc11c740 10 client.0 _ll_register_callbacks cb 0x7fa1d8031750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:46.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d50e9f0 0x55fe7d974790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d50e9f0 0x55fe7d974790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36150/0 (socket says 172.21.15.37:36150) 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/4072385320 learned_addr learned my addr 172.21.15.37:0/4072385320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 0x55fe7d974d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d52f390 0x55fe7d979d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/4072385320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 msgr2=0x55fe7d974d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 0x55fe7d974d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/4072385320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d52f390 msgr2=0x55fe7d979d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d52f390 0x55fe7d979d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 -- 172.21.15.37:0/4072385320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe7d97a400 con 0x55fe7d50e9f0 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1e6ffd640 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d50e9f0 0x55fe7d974790 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8001eb0 tx=0x7fa1d80039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534f53442c8b39b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1ceffd640 1 -- 172.21.15.37:0/4072385320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8045040 con 0x55fe7d50e9f0 2024-08-31T06:56:46.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1ceffd640 1 -- 172.21.15.37:0/4072385320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fa1d8031bf0 con 0x55fe7d50e9f0 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.353+0000 7fa1fc11c740 1 -- 172.21.15.37:0/4072385320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e00043d0 con 0x55fe7d50e9f0 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1ceffd640 1 -- 172.21.15.37:0/4072385320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1d8031400 con 0x55fe7d50e9f0 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1fc11c740 10 client.17817 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1fc11c740 1 -- 172.21.15.37:0/4072385320 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fe7d981770 con 0x55fe7d50e9f0 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1ceffd640 1 -- 172.21.15.37:0/4072385320 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1e00043d0 con 0x55fe7d50e9f0 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1ceffd640 1 -- 172.21.15.37:0/4072385320 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa1d803a070 con 0x55fe7d50e9f0 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1fc11c740 10 client.17817 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1fc11c740 10 client.17817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1fc11c740 20 client.17817 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55fe7d550070 0x55fe7d983e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1fc11c740 4 client.17817 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1fc11c740 1 -- 172.21.15.37:0/4072385320 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fe7d867760 con 0x55fe7d550070 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.354+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55fe7d550070 0x55fe7d983e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1ef7fe640 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55fe7d550070 0x55fe7d983e20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb3b14cc7abc0991 server_cookie=c064201ed9643a26 in_seq=0 out_seq=0 2024-08-31T06:56:46.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1ceffd640 10 client.17817 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1ceffd640 1 -- 172.21.15.37:0/4072385320 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x55fe7d867760 con 0x55fe7d550070 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1ceffd640 10 client.17817 handle_command_reply: tid=0 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 client.17817 shutdown 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 -- 172.21.15.37:0/4072385320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d50e9f0 msgr2=0x55fe7d974790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d50e9f0 0x55fe7d974790 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fa1d8001eb0 tx=0x7fa1d80039d0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 -- 172.21.15.37:0/4072385320 shutdown_connections 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55fe7d550070 0x55fe7d983e20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55fe7d52f390 0x55fe7d979d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fe7d5271b0 0x55fe7d974d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 --2- 172.21.15.37:0/4072385320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fe7d50e9f0 0x55fe7d974790 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 -- 172.21.15.37:0/4072385320 >> 172.21.15.37:0/4072385320 conn(0x55fe7d544460 msgr2=0x55fe7d8f62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1ceffd640 0 client.17817 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:46.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 -- 172.21.15.37:0/4072385320 shutdown_connections 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.355+0000 7fa1fc11c740 1 -- 172.21.15.37:0/4072385320 wait complete. 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1fc11c740 20 client.17817 trim_cache size 0 max 16384 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {}, 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_stats": { 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stdout: "c2e4ff93-1d74-48df-8d5d-598d76d0993b": { 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:55:30.580499+0000", 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.365 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "232816fe-0f29-450c-bde6-cd0f5fca6fb1": { 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:48.402851+0000", 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "5235cd7a-0026-439c-bb69-023a1bfcedc7": { 2024-08-31T06:56:46.366 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:26.646033+0000", 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "0c32d4e3-e6b2-4dd8-85a6-a5a094da7a8d": { 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:46:41.376954+0000", 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.367 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "8cea6733-dd4f-4433-886c-26c13da5de04": { 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:16.562118+0000", 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.368 INFO:teuthology.orchestra.run.smithi037.stdout: "83d4af95-2f90-4f54-ad46-35c0bccd0728": { 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:47:28.495566+0000", 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "ed2cc30c-a429-4a5d-b939-87f726e6372c": { 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:10.654216+0000", 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.369 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "c9a1c375-76b0-44f1-9019-3cb3b5c85711": { 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:48:59.429800+0000", 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "8c6f02a9-24da-4675-a2f0-73d36a5c4bec": { 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:49:42.648433+0000", 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.370 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "7d665108-288f-4fce-9300-5f55bc84ce85": { 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:50:24.726077+0000", 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "cc6a7d83-5667-4571-aa01-e0b61c8b8b4e": { 2024-08-31T06:56:46.371 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:56:12.945146+0000", 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "4b4e0ea3-9469-463c-8e1a-fe834f4567d5": { 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:07.259716+0000", 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "5fd7f13e-fd58-49db-8497-2a7be28cf588": { 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:54:37.375943+0000", 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "89dd192a-dd56-4a69-b909-ea46d1b786dd": { 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:00.198268+0000", 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.373 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "36e66c2a-04e4-40c8-867d-849592d17df3": { 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:51:17.794627+0000", 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "deffd930-526d-4ef6-92aa-59df677c2e84": { 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:42.112913+0000", 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.374 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "2c9db99a-5b71-4fa3-abac-7e410e0a9f5b": { 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:52:52.665824+0000", 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "0e98be92-c53a-4308-8d00-e98ba735e9d7": { 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "start_time": "2024-08-31T06:53:34.609471+0000", 2024-08-31T06:56:46.375 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-31T06:56:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_started": 0, 2024-08-31T06:56:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_passed": 0, 2024-08-31T06:56:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_failed": 0, 2024-08-31T06:56:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: "uninline_skipped": 0 2024-08-31T06:56:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:46.376 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:46.376 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa1dc0b4cd0 msgr2=0x7fa1dc0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa1dc0b4cd0 0x7fa1dc0b71e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa1e80ac160 tx=0x7fa1e8092050 comp rx=0 tx=0).stop 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f01069c0 msgr2=0x7fa1f019fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f01069c0 0x7fa1f019fa30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800cce0 tx=0x7fa1e800a620 comp rx=0 tx=0).stop 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/1912174867 shutdown_connections 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa1dc0b4cd0 0x7fa1dc0b71e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1f01069c0 0x7fa1f019fa30 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1f0106070 0x7fa1f019a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 --2- 172.21.15.37:0/1912174867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1f0101e20 0x7fa1f019a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/1912174867 >> 172.21.15.37:0/1912174867 conn(0x7fa1f0079d30 msgr2=0x7fa1f01073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/1912174867 shutdown_connections 2024-08-31T06:56:46.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:46.356+0000 7fa1f5ba7640 1 -- 172.21.15.37:0/1912174867 wait complete. 2024-08-31T06:56:47.328 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-31T06:56:47.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:56:47.579 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:48.012 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:47 smithi037 ceph-mon[18612]: pgmap v626: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:56:48.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 -- 172.21.15.37:0/1107488922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c108ab0 msgr2=0x7fa58c10f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 --2- 172.21.15.37:0/1107488922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c108ab0 0x7fa58c10f2e0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fa584009ca0 tx=0x7fa58402a8c0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 -- 172.21.15.37:0/1107488922 shutdown_connections 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 --2- 172.21.15.37:0/1107488922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c108ab0 0x7fa58c10f2e0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 --2- 172.21.15.37:0/1107488922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa58c108160 0x7fa58c108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 --2- 172.21.15.37:0/1107488922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa58c102820 0x7fa58c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 -- 172.21.15.37:0/1107488922 >> 172.21.15.37:0/1107488922 conn(0x7fa58c0794e0 msgr2=0x7fa58c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 -- 172.21.15.37:0/1107488922 shutdown_connections 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.011+0000 7fa5936a7640 1 -- 172.21.15.37:0/1107488922 wait complete. 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.012+0000 7fa5936a7640 1 Processor -- start 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.012+0000 7fa5936a7640 1 -- start start 2024-08-31T06:56:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.012+0000 7fa5936a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c102820 0x7fa58c19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.012+0000 7fa5936a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa58c108160 0x7fa58c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.012+0000 7fa5936a7640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa58c108ab0 0x7fa58c19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.012+0000 7fa5936a7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c112630 con 0x7fa58c102820 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.012+0000 7fa5936a7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c1124b0 con 0x7fa58c108160 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.012+0000 7fa5936a7640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c1127b0 con 0x7fa58c108ab0 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c102820 0x7fa58c19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c102820 0x7fa58c19a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36166/0 (socket says 172.21.15.37:36166) 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 -- 172.21.15.37:0/861484953 learned_addr learned my addr 172.21.15.37:0/861484953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa590c42640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa58c108160 0x7fa58c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591c44640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa58c108ab0 0x7fa58c19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 -- 172.21.15.37:0/861484953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa58c108ab0 msgr2=0x7fa58c19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa58c108ab0 0x7fa58c19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 -- 172.21.15.37:0/861484953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa58c108160 msgr2=0x7fa58c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa58c108160 0x7fa58c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 -- 172.21.15.37:0/861484953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c1a00e0 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa591443640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c102820 0x7fa58c19a230 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c920 tx=0x7fa58800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa5827fc640 1 -- 172.21.15.37:0/861484953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588007c70 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c1a03d0 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa5827fc640 1 -- 172.21.15.37:0/861484953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa588007e10 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa5827fc640 1 -- 172.21.15.37:0/861484953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5880186f0 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.013+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c1a6bf0 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.014+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58c103aa0 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.016+0000 7fa5827fc640 1 -- 172.21.15.37:0/861484953 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fa58800f450 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.016+0000 7fa5827fc640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5780b4cd0 0x7fa5780b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.017+0000 7fa590c42640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5780b4cd0 0x7fa5780b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.017+0000 7fa5827fc640 1 -- 172.21.15.37:0/861484953 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fa5880e5940 con 0x7fa58c102820 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.017+0000 7fa590c42640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5780b4cd0 0x7fa5780b71e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa58c107970 tx=0x7fa57c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:48.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.021+0000 7fa5827fc640 1 -- 172.21.15.37:0/861484953 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fa588014030 con 0x7fa58c102820 2024-08-31T06:56:48.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:47 smithi106 ceph-mon[22134]: pgmap v626: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:56:48.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:47 smithi066 ceph-mon[22244]: pgmap v626: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:56:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.245+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa58c102c30 con 0x7fa58c102820 2024-08-31T06:56:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.246+0000 7fa5827fc640 1 -- 172.21.15.37:0/861484953 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fa5880ac7d0 con 0x7fa58c102820 2024-08-31T06:56:48.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:56:48.247 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:56:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:56:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5780b4cd0 msgr2=0x7fa5780b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5780b4cd0 0x7fa5780b71e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa58c107970 tx=0x7fa57c00b390 comp rx=0 tx=0).stop 2024-08-31T06:56:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c102820 msgr2=0x7fa58c19a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c102820 0x7fa58c19a230 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c920 tx=0x7fa58800cde0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 shutdown_connections 2024-08-31T06:56:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fa5780b4cd0 0x7fa5780b71e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa58c108ab0 0x7fa58c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa58c108160 0x7fa58c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 --2- 172.21.15.37:0/861484953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa58c102820 0x7fa58c19a230 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 >> 172.21.15.37:0/861484953 conn(0x7fa58c0794e0 msgr2=0x7fa58c101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 shutdown_connections 2024-08-31T06:56:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:48.248+0000 7fa5936a7640 1 -- 172.21.15.37:0/861484953 wait complete. 2024-08-31T06:56:48.954 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:48 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/861484953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:56:48.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-31T06:56:49.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:48 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/861484953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:56:49.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:48 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/861484953' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:56:49.209 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 -- 172.21.15.37:0/2535586424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108a90 msgr2=0x7f793410f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 --2- 172.21.15.37:0/2535586424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108a90 0x7f793410f2c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f792c009ca0 tx=0x7f792c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 -- 172.21.15.37:0/2535586424 shutdown_connections 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 --2- 172.21.15.37:0/2535586424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108a90 0x7f793410f2c0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 --2- 172.21.15.37:0/2535586424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7934108140 0x7f7934108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 --2- 172.21.15.37:0/2535586424 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7934102800 0x7f7934102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 -- 172.21.15.37:0/2535586424 >> 172.21.15.37:0/2535586424 conn(0x7f79340794c0 msgr2=0x7f79340798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 -- 172.21.15.37:0/2535586424 shutdown_connections 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.728+0000 7f7938c72640 1 -- 172.21.15.37:0/2535586424 wait complete. 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.729+0000 7f7938c72640 1 Processor -- start 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.729+0000 7f7938c72640 1 -- start start 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.729+0000 7f7938c72640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7934102800 0x7f793419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.729+0000 7f7938c72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108140 0x7f793419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.729+0000 7f7938c72640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7934108a90 0x7f793419f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.729+0000 7f7938c72640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7934113700 con 0x7f7934108140 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.729+0000 7f7938c72640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7934113580 con 0x7f7934108a90 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.729+0000 7f7938c72640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7934113880 con 0x7f7934102800 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108140 0x7f793419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108140 0x7f793419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36192/0 (socket says 172.21.15.37:36192) 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 -- 172.21.15.37:0/652446144 learned_addr learned my addr 172.21.15.37:0/652446144 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f793259c640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7934102800 0x7f793419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7932d9d640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7934108a90 0x7f793419f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 -- 172.21.15.37:0/652446144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7934102800 msgr2=0x7f793419a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7934102800 0x7f793419a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 -- 172.21.15.37:0/652446144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7934108a90 msgr2=0x7f793419f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7934108a90 0x7f793419f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 -- 172.21.15.37:0/652446144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79341a0040 con 0x7f7934108140 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7931d9b640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108140 0x7f793419a670 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f792800e9c0 tx=0x7f792800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f79237fe640 1 -- 172.21.15.37:0/652446144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792800cd80 con 0x7f7934108140 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7938c72640 1 -- 172.21.15.37:0/652446144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79341a0330 con 0x7f7934108140 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f79237fe640 1 -- 172.21.15.37:0/652446144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79280054b0 con 0x7f7934108140 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f79237fe640 1 -- 172.21.15.37:0/652446144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928010430 con 0x7f7934108140 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.730+0000 7f7938c72640 1 -- 172.21.15.37:0/652446144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341a6a90 con 0x7f7934108140 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.733+0000 7f793f1e7740 1 Processor -- start 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793f1e7740 1 -- start start 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad8a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad8a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f79237fe640 1 -- 172.21.15.37:0/652446144 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f79280105d0 con 0x7f7934108140 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad8ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793f1e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612aad01680 con 0x5612aa9e5070 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793f1e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5612aacf0c10 con 0x5612aa9bc1b0 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793f1e7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5612aacf4bc0 con 0x5612aa9c4390 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7932d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad8a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7932d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad8a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36206/0 (socket says 172.21.15.37:36206) 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7932d9d640 1 -- 172.21.15.37:0/1594694964 learned_addr learned my addr 172.21.15.37:0/1594694964 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793259c640 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad8a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7931d9b640 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad8ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7932d9d640 1 -- 172.21.15.37:0/1594694964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 msgr2=0x5612aad8ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7932d9d640 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad8ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7932d9d640 1 -- 172.21.15.37:0/1594694964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 msgr2=0x5612aad8a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:49.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7932d9d640 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad8a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7932d9d640 1 -- 172.21.15.37:0/1594694964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612aaa50650 con 0x5612aa9e5070 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f7931d9b640 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad8ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.734+0000 7f793259c640 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad8a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.735+0000 7f7932d9d640 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad8a310 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f792c009ca0 tx=0x7f792c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b959039d20976f57 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.735+0000 7f7920ff9640 1 -- 172.21.15.37:0/1594694964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c031980 con 0x5612aa9e5070 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.735+0000 7f79237fe640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f791c0b4ca0 0x7f791c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.735+0000 7f7920ff9640 1 -- 172.21.15.37:0/1594694964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f792c036030 con 0x5612aa9e5070 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.735+0000 7f7920ff9640 1 -- 172.21.15.37:0/1594694964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c004460 con 0x5612aa9e5070 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.735+0000 7f793259c640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f791c0b4ca0 0x7f791c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.735+0000 7f79237fe640 1 -- 172.21.15.37:0/652446144 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f79280e5b20 con 0x7f7934108140 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 -- 172.21.15.37:0/1594694964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 msgr2=0x5612aad8a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793259c640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f791c0b4ca0 0x7f791c0b71b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5612aad88f90 tx=0x7f792400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:49.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad8a310 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f792c009ca0 tx=0x7f792c009a20 comp rx=0 tx=0).stop 2024-08-31T06:56:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 -- 172.21.15.37:0/1594694964 shutdown_connections 2024-08-31T06:56:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad8ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad8a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 --2- 172.21.15.37:0/1594694964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad8a310 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 -- 172.21.15.37:0/1594694964 >> 172.21.15.37:0/1594694964 conn(0x5612aa9d9460 msgr2=0x5612aad88200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 -- 172.21.15.37:0/1594694964 shutdown_connections 2024-08-31T06:56:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.736+0000 7f793f1e7740 1 -- 172.21.15.37:0/1594694964 wait complete. 2024-08-31T06:56:49.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 1 -- start start 2024-08-31T06:56:49.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 1 Processor -- start 2024-08-31T06:56:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad95a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9c4390 0x5612aad95fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9e5070 0x5612aada1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612aab53700 con 0x5612aa9c4390 2024-08-31T06:56:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x5612aac77750 con 0x5612aa9bc1b0 2024-08-31T06:56:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x5612aad98910 con 0x5612aa9e5070 2024-08-31T06:56:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f7931d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9c4390 0x5612aad95fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f7931d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9c4390 0x5612aad95fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36220/0 (socket says 172.21.15.37:36220) 2024-08-31T06:56:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f7931d9b640 1 -- 172.21.15.37:0/3770998446 learned_addr learned my addr 172.21.15.37:0/3770998446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793f1e7740 10 client.0 _ll_register_callbacks cb 0x5612aaca6e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.737+0000 7f793259c640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7932d9d640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9e5070 0x5612aada1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7931d9b640 1 -- 172.21.15.37:0/3770998446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9e5070 msgr2=0x5612aada1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7931d9b640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9e5070 0x5612aada1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7931d9b640 1 -- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 msgr2=0x5612aad95a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7931d9b640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad95a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7931d9b640 1 -- 172.21.15.37:0/3770998446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612aacb0900 con 0x5612aa9c4390 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7932d9d640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9e5070 0x5612aada1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f793259c640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad95a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7931d9b640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9c4390 0x5612aad95fb0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f79280a82a0 tx=0x7f79280aba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c95c8a98904684 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7919ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7919ffb640 1 -- 172.21.15.37:0/3770998446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280ea040 con 0x5612aa9c4390 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7919ffb640 1 -- 172.21.15.37:0/3770998446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f79280ab480 con 0x5612aa9c4390 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f793f1e7740 1 -- 172.21.15.37:0/3770998446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f792c036030 con 0x5612aa9c4390 2024-08-31T06:56:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7919ffb640 1 -- 172.21.15.37:0/3770998446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f79280e3710 con 0x5612aa9c4390 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f793f1e7740 10 client.17835 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f793f1e7740 1 -- 172.21.15.37:0/3770998446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5612aada4640 con 0x5612aa9c4390 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.738+0000 7f7919ffb640 1 -- 172.21.15.37:0/3770998446 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f792c036030 con 0x5612aa9c4390 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f7919ffb640 1 -- 172.21.15.37:0/3770998446 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f79280a7b90 con 0x5612aa9c4390 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f793f1e7740 10 client.17835 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f793f1e7740 10 client.17835 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f793f1e7740 20 client.17835 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f793f1e7740 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5612aa9a39f0 0x5612aada7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f793f1e7740 4 client.17835 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f793f1e7740 1 -- 172.21.15.37:0/3770998446 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612aad035d0 con 0x5612aa9a39f0 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f793259c640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5612aa9a39f0 0x5612aada7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f7919ffb640 10 client.17835 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:56:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.739+0000 7f793259c640 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5612aa9a39f0 0x5612aada7b10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=614105e062de21 server_cookie=277b63318d6dac9b in_seq=0 out_seq=0 2024-08-31T06:56:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f7919ffb640 1 -- 172.21.15.37:0/3770998446 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5612aad035d0 con 0x5612aa9a39f0 2024-08-31T06:56:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f7919ffb640 10 client.17835 handle_command_reply: tid=0 2024-08-31T06:56:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 client.17835 shutdown 2024-08-31T06:56:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 -- 172.21.15.37:0/3770998446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9c4390 msgr2=0x5612aad95fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9c4390 0x5612aad95fb0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f79280a82a0 tx=0x7f79280aba50 comp rx=0 tx=0).stop 2024-08-31T06:56:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 -- 172.21.15.37:0/3770998446 shutdown_connections 2024-08-31T06:56:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9c4390 0x5612aad95fb0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5612aa9a39f0 0x5612aada7b10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f7919ffb640 0 client.17835 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:56:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9e5070 0x5612aada1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 --2- 172.21.15.37:0/3770998446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9bc1b0 0x5612aad95a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.740+0000 7f793f1e7740 1 -- 172.21.15.37:0/3770998446 >> 172.21.15.37:0/3770998446 conn(0x5612aa9d9460 msgr2=0x5612aad8d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.741+0000 7f793f1e7740 1 -- 172.21.15.37:0/3770998446 shutdown_connections 2024-08-31T06:56:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.741+0000 7f793f1e7740 1 -- 172.21.15.37:0/3770998446 wait complete. 2024-08-31T06:56:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.741+0000 7f793f1e7740 20 client.17835 trim_cache size 0 max 16384 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793f1e7740 1 Processor -- start 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793f1e7740 1 -- start start 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9bc1b0 0x5612aad8db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad92c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9e5070 0x5612aad931a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793f1e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79341b1ba0 con 0x5612aa9bc1b0 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793f1e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79341af470 con 0x5612aa9e5070 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793f1e7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f79341ad2e0 con 0x5612aa9c4390 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9bc1b0 0x5612aad8db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9bc1b0 0x5612aad8db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36232/0 (socket says 172.21.15.37:36232) 2024-08-31T06:56:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793259c640 1 -- 172.21.15.37:0/1020357668 learned_addr learned my addr 172.21.15.37:0/1020357668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f7931d9b640 1 --2- 172.21.15.37:0/1020357668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad92c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793259c640 1 -- 172.21.15.37:0/1020357668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 msgr2=0x5612aad92c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793259c640 1 --2- 172.21.15.37:0/1020357668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad92c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793259c640 1 -- 172.21.15.37:0/1020357668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9e5070 msgr2=0x5612aad931a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793259c640 1 --2- 172.21.15.37:0/1020357668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9e5070 0x5612aad931a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.754+0000 7f793259c640 1 -- 172.21.15.37:0/1020357668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612aad96b10 con 0x5612aa9bc1b0 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.755+0000 7f793259c640 1 --2- 172.21.15.37:0/1020357668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9bc1b0 0x5612aad8db20 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x5612aada8150 tx=0x7f7924015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93341e2c38b832 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.755+0000 7f791bfff640 1 -- 172.21.15.37:0/1020357668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924005020 con 0x5612aa9bc1b0 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.755+0000 7f791bfff640 1 -- 172.21.15.37:0/1020357668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79240047a0 con 0x5612aa9bc1b0 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.755+0000 7f791bfff640 1 -- 172.21.15.37:0/1020357668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924005650 con 0x5612aa9bc1b0 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.755+0000 7f793f1e7740 1 -- 172.21.15.37:0/1020357668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9bc1b0 msgr2=0x5612aad8db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.755+0000 7f793f1e7740 1 --2- 172.21.15.37:0/1020357668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9bc1b0 0x5612aad8db20 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x5612aada8150 tx=0x7f7924015000 comp rx=0 tx=0).stop 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 -- 172.21.15.37:0/1020357668 shutdown_connections 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 --2- 172.21.15.37:0/1020357668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9e5070 0x5612aad931a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 --2- 172.21.15.37:0/1020357668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9c4390 0x5612aad92c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 --2- 172.21.15.37:0/1020357668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9bc1b0 0x5612aad8db20 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 -- 172.21.15.37:0/1020357668 >> 172.21.15.37:0/1020357668 conn(0x5612aa9d9460 msgr2=0x5612aad8d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 -- 172.21.15.37:0/1020357668 shutdown_connections 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 -- 172.21.15.37:0/1020357668 wait complete. 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 -- start start 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 Processor -- start 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9bc1b0 0x5612aad9e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9c4390 0x5612aad9a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad9afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f79341ad930 con 0x5612aa9e5070 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f79341aeda0 con 0x5612aa9c4390 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f79341ae000 con 0x5612aa9bc1b0 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.756+0000 7f793f1e7740 10 client.0 _ll_register_callbacks cb 0x7f7928004920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad9afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad9afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36242/0 (socket says 172.21.15.37:36242) 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f793259c640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9bc1b0 0x5612aad9e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 -- 172.21.15.37:0/2087573378 learned_addr learned my addr 172.21.15.37:0/2087573378 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7931d9b640 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9c4390 0x5612aad9a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 -- 172.21.15.37:0/2087573378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9bc1b0 msgr2=0x5612aad9e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9bc1b0 0x5612aad9e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 -- 172.21.15.37:0/2087573378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9c4390 msgr2=0x5612aad9a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9c4390 0x5612aad9a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 -- 172.21.15.37:0/2087573378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612aad9b730 con 0x5612aa9e5070 2024-08-31T06:56:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7932d9d640 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad9afa0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f792c02ade0 tx=0x7f792c0318c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bd3de07f611fb7 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7919ffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7919ffb640 1 -- 172.21.15.37:0/2087573378 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c003b80 con 0x5612aa9e5070 2024-08-31T06:56:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7919ffb640 1 -- 172.21.15.37:0/2087573378 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f792c003d20 con 0x5612aa9e5070 2024-08-31T06:56:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f793f1e7740 1 -- 172.21.15.37:0/2087573378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79240047a0 con 0x5612aa9e5070 2024-08-31T06:56:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f7919ffb640 1 -- 172.21.15.37:0/2087573378 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f792c004040 con 0x5612aa9e5070 2024-08-31T06:56:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f793f1e7740 10 client.17841 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.757+0000 7f793f1e7740 1 -- 172.21.15.37:0/2087573378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5612aae13470 con 0x5612aa9e5070 2024-08-31T06:56:49.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f7919ffb640 1 -- 172.21.15.37:0/2087573378 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79240047a0 con 0x5612aa9e5070 2024-08-31T06:56:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f7919ffb640 1 -- 172.21.15.37:0/2087573378 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f792c04e070 con 0x5612aa9e5070 2024-08-31T06:56:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f793f1e7740 10 client.17841 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f793f1e7740 10 client.17841 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-31T06:56:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f793f1e7740 20 client.17841 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f793f1e7740 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5612aa978da0 0x5612aae159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f793f1e7740 4 client.17841 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:56:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f793f1e7740 1 -- 172.21.15.37:0/2087573378 --> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5612aacff070 con 0x5612aa978da0 2024-08-31T06:56:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.758+0000 7f793259c640 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5612aa978da0 0x5612aae159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f7919ffb640 10 client.17841 ms_handle_connect on v2:172.21.15.66:6836/3257187794 2024-08-31T06:56:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793259c640 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5612aa978da0 0x5612aae159f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf06e6035fb5ac5c server_cookie=fc44dba6a851c82d in_seq=0 out_seq=0 2024-08-31T06:56:49.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f7919ffb640 1 -- 172.21.15.37:0/2087573378 <== mds.2 v2:172.21.15.66:6836/3257187794 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5612aacff070 con 0x5612aa978da0 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f7919ffb640 10 client.17841 handle_command_reply: tid=0 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 client.17841 shutdown 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 -- 172.21.15.37:0/2087573378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 msgr2=0x5612aad9afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad9afa0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f792c02ade0 tx=0x7f792c0318c0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 -- 172.21.15.37:0/2087573378 shutdown_connections 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612aa9e5070 0x5612aad9afa0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.66:6836/3257187794,v1:172.21.15.66:6837/3257187794] conn(0x5612aa978da0 0x5612aae159f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5612aa9c4390 0x5612aad9a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f7919ffb640 0 client.17841 ms_handle_reset on v2:172.21.15.66:6836/3257187794 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 --2- 172.21.15.37:0/2087573378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5612aa9bc1b0 0x5612aad9e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 -- 172.21.15.37:0/2087573378 >> 172.21.15.37:0/2087573378 conn(0x5612aa9d9460 msgr2=0x5612aad93eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:49.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 -- 172.21.15.37:0/2087573378 shutdown_connections 2024-08-31T06:56:49.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 1 -- 172.21.15.37:0/2087573378 wait complete. 2024-08-31T06:56:49.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.759+0000 7f793f1e7740 20 client.17841 trim_cache size 0 max 16384 2024-08-31T06:56:49.771 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 -- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f791c0b4ca0 msgr2=0x7f791c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f791c0b4ca0 0x7f791c0b71b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x5612aad88f90 tx=0x7f792400b390 comp rx=0 tx=0).stop 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 -- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108140 msgr2=0x7f793419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108140 0x7f793419a670 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f792800e9c0 tx=0x7f792800ee80 comp rx=0 tx=0).stop 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 -- 172.21.15.37:0/652446144 shutdown_connections 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f791c0b4ca0 0x7f791c0b71b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7934108140 0x7f793419a670 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7934108a90 0x7f793419f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 --2- 172.21.15.37:0/652446144 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7934102800 0x7f793419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:49.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 -- 172.21.15.37:0/652446144 >> 172.21.15.37:0/652446144 conn(0x7f79340794c0 msgr2=0x7f79341041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:49.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 -- 172.21.15.37:0/652446144 shutdown_connections 2024-08-31T06:56:49.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:49.760+0000 7f7938c72640 1 -- 172.21.15.37:0/652446144 wait complete. 2024-08-31T06:56:50.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:49 smithi106 ceph-mon[22134]: pgmap v627: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:56:50.090 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:49 smithi037 ceph-mon[18612]: pgmap v627: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:56:50.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:49 smithi066 ceph-mon[22244]: pgmap v627: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-31T06:56:50.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-31T06:56:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:51.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 -- 172.21.15.37:0/132311829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8102820 msgr2=0x7f3dd8102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 --2- 172.21.15.37:0/132311829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8102820 0x7f3dd8102c30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009900 tx=0x7f3dc002a410 comp rx=0 tx=0).stop 2024-08-31T06:56:51.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 -- 172.21.15.37:0/132311829 shutdown_connections 2024-08-31T06:56:51.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 --2- 172.21.15.37:0/132311829 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3dd8108ab0 0x7f3dd810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 --2- 172.21.15.37:0/132311829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dd8108160 0x7f3dd8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 --2- 172.21.15.37:0/132311829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8102820 0x7f3dd8102c30 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 -- 172.21.15.37:0/132311829 >> 172.21.15.37:0/132311829 conn(0x7f3dd80794e0 msgr2=0x7f3dd80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 -- 172.21.15.37:0/132311829 shutdown_connections 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.212+0000 7f3dde18b640 1 -- 172.21.15.37:0/132311829 wait complete. 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dde18b640 1 Processor -- start 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dde18b640 1 -- start start 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dde18b640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dd8102820 0x7f3dd81990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dde18b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8108160 0x7f3dd8199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dde18b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3dd8108ab0 0x7f3dd819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dde18b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81125e0 con 0x7f3dd8108160 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dde18b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8112460 con 0x7f3dd8108ab0 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dde18b640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd8112760 con 0x7f3dd8102820 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8108160 0x7f3dd8199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8108160 0x7f3dd8199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36250/0 (socket says 172.21.15.37:36250) 2024-08-31T06:56:51.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/2918193957 learned_addr learned my addr 172.21.15.37:0/2918193957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dd8102820 0x7f3dd81990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.213+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3dd8108ab0 0x7f3dd819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/2918193957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dd8102820 msgr2=0x7f3dd81990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dd8102820 0x7f3dd81990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/2918193957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3dd8108ab0 msgr2=0x7f3dd819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3dd8108ab0 0x7f3dd819e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/2918193957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dd819ef60 con 0x7f3dd8108160 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8108160 0x7f3dd8199650 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800d740 tx=0x7f3dc800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2918193957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8017070 con 0x7f3dd8108160 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2918193957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dc800de50 con 0x7f3dd8108160 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2918193957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8004c60 con 0x7f3dd8108160 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dde18b640 1 -- 172.21.15.37:0/2918193957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dd819f250 con 0x7f3dd8108160 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.214+0000 7f3dde18b640 1 -- 172.21.15.37:0/2918193957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dd806b8e0 con 0x7f3dd8108160 2024-08-31T06:56:51.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3de4700740 1 Processor -- start 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3de4700740 1 -- start start 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2918193957 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f3dc8004e00 con 0x7f3dd8108160 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3de4700740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c9296b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3de4700740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c9259d1b0 0x559c9296b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3de4700740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c925a5390 0x559c9296bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3de4700740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c928e2680 con 0x559c925c6070 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3de4700740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559c928d1c10 con 0x559c925a5390 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3de4700740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559c928d5bc0 con 0x559c9259d1b0 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3dd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c9296b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3dd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c9296b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36258/0 (socket says 172.21.15.37:36258) 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3dd7fff640 1 -- 172.21.15.37:0/3259939193 learned_addr learned my addr 172.21.15.37:0/3259939193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.217+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c9259d1b0 0x559c9296b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c925a5390 0x559c9296bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd7fff640 1 -- 172.21.15.37:0/3259939193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c9259d1b0 msgr2=0x559c9296b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c9259d1b0 0x559c9296b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd7fff640 1 -- 172.21.15.37:0/3259939193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c925a5390 msgr2=0x559c9296bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c925a5390 0x559c9296bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd7fff640 1 -- 172.21.15.37:0/3259939193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c92631650 con 0x559c925c6070 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c925a5390 0x559c9296bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c9296b310 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c590 tx=0x7f3dd0009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6739757b3dbb98ae server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd4ff9640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3dc40b4cd0 0x7f3dc40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3259939193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0017680 con 0x559c925c6070 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3259939193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dd001c070 con 0x559c925c6070 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dcdffb640 1 -- 172.21.15.37:0/3259939193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000a9f0 con 0x559c925c6070 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3dc40b4cd0 0x7f3dc40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.218+0000 7f3dd4ff9640 1 -- 172.21.15.37:0/2918193957 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f3dc80e4e40 con 0x7f3dd8108160 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 -- 172.21.15.37:0/3259939193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 msgr2=0x559c9296b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3dc40b4cd0 0x7f3dc40b71e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00057c0 tx=0x7f3dc00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c9296b310 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000c590 tx=0x7f3dd0009730 comp rx=0 tx=0).stop 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 -- 172.21.15.37:0/3259939193 shutdown_connections 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c925a5390 0x559c9296bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c9259d1b0 0x559c9296b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 --2- 172.21.15.37:0/3259939193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c9296b310 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 -- 172.21.15.37:0/3259939193 >> 172.21.15.37:0/3259939193 conn(0x559c925ba460 msgr2=0x559c92969200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 -- 172.21.15.37:0/3259939193 shutdown_connections 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.219+0000 7f3de4700740 1 -- 172.21.15.37:0/3259939193 wait complete. 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 1 -- start start 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 1 Processor -- start 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c92976b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925a5390 0x559c92977050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c92982e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c92734700 con 0x559c925c6070 2024-08-31T06:56:51.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x559c92858750 con 0x559c9259d1b0 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x559c92979af0 con 0x559c925a5390 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3de4700740 10 client.0 _ll_register_callbacks cb 0x559c92887e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3dd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c92982e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3dd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c92982e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36262/0 (socket says 172.21.15.37:36262) 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3dd7fff640 1 -- 172.21.15.37:0/1566266505 learned_addr learned my addr 172.21.15.37:0/1566266505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c92976b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.220+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925a5390 0x559c92977050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3dd7fff640 1 -- 172.21.15.37:0/1566266505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925a5390 msgr2=0x559c92977050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925a5390 0x559c92977050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3dd7fff640 1 -- 172.21.15.37:0/1566266505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 msgr2=0x559c92976b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c92976b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3dd7fff640 1 -- 172.21.15.37:0/1566266505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c92891900 con 0x559c925c6070 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c92982e10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000bee0 tx=0x7f3dd000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247bc1df5ffbd02e server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:51.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3db6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1566266505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0004e50 con 0x559c925c6070 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1566266505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f3dd0005050 con 0x559c925c6070 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3de4700740 1 -- 172.21.15.37:0/1566266505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dd001c070 con 0x559c925c6070 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1566266505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3dd000a440 con 0x559c925c6070 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3de4700740 10 client.17853 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.221+0000 7f3de4700740 1 -- 172.21.15.37:0/1566266505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c929858c0 con 0x559c925c6070 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1566266505 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dd001c070 con 0x559c925c6070 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1566266505 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3dd0017640 con 0x559c925c6070 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3de4700740 10 client.17853 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3de4700740 10 client.17853 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3de4700740 20 client.17853 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3de4700740 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559c925849f0 0x559c92988c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3de4700740 4 client.17853 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3de4700740 1 -- 172.21.15.37:0/1566266505 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c928e45d0 con 0x559c925849f0 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.222+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559c925849f0 0x559c92988c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.223+0000 7f3db6ffd640 10 client.17853 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.223+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559c925849f0 0x559c92988c80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9fe8ecd16a8618a1 server_cookie=92b007abfad19dba in_seq=0 out_seq=0 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.223+0000 7f3db6ffd640 1 -- 172.21.15.37:0/1566266505 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c928e45d0 con 0x559c925849f0 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.223+0000 7f3db6ffd640 10 client.17853 handle_command_reply: tid=0 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.223+0000 7f3de4700740 1 client.17853 shutdown 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 -- 172.21.15.37:0/1566266505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 msgr2=0x559c92982e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c92982e10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000bee0 tx=0x7f3dd000bf10 comp rx=0 tx=0).stop 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 -- 172.21.15.37:0/1566266505 shutdown_connections 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559c925849f0 0x559c92988c80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925c6070 0x559c92982e10 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3db6ffd640 0 client.17853 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925a5390 0x559c92977050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 --2- 172.21.15.37:0/1566266505 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c92976b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 -- 172.21.15.37:0/1566266505 >> 172.21.15.37:0/1566266505 conn(0x559c925ba460 msgr2=0x559c9296e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:51.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 -- 172.21.15.37:0/1566266505 shutdown_connections 2024-08-31T06:56:51.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 1 -- 172.21.15.37:0/1566266505 wait complete. 2024-08-31T06:56:51.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.224+0000 7f3de4700740 20 client.17853 trim_cache size 0 max 16384 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.237+0000 7f3de4700740 1 Processor -- start 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.237+0000 7f3de4700740 1 -- start start 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3de4700740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c9296eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3de4700740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c9298c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3de4700740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 0x559c9298c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3de4700740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81afa60 con 0x559c925a5390 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3de4700740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81ad330 con 0x559c9259d1b0 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3de4700740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81ab1a0 con 0x559c925c6070 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c9298c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c9298c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36264/0 (socket says 172.21.15.37:36264) 2024-08-31T06:56:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/4004147261 learned_addr learned my addr 172.21.15.37:0/4004147261 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c9296eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/4004147261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 msgr2=0x559c9298c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 0x559c9298c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 0x559c9298c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/4004147261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 msgr2=0x559c9296eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c9296eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/4004147261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c9296d830 con 0x559c925a5390 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c9296eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c9298c090 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80ab580 tx=0x7f3dc80b4260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ff4cf4c0316c4a server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dcd7fa640 1 -- 172.21.15.37:0/4004147261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc8020040 con 0x559c925a5390 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dcd7fa640 1 -- 172.21.15.37:0/4004147261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dc80afdb0 con 0x559c925a5390 2024-08-31T06:56:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.238+0000 7f3dcd7fa640 1 -- 172.21.15.37:0/4004147261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80ce0b0 con 0x559c925a5390 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 -- 172.21.15.37:0/4004147261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 msgr2=0x559c9298c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c9298c090 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80ab580 tx=0x7f3dc80b4260 comp rx=0 tx=0).stop 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 -- 172.21.15.37:0/4004147261 shutdown_connections 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c9298c090 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 0x559c9298c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 --2- 172.21.15.37:0/4004147261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c9296eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 -- 172.21.15.37:0/4004147261 >> 172.21.15.37:0/4004147261 conn(0x559c925ba460 msgr2=0x559c9296e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 -- 172.21.15.37:0/4004147261 shutdown_connections 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.239+0000 7f3de4700740 1 -- 172.21.15.37:0/4004147261 wait complete. 2024-08-31T06:56:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 1 -- start start 2024-08-31T06:56:51.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 1 Processor -- start 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c929eb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c929ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 0x559c929f0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81ab7f0 con 0x559c925a5390 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81acc60 con 0x559c9259d1b0 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f3dd81abec0 con 0x559c925c6070 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3de4700740 10 client.0 _ll_register_callbacks cb 0x7f3dc0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c929ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3dd6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c929ebb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36266/0 (socket says 172.21.15.37:36266) 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.240+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/2093855724 learned_addr learned my addr 172.21.15.37:0/2093855724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c929eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3dd7fff640 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 0x559c929f0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/2093855724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 msgr2=0x559c929f0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 0x559c929f0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/2093855724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 msgr2=0x559c929eb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c929eb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3dd6ffd640 1 -- 172.21.15.37:0/2093855724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c929f11d0 con 0x559c925a5390 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3dd6ffd640 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c929ebb40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80e2650 tx=0x7f3dc8009f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771764b4e54d7db9 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3db6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3db6ffd640 1 -- 172.21.15.37:0/2093855724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc805b020 con 0x559c925a5390 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3db6ffd640 1 -- 172.21.15.37:0/2093855724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f3dc80d2070 con 0x559c925a5390 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3de4700740 1 -- 172.21.15.37:0/2093855724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc80afdb0 con 0x559c925a5390 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3db6ffd640 1 -- 172.21.15.37:0/2093855724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3dc8020040 con 0x559c925a5390 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3de4700740 10 client.17859 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.241+0000 7f3de4700740 1 -- 172.21.15.37:0/2093855724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559c929f8530 con 0x559c925a5390 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3db6ffd640 1 -- 172.21.15.37:0/2093855724 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3dc80afdb0 con 0x559c925a5390 2024-08-31T06:56:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3db6ffd640 1 -- 172.21.15.37:0/2093855724 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3dc80c7020 con 0x559c925a5390 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3de4700740 10 client.17859 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3de4700740 10 client.17859 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3de4700740 20 client.17859 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3de4700740 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559c92559da0 0x559c929facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3de4700740 4 client.17859 mds_command: new command op to 24658 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3de4700740 1 -- 172.21.15.37:0/2093855724 --> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559c928e0070 con 0x559c92559da0 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559c92559da0 0x559c929facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3db6ffd640 10 client.17859 ms_handle_connect on v2:172.21.15.106:6838/1806859517 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.242+0000 7f3dd77fe640 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559c92559da0 0x559c929facf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e861aa812685f95 server_cookie=d9ab71412686b133 in_seq=0 out_seq=0 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3db6ffd640 1 -- 172.21.15.37:0/2093855724 <== mds.1 v2:172.21.15.106:6838/1806859517 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559c928e0070 con 0x559c92559da0 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3db6ffd640 10 client.17859 handle_command_reply: tid=0 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 client.17859 shutdown 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 -- 172.21.15.37:0/2093855724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 msgr2=0x559c929ebb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c929ebb40 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f3dc80e2650 tx=0x7f3dc8009f40 comp rx=0 tx=0).stop 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 -- 172.21.15.37:0/2093855724 shutdown_connections 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.106:6838/1806859517,v1:172.21.15.106:6839/1806859517] conn(0x559c92559da0 0x559c929facf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c925a5390 0x559c929ebb40 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559c925c6070 0x559c929f0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3db6ffd640 0 client.17859 ms_handle_reset on v2:172.21.15.106:6838/1806859517 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 --2- 172.21.15.37:0/2093855724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x559c9259d1b0 0x559c929eb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 -- 172.21.15.37:0/2093855724 >> 172.21.15.37:0/2093855724 conn(0x559c925ba460 msgr2=0x559c9296c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 -- 172.21.15.37:0/2093855724 shutdown_connections 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 1 -- 172.21.15.37:0/2093855724 wait complete. 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.243+0000 7f3de4700740 20 client.17859 trim_cache size 0 max 16384 2024-08-31T06:56:51.250 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 -- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3dc40b4cd0 msgr2=0x7f3dc40b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3dc40b4cd0 0x7f3dc40b71e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00057c0 tx=0x7f3dc00058d0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 -- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8108160 msgr2=0x7f3dd8199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8108160 0x7f3dd8199650 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f3dc800d740 tx=0x7f3dc800dc00 comp rx=0 tx=0).stop 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 -- 172.21.15.37:0/2918193957 shutdown_connections 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f3dc40b4cd0 0x7f3dc40b71e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd8108160 0x7f3dd8199650 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3dd8108ab0 0x7f3dd819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 --2- 172.21.15.37:0/2918193957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3dd8102820 0x7f3dd81990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 -- 172.21.15.37:0/2918193957 >> 172.21.15.37:0/2918193957 conn(0x7f3dd80794e0 msgr2=0x7f3dd81012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 -- 172.21.15.37:0/2918193957 shutdown_connections 2024-08-31T06:56:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:51.244+0000 7f3dde18b640 1 -- 172.21.15.37:0/2918193957 wait complete. 2024-08-31T06:56:51.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:51 smithi037 ceph-mon[18612]: pgmap v628: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T06:56:52.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:51 smithi106 ceph-mon[22134]: pgmap v628: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T06:56:52.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-31T06:56:52.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:51 smithi066 ceph-mon[22244]: pgmap v628: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T06:56:52.338 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:52.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 -- 172.21.15.37:0/3762363513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2360102880 msgr2=0x7f2360102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 --2- 172.21.15.37:0/3762363513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2360102880 0x7f2360102c90 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f235c009900 tx=0x7f235c02a410 comp rx=0 tx=0).stop 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 -- 172.21.15.37:0/3762363513 shutdown_connections 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 --2- 172.21.15.37:0/3762363513 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2360108b10 0x7f236010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 --2- 172.21.15.37:0/3762363513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f23601081c0 0x7f23601085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 --2- 172.21.15.37:0/3762363513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2360102880 0x7f2360102c90 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 -- 172.21.15.37:0/3762363513 >> 172.21.15.37:0/3762363513 conn(0x7f2360079510 msgr2=0x7f2360079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 -- 172.21.15.37:0/3762363513 shutdown_connections 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 -- 172.21.15.37:0/3762363513 wait complete. 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 Processor -- start 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.873+0000 7f2367843640 1 -- start start 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2367843640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2360102880 0x7f23601119a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2367843640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23601081c0 0x7f2360111ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2367843640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2360108b10 0x7f2360112420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2367843640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f236006c710 con 0x7f23601081c0 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2367843640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f236006c590 con 0x7f2360102880 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2367843640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f236006c890 con 0x7f2360108b10 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23601081c0 0x7f2360111ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23601081c0 0x7f2360111ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36276/0 (socket says 172.21.15.37:36276) 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 -- 172.21.15.37:0/2552039761 learned_addr learned my addr 172.21.15.37:0/2552039761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f23655df640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2360102880 0x7f23601119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2365de0640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2360108b10 0x7f2360112420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 -- 172.21.15.37:0/2552039761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2360108b10 msgr2=0x7f2360112420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2360108b10 0x7f2360112420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 -- 172.21.15.37:0/2552039761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2360102880 msgr2=0x7f23601119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2360102880 0x7f23601119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 -- 172.21.15.37:0/2552039761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23601a8540 con 0x7f23601081c0 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2365de0640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2360108b10 0x7f2360112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.874+0000 7f2364dde640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23601081c0 0x7f2360111ee0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f235000c970 tx=0x7f235000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.875+0000 7f23567fc640 1 -- 172.21.15.37:0/2552039761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350007bb0 con 0x7f23601081c0 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.875+0000 7f23567fc640 1 -- 172.21.15.37:0/2552039761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2350007d50 con 0x7f23601081c0 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.875+0000 7f2367843640 1 -- 172.21.15.37:0/2552039761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23601a8830 con 0x7f23601081c0 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.875+0000 7f23567fc640 1 -- 172.21.15.37:0/2552039761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2350004da0 con 0x7f23601081c0 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.875+0000 7f2367843640 1 -- 172.21.15.37:0/2552039761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23601a8d70 con 0x7f23601081c0 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f23567fc640 1 -- 172.21.15.37:0/2552039761 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f2350004f40 con 0x7f23601081c0 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f236ddb8740 1 Processor -- start 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f236ddb8740 1 -- start start 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9ce070 0x55b09dd73310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9a51b0 0x55b09dd73850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd73d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f236ddb8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b09dcea680 con 0x55b09d9ce070 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f236ddb8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b09dcd9c10 con 0x55b09d9ad390 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f236ddb8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b09dcddbc0 con 0x55b09d9a51b0 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f2365de0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9ce070 0x55b09dd73310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f2365de0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9ce070 0x55b09dd73310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36280/0 (socket says 172.21.15.37:36280) 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f2365de0640 1 -- 172.21.15.37:0/2404552022 learned_addr learned my addr 172.21.15.37:0/2404552022 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f2364dde640 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd73d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.878+0000 7f23655df640 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9a51b0 0x55b09dd73850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f2365de0640 1 -- 172.21.15.37:0/2404552022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9a51b0 msgr2=0x55b09dd73850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f2365de0640 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9a51b0 0x55b09dd73850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f2365de0640 1 -- 172.21.15.37:0/2404552022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 msgr2=0x55b09dd73d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f2365de0640 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd73d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f2365de0640 1 -- 172.21.15.37:0/2404552022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09da39650 con 0x55b09d9ce070 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f2365de0640 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9ce070 0x55b09dd73310 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2358009e40 tx=0x7f235800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9340a08b22d7ebc4 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:52.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f23567fc640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f234c0b4ca0 0x7f234c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f234b7fe640 1 -- 172.21.15.37:0/2404552022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358004d20 con 0x55b09d9ce070 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f23655df640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f234c0b4ca0 0x7f234c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f234b7fe640 1 -- 172.21.15.37:0/2404552022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23580054b0 con 0x55b09d9ce070 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f234b7fe640 1 -- 172.21.15.37:0/2404552022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2358011680 con 0x55b09d9ce070 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.879+0000 7f23567fc640 1 -- 172.21.15.37:0/2552039761 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f23500e5390 con 0x7f23601081c0 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 -- 172.21.15.37:0/2404552022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9ce070 msgr2=0x55b09dd73310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f23655df640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f234c0b4ca0 0x7f234c0b71b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f235c006010 tx=0x7f235c009640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9ce070 0x55b09dd73310 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2358009e40 tx=0x7f235800f730 comp rx=0 tx=0).stop 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 -- 172.21.15.37:0/2404552022 shutdown_connections 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd73d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9a51b0 0x55b09dd73850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 --2- 172.21.15.37:0/2404552022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9ce070 0x55b09dd73310 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 -- 172.21.15.37:0/2404552022 >> 172.21.15.37:0/2404552022 conn(0x55b09d9c2460 msgr2=0x55b09dd71200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 -- 172.21.15.37:0/2404552022 shutdown_connections 2024-08-31T06:56:52.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 -- 172.21.15.37:0/2404552022 wait complete. 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.880+0000 7f236ddb8740 1 -- start start 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f236ddb8740 1 Processor -- start 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd7eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd7f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ce070 0x55b09dd8ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f236ddb8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b09db3c700 con 0x55b09d9a51b0 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f236ddb8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x55b09dc60750 con 0x55b09d9ad390 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f236ddb8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x55b09dd81af0 con 0x55b09d9ce070 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f23655df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd7eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f236ddb8740 10 client.0 _ll_register_callbacks cb 0x55b09dc8fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f23655df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd7eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36282/0 (socket says 172.21.15.37:36282) 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f23655df640 1 -- 172.21.15.37:0/1684479071 learned_addr learned my addr 172.21.15.37:0/1684479071 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f2364dde640 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd7f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f2365de0640 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ce070 0x55b09dd8ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f23655df640 1 -- 172.21.15.37:0/1684479071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ce070 msgr2=0x55b09dd8ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.881+0000 7f23655df640 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ce070 0x55b09dd8ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f23655df640 1 -- 172.21.15.37:0/1684479071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 msgr2=0x55b09dd7f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f23655df640 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd7f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f23655df640 1 -- 172.21.15.37:0/1684479071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09dc99900 con 0x55b09d9a51b0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f2365de0640 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ce070 0x55b09dd8ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f23655df640 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd7eb10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f235c033000 tx=0x7f235c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413bc4f771129de8 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f2348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f2348ff9640 1 -- 172.21.15.37:0/1684479071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c04b030 con 0x55b09d9a51b0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f2348ff9640 1 -- 172.21.15.37:0/1684479071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f235c003800 con 0x55b09d9a51b0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f236ddb8740 1 -- 172.21.15.37:0/1684479071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23580054b0 con 0x55b09d9a51b0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f2348ff9640 1 -- 172.21.15.37:0/1684479071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f235c035050 con 0x55b09d9a51b0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f236ddb8740 10 client.17871 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f236ddb8740 1 -- 172.21.15.37:0/1684479071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b09dd8d950 con 0x55b09d9a51b0 2024-08-31T06:56:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.882+0000 7f2348ff9640 1 -- 172.21.15.37:0/1684479071 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23580054b0 con 0x55b09d9a51b0 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f2348ff9640 1 -- 172.21.15.37:0/1684479071 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f235c059930 con 0x55b09d9a51b0 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f236ddb8740 10 client.17871 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f236ddb8740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f236ddb8740 20 client.17871 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b09d98c9f0 0x55b09dd90e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f236ddb8740 4 client.17871 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f236ddb8740 1 -- 172.21.15.37:0/1684479071 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b09dcec5d0 con 0x55b09d98c9f0 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f2364dde640 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b09d98c9f0 0x55b09dd90e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f2348ff9640 10 client.17871 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.883+0000 7f2364dde640 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b09d98c9f0 0x55b09dd90e50 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d52f22d4be89f91 server_cookie=811d1dbd38a49f9d in_seq=0 out_seq=0 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f2348ff9640 1 -- 172.21.15.37:0/1684479071 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b09dcec5d0 con 0x55b09d98c9f0 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f2348ff9640 10 client.17871 handle_command_reply: tid=0 2024-08-31T06:56:52.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 client.17871 shutdown 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 -- 172.21.15.37:0/1684479071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 msgr2=0x55b09dd7eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd7eb10 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f235c033000 tx=0x7f235c009260 comp rx=0 tx=0).stop 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 -- 172.21.15.37:0/1684479071 shutdown_connections 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b09d98c9f0 0x55b09dd90e50 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ce070 0x55b09dd8ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd7f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f2348ff9640 0 client.17871 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1684479071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd7eb10 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.884+0000 7f236ddb8740 1 -- 172.21.15.37:0/1684479071 >> 172.21.15.37:0/1684479071 conn(0x55b09d9c2460 msgr2=0x55b09dd764f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.885+0000 7f236ddb8740 1 -- 172.21.15.37:0/1684479071 shutdown_connections 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.885+0000 7f236ddb8740 1 -- 172.21.15.37:0/1684479071 wait complete. 2024-08-31T06:56:52.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.885+0000 7f236ddb8740 20 client.17871 trim_cache size 0 max 16384 2024-08-31T06:56:52.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f236ddb8740 1 Processor -- start 2024-08-31T06:56:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f236ddb8740 1 -- start start 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d98c9f0 0x55b09dd74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9a51b0 0x55b09dd80740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ad390 0x55b09dd8ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f236ddb8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f23601b3f40 con 0x55b09d98c9f0 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f236ddb8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23601b1810 con 0x55b09d9a51b0 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f236ddb8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f23601af680 con 0x55b09d9ad390 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f23655df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d98c9f0 0x55b09dd74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f23655df640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d98c9f0 0x55b09dd74d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36296/0 (socket says 172.21.15.37:36296) 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.898+0000 7f23655df640 1 -- 172.21.15.37:0/1947615819 learned_addr learned my addr 172.21.15.37:0/1947615819 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:52.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f23655df640 1 -- 172.21.15.37:0/1947615819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ad390 msgr2=0x55b09dd8ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f23655df640 1 --2- 172.21.15.37:0/1947615819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ad390 0x55b09dd8ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f2364dde640 1 --2- 172.21.15.37:0/1947615819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9a51b0 0x55b09dd80740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f23655df640 1 -- 172.21.15.37:0/1947615819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9a51b0 msgr2=0x55b09dd80740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f23655df640 1 --2- 172.21.15.37:0/1947615819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9a51b0 0x55b09dd80740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f23655df640 1 -- 172.21.15.37:0/1947615819 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b09dd75830 con 0x55b09d98c9f0 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f23655df640 1 --2- 172.21.15.37:0/1947615819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d98c9f0 0x55b09dd74d00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f235c009230 tx=0x7f235c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98401266cbf26e7d server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f234affd640 1 -- 172.21.15.37:0/1947615819 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c04b040 con 0x55b09d98c9f0 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f234affd640 1 -- 172.21.15.37:0/1947615819 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f235c05e070 con 0x55b09d98c9f0 2024-08-31T06:56:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.899+0000 7f234affd640 1 -- 172.21.15.37:0/1947615819 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235c047440 con 0x55b09d98c9f0 2024-08-31T06:56:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 -- 172.21.15.37:0/1947615819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d98c9f0 msgr2=0x55b09dd74d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1947615819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d98c9f0 0x55b09dd74d00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f235c009230 tx=0x7f235c005c90 comp rx=0 tx=0).stop 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 -- 172.21.15.37:0/1947615819 shutdown_connections 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1947615819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d9ad390 0x55b09dd8ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1947615819 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9a51b0 0x55b09dd80740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 --2- 172.21.15.37:0/1947615819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d98c9f0 0x55b09dd74d00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 -- 172.21.15.37:0/1947615819 >> 172.21.15.37:0/1947615819 conn(0x55b09d9c2460 msgr2=0x55b09dd80030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 -- 172.21.15.37:0/1947615819 shutdown_connections 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 -- 172.21.15.37:0/1947615819 wait complete. 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 -- start start 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.900+0000 7f236ddb8740 1 Processor -- start 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d98c9f0 0x55b09dd876e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd85bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f236ddb8740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f236ddb8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f23601afcd0 con 0x55b09d9a51b0 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f236ddb8740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f23601b1140 con 0x55b09d9ad390 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f236ddb8740 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f23601b03a0 con 0x55b09d98c9f0 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f236ddb8740 10 client.0 _ll_register_callbacks cb 0x7f235c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2364dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd85bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2364dde640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd85bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36312/0 (socket says 172.21.15.37:36312) 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2364dde640 1 -- 172.21.15.37:0/249065107 learned_addr learned my addr 172.21.15.37:0/249065107 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2365de0640 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f23655df640 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d98c9f0 0x55b09dd876e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2364dde640 1 -- 172.21.15.37:0/249065107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d98c9f0 msgr2=0x55b09dd876e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2364dde640 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d98c9f0 0x55b09dd876e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2364dde640 1 -- 172.21.15.37:0/249065107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 msgr2=0x55b09dd862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2364dde640 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd862b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.901+0000 7f2364dde640 1 -- 172.21.15.37:0/249065107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b09ddfb830 con 0x55b09d9a51b0 2024-08-31T06:56:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f2364dde640 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd85bc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f235000c940 tx=0x7f23500e78a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb14f11c4b731b6c server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f2348ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f2348ff9640 1 -- 172.21.15.37:0/249065107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235001d040 con 0x55b09d9a51b0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f2348ff9640 1 -- 172.21.15.37:0/249065107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f23500e2d70 con 0x55b09d9a51b0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f236ddb8740 1 -- 172.21.15.37:0/249065107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f235c05e070 con 0x55b09d9a51b0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f2348ff9640 1 -- 172.21.15.37:0/249065107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f23500046c0 con 0x55b09d9a51b0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f236ddb8740 10 client.17877 fetch_fsmap learned FSMap version 25 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f236ddb8740 1 -- 172.21.15.37:0/249065107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b09ddfc960 con 0x55b09d9a51b0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f2348ff9640 1 -- 172.21.15.37:0/249065107 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f235c05e070 con 0x55b09d9a51b0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f2348ff9640 1 -- 172.21.15.37:0/249065107 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f23500a7d20 con 0x55b09d9a51b0 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f236ddb8740 10 client.17877 fetch_fsmap finished waiting for FSMap version 25 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f236ddb8740 10 client.17877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f236ddb8740 20 client.17877 populate_metadata read hostname 'smithi037' 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.902+0000 7f236ddb8740 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b09d9ce070 0x55b09ddff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f236ddb8740 4 client.17877 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-31T06:56:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f236ddb8740 1 -- 172.21.15.37:0/249065107 --> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b09dce8070 con 0x55b09d9ce070 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f23655df640 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b09d9ce070 0x55b09ddff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f2348ff9640 10 client.17877 ms_handle_connect on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f23655df640 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b09d9ce070 0x55b09ddff0a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff332823f257de50 server_cookie=97d62a737ba3c72d in_seq=0 out_seq=0 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f2348ff9640 1 -- 172.21.15.37:0/249065107 <== mds.0 v2:172.21.15.66:6838/2855667585 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b09dce8070 con 0x55b09d9ce070 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f2348ff9640 10 client.17877 handle_command_reply: tid=0 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f236ddb8740 1 client.17877 shutdown 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f236ddb8740 1 -- 172.21.15.37:0/249065107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 msgr2=0x55b09dd85bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.903+0000 7f236ddb8740 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd85bc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f235000c940 tx=0x7f23500e78a0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 1 -- 172.21.15.37:0/249065107 shutdown_connections 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.66:6838/2855667585,v1:172.21.15.66:6839/2855667585] conn(0x55b09d9ce070 0x55b09ddff0a0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b09d9a51b0 0x55b09dd85bc0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55b09d9ad390 0x55b09dd862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2348ff9640 0 client.17877 ms_handle_reset on v2:172.21.15.66:6838/2855667585 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 1 --2- 172.21.15.37:0/249065107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b09d98c9f0 0x55b09dd876e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 1 -- 172.21.15.37:0/249065107 >> 172.21.15.37:0/249065107 conn(0x55b09d9c2460 msgr2=0x55b09dd74ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 1 -- 172.21.15.37:0/249065107 shutdown_connections 2024-08-31T06:56:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 1 -- 172.21.15.37:0/249065107 wait complete. 2024-08-31T06:56:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f236ddb8740 20 client.17877 trim_cache size 0 max 16384 2024-08-31T06:56:52.909 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-31T06:56:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 -- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f234c0b4ca0 msgr2=0x7f234c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f234c0b4ca0 0x7f234c0b71b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f235c006010 tx=0x7f235c009640 comp rx=0 tx=0).stop 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 -- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23601081c0 msgr2=0x7f2360111ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23601081c0 0x7f2360111ee0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f235000c970 tx=0x7f235000ce30 comp rx=0 tx=0).stop 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 -- 172.21.15.37:0/2552039761 shutdown_connections 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f234c0b4ca0 0x7f234c0b71b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23601081c0 0x7f2360111ee0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2360108b10 0x7f2360112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 --2- 172.21.15.37:0/2552039761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2360102880 0x7f23601119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 -- 172.21.15.37:0/2552039761 >> 172.21.15.37:0/2552039761 conn(0x7f2360079510 msgr2=0x7f23601063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.904+0000 7f2367843640 1 -- 172.21.15.37:0/2552039761 shutdown_connections 2024-08-31T06:56:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:52.905+0000 7f2367843640 1 -- 172.21.15.37:0/2552039761 wait complete. 2024-08-31T06:56:53.683 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_d19e6118f7015f0047264006cb0c873528eb3ae6/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-31T06:56:53.684 INFO:tasks.fwd_scrub:done joining 2024-08-31T06:56:53.684 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-31T06:56:53.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-31T06:56:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 -- 172.21.15.37:0/1106536786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4108210 msgr2=0x7f5cf410ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/1106536786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4108210 0x7f5cf410ea40 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009ca0 tx=0x7f5cec02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:56:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 -- 172.21.15.37:0/1106536786 shutdown_connections 2024-08-31T06:56:53.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/1106536786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4108210 0x7f5cf410ea40 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:53.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/1106536786 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf41078c0 0x7f5cf4107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:53.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/1106536786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cf4101f90 0x7f5cf41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:53.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 -- 172.21.15.37:0/1106536786 >> 172.21.15.37:0/1106536786 conn(0x7f5cf4079c10 msgr2=0x7f5cf407a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:53.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 -- 172.21.15.37:0/1106536786 shutdown_connections 2024-08-31T06:56:53.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.812+0000 7f5cf8d78640 1 -- 172.21.15.37:0/1106536786 wait complete. 2024-08-31T06:56:53.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf8d78640 1 Processor -- start 2024-08-31T06:56:53.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf8d78640 1 -- start start 2024-08-31T06:56:53.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf8d78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4101f90 0x7f5cf4198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:53.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf8d78640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf41078c0 0x7f5cf4199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:53.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf8d78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cf4108210 0x7f5cf419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf8d78640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4111d30 con 0x7f5cf4101f90 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf8d78640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4111bb0 con 0x7f5cf4108210 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf8d78640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf4111eb0 con 0x7f5cf41078c0 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4101f90 0x7f5cf4198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4101f90 0x7f5cf4198ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36342/0 (socket says 172.21.15.37:36342) 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf259c640 1 -- 172.21.15.37:0/799093067 learned_addr learned my addr 172.21.15.37:0/799093067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf2d9d640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cf4108210 0x7f5cf419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.813+0000 7f5cf1d9b640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf41078c0 0x7f5cf4199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5cf259c640 1 -- 172.21.15.37:0/799093067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf41078c0 msgr2=0x7f5cf4199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5cf259c640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf41078c0 0x7f5cf4199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5cf259c640 1 -- 172.21.15.37:0/799093067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cf4108210 msgr2=0x7f5cf419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5cf259c640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cf4108210 0x7f5cf419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5cf259c640 1 -- 172.21.15.37:0/799093067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf419ef20 con 0x7f5cf4101f90 2024-08-31T06:56:53.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5cf259c640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4101f90 0x7f5cf4198ff0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400d950 tx=0x7f5ce400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:53.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5ce37fe640 1 -- 172.21.15.37:0/799093067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4017070 con 0x7f5cf4101f90 2024-08-31T06:56:53.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5ce37fe640 1 -- 172.21.15.37:0/799093067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ce4009c30 con 0x7f5cf4101f90 2024-08-31T06:56:53.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf419f210 con 0x7f5cf4101f90 2024-08-31T06:56:53.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5ce37fe640 1 -- 172.21.15.37:0/799093067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400f620 con 0x7f5cf4101f90 2024-08-31T06:56:53.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.814+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf41a59a0 con 0x7f5cf4101f90 2024-08-31T06:56:53.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.815+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cf41023a0 con 0x7f5cf4101f90 2024-08-31T06:56:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.817+0000 7f5ce37fe640 1 -- 172.21.15.37:0/799093067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f5ce4010460 con 0x7f5cf4101f90 2024-08-31T06:56:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.817+0000 7f5ce37fe640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5cdc0b4ca0 0x7f5cdc0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.818+0000 7f5cf1d9b640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5cdc0b4ca0 0x7f5cdc0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.818+0000 7f5ce37fe640 1 -- 172.21.15.37:0/799093067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f5ce40e50d0 con 0x7f5cf4101f90 2024-08-31T06:56:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.818+0000 7f5cf1d9b640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5cdc0b4ca0 0x7f5cdc0b71b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5cf407a550 tx=0x7f5ce800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:53.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:53.821+0000 7f5ce37fe640 1 -- 172.21.15.37:0/799093067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5ce4009de0 con 0x7f5cf4101f90 2024-08-31T06:56:54.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.007+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cf41a5bd0 con 0x7f5cf4101f90 2024-08-31T06:56:54.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.008+0000 7f5ce37fe640 1 -- 172.21.15.37:0/799093067 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+23139 (secure 0 0 0) 0x7f5ce40b4410 con 0x7f5cf4101f90 2024-08-31T06:56:54.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:56:54.009 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:56:16.728196+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":83,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:56:54.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5cdc0b4ca0 msgr2=0x7f5cdc0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5cdc0b4ca0 0x7f5cdc0b71b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5cf407a550 tx=0x7f5ce800b410 comp rx=0 tx=0).stop 2024-08-31T06:56:54.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4101f90 msgr2=0x7f5cf4198ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4101f90 0x7f5cf4198ff0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400d950 tx=0x7f5ce400de10 comp rx=0 tx=0).stop 2024-08-31T06:56:54.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 shutdown_connections 2024-08-31T06:56:54.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5cdc0b4ca0 0x7f5cdc0b71b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cf4108210 0x7f5cf419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cf41078c0 0x7f5cf4199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 --2- 172.21.15.37:0/799093067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf4101f90 0x7f5cf4198ff0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 >> 172.21.15.37:0/799093067 conn(0x7f5cf4079c10 msgr2=0x7f5cf41056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:54.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 shutdown_connections 2024-08-31T06:56:54.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.010+0000 7f5cf8d78640 1 -- 172.21.15.37:0/799093067 wait complete. 2024-08-31T06:56:54.023 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-31T06:40:10.611808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-31T06:44:39.177728+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-31T06:44:41.318390+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 83, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-31T06:56:54.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-31T06:56:54.044 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:53 smithi037 ceph-mon[18612]: pgmap v629: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:56:54.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:53 smithi106 ceph-mon[22134]: pgmap v629: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:56:54.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:53 smithi066 ceph-mon[22244]: pgmap v629: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 -- 172.21.15.37:0/1977054845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc310104fe0 msgr2=0x7fc31010d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 --2- 172.21.15.37:0/1977054845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc310104fe0 0x7fc31010d620 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc304009900 tx=0x7fc30402a410 comp rx=0 tx=0).stop 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 -- 172.21.15.37:0/1977054845 shutdown_connections 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 --2- 172.21.15.37:0/1977054845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc310104fe0 0x7fc31010d620 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 --2- 172.21.15.37:0/1977054845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31010db60 0x7fc310110000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 --2- 172.21.15.37:0/1977054845 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3101045b0 0x7fc3101049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 -- 172.21.15.37:0/1977054845 >> 172.21.15.37:0/1977054845 conn(0x7fc3100793d0 msgr2=0x7fc3100797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 -- 172.21.15.37:0/1977054845 shutdown_connections 2024-08-31T06:56:54.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 -- 172.21.15.37:0/1977054845 wait complete. 2024-08-31T06:56:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 Processor -- start 2024-08-31T06:56:54.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.137+0000 7fc317750640 1 -- start start 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc317750640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3101045b0 0x7fc31019a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc317750640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc310104fe0 0x7fc31019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc317750640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31010db60 0x7fc31019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc317750640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3101135f0 con 0x7fc3101045b0 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc317750640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc310113470 con 0x7fc31010db60 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc317750640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc310113770 con 0x7fc310104fe0 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3101045b0 0x7fc31019a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3101045b0 0x7fc31019a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36356/0 (socket says 172.21.15.37:36356) 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 -- 172.21.15.37:0/1807790246 learned_addr learned my addr 172.21.15.37:0/1807790246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc315ced640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31010db60 0x7fc31019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc314ceb640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc310104fe0 0x7fc31019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 -- 172.21.15.37:0/1807790246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc310104fe0 msgr2=0x7fc31019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc310104fe0 0x7fc31019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 -- 172.21.15.37:0/1807790246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31010db60 msgr2=0x7fc31019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31010db60 0x7fc31019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 -- 172.21.15.37:0/1807790246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3101a0030 con 0x7fc3101045b0 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc314ceb640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc310104fe0 0x7fc31019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc315ced640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31010db60 0x7fc31019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.138+0000 7fc3154ec640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3101045b0 0x7fc31019a190 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fc30000cce0 tx=0x7fc30000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.139+0000 7fc30e7fc640 1 -- 172.21.15.37:0/1807790246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30000f650 con 0x7fc3101045b0 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.139+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3101a0320 con 0x7fc3101045b0 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.139+0000 7fc30e7fc640 1 -- 172.21.15.37:0/1807790246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc30000fc80 con 0x7fc3101045b0 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.139+0000 7fc30e7fc640 1 -- 172.21.15.37:0/1807790246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc300018ae0 con 0x7fc3101045b0 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.139+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3101a6b40 con 0x7fc3101045b0 2024-08-31T06:56:54.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.140+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3101049c0 con 0x7fc3101045b0 2024-08-31T06:56:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.141+0000 7fc30e7fc640 1 -- 172.21.15.37:0/1807790246 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fc300018c80 con 0x7fc3101045b0 2024-08-31T06:56:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.142+0000 7fc30e7fc640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc2f80b4ca0 0x7fc2f80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.142+0000 7fc314ceb640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc2f80b4ca0 0x7fc2f80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.142+0000 7fc30e7fc640 1 -- 172.21.15.37:0/1807790246 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fc3000e5d90 con 0x7fc3101045b0 2024-08-31T06:56:54.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.142+0000 7fc314ceb640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc2f80b4ca0 0x7fc2f80b71b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc304006010 tx=0x7fc304000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:54.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.145+0000 7fc30e7fc640 1 -- 172.21.15.37:0/1807790246 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc300014030 con 0x7fc3101045b0 2024-08-31T06:56:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.329+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc31002e430 con 0x7fc3101045b0 2024-08-31T06:56:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.330+0000 7fc30e7fc640 1 -- 172.21.15.37:0/1807790246 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fc3000acbc0 con 0x7fc3101045b0 2024-08-31T06:56:54.330 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-08-31T06:56:54.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.331+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc2f80b4ca0 msgr2=0x7fc2f80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.331+0000 7fc317750640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc2f80b4ca0 0x7fc2f80b71b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc304006010 tx=0x7fc304000bc0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.331+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3101045b0 msgr2=0x7fc31019a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.331+0000 7fc317750640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3101045b0 0x7fc31019a190 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fc30000cce0 tx=0x7fc30000a620 comp rx=0 tx=0).stop 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.332+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 shutdown_connections 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.332+0000 7fc317750640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc2f80b4ca0 0x7fc2f80b71b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.332+0000 7fc317750640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc31010db60 0x7fc31019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.332+0000 7fc317750640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc310104fe0 0x7fc31019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.332+0000 7fc317750640 1 --2- 172.21.15.37:0/1807790246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3101045b0 0x7fc31019a190 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.332+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 >> 172.21.15.37:0/1807790246 conn(0x7fc3100793d0 msgr2=0x7fc3101007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.332+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 shutdown_connections 2024-08-31T06:56:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.332+0000 7fc317750640 1 -- 172.21.15.37:0/1807790246 wait complete. 2024-08-31T06:56:54.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-31T06:56:54.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 -- 172.21.15.37:0/3318431937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 msgr2=0x7f69501084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 --2- 172.21.15.37:0/3318431937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 0x7f69501084b0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6944009900 tx=0x7f694402a410 comp rx=0 tx=0).stop 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 -- 172.21.15.37:0/3318431937 shutdown_connections 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 --2- 172.21.15.37:0/3318431937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 0x7f69501084b0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 --2- 172.21.15.37:0/3318431937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69501089f0 0x7f695010f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 --2- 172.21.15.37:0/3318431937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69501027c0 0x7f6950102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 -- 172.21.15.37:0/3318431937 >> 172.21.15.37:0/3318431937 conn(0x7f69500793d0 msgr2=0x7f69500797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 -- 172.21.15.37:0/3318431937 shutdown_connections 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.496+0000 7f695540e640 1 -- 172.21.15.37:0/3318431937 wait complete. 2024-08-31T06:56:54.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.497+0000 7f695540e640 1 Processor -- start 2024-08-31T06:56:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.497+0000 7f695540e640 1 -- start start 2024-08-31T06:56:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.497+0000 7f695540e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69501027c0 0x7f695019a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.497+0000 7f695540e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 0x7f695019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.497+0000 7f695540e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69501089f0 0x7f695019f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f695540e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6950112530 con 0x7f69501080a0 2024-08-31T06:56:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f695540e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f69501123b0 con 0x7f69501089f0 2024-08-31T06:56:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f695540e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f69501126b0 con 0x7f69501027c0 2024-08-31T06:56:54.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 0x7f695019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 0x7f695019a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35796/0 (socket says 172.21.15.37:35796) 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 -- 172.21.15.37:0/3066526257 learned_addr learned my addr 172.21.15.37:0/3066526257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694effd640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69501027c0 0x7f695019a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 -- 172.21.15.37:0/3066526257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69501027c0 msgr2=0x7f695019a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69501027c0 0x7f695019a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 -- 172.21.15.37:0/3066526257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69501089f0 msgr2=0x7f695019f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694f7fe640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69501089f0 0x7f695019f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69501089f0 0x7f695019f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 -- 172.21.15.37:0/3066526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69501a00d0 con 0x7f69501080a0 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f694e7fc640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 0x7f695019a740 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6944005940 tx=0x7f69440040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f6937fff640 1 -- 172.21.15.37:0/3066526257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694403f030 con 0x7f69501080a0 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f6937fff640 1 -- 172.21.15.37:0/3066526257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6944003a80 con 0x7f69501080a0 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69501a0360 con 0x7f69501080a0 2024-08-31T06:56:54.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f6937fff640 1 -- 172.21.15.37:0/3066526257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944035070 con 0x7f69501080a0 2024-08-31T06:56:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.498+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69501a6b50 con 0x7f69501080a0 2024-08-31T06:56:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.499+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69501039e0 con 0x7f69501080a0 2024-08-31T06:56:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.501+0000 7f6937fff640 1 -- 172.21.15.37:0/3066526257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f6944042030 con 0x7f69501080a0 2024-08-31T06:56:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.502+0000 7f6937fff640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69380b4ca0 0x7f69380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.502+0000 7f694effd640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69380b4ca0 0x7f69380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.502+0000 7f6937fff640 1 -- 172.21.15.37:0/3066526257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7f6944105ee0 con 0x7f69501080a0 2024-08-31T06:56:54.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.502+0000 7f694effd640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69380b4ca0 0x7f69380b71b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f694000bbe0 tx=0x7f694000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:54.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.505+0000 7f6937fff640 1 -- 172.21.15.37:0/3066526257 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f69440ccc80 con 0x7f69501080a0 2024-08-31T06:56:54.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.690+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f69501a6d20 con 0x7f69501080a0 2024-08-31T06:56:54.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.691+0000 7f6937fff640 1 -- 172.21.15.37:0/3066526257 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f69440d51c0 con 0x7f69501080a0 2024-08-31T06:56:54.692 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69380b4ca0 msgr2=0x7f69380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69380b4ca0 0x7f69380b71b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f694000bbe0 tx=0x7f694000b390 comp rx=0 tx=0).stop 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 msgr2=0x7f695019a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 0x7f695019a740 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6944005940 tx=0x7f69440040e0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 shutdown_connections 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f69380b4ca0 0x7f69380b71b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69501080a0 0x7f695019a740 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69501089f0 0x7f695019f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 --2- 172.21.15.37:0/3066526257 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69501027c0 0x7f695019a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 >> 172.21.15.37:0/3066526257 conn(0x7f69500793d0 msgr2=0x7f6950101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:54.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 shutdown_connections 2024-08-31T06:56:54.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.693+0000 7f695540e640 1 -- 172.21.15.37:0/3066526257 wait complete. 2024-08-31T06:56:54.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 -- 172.21.15.37:0/387802766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c104680 msgr2=0x7fb44c104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 --2- 172.21.15.37:0/387802766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c104680 0x7fb44c104a90 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009900 tx=0x7fb43c02a410 comp rx=0 tx=0).stop 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 -- 172.21.15.37:0/387802766 shutdown_connections 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 --2- 172.21.15.37:0/387802766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb44c10dae0 0x7fb44c10ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 --2- 172.21.15.37:0/387802766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb44c104fd0 0x7fb44c10d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 --2- 172.21.15.37:0/387802766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c104680 0x7fb44c104a90 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 -- 172.21.15.37:0/387802766 >> 172.21.15.37:0/387802766 conn(0x7fb44c0fe150 msgr2=0x7fb44c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 -- 172.21.15.37:0/387802766 shutdown_connections 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 -- 172.21.15.37:0/387802766 wait complete. 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.819+0000 7fb451d80640 1 Processor -- start 2024-08-31T06:56:54.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb451d80640 1 -- start start 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb451d80640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb44c104680 0x7fb44c19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb451d80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb44c104fd0 0x7fb44c19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb451d80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c10dae0 0x7fb44c19fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb451d80640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c1136d0 con 0x7fb44c10dae0 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb451d80640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c113550 con 0x7fb44c104fd0 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb451d80640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c113850 con 0x7fb44c104680 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c10dae0 0x7fb44c19fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c10dae0 0x7fb44c19fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35824/0 (socket says 172.21.15.37:35824) 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44bfff640 1 -- 172.21.15.37:0/3473501643 learned_addr learned my addr 172.21.15.37:0/3473501643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44b7fe640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb44c104680 0x7fb44c19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44affd640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb44c104fd0 0x7fb44c19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44bfff640 1 -- 172.21.15.37:0/3473501643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb44c104680 msgr2=0x7fb44c19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44bfff640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb44c104680 0x7fb44c19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44bfff640 1 -- 172.21.15.37:0/3473501643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb44c104fd0 msgr2=0x7fb44c19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.820+0000 7fb44bfff640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb44c104fd0 0x7fb44c19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb44bfff640 1 -- 172.21.15.37:0/3473501643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c1a0120 con 0x7fb44c10dae0 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb44affd640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb44c104fd0 0x7fb44c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb44b7fe640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb44c104680 0x7fb44c19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb44bfff640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c10dae0 0x7fb44c19fa20 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b970 tx=0x7fb44400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb448ff9640 1 -- 172.21.15.37:0/3473501643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444019070 con 0x7fb44c10dae0 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44c1a0410 con 0x7fb44c10dae0 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb448ff9640 1 -- 172.21.15.37:0/3473501643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb444014440 con 0x7fb44c10dae0 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb448ff9640 1 -- 172.21.15.37:0/3473501643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440075d0 con 0x7fb44c10dae0 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.821+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44c1a6ba0 con 0x7fb44c10dae0 2024-08-31T06:56:54.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.822+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb44c104b10 con 0x7fb44c10dae0 2024-08-31T06:56:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.824+0000 7fb448ff9640 1 -- 172.21.15.37:0/3473501643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fb44401c070 con 0x7fb44c10dae0 2024-08-31T06:56:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.824+0000 7fb448ff9640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb4340b4ca0 0x7fb4340b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.824+0000 7fb44b7fe640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb4340b4ca0 0x7fb4340b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.824+0000 7fb448ff9640 1 -- 172.21.15.37:0/3473501643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fb4440e4f20 con 0x7fb44c10dae0 2024-08-31T06:56:54.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.825+0000 7fb44b7fe640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb4340b4ca0 0x7fb4340b71b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb43c000c00 tx=0x7fb43c005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:54.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:54.828+0000 7fb448ff9640 1 -- 172.21.15.37:0/3473501643 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fb4440abd20 con 0x7fb44c10dae0 2024-08-31T06:56:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.015+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb44c19b310 con 0x7fb44c10dae0 2024-08-31T06:56:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.015+0000 7fb448ff9640 1 -- 172.21.15.37:0/3473501643 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7fb4440b4260 con 0x7fb44c10dae0 2024-08-31T06:56:55.016 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.017+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb4340b4ca0 msgr2=0x7fb4340b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.017+0000 7fb451d80640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb4340b4ca0 0x7fb4340b71b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb43c000c00 tx=0x7fb43c005a20 comp rx=0 tx=0).stop 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.017+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c10dae0 msgr2=0x7fb44c19fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.017+0000 7fb451d80640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c10dae0 0x7fb44c19fa20 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b970 tx=0x7fb44400be30 comp rx=0 tx=0).stop 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.017+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 shutdown_connections 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.018+0000 7fb451d80640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fb4340b4ca0 0x7fb4340b71b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.018+0000 7fb451d80640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c10dae0 0x7fb44c19fa20 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.018+0000 7fb451d80640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb44c104fd0 0x7fb44c19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.018+0000 7fb451d80640 1 --2- 172.21.15.37:0/3473501643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb44c104680 0x7fb44c19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.018+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 >> 172.21.15.37:0/3473501643 conn(0x7fb44c0fe150 msgr2=0x7fb44c0fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.018+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 shutdown_connections 2024-08-31T06:56:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.018+0000 7fb451d80640 1 -- 172.21.15.37:0/3473501643 wait complete. 2024-08-31T06:56:55.029 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:54 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/799093067' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:56:55.029 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:54 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/1807790246' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:56:55.029 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:54 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3066526257' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:56:55.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-31T06:56:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:54 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/799093067' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:56:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:54 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/1807790246' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:56:55.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:54 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3066526257' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:56:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:54 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/799093067' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:56:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:54 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/1807790246' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-31T06:56:55.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:54 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3066526257' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 -- 172.21.15.37:0/3562086533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 msgr2=0x7fda5010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 --2- 172.21.15.37:0/3562086533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 0x7fda5010d5a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fda44009900 tx=0x7fda4402a410 comp rx=0 tx=0).stop 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 -- 172.21.15.37:0/3562086533 shutdown_connections 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 --2- 172.21.15.37:0/3562086533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 0x7fda5010d5a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 --2- 172.21.15.37:0/3562086533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda5010db30 0x7fda50110010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 --2- 172.21.15.37:0/3562086533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda50104710 0x7fda50104b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 -- 172.21.15.37:0/3562086533 >> 172.21.15.37:0/3562086533 conn(0x7fda500fe160 msgr2=0x7fda501005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 -- 172.21.15.37:0/3562086533 shutdown_connections 2024-08-31T06:56:55.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 -- 172.21.15.37:0/3562086533 wait complete. 2024-08-31T06:56:55.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 Processor -- start 2024-08-31T06:56:55.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.140+0000 7fda56321640 1 -- start start 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda56321640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda50104710 0x7fda5019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda56321640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 0x7fda5019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda56321640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5010db30 0x7fda5019f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda56321640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda50113620 con 0x7fda50105060 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda56321640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fda501134a0 con 0x7fda5010db30 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda56321640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fda501137a0 con 0x7fda50104710 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 0x7fda5019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 0x7fda5019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35836/0 (socket says 172.21.15.37:35836) 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 -- 172.21.15.37:0/782475836 learned_addr learned my addr 172.21.15.37:0/782475836 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda548be640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5010db30 0x7fda5019f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 -- 172.21.15.37:0/782475836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda50104710 msgr2=0x7fda5019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:55.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4ffff640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda50104710 0x7fda5019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda50104710 0x7fda5019a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 -- 172.21.15.37:0/782475836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5010db30 msgr2=0x7fda5019f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5010db30 0x7fda5019f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 -- 172.21.15.37:0/782475836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda501a0030 con 0x7fda50105060 2024-08-31T06:56:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda548be640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5010db30 0x7fda5019f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-31T06:56:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4f7fe640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 0x7fda5019a6a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fda44005940 tx=0x7fda44005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.141+0000 7fda4d7fa640 1 -- 172.21.15.37:0/782475836 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4403f030 con 0x7fda50105060 2024-08-31T06:56:55.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.142+0000 7fda4d7fa640 1 -- 172.21.15.37:0/782475836 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda440043d0 con 0x7fda50105060 2024-08-31T06:56:55.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.142+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda501a02c0 con 0x7fda50105060 2024-08-31T06:56:55.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.142+0000 7fda4d7fa640 1 -- 172.21.15.37:0/782475836 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44035070 con 0x7fda50105060 2024-08-31T06:56:55.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.142+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda501a6ab0 con 0x7fda50105060 2024-08-31T06:56:55.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.143+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5006bd50 con 0x7fda50105060 2024-08-31T06:56:55.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.144+0000 7fda4d7fa640 1 -- 172.21.15.37:0/782475836 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fda44042030 con 0x7fda50105060 2024-08-31T06:56:55.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.145+0000 7fda4d7fa640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fda380b4ca0 0x7fda380b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:56:55.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.145+0000 7fda4ffff640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fda380b4ca0 0x7fda380b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:56:55.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.145+0000 7fda4d7fa640 1 -- 172.21.15.37:0/782475836 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8499+0+0 (secure 0 0 0) 0x7fda44105ce0 con 0x7fda50105060 2024-08-31T06:56:55.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.146+0000 7fda4ffff640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fda380b4ca0 0x7fda380b71b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fda40009aa0 tx=0x7fda40005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:56:55.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.148+0000 7fda4d7fa640 1 -- 172.21.15.37:0/782475836 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fda440ccae0 con 0x7fda50105060 2024-08-31T06:56:55.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.382+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fda5019b220 con 0x7fda50105060 2024-08-31T06:56:55.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.390+0000 7fda4d7fa640 1 -- 172.21.15.37:0/782475836 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+826324 (secure 0 0 0) 0x7fda440cc3e0 con 0x7fda50105060 2024-08-31T06:56:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:56:55.402 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:56:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 26, 2024-08-31T06:56:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "active_gid": 14223, 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "active_name": "x", 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addrs": { 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6800", 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1776458941 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6801", 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1776458941 2024-08-31T06:56:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addr": "172.21.15.37:6801/1776458941", 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "active_change": "2024-08-31T06:38:18.150303+0000", 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "active_mgr_features": 4540701547738038271, 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "standbys": [ 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24145, 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "z", 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-08-31T06:56:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-08-31T06:56:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T06:56:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-08-31T06:56:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-08-31T06:56:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-08-31T06:56:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-08-31T06:56:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-08-31T06:56:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-08-31T06:56:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-08-31T06:56:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-08-31T06:56:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T06:56:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T06:56:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T06:56:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T06:56:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T06:56:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T06:56:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T06:56:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T06:56:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T06:56:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-08-31T06:56:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-08-31T06:56:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T06:56:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-08-31T06:56:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-08-31T06:56:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-08-31T06:56:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-08-31T06:56:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-08-31T06:56:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-08-31T06:56:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-08-31T06:56:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T06:56:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T06:56:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T06:56:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T06:56:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T06:56:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T06:56:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T06:56:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T06:56:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T06:56:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T06:56:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T06:56:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T06:56:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T06:56:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T06:56:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T06:56:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-31T06:56:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-08-31T06:56:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-08-31T06:56:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-08-31T06:56:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.593 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.594 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.596 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-08-31T06:56:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-08-31T06:56:55.599 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-08-31T06:56:55.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-31T06:56:55.601 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:55.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-08-31T06:56:55.605 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.606 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.607 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.610 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.611 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-31T06:56:55.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.615 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-08-31T06:56:55.616 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.618 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T06:56:55.620 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.621 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.624 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.626 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-08-31T06:56:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-08-31T06:56:55.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-08-31T06:56:55.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.629 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.630 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.631 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.632 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.635 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.638 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.640 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.641 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.643 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.644 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.645 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.651 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.653 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.654 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.655 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.656 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.659 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.660 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.661 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.665 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.668 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.670 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.672 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.676 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.677 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.686 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.688 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.689 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.691 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.692 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.695 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-08-31T06:56:55.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.701 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.702 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.703 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.704 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.705 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.707 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-08-31T06:56:55.718 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.719 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.722 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.725 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.726 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:55.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.735 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.736 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.739 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.741 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.745 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.747 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.748 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.750 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-08-31T06:56:55.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T06:56:55.753 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.754 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.756 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.757 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.759 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.761 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.763 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.765 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.768 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.770 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.771 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.774 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.776 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.780 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.781 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-08-31T06:56:55.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.783 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.784 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.785 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-08-31T06:56:55.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-08-31T06:56:55.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.793 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.799 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.802 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.803 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.806 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.810 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.811 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.813 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.816 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.818 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.822 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.825 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.828 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.834 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T06:56:55.844 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.847 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.848 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.853 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.854 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.855 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.857 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.864 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.865 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.866 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.869 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.871 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.872 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-08-31T06:56:55.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-08-31T06:56:55.874 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.875 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.877 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.878 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.879 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.880 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.881 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.882 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.883 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.886 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.887 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.888 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.889 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.890 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24158, 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "y", 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-08-31T06:56:55.891 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T06:56:55.892 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.893 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.894 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.895 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.898 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.899 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.900 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.901 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-08-31T06:56:55.902 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.905 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.907 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.908 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-31T06:56:55.909 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.910 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-08-31T06:56:55.912 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.913 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.915 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.916 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.918 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.919 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.920 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-31T06:56:55.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.922 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.923 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.924 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.925 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.926 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.927 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-08-31T06:56:55.928 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.929 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:55.933 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.934 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-08-31T06:56:55.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-08-31T06:56:55.936 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-08-31T06:56:55.937 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.939 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T06:56:55.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.942 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.943 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T06:56:55.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T06:56:55.946 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T06:56:55.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.948 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.949 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.950 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.951 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.952 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.953 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T06:56:55.955 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.956 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.957 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.958 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-08-31T06:56:55.959 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.960 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.961 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.962 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T06:56:55.963 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:55.964 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.965 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.966 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.967 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.968 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.970 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.971 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.972 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T06:56:55.973 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T06:56:55.974 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.976 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.977 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.979 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.980 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.981 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.982 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.983 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.984 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.985 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.986 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.987 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.988 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.989 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.990 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.991 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.992 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.993 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.994 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.995 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:55.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.997 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:55.998 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:55.999 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T06:56:56.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T06:56:56.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T06:56:56.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T06:56:56.006 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T06:56:56.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T06:56:56.008 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T06:56:56.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T06:56:56.010 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T06:56:56.011 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.012 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.013 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.015 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.016 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.019 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.022 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.023 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.024 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.025 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.027 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.028 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.029 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.030 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.032 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.033 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.034 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.036 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.037 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.038 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.040 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.042 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.043 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.044 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.046 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.047 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.052 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-08-31T06:56:56.054 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.056 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.057 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.058 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.059 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.060 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.061 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.062 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.063 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.064 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-31T06:56:56.066 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.067 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-31T06:56:56.068 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.069 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-08-31T06:56:56.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-08-31T06:56:56.072 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.073 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.075 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.076 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.077 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-08-31T06:56:56.078 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-08-31T06:56:56.079 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.080 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.081 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.082 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.085 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-08-31T06:56:56.086 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.087 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.088 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.089 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.090 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.091 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.092 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-08-31T06:56:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.098 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.100 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.101 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.104 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-08-31T06:56:56.106 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.107 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.108 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.109 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-08-31T06:56:56.110 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.111 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.112 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.114 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.115 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.116 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.117 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.119 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.120 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.123 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.124 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-08-31T06:56:56.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.131 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.133 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.134 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.135 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.136 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.139 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-08-31T06:56:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-08-31T06:56:56.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.144 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.150 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.153 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.154 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.156 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.157 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.159 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.160 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.162 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.164 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.167 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-08-31T06:56:56.172 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.177 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.178 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.180 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.181 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.183 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.185 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.186 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.187 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.188 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.190 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.192 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.195 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.197 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.198 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.200 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.201 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.202 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.203 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.206 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.209 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.210 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.212 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.216 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.222 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.225 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.227 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.230 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.234 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.236 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.237 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.238 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.247 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.250 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.251 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.252 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.253 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.254 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.255 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T06:56:56.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.261 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.262 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-08-31T06:56:56.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-08-31T06:56:56.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-08-31T06:56:56.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-08-31T06:56:56.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-08-31T06:56:56.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.269 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.270 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.272 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.276 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.277 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.278 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.282 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.284 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-08-31T06:56:56.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.286 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.287 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.288 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.289 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.290 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.292 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.293 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.295 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.296 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.297 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.298 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.299 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.300 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.306 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.308 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.311 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-08-31T06:56:56.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-08-31T06:56:56.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-08-31T06:56:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-08-31T06:56:56.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.323 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.325 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.326 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.327 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.330 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.331 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.333 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.335 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.336 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.337 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.340 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.342 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.343 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.344 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.345 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.346 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.347 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.348 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.351 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.356 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:56.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-08-31T06:56:56.358 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.363 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.366 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-08-31T06:56:56.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.368 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.369 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard", 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "restful", 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "snap_schedule" 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-08-31T06:56:56.370 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-08-31T06:56:56.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.372 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.374 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.375 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.376 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.377 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-08-31T06:56:56.381 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.384 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.385 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.387 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-31T06:56:56.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-08-31T06:56:56.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-08-31T06:56:56.391 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-08-31T06:56:56.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.393 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-31T06:56:56.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.396 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.398 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.400 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-08-31T06:56:56.402 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.403 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:56.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-08-31T06:56:56.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.409 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-08-31T06:56:56.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-08-31T06:56:56.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.414 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-31T06:56:56.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.418 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-08-31T06:56:56.420 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-08-31T06:56:56.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:56.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-08-31T06:56:56.423 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.429 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-08-31T06:56:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_oauth2_proxy": { 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_oauth2_proxy", 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-08-31T06:56:56.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "oauth2-proxy container image", 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-31T06:56:56.433 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-31T06:56:56.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-08-31T06:56:56.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-08-31T06:56:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-08-31T06:56:56.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-08-31T06:56:56.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.453 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-08-31T06:56:56.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-31T06:56:56.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.469 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.477 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.480 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-08-31T06:56:56.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.485 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.496 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.498 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-31T06:56:56.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-31T06:56:56.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-31T06:56:56.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.523 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-31T06:56:56.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-31T06:56:56.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.527 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-31T06:56:56.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.533 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.537 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.539 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.543 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.547 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.548 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.549 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.550 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.553 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.554 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.556 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-08-31T06:56:56.558 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-08-31T06:56:56.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-08-31T06:56:56.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-08-31T06:56:56.562 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-08-31T06:56:56.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.567 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-08-31T06:56:56.576 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.578 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.581 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.587 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:56:56.589 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-31T06:56:56.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-08-31T06:56:56.591 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-31T06:56:56.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.594 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.596 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.598 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.602 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.606 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.608 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.610 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.614 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.617 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-08-31T06:56:56.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-08-31T06:56:56.621 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-08-31T06:56:56.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-08-31T06:56:56.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.625 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.627 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.629 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.630 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-08-31T06:56:56.632 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.633 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.635 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.638 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.639 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.642 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.643 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.645 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.649 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.650 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.651 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.654 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.655 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.657 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.659 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.662 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.663 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.665 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.668 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.671 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.672 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-08-31T06:56:56.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-31T06:56:56.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.682 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.687 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-08-31T06:56:56.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.690 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-31T06:56:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-08-31T06:56:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-31T06:56:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max_requests": { 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_requests", 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-31T06:56:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-08-31T06:56:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.747 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.751 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.753 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.754 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-08-31T06:56:56.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.761 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.763 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-08-31T06:56:56.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-08-31T06:56:56.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.768 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.770 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.773 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.774 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.775 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.776 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.777 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.780 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.781 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.783 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.784 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-31T06:56:56.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-08-31T06:56:56.787 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.788 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.789 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.790 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.797 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.800 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.802 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.807 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.813 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.814 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.815 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.818 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.819 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.820 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.821 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.822 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.823 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.826 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.832 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-08-31T06:56:56.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.835 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.836 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.837 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.841 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-31T06:56:56.844 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard": "https://172.21.15.37:8443/" 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "always_on_modules": { 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "octopus": [ 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-31T06:56:56.845 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "pacific": [ 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-31T06:56:56.846 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "quincy": [ 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-31T06:56:56.847 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "reef": [ 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-31T06:56:56.848 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "squid": [ 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.849 INFO:teuthology.orchestra.run.smithi037.stdout: "last_failure_osd_epoch": 5, 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "active_clients": [ 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3202629126 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "libcephsqlite", 2024-08-31T06:56:56.850 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1779625477 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2626518105 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.851 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1181238450 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-31T06:56:56.852 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3495670495 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1522306917 2024-08-31T06:56:56.853 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:56.854 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-31T06:56:56.854 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:56:56.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fda380b4ca0 msgr2=0x7fda380b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:56.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fda380b4ca0 0x7fda380b71b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fda40009aa0 tx=0x7fda40005f90 comp rx=0 tx=0).stop 2024-08-31T06:56:56.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 msgr2=0x7fda5019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 0x7fda5019a6a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fda44005940 tx=0x7fda44005e10 comp rx=0 tx=0).stop 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 shutdown_connections 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fda380b4ca0 0x7fda380b71b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda50105060 0x7fda5019a6a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5010db30 0x7fda5019f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 --2- 172.21.15.37:0/782475836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda50104710 0x7fda5019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.396+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 >> 172.21.15.37:0/782475836 conn(0x7fda500fe160 msgr2=0x7fda500fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.397+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 shutdown_connections 2024-08-31T06:56:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:56:55.397+0000 7fda56321640 1 -- 172.21.15.37:0/782475836 wait complete. 2024-08-31T06:56:56.863 DEBUG:tasks.check_counter:Getting stats from a 2024-08-31T06:56:56.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-31T06:56:56.864 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:55 smithi037 ceph-mon[18612]: pgmap v630: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T06:56:56.864 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:55 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3473501643' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:56:56.864 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:55 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/782475836' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T06:56:56.865 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:55 smithi066 ceph-mon[22244]: pgmap v630: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T06:56:56.865 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:55 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3473501643' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:56:56.865 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:55 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/782475836' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T06:56:56.865 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:55 smithi106 ceph-mon[22134]: pgmap v630: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-08-31T06:56:56.865 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:55 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3473501643' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-31T06:56:56.865 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:55 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/782475836' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-31T06:56:57.128 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:57.659 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:56:57.659 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:56:57.659 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.001160111, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000184764, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:57.660 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 212, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 203, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1132752, 2024-08-31T06:56:57.661 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 123872, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.043297363, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.018924571, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.034004407, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 203, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.015126492, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000074514 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.662 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 1132752, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 123872 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 153, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 106864, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-08-31T06:56:57.663 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.014884919, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.012076226, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001289729, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 151, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.007627406, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000050512 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:57.664 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 106864 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:56:57.665 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:56:57.666 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-08-31T06:56:57.667 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148967, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 29, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:56:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:57.669 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 209, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 1100384, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 209, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 209, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1100384, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:57.670 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:57.671 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:57.671 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:57.671 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:57.671 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:56:58.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:57 smithi106 ceph-mon[22134]: pgmap v631: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:56:58.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:57 smithi037 ceph-mon[18612]: pgmap v631: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:56:58.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:57 smithi066 ceph-mon[22244]: pgmap v631: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-31T06:56:58.565 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-08-31T06:56:58.565 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-08-31T06:56:58.565 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-08-31T06:56:58.565 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-08-31T06:56:58.566 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-08-31T06:56:58.566 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-08-31T06:56:58.566 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-08-31T06:56:58.566 DEBUG:tasks.check_counter:Getting stats from d 2024-08-31T06:56:58.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-31T06:56:58.823 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:56:59.327 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:56:59.327 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 219, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 210, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1134720, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 127872, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.043606766, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.018163243, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.034880772, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:56:59.328 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 210, 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.014486049, 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000068981 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 1134720, 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 127872 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.329 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 157, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 107568, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.015322651, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.012179250, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001249229, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 155, 2024-08-31T06:56:59.330 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.007861311, 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000050718 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 107568 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:56:59.331 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.000243727, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000177764, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:56:59.334 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:56:59.335 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148967, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 29, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:56:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-08-31T06:56:59.337 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 216, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 1101358, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 216, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 216, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1101358, 2024-08-31T06:56:59.338 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-31T06:56:59.339 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:56:59.339 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:56:59.339 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:56:59.339 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:59.339 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:56:59.339 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:56:59.952 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:56:59 smithi037 ceph-mon[18612]: pgmap v632: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:56:59.982 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-31T06:56:59.982 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-31T06:56:59.983 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-08-31T06:56:59.983 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-08-31T06:56:59.983 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-08-31T06:56:59.983 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-08-31T06:56:59.983 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-08-31T06:56:59.983 DEBUG:tasks.check_counter:Getting stats from g 2024-08-31T06:56:59.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-31T06:57:00.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:56:59 smithi106 ceph-mon[22134]: pgmap v632: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:57:00.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:56:59 smithi066 ceph-mon[22244]: pgmap v632: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-31T06:57:00.234 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-08-31T06:57:00.747 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.001133794, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000194562, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:00.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 154, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 107040, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.014599210, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.011634005, 2024-08-31T06:57:00.749 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001559777, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 152, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.006848033, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000045052 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 107040 2024-08-31T06:57:00.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 214, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 205, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1133296, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 125136, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.040716792, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.017373576, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.032500931, 2024-08-31T06:57:00.751 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 205, 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.013927184, 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000067937 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 1133296, 2024-08-31T06:57:00.752 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 125136 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:00.753 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:00.754 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:00.755 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148967, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 29, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:00.756 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-08-31T06:57:00.757 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 211, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 1100644, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 211, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 211, 2024-08-31T06:57:00.758 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1100644, 2024-08-31T06:57:00.759 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-31T06:57:00.759 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:00.759 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:00.759 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:00.759 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:57:00.759 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:57:00.759 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:57:01.547 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-08-31T06:57:01.548 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-08-31T06:57:01.548 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-08-31T06:57:01.548 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-08-31T06:57:01.548 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-08-31T06:57:01.548 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-08-31T06:57:01.548 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-08-31T06:57:01.548 DEBUG:tasks.check_counter:Getting stats from j 2024-08-31T06:57:01.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-31T06:57:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:01 smithi106 ceph-mon[22134]: pgmap v633: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:57:02.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:01 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:57:02.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:01 smithi037 ceph-mon[18612]: pgmap v633: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:57:02.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:01 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:57:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:01 smithi066 ceph-mon[22244]: pgmap v633: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-31T06:57:02.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:01 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-31T06:57:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-31T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 220, 2024-08-31T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 211, 2024-08-31T06:57:02.950 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1134992, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 128512, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.046599188, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.019833250, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.036167435, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 211, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.014834959, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000070307 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.951 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 1134992, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 128512 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 159, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 160, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 107920, 2024-08-31T06:57:02.952 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 3, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.015094714, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.012243210, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.001351344, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 157, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.007301555, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000046506 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:02.953 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 107920 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.000476747, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T06:57:02.954 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000408578, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:57:02.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:02.956 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:02.957 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:02.958 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148984, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 30, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-08-31T06:57:02.959 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-31T06:57:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 217, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 1101488, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 217, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 217, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1101488, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-31T06:57:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-31T06:57:02.962 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:57:02.962 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-31T06:57:02.962 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-31T06:57:03.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:03 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:03 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:03 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:03 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.605 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:03 smithi037 ceph-mon[18612]: pgmap v634: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:57:03.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:03 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:03 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:03 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:03 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:03 smithi066 ceph-mon[22244]: pgmap v634: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:57:03.721 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-31T06:57:03.721 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-31T06:57:03.721 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-08-31T06:57:03.721 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-08-31T06:57:03.721 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-08-31T06:57:03.721 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-08-31T06:57:03.721 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-08-31T06:57:03.721 DEBUG:tasks.check_counter:Getting stats from b 2024-08-31T06:57:03.721 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-31T06:57:03.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:03 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:03 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:03 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:03 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:03.816 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:03 smithi106 ceph-mon[22134]: pgmap v634: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-08-31T06:57:03.994 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1439, 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1341, 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 599467, 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 3454262, 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 150, 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.218715839, 2024-08-31T06:57:04.745 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.072603446, 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.114350992, 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.023079938, 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1339, 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.579525529, 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000432804 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1307, 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000333837, 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000255 2024-08-31T06:57:04.746 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 36464, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 2336 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 2229, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1010, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1949422, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 590945, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 18, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 7, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.313513065, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.083855276, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.145542672, 2024-08-31T06:57:04.747 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.099221572, 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1010, 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 1.281224236, 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001268538 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2049, 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000511646, 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000249 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 1562688, 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 282128 2024-08-31T06:57:04.748 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 900, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 1019, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 305412, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 1002787, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 35, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 6, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.131913049, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.055312665, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.067547527, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.015947700, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1017, 2024-08-31T06:57:04.749 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.567196180, 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000557715 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1112, 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000303989, 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000273 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 363536 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-08-31T06:57:04.750 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 738, 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.231213508, 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000313297 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-08-31T06:57:04.751 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 83, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.002907156, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000035025 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 173, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 173, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 173, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 16.970834511, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.098097309 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-08-31T06:57:04.752 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 67, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 36, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 5, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 31, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 28, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 3, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 3, 2024-08-31T06:57:04.753 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 2, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 323, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 311, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-08-31T06:57:04.754 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 206, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 4, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 234, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 6, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 206, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 130, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 18, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 112, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 76, 2024-08-31T06:57:04.755 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 34, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 36, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 115, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 78, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 2, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 34 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 11, 2024-08-31T06:57:04.756 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 24, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 2, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 6, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 4, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:57:04.757 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 2, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 24, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 18, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.758 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 251, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 166, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 166, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 85, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 22, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 14, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 13, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 13, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 1, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 1, 2024-08-31T06:57:04.759 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 1, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 5242236, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 5435024, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 0, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 207, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 7.570578321, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.036572842 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 0 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 29, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 51, 2024-08-31T06:57:04.760 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 22, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 20, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 20, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 0, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 36, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 40, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 4, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 3, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 21, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 18, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 124160, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 338444288 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.761 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 234, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 1, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 173, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 29, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 2, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 8, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.007115521, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000889440 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 109, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.021202394, 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000194517 2024-08-31T06:57:04.762 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.006536560, 2024-08-31T06:57:04.763 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.002178853 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.764 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.765 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.766 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-08-31T06:57:04.766 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 11, 2024-08-31T06:57:04.766 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.001811487, 2024-08-31T06:57:04.766 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000164680 2024-08-31T06:57:04.766 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.766 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-08-31T06:57:04.766 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 8, 2024-08-31T06:57:04.766 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 16.799585341, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 2.099948167 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 11, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.061776569, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.005616051 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.767 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1, 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000750307, 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000750307 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2, 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.002172490, 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001086245 2024-08-31T06:57:04.768 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.016520609, 2024-08-31T06:57:04.769 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.008260304 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 5, 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.024151285, 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.004830257 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-08-31T06:57:04.770 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.001093976, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001093976 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.771 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 8, 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.023479108, 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.002934888 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.772 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 4, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.004638864, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001159716 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.773 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 2, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 4, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 2, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 2, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 27, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 13, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 617, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:04.774 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:04.775 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:04.776 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 334830, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 110, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:04.777 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 8160, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 180, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 134172, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 1070, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-08-31T06:57:04.778 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 1234, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 1372169, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 36, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 1234, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1234, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 87.499264389, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.070907021 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.779 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1234, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 1423 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 1234, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 243, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 991, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 47, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 28, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 19, 2024-08-31T06:57:04.780 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 208, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 63, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 579, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 224, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 56, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:57:04.781 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-08-31T06:57:04.782 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 84, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 10, 2024-08-31T06:57:04.783 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 12, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 12, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 183, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 0, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 16 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 1, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.784 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 66, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 3, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 67, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 4, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 4564, 2024-08-31T06:57:04.785 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 2382049, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 4564, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 4564, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2382049, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-08-31T06:57:04.786 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 1234, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 1372605, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 1234, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1372605, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.787 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 1234, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 1234, 2024-08-31T06:57:04.788 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 1234, 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1234, 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:04.789 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 4, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 436, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 4, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 1, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 436, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x56274419a680": { 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 60, 2024-08-31T06:57:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 251, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1240720, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 251, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 207, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1240660, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:04.791 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:04.792 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.792 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:04.792 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-08-31T06:57:04.792 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 31 2024-08-31T06:57:04.792 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:04.792 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-08-31T06:57:05.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:57:05.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:57:05.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:04 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:57:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:57:05.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:04 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-31T06:57:05.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-31T06:57:05.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:04 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' 2024-08-31T06:57:05.725 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-08-31T06:57:05.725 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-08-31T06:57:05.725 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=11 2024-08-31T06:57:05.726 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-08-31T06:57:05.726 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-08-31T06:57:05.726 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-08-31T06:57:05.726 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-08-31T06:57:05.726 DEBUG:tasks.check_counter:Getting stats from e 2024-08-31T06:57:05.726 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-31T06:57:05.985 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:57:06.255 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:06 smithi066 ceph-mon[22244]: pgmap v635: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:57:06.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:06 smithi106 ceph-mon[22134]: pgmap v635: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:57:06.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:05 smithi037 ceph-mon[18612]: pgmap v635: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-08-31T06:57:06.484 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-08-31T06:57:06.484 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:06.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 743, 2024-08-31T06:57:06.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 745, 2024-08-31T06:57:06.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 197729, 2024-08-31T06:57:06.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 236338, 2024-08-31T06:57:06.484 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 6, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.090858465, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.044826179, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.018016356, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.019403863, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 743, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.033132600, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000044593 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.485 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 650, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 807, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 159836, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 566019, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 5, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 4, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.090602095, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.041607816, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.016242327, 2024-08-31T06:57:06.486 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.024517393, 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 805, 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.033275580, 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000041336 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 359632 2024-08-31T06:57:06.487 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 970, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 959, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1409616, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 364198, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 3, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.166732675, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.068993124, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.068828041, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.032489182, 2024-08-31T06:57:06.488 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 959, 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.064886241, 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000067660 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 1163328, 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 131104 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.489 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3493, 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.119134858, 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000034106 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.490 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 0, 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 0, 2024-08-31T06:57:06.491 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 0, 2024-08-31T06:57:06.492 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 1, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 0, 2024-08-31T06:57:06.493 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-08-31T06:57:06.494 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:57:06.495 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 0 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 0, 2024-08-31T06:57:06.496 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-08-31T06:57:06.497 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-08-31T06:57:06.498 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 8, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-08-31T06:57:06.499 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 4196840, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 4196699, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 8 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 3, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 3, 2024-08-31T06:57:06.500 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 1, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 1, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 116708, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 316424192 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 0, 2024-08-31T06:57:06.501 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 0, 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 0, 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.502 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-08-31T06:57:06.503 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-08-31T06:57:06.504 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.505 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.506 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.507 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.508 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.509 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.510 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-08-31T06:57:06.511 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.512 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 2, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 4, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 2, 2024-08-31T06:57:06.513 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 3, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 0, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 0, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 2159, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:06.514 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:06.515 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:06.516 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 189417, 2024-08-31T06:57:06.517 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 52, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 8160, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 180, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:06.518 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 8512, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 13, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-08-31T06:57:06.519 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 2125, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 21, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 3, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 2125, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2125, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 1.103990752, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000519525 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2125, 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 2126 2024-08-31T06:57:06.520 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 2125, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 2125, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 1380, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 743, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-08-31T06:57:06.521 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 1, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:57:06.522 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-08-31T06:57:06.523 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 84, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 10, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 5, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 5, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 0, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 2, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 0 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.524 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-08-31T06:57:06.525 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 2359, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1539921, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 2359, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2359, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1539921, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.526 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2125, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 2541, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2125, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2541, 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:06.527 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 2125, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 2125, 2024-08-31T06:57:06.528 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 2125, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2125, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:06.529 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x55b0d26828f0": { 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:06.530 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:06.531 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:06.532 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.532 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:06.532 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-08-31T06:57:06.532 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 0 2024-08-31T06:57:06.532 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:06.532 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-08-31T06:57:07.353 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-31T06:57:07.353 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-31T06:57:07.353 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-08-31T06:57:07.353 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-08-31T06:57:07.353 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-08-31T06:57:07.353 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:57:07.353 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:57:07.354 DEBUG:tasks.check_counter:Getting stats from h 2024-08-31T06:57:07.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-31T06:57:07.612 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:57:08.120 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-08-31T06:57:08.120 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:08.120 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 565, 2024-08-31T06:57:08.120 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 594, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 161967, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 360589, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 10, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.085526000, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.041485206, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.036063699, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.004630054, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 594, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.042348899, 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000071294 2024-08-31T06:57:08.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 1090, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000275787, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000253 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 322, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 313, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1182741, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 595987, 2024-08-31T06:57:08.122 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 42, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 6, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.067501568, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.023004655, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.056983202, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000452286, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 312, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.024994481, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000080110 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 59, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000009586, 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000162 2024-08-31T06:57:08.123 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 1173168, 2024-08-31T06:57:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 139040 2024-08-31T06:57:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 44, 2024-08-31T06:57:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 248, 2024-08-31T06:57:08.124 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 11850, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 431156, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 13, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 6, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.025720135, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.013316038, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.010761062, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000218370, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 245, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.019208144, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000078400 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.125 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 111, 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000027525, 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000247 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 8432, 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 373952 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 1, 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-MDSRank": { 2024-08-31T06:57:08.126 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 53, 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.002071667, 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000039088 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "finisher-PurgeQueue": { 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "queue_len": 0, 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "complete_latency": { 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2, 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000012106, 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000006053 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.127 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "request": 11, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "reply": 7, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "reply_latency": { 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 7, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.001448825, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000206975 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_reply": 0, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "forward": 4, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_complete": 0, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_fetch_keys": 0, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_commit": 11, 2024-08-31T06:57:08.128 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_split": 0, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_merge": 0, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes": 16, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_top": 0, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_bottom": 16, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pin_tail": 0, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_pinned": 13, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_expired": 4, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "inodes_with_caps": 1, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "caps": 1, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "subtrees": 3, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse": 31, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_hit": 23, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_forward": 0, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_discover": 6, 2024-08-31T06:57:08.129 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_remote_ino": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "traverse_lock": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "load_cent": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "q": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "exported": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "exported_inodes": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "imported": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "imported_inodes": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_dir_fetch": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "openino_peer_discover": 0, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rfiles": 4, 2024-08-31T06:57:08.130 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rbytes": 234, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "root_rsnaps": 6, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_set_tag": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "scrub_file_inodes": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_revoke": 4, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:57:08.131 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps": 4, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_cap_release": 0, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "process_request_cap_release": 1 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_cache": { 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update": 0, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_update_receipt": 15, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_try_discover": 10, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_send_discover": 12, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "dir_handle_discover": 0, 2024-08-31T06:57:08.132 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_delayed": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_created": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_enqueued": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_reintegrated": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "strays_migrated": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_processing": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_started": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "recovery_completed": 0, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_path": 2, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_quiesce_inode": 11, 2024-08-31T06:57:08.133 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_exportdir": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_flush": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_fragstats": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "ireq_inodestats": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_started": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_succeeded": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "uninline_write_failed": 0 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_log": { 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "evlrg": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "evadd": 8, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "evex": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "evtrm": 0, 2024-08-31T06:57:08.134 INFO:teuthology.orchestra.run.smithi066.stdout: "ev": 8, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "evexg": 0, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "evexd": 0, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "segadd": 2, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "segex": 0, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "segtrm": 0, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "seg": 2, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "segmjr": 2, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "segexg": 0, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "segexd": 0, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "expos": 4194304, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "wrpos": 4196840, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "rdpos": 0, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "jlat": { 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 7, 2024-08-31T06:57:08.135 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.015820712, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.002260101 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "replayed": 0 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_mem": { 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "ino": 20, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "ino+": 22, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "ino-": 2, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "dir": 19, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "dir+": 22, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "dir-": 3, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "dn": 16, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "dn+": 20, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "dn-": 4, 2024-08-31T06:57:08.136 INFO:teuthology.orchestra.run.smithi066.stdout: "cap": 1, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "cap+": 5, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "cap-": 4, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "rss": 119236, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "heap": 325857280 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_server": { 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_client_request": 12, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "dispatch_server_request": 0, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_request": 11, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_client_session": 26, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "handle_peer_request": 0, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "req_create_latency": { 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.137 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getattr_latency": { 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 5, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.001038628, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000207725 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getfilelock_latency": { 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "req_link_latency": { 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.138 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookup_latency": { 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 2, 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000410197, 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000205098 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookuphash_latency": { 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupino_latency": { 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.139 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupname_latency": { 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupparent_latency": { 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lookupsnap_latency": { 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.140 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.141 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.141 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.141 INFO:teuthology.orchestra.run.smithi066.stdout: "req_lssnap_latency": { 2024-08-31T06:57:08.141 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.141 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.141 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mkdir_latency": { 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mknod_latency": { 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "req_mksnap_latency": { 2024-08-31T06:57:08.142 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "req_open_latency": { 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "req_readdir_latency": { 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.143 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rename_latency": { 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "req_renamesnap_latency": { 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.144 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "req_snapdiff_latency": { 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmdir_latency": { 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.145 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmsnap_latency": { 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: "req_rmxattr_latency": { 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.146 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setattr_latency": { 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setdirlayout_latency": { 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setfilelock_latency": { 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.147 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setlayout_latency": { 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "req_setxattr_latency": { 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "req_symlink_latency": { 2024-08-31T06:57:08.148 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "req_unlink_latency": { 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "req_getvxattr_latency": { 2024-08-31T06:57:08.149 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_sessions": { 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "session_count": 2, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "session_add": 4, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "session_remove": 2, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_open": 2, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "sessions_stale": 0, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "total_load": 5, 2024-08-31T06:57:08.150 INFO:teuthology.orchestra.run.smithi066.stdout: "average_load": 1, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "avg_session_uptime": 621, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "mdthresh_evicted": 0 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:08.151 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:08.152 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-08-31T06:57:08.153 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 240007, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 88, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:08.154 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 8160, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 180, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 82653, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 342, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-08-31T06:57:08.155 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "objecter": { 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "op_active": 0, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "op_laggy": 0, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send": 46, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "op_send_bytes": 13153, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "op_resend": 28, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "op_reply": 46, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "op_latency": { 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 46, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.233998089, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.005086914 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.156 INFO:teuthology.orchestra.run.smithi066.stdout: "op_inflight": 0, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "oplen_avg": { 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 46, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 70 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "op": 46, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "op_r": 0, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "op_w": 46, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "op_rmw": 0, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "op_pg": 0, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_stat": 0, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_create": 10, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_read": 0, 2024-08-31T06:57:08.157 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_write": 7, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writefull": 8, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_writesame": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_append": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_zero": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_truncate": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_delete": 6, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_mapext": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_sparse_read": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_clonerange": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_getxattr": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_setxattr": 20, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_rmxattr": 0, 2024-08-31T06:57:08.158 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_call": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_watch": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_notify": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "osdop_other": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_active": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_send": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_resend": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "linger_ping": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_active": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_send": 0, 2024-08-31T06:57:08.159 INFO:teuthology.orchestra.run.smithi066.stdout: "poolop_resend": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_active": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_send": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "poolstat_resend": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_active": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_send": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "statfs_resend": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "command_active": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "command_send": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "command_resend": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "map_epoch": 85, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "map_full": 0, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "map_inc": 11, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_sessions": 8, 2024-08-31T06:57:08.160 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_open": 8, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_session_close": 0, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_laggy": 0, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_wr": 17, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_rd": 0, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_del": 2 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "oft": { 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_objs": 1, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_updates": 0, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "omap_total_removes": 0 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.161 INFO:teuthology.orchestra.run.smithi066.stdout: "purge_queue": { 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops": 0, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing": 0, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executing_high_water": 0, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed_ops": 0, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_executed": 0, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "pq_item_in_journal": 0 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-08-31T06:57:08.162 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 927, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1255551, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 927, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 927, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1255551, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.163 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_bytes": { 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 46, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 13153, 2024-08-31T06:57:08.164 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 46, 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 13153, 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-objecter_ops": { 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 1024, 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:08.165 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 46, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 46, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 46, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 46, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.166 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 0, 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:08.167 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-write_buf_throttle-0x55919178c680": { 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 3758096384, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 8, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 2536, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 8, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:08.168 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 7, 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 2536, 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: "trackedop": { 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: "slow_ops_count": 13 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:08.169 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-08-31T06:57:08.316 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:08 smithi106 ceph-mon[22134]: pgmap v636: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:57:08.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:08 smithi037 ceph-mon[18612]: pgmap v636: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:57:08.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:08 smithi066 ceph-mon[22244]: pgmap v636: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-08-31T06:57:09.086 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-31T06:57:09.086 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-31T06:57:09.086 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-08-31T06:57:09.086 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=15 2024-08-31T06:57:09.086 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-08-31T06:57:09.086 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:57:09.086 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:57:09.086 DEBUG:tasks.check_counter:Getting stats from k 2024-08-31T06:57:09.086 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-31T06:57:09.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:09 smithi106 ceph-mon[22134]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T06:57:09.342 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.b/config 2024-08-31T06:57:09.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:09 smithi037 ceph-mon[18612]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T06:57:09.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:09 smithi066 ceph-mon[22244]: osdmap e85: 12 total, 12 up, 12 in 2024-08-31T06:57:09.876 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-08-31T06:57:09.876 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:09.876 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 4, 2024-08-31T06:57:09.876 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 4, 2024-08-31T06:57:09.876 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 2992, 2024-08-31T06:57:09.876 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 448, 2024-08-31T06:57:09.876 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 4, 2024-08-31T06:57:09.876 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 0, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.003336840, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.000036193, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.002358019, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 3, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.003992648, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.001330882 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:09.877 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 448 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 219, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 212, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 1132816, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 129984, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 2, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 1, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.043708654, 2024-08-31T06:57:09.878 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.016945573, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.037430210, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 211, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.013862679, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000065699 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.879 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 1132816, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 129984 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_messages": 1, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages": 160, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_bytes": 160, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_bytes": 108096, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_created_connections": 3, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_total_time": 0.015320514, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_send_time": 0.011869055, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_recv_time": 0.001276643, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:09.880 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 158, 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.010637027, 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000067322 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "msgr_send_encrypted_bytes": 108096 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "cct": { 2024-08-31T06:57:09.881 INFO:teuthology.orchestra.run.smithi066.stdout: "total_workers": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "unhealthy_workers": 0 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "mempool": { 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:09.882 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:09.883 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_items": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_bytes": 149998, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_anon_items": 30, 2024-08-31T06:57:09.884 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_bytes": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_items": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_bytes": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_items": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "pgmap_items": 0, 2024-08-31T06:57:09.885 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_bytes": 928, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_co_items": 2, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_1_items": 0, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "unittest_2_items": 0 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "val": 0, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "max": 104857600, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "get_started": 0, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "get": 220, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "get_sum": 1101878, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "get_or_fail_success": 220, 2024-08-31T06:57:09.886 INFO:teuthology.orchestra.run.smithi066.stdout: "take": 0, 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: "take_sum": 0, 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: "put": 220, 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: "put_sum": 1101878, 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: "wait": { 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: "avgcount": 0, 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: "sum": 0.000000000, 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: "avgtime": 0.000000000 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-08-31T06:57:09.887 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-08-31T06:57:10.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:10 smithi106 ceph-mon[22134]: pgmap v638: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:57:10.356 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:10 smithi037 ceph-mon[18612]: pgmap v638: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:57:10.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:10 smithi066 ceph-mon[22244]: pgmap v638: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:57:10.544 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-08-31T06:57:10.545 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-08-31T06:57:10.545 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-08-31T06:57:10.545 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-08-31T06:57:10.545 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-08-31T06:57:10.545 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-08-31T06:57:10.545 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-08-31T06:57:10.545 DEBUG:tasks.check_counter:Getting stats from c 2024-08-31T06:57:10.545 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-31T06:57:10.803 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 1594, 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 1596, 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 1711375, 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 506902, 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 6, 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:11.326 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.197485794, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.085625028, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.044623627, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.051665651, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1594, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.064966422, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000040756 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 239, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 230, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 1163016, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 132330, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 4, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 3, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.045312931, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.019433088, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.038657951, 2024-08-31T06:57:11.328 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000107671, 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 229, 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.017522154, 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000076515 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 1161360, 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 130992 2024-08-31T06:57:11.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 733, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 887, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 182483, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 592915, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 4, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 3, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.103119781, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.051417308, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.018591726, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.024569875, 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:11.330 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 886, 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.042231859, 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000047665 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 361728 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2024-08-31T06:57:11.331 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 1, 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-MDSRank": { 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 3822, 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.113913115, 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000029804 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-PurgeQueue": { 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-08-31T06:57:11.332 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": { 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "request": 0, 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "reply": 0, 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "reply_latency": { 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.333 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_reply": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "forward": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_complete": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_keys": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_commit": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_split": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_merge": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes": 31, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_top": 6, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_bottom": 25, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pin_tail": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pinned": 23, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_expired": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_with_caps": 0, 2024-08-31T06:57:11.334 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "subtrees": 2, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_hit": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_forward": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_discover": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_remote_ino": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_lock": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "load_cent": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "q": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "exported": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "exported_inodes": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "imported": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "imported_inodes": 0, 2024-08-31T06:57:11.335 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_dir_fetch": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_peer_discover": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rfiles": 4, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rbytes": 234, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rsnaps": 6, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_set_tag": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:57:11.336 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_file_inodes": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_cap_release": 0, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "process_request_cap_release": 0 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache": { 2024-08-31T06:57:11.337 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update_receipt": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_try_discover": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_send_discover": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_handle_discover": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_delayed": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_created": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_enqueued": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_reintegrated": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_migrated": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_processing": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:57:11.338 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_started": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_completed": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_quiesce_path": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_quiesce_inode": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_exportdir": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_flush": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragstats": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_inodestats": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_started": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_succeeded": 0, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_write_failed": 0 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log": { 2024-08-31T06:57:11.339 INFO:teuthology.orchestra.run.smithi106.stdout: "evlrg": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "evadd": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "evex": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "evtrm": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "ev": 251, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "evexg": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "evexd": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "segadd": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "segex": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "segtrm": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "seg": 2, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "segmjr": 14, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "segexg": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "segexd": 0, 2024-08-31T06:57:11.340 INFO:teuthology.orchestra.run.smithi106.stdout: "expos": 5242236, 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "wrpos": 5435024, 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "rdpos": 5434964, 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "jlat": { 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "replayed": 251 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_mem": { 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "ino": 20, 2024-08-31T06:57:11.341 INFO:teuthology.orchestra.run.smithi106.stdout: "ino+": 24, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "ino-": 4, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "dir": 11, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "dir+": 11, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "dir-": 0, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "dn": 31, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "dn+": 31, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "dn-": 0, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "cap": 0, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "cap+": 0, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "cap-": 0, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "rss": 116860, 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: "heap": 316428288 2024-08-31T06:57:11.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_server": { 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_client_request": 0, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_server_request": 0, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_request": 0, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_session": 0, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_peer_request": 0, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "req_create_latency": { 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getattr_latency": { 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.343 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getfilelock_latency": { 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: "req_link_latency": { 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookup_latency": { 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookuphash_latency": { 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.345 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupino_latency": { 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupname_latency": { 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupparent_latency": { 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.346 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupsnap_latency": { 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lssnap_latency": { 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.347 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mkdir_latency": { 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mknod_latency": { 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.348 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mksnap_latency": { 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "req_open_latency": { 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "req_readdir_latency": { 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.349 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rename_latency": { 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "req_renamesnap_latency": { 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "req_snapdiff_latency": { 2024-08-31T06:57:11.350 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmdir_latency": { 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmsnap_latency": { 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmxattr_latency": { 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setattr_latency": { 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setdirlayout_latency": { 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.352 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setfilelock_latency": { 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setlayout_latency": { 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setxattr_latency": { 2024-08-31T06:57:11.353 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "req_symlink_latency": { 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "req_unlink_latency": { 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.354 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getvxattr_latency": { 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sessions": { 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "session_count": 2, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "session_add": 4, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "session_remove": 2, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_open": 3, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_stale": 0, 2024-08-31T06:57:11.355 INFO:teuthology.orchestra.run.smithi106.stdout: "total_load": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "average_load": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "avg_session_uptime": 2214, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "mdthresh_evicted": 0 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:11.356 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:11.357 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:11.358 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 189400, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 51, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 8280, 2024-08-31T06:57:11.359 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 183, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 0, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 93548, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 588, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter": { 2024-08-31T06:57:11.360 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 2325, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 26, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 4, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 2325, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2325, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 3.591913355, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001544908 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2325, 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 2326 2024-08-31T06:57:11.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 2325, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 2325, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 1461, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 861, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2024-08-31T06:57:11.362 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 2, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2024-08-31T06:57:11.363 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2024-08-31T06:57:11.364 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 85, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 11, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 5, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 5, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 0, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 2, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 0 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "oft": { 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_objs": 0, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:57:11.365 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_updates": 0, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_removes": 0 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "purge_queue": { 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops": 0, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing": 0, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_high_water": 0, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed_ops": 0, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed": 0, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_item_in_journal": 0 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-08-31T06:57:11.366 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 2562, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 2811247, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 2562, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 2562, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 2811247, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.367 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes": { 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 2325, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 1240730, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 2325, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1240730, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.368 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops": { 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 2325, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 2325, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 2325, 2024-08-31T06:57:11.369 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 2325, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:11.370 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle-0x563d5888ac30": { 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:11.371 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:11.372 INFO:teuthology.orchestra.run.smithi106.stdout: "trackedop": { 2024-08-31T06:57:11.373 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_ops_count": 0 2024-08-31T06:57:11.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:11.373 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-31T06:57:12.092 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-08-31T06:57:12.092 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-08-31T06:57:12.093 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-08-31T06:57:12.093 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-08-31T06:57:12.093 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-08-31T06:57:12.093 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:57:12.093 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:57:12.093 DEBUG:tasks.check_counter:Getting stats from f 2024-08-31T06:57:12.093 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-31T06:57:12.314 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:12 smithi106 ceph-mon[22134]: pgmap v639: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:57:12.346 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:57:12.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:12 smithi037 ceph-mon[18612]: pgmap v639: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:57:12.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:12 smithi066 ceph-mon[22244]: pgmap v639: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-08-31T06:57:12.839 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-31T06:57:12.839 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:12.839 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 974, 2024-08-31T06:57:12.839 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 965, 2024-08-31T06:57:12.839 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 1409776, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 366474, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 5, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 1, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.166444012, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.069057539, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.068143606, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.033851775, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 964, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.058082432, 2024-08-31T06:57:12.840 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000060251 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 1161472, 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 131472 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:12.841 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 7, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 163, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 3708, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 362618, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 4, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 3, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.013627156, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.008978404, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.003137154, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000082782, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 162, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.013908526, 2024-08-31T06:57:12.842 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000085855 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 361920 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 1402, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 1403, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 359678, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 445525, 2024-08-31T06:57:12.843 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 4, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 3, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.129214377, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.056662492, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.026924362, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.038137645, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1401, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.069735778, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000049775 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.844 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 1, 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-MDSRank": { 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 3623, 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.113241938, 2024-08-31T06:57:12.845 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000031256 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-PurgeQueue": { 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": { 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "request": 0, 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "reply": 0, 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "reply_latency": { 2024-08-31T06:57:12.846 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_reply": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "forward": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_complete": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_keys": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_commit": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_split": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_merge": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_top": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_bottom": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pin_tail": 0, 2024-08-31T06:57:12.847 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pinned": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_expired": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_with_caps": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "subtrees": 1, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_hit": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_forward": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_discover": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_remote_ino": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_lock": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "load_cent": 0, 2024-08-31T06:57:12.848 INFO:teuthology.orchestra.run.smithi106.stdout: "q": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "exported": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "exported_inodes": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "imported": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "imported_inodes": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_dir_fetch": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_peer_discover": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rfiles": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rbytes": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rsnaps": 0, 2024-08-31T06:57:12.849 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_set_tag": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_file_inodes": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_revoke": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:57:12.850 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_cap_release": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "process_request_cap_release": 0 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache": { 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update_receipt": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_try_discover": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_send_discover": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_handle_discover": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_delayed": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:57:12.851 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_created": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_enqueued": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_reintegrated": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_migrated": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_processing": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_started": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_completed": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_quiesce_path": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_quiesce_inode": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_exportdir": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_flush": 0, 2024-08-31T06:57:12.852 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragstats": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_inodestats": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_started": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_succeeded": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_write_failed": 0 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log": { 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "evlrg": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "evadd": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "evex": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "evtrm": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "ev": 7, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "evexg": 0, 2024-08-31T06:57:12.853 INFO:teuthology.orchestra.run.smithi106.stdout: "evexd": 0, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "segadd": 0, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "segex": 0, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "segtrm": 0, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "seg": 2, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "segmjr": 2, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "segexg": 0, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "segexd": 0, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "expos": 4194304, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "wrpos": 4196449, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "rdpos": 4196308, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "jlat": { 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.854 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "replayed": 7 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_mem": { 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "ino": 3, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "ino+": 3, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "ino-": 0, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "dir": 1, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "dir+": 1, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "dir-": 0, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "dn": 0, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "dn+": 0, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "dn-": 0, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "cap": 0, 2024-08-31T06:57:12.855 INFO:teuthology.orchestra.run.smithi106.stdout: "cap+": 0, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "cap-": 0, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "rss": 117212, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "heap": 316420096 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_server": { 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_client_request": 0, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_server_request": 0, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_request": 0, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_session": 0, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_peer_request": 0, 2024-08-31T06:57:12.856 INFO:teuthology.orchestra.run.smithi106.stdout: "req_create_latency": { 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getattr_latency": { 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getfilelock_latency": { 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "req_link_latency": { 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookup_latency": { 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookuphash_latency": { 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.858 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupino_latency": { 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupname_latency": { 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupparent_latency": { 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.859 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupsnap_latency": { 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lssnap_latency": { 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.860 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mkdir_latency": { 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mknod_latency": { 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.861 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mksnap_latency": { 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "req_open_latency": { 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "req_readdir_latency": { 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rename_latency": { 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "req_renamesnap_latency": { 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.863 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "req_snapdiff_latency": { 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmdir_latency": { 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmsnap_latency": { 2024-08-31T06:57:12.864 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmxattr_latency": { 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setattr_latency": { 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.865 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setdirlayout_latency": { 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setfilelock_latency": { 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setlayout_latency": { 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.866 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setxattr_latency": { 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "req_symlink_latency": { 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "req_unlink_latency": { 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.867 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getvxattr_latency": { 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sessions": { 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "session_count": 1, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "session_add": 3, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "session_remove": 2, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_open": 2, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_stale": 0, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "total_load": 0, 2024-08-31T06:57:12.868 INFO:teuthology.orchestra.run.smithi106.stdout: "average_load": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "avg_session_uptime": 2743, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mdthresh_evicted": 0 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:12.869 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:12.870 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:12.871 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 181303, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 46, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 8280, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 183, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:12.872 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 0, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 8512, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 13, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter": { 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 2142, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 21, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 3, 2024-08-31T06:57:12.873 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 2142, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2142, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 1.535962958, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000717069 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2142, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 2143 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 2142, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 2142, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 0, 2024-08-31T06:57:12.874 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 1392, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 748, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2024-08-31T06:57:12.875 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 1, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2024-08-31T06:57:12.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2024-08-31T06:57:12.877 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 85, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 11, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 4, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 4, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 0, 2024-08-31T06:57:12.878 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 2, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 0 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "oft": { 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_objs": 0, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_updates": 0, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_removes": 0 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "purge_queue": { 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops": 0, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing": 0, 2024-08-31T06:57:12.879 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_high_water": 0, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed_ops": 0, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed": 0, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_item_in_journal": 0 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 2379, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 1543999, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 2379, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 2379, 2024-08-31T06:57:12.880 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1543999, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes": { 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:12.881 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 2142, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 2150, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 2142, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 2150, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops": { 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 2142, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 2142, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 2142, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 2142, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:57:12.883 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.884 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle-0x55f1a6a4a9c0": { 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:12.885 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: "trackedop": { 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_ops_count": 0 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:12.886 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-31T06:57:13.499 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-31T06:57:13.499 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-31T06:57:13.499 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-08-31T06:57:13.499 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-08-31T06:57:13.500 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-08-31T06:57:13.500 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:57:13.500 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:57:13.500 DEBUG:tasks.check_counter:Getting stats from i 2024-08-31T06:57:13.500 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-31T06:57:13.747 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:57:14.125 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:14 smithi106 ceph-mon[22134]: pgmap v640: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:14.245 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 828, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 849, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 1336755, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 414315, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 11, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.126086004, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.055912944, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.075857271, 2024-08-31T06:57:14.246 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.004798823, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 851, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.059716511, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000070172 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1096, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000350593, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000319 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 1177552, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 135280 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.247 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 33, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 223, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 7769, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 402963, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 11, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 6, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.019821576, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.011212107, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.006550281, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000257975, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 219, 2024-08-31T06:57:14.248 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.033748749, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000154103 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 69, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000021776, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000315 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 361856 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 56, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 59, 2024-08-31T06:57:14.249 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 10536, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 457855, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 43, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 6, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.018968855, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.002227286, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.015198091, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000457471, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 57, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.022925533, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000402202 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.250 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 44, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000006018, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000136 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 928, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 976 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 1, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-MDSRank": { 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 40, 2024-08-31T06:57:14.251 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.001974293, 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000049357 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-PurgeQueue": { 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2, 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000006188, 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000003094 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": { 2024-08-31T06:57:14.252 INFO:teuthology.orchestra.run.smithi106.stdout: "request": 4, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "reply": 3, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "reply_latency": { 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 3, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.001656265, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000552088 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_reply": 0, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "forward": 1, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_complete": 0, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_fetch_keys": 0, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_commit": 11, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_split": 0, 2024-08-31T06:57:14.253 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_merge": 0, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes": 16, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_top": 0, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_bottom": 16, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pin_tail": 0, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_pinned": 13, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_expired": 4, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "inodes_with_caps": 3, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": 3, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "subtrees": 3, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse": 20, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_hit": 14, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_forward": 1, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_discover": 5, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_dir_fetch": 0, 2024-08-31T06:57:14.254 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_remote_ino": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "traverse_lock": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "load_cent": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "q": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "exported": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "exported_inodes": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "imported": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "imported_inodes": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_dir_fetch": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_backtrace_fetch": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "openino_peer_discover": 0, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rfiles": 4, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rbytes": 234, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "root_rsnaps": 6, 2024-08-31T06:57:14.255 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_fetch": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_set_tag": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_backtrace_repaired": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_inotable_repaired": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_inodes": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dir_base_inodes": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_dirfrag_rstats": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "scrub_file_inodes": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_inode_file_caps": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_revoke": 3, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_grant": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_trunc": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-31T06:57:14.256 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps": 3, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_caps_dirty": 0, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_cap_release": 0, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "process_request_cap_release": 0 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_cache": { 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update": 0, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_update_receipt": 17, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_try_discover": 11, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_send_discover": 12, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "dir_handle_discover": 0, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays": 0, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_delayed": 0, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "num_strays_enqueuing": 0, 2024-08-31T06:57:14.257 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_created": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_enqueued": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_reintegrated": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "strays_migrated": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_processing": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_enqueued": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "num_recovering_prioritized": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_started": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "recovery_completed": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_quiesce_path": 2, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_quiesce_inode": 11, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_enqueue_scrub": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_exportdir": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_flush": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragmentdir": 0, 2024-08-31T06:57:14.258 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_fragstats": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "ireq_inodestats": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_started": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_succeeded": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "uninline_write_failed": 0 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_log": { 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "evlrg": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "evadd": 7, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "evex": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "evtrm": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "ev": 7, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "evexg": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "evexd": 0, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "segadd": 2, 2024-08-31T06:57:14.259 INFO:teuthology.orchestra.run.smithi106.stdout: "segex": 0, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "segtrm": 0, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "seg": 2, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "segmjr": 2, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "segexg": 0, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "segexd": 0, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "expos": 4194304, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "wrpos": 4196449, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "rdpos": 0, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "jlat": { 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 6, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.012653586, 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.002108931 2024-08-31T06:57:14.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "replayed": 0 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_mem": { 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "ino": 20, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "ino+": 22, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "ino-": 2, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "dir": 19, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "dir+": 23, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "dir-": 4, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "dn": 16, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "dn+": 20, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "dn-": 4, 2024-08-31T06:57:14.261 INFO:teuthology.orchestra.run.smithi106.stdout: "cap": 3, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "cap+": 3, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "cap-": 0, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "rss": 121200, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "heap": 325857280 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_server": { 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_client_request": 7, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "dispatch_server_request": 0, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_request": 4, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_client_session": 17, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "handle_peer_request": 1, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "req_create_latency": { 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.262 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getattr_latency": { 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 3, 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.001656265, 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000552088 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getfilelock_latency": { 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "req_link_latency": { 2024-08-31T06:57:14.263 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookup_latency": { 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookuphash_latency": { 2024-08-31T06:57:14.264 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupino_latency": { 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupname_latency": { 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.265 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupparent_latency": { 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lookupsnap_latency": { 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.266 INFO:teuthology.orchestra.run.smithi106.stdout: "req_lssnap_latency": { 2024-08-31T06:57:14.267 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.267 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.267 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.267 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mkdir_latency": { 2024-08-31T06:57:14.267 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mknod_latency": { 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "req_mksnap_latency": { 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.268 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "req_open_latency": { 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "req_readdir_latency": { 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.269 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rename_latency": { 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "req_renamesnap_latency": { 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "req_snapdiff_latency": { 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.270 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmdir_latency": { 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmsnap_latency": { 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "req_rmxattr_latency": { 2024-08-31T06:57:14.271 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setattr_latency": { 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setdirlayout_latency": { 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setfilelock_latency": { 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setlayout_latency": { 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "req_setxattr_latency": { 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.273 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "req_symlink_latency": { 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "req_unlink_latency": { 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_revoke_eviction": 0, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "cap_acquisition_throttle": 0, 2024-08-31T06:57:14.274 INFO:teuthology.orchestra.run.smithi106.stdout: "req_getvxattr_latency": { 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_sessions": { 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "session_count": 1, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "session_add": 3, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "session_remove": 2, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_open": 1, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "sessions_stale": 0, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "total_load": 2, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "average_load": 2, 2024-08-31T06:57:14.275 INFO:teuthology.orchestra.run.smithi106.stdout: "avg_session_uptime": 644, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "mdthresh_evicted": 0 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:14.276 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:14.277 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2024-08-31T06:57:14.278 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 246908, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 82, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:14.279 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 8280, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 183, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 0, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 83277, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 344, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2024-08-31T06:57:14.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter": { 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 43, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 12606, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 33, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 43, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 43, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.282993242, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.006581238 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.281 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 43, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 66 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 43, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 0, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 43, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 0, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 10, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 0, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 6, 2024-08-31T06:57:14.282 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 7, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 6, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 20, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2024-08-31T06:57:14.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2024-08-31T06:57:14.284 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 85, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 11, 2024-08-31T06:57:14.285 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 9, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 9, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 16, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 0, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 1 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "oft": { 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_objs": 1, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_kv_pairs": 0, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_updates": 0, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_total_removes": 0 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.286 INFO:teuthology.orchestra.run.smithi106.stdout: "purge_queue": { 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops": 0, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_ops_high_water": 0, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing": 0, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executing_high_water": 0, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed_ops": 0, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_executed": 0, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "pq_item_in_journal": 0 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 913, 2024-08-31T06:57:14.287 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 1256083, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 913, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 913, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1256083, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.288 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes": { 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 43, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 12606, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 43, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 12606, 2024-08-31T06:57:14.289 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops": { 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:14.290 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 43, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 43, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 43, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 43, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle": { 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-08-31T06:57:14.291 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.292 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-write_buf_throttle-0x55be2affc820": { 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 3758096384, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 7, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 2145, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 7, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 6, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 2145, 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:14.293 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:14.294 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:14.294 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:14.294 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:14.294 INFO:teuthology.orchestra.run.smithi106.stdout: "trackedop": { 2024-08-31T06:57:14.294 INFO:teuthology.orchestra.run.smithi106.stdout: "slow_ops_count": 13 2024-08-31T06:57:14.294 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:14.294 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-31T06:57:14.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:14 smithi037 ceph-mon[18612]: pgmap v640: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:14.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:14 smithi066 ceph-mon[22244]: pgmap v640: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:15.003 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-08-31T06:57:15.004 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-08-31T06:57:15.004 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-08-31T06:57:15.004 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=17 2024-08-31T06:57:15.004 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-08-31T06:57:15.004 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-08-31T06:57:15.004 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-08-31T06:57:15.004 DEBUG:tasks.check_counter:Getting stats from l 2024-08-31T06:57:15.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-31T06:57:15.248 INFO:teuthology.orchestra.run.smithi106.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.c/config 2024-08-31T06:57:15.686 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-08-31T06:57:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2024-08-31T06:57:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 0, 2024-08-31T06:57:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 2, 2024-08-31T06:57:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 0, 2024-08-31T06:57:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 0, 2024-08-31T06:57:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 4, 2024-08-31T06:57:15.686 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 0, 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.001051425, 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.000000000, 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.000217676, 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:15.687 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 0 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 221, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 214, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 1133360, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 131264, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 2, 2024-08-31T06:57:15.688 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 1, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.044547336, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.019265243, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.037866349, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 213, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.012611033, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000059206 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:15.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 1133360, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 131264 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 5, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 164, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 3152, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 108896, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 3, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 2, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.015248134, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.010703403, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.002706697, 2024-08-31T06:57:15.690 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 163, 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.013874404, 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000085119 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 108896 2024-08-31T06:57:15.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2024-08-31T06:57:15.692 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2024-08-31T06:57:15.693 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2024-08-31T06:57:15.694 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 148967, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 29, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2024-08-31T06:57:15.695 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 0, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 0, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 928, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 2, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2024-08-31T06:57:15.696 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 222, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 1102138, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 222, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 222, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1102138, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:15.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-08-31T06:57:15.698 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-08-31T06:57:16.315 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:16 smithi106 ceph-mon[22134]: pgmap v641: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:16.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:16 smithi037 ceph-mon[18612]: pgmap v641: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:16.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:16 smithi066 ceph-mon[22244]: pgmap v641: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:16.391 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-08-31T06:57:16.392 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-08-31T06:57:16.392 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-08-31T06:57:16.392 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-08-31T06:57:16.392 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-08-31T06:57:16.392 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-08-31T06:57:16.392 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-08-31T06:57:16.392 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-31T06:57:16.402 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-31T06:57:16.402 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:57:16.402 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T06:57:16.419 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:57:16.419 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T06:57:16.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T06:57:16.777 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 -- 172.21.15.37:0/2680141501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f8810dbb0 msgr2=0x7f2f881100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 --2- 172.21.15.37:0/2680141501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f8810dbb0 0x7f2f881100a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009ca0 tx=0x7f2f8002a8c0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 -- 172.21.15.37:0/2680141501 shutdown_connections 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 --2- 172.21.15.37:0/2680141501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f8810dbb0 0x7f2f881100a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 --2- 172.21.15.37:0/2680141501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f881050a0 0x7f2f8810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 --2- 172.21.15.37:0/2680141501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f88104750 0x7f2f88104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 -- 172.21.15.37:0/2680141501 >> 172.21.15.37:0/2680141501 conn(0x7f2f880794d0 msgr2=0x7f2f880798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 -- 172.21.15.37:0/2680141501 shutdown_connections 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 -- 172.21.15.37:0/2680141501 wait complete. 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.272+0000 7f2f8f722640 1 Processor -- start 2024-08-31T06:57:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8f722640 1 -- start start 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8f722640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f88104750 0x7f2f8819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8f722640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f881050a0 0x7f2f8819a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8f722640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f8810dbb0 0x7f2f8819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8f722640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88113730 con 0x7f2f881050a0 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8f722640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881135b0 con 0x7f2f88104750 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8f722640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881138b0 con 0x7f2f8810dbb0 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8ccbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f881050a0 0x7f2f8819a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8d4be640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f88104750 0x7f2f8819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8ccbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f881050a0 0x7f2f8819a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60710/0 (socket says 172.21.15.37:60710) 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8ccbd640 1 -- 172.21.15.37:0/3961281894 learned_addr learned my addr 172.21.15.37:0/3961281894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8dcbf640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f8810dbb0 0x7f2f8819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8ccbd640 1 -- 172.21.15.37:0/3961281894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f8810dbb0 msgr2=0x7f2f8819f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8ccbd640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f8810dbb0 0x7f2f8819f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8ccbd640 1 -- 172.21.15.37:0/3961281894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f88104750 msgr2=0x7f2f8819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8ccbd640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f88104750 0x7f2f8819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.273+0000 7f2f8ccbd640 1 -- 172.21.15.37:0/3961281894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f881a00d0 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.274+0000 7f2f8ccbd640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f881050a0 0x7f2f8819a700 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800e9c0 tx=0x7f2f7800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.274+0000 7f2f7e7fc640 1 -- 172.21.15.37:0/3961281894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7800ccc0 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.274+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f881a03c0 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.274+0000 7f2f7e7fc640 1 -- 172.21.15.37:0/3961281894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f780054b0 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.274+0000 7f2f7e7fc640 1 -- 172.21.15.37:0/3961281894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78010430 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.274+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f881a6b20 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.275+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f88104b60 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.276+0000 7f2f7e7fc640 1 -- 172.21.15.37:0/3961281894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f2f78004f20 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.277+0000 7f2f7e7fc640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2f740b4ca0 0x7f2f740b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.277+0000 7f2f8d4be640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2f740b4ca0 0x7f2f740b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.278+0000 7f2f7e7fc640 1 -- 172.21.15.37:0/3961281894 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8499+0+0 (secure 0 0 0) 0x7f2f780e5800 con 0x7f2f881050a0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.278+0000 7f2f8d4be640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2f740b4ca0 0x7f2f740b71b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2f8806ba00 tx=0x7f2f8400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.282+0000 7f2f7e7fc640 1 -- 172.21.15.37:0/3961281894 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f2f780ac600 con 0x7f2f881050a0 2024-08-31T06:57:17.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.482+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2f8819b290 con 0x7f2f881050a0 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.483+0000 7f2f7e7fc640 1 -- 172.21.15.37:0/3961281894 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v86) ==== 81+0+885 (secure 0 0 0) 0x7f2f780abf00 con 0x7f2f881050a0 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3700278983 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2470001977 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/927770183 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/927770183 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2248986445 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2568176479 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1863763988 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:17.484 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1769436059 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1769436059 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/644899001 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3538486341 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3404040012 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2862953179 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3700278983 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:17.485 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1887643079 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:17.485 INFO:teuthology.orchestra.run.smithi037.stderr:listed 15 entries 2024-08-31T06:57:17.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2f740b4ca0 msgr2=0x7f2f740b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:17.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2f740b4ca0 0x7f2f740b71b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2f8806ba00 tx=0x7f2f8400b390 comp rx=0 tx=0).stop 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f881050a0 msgr2=0x7f2f8819a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f881050a0 0x7f2f8819a700 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f2f7800e9c0 tx=0x7f2f7800ee80 comp rx=0 tx=0).stop 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 shutdown_connections 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f2f740b4ca0 0x7f2f740b71b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f881050a0 0x7f2f8819a700 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f8810dbb0 0x7f2f8819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 --2- 172.21.15.37:0/3961281894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f88104750 0x7f2f8819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 >> 172.21.15.37:0/3961281894 conn(0x7f2f880794d0 msgr2=0x7f2f88100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 shutdown_connections 2024-08-31T06:57:17.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:17.485+0000 7f2f8f722640 1 -- 172.21.15.37:0/3961281894 wait complete. 2024-08-31T06:57:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:17 smithi106 ceph-mon[22134]: pgmap v642: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:17 smithi106 ceph-mon[22134]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T06:57:18.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:17 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3961281894' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:57:18.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:17 smithi037 ceph-mon[18612]: pgmap v642: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:18.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:17 smithi037 ceph-mon[18612]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T06:57:18.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:17 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3961281894' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:57:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:17 smithi066 ceph-mon[22244]: pgmap v642: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:17 smithi066 ceph-mon[22244]: osdmap e86: 12 total, 12 up, 12 in 2024-08-31T06:57:18.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:17 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3961281894' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:57:18.171 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-31T06:57:18.171 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-31T06:57:18.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd blocklist ls 2024-08-31T06:57:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 -- 172.21.15.37:0/1723712327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 msgr2=0x7fae5c1027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 --2- 172.21.15.37:0/1723712327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 0x7fae5c1027c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fae58009900 tx=0x7fae5802a480 comp rx=0 tx=0).stop 2024-08-31T06:57:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 -- 172.21.15.37:0/1723712327 shutdown_connections 2024-08-31T06:57:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 --2- 172.21.15.37:0/1723712327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae5c10ff60 0x7fae5c112380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 --2- 172.21.15.37:0/1723712327 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae5c102d00 0x7fae5c10fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 --2- 172.21.15.37:0/1723712327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 0x7fae5c1027c0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 -- 172.21.15.37:0/1723712327 >> 172.21.15.37:0/1723712327 conn(0x7fae5c0794f0 msgr2=0x7fae5c079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 -- 172.21.15.37:0/1723712327 shutdown_connections 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.954+0000 7fae63ce1640 1 -- 172.21.15.37:0/1723712327 wait complete. 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae63ce1640 1 Processor -- start 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae63ce1640 1 -- start start 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae63ce1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 0x7fae5c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae63ce1640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae5c102d00 0x7fae5c19c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae63ce1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae5c10ff60 0x7fae5c1a1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae63ce1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c115900 con 0x7fae5c1023b0 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae63ce1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c115780 con 0x7fae5c10ff60 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae63ce1640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c115a80 con 0x7fae5c102d00 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae61a7d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 0x7fae5c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae61a7d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 0x7fae5c19c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60718/0 (socket says 172.21.15.37:60718) 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae61a7d640 1 -- 172.21.15.37:0/4134224321 learned_addr learned my addr 172.21.15.37:0/4134224321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae6227e640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae5c10ff60 0x7fae5c1a1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.955+0000 7fae6127c640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae5c102d00 0x7fae5c19c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae61a7d640 1 -- 172.21.15.37:0/4134224321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae5c102d00 msgr2=0x7fae5c19c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae61a7d640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae5c102d00 0x7fae5c19c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae61a7d640 1 -- 172.21.15.37:0/4134224321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae5c10ff60 msgr2=0x7fae5c1a1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae61a7d640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae5c10ff60 0x7fae5c1a1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae61a7d640 1 -- 172.21.15.37:0/4134224321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c1a22a0 con 0x7fae5c1023b0 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae61a7d640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 0x7fae5c19c330 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fae58009230 tx=0x7fae58004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae52ffd640 1 -- 172.21.15.37:0/4134224321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5803f030 con 0x7fae5c1023b0 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae52ffd640 1 -- 172.21.15.37:0/4134224321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae58003a80 con 0x7fae5c1023b0 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae52ffd640 1 -- 172.21.15.37:0/4134224321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58035070 con 0x7fae5c1023b0 2024-08-31T06:57:18.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5c1a2530 con 0x7fae5c1023b0 2024-08-31T06:57:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.956+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae5c1a8cf0 con 0x7fae5c1023b0 2024-08-31T06:57:18.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.957+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5c1027c0 con 0x7fae5c1023b0 2024-08-31T06:57:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.959+0000 7fae52ffd640 1 -- 172.21.15.37:0/4134224321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fae58042030 con 0x7fae5c1023b0 2024-08-31T06:57:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.959+0000 7fae52ffd640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae480b4d20 0x7fae480b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.959+0000 7fae6127c640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae480b4d20 0x7fae480b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.959+0000 7fae52ffd640 1 -- 172.21.15.37:0/4134224321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8499+0+0 (secure 0 0 0) 0x7fae58105fb0 con 0x7fae5c1023b0 2024-08-31T06:57:18.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.960+0000 7fae6127c640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae480b4d20 0x7fae480b7230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fae5c079dd0 tx=0x7fae4c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:18.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:18.962+0000 7fae52ffd640 1 -- 172.21.15.37:0/4134224321 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fae580cc760 con 0x7fae5c1023b0 2024-08-31T06:57:19.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.162+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fae5c19d460 con 0x7fae5c1023b0 2024-08-31T06:57:19.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.163+0000 7fae52ffd640 1 -- 172.21.15.37:0/4134224321 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v86) ==== 81+0+885 (secure 0 0 0) 0x7fae580ede20 con 0x7fae5c1023b0 2024-08-31T06:57:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3700278983 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2470001977 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/927770183 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/927770183 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2248986445 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2568176479 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1863763988 2024-09-01T06:36:48.914944+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1769436059 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1769436059 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/644899001 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3538486341 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3404040012 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2862953179 2024-09-01T06:37:14.112103+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3700278983 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1887643079 2024-09-01T06:38:18.150139+0000 2024-08-31T06:57:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:listed 15 entries 2024-08-31T06:57:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae480b4d20 msgr2=0x7fae480b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae480b4d20 0x7fae480b7230 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fae5c079dd0 tx=0x7fae4c00b390 comp rx=0 tx=0).stop 2024-08-31T06:57:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 msgr2=0x7fae5c19c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 0x7fae5c19c330 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fae58009230 tx=0x7fae58004270 comp rx=0 tx=0).stop 2024-08-31T06:57:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 shutdown_connections 2024-08-31T06:57:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fae480b4d20 0x7fae480b7230 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae5c10ff60 0x7fae5c1a1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae5c102d00 0x7fae5c19c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 --2- 172.21.15.37:0/4134224321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae5c1023b0 0x7fae5c19c330 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 >> 172.21.15.37:0/4134224321 conn(0x7fae5c0794f0 msgr2=0x7fae5c111440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 shutdown_connections 2024-08-31T06:57:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:19.165+0000 7fae63ce1640 1 -- 172.21.15.37:0/4134224321 wait complete. 2024-08-31T06:57:19.838 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2024-08-31T06:57:19.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:57:19.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-31T06:57:19.867 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[73644]: fuse finished with error 0 and tester_r 0 2024-08-31T06:57:19.867 INFO:teuthology.orchestra.run:waiting for 300 2024-08-31T06:57:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:19 smithi106 ceph-mon[22134]: pgmap v644: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:20.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:19 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/4134224321' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:57:20.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:19 smithi037 ceph-mon[18612]: pgmap v644: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:20.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:19 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/4134224321' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:57:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:19 smithi066 ceph-mon[22244]: pgmap v644: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:20.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:19 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/4134224321' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-31T06:57:22.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:21 smithi106 ceph-mon[22134]: pgmap v645: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:22.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:21 smithi037 ceph-mon[18612]: pgmap v645: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:22.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:21 smithi066 ceph-mon[22244]: pgmap v645: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-08-31T06:57:24.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:23 smithi106 ceph-mon[22134]: pgmap v646: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 6 op/s 2024-08-31T06:57:24.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:23 smithi037 ceph-mon[18612]: pgmap v646: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 6 op/s 2024-08-31T06:57:24.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:23 smithi066 ceph-mon[22244]: pgmap v646: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 6 op/s 2024-08-31T06:57:25.968 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T06:57:25.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:57:25.969 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-31T06:57:26.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:57:26.001 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-08-31T06:57:26.059 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-31T06:57:26.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:57:26.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-31T06:57:26.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:25 smithi106 ceph-mon[22134]: pgmap v647: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 6 op/s 2024-08-31T06:57:26.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:25 smithi037 ceph-mon[18612]: pgmap v647: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 6 op/s 2024-08-31T06:57:26.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-31T06:57:26.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-08-31T06:57:26.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:25 smithi066 ceph-mon[22244]: pgmap v647: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 6 op/s 2024-08-31T06:57:26.227 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-31T06:57:26.238 INFO:tasks.cephadm:Teardown begin 2024-08-31T06:57:26.238 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-31T06:57:26.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:57:26.495 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.012+0000 7f4931f9e640 1 -- 172.21.15.37:0/2856084396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c102810 msgr2=0x7f492c102c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.012+0000 7f4931f9e640 1 --2- 172.21.15.37:0/2856084396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c102810 0x7f492c102c20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f491c009900 tx=0x7f491c02a410 comp rx=0 tx=0).stop 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 -- 172.21.15.37:0/2856084396 shutdown_connections 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 --2- 172.21.15.37:0/2856084396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f492c108aa0 0x7f492c10f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 --2- 172.21.15.37:0/2856084396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f492c108150 0x7f492c108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 --2- 172.21.15.37:0/2856084396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c102810 0x7f492c102c20 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 -- 172.21.15.37:0/2856084396 >> 172.21.15.37:0/2856084396 conn(0x7f492c0794b0 msgr2=0x7f492c0798c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 -- 172.21.15.37:0/2856084396 shutdown_connections 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 -- 172.21.15.37:0/2856084396 wait complete. 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 Processor -- start 2024-08-31T06:57:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.013+0000 7f4931f9e640 1 -- start start 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4931f9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f492c102810 0x7f492c199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4931f9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c108150 0x7f492c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4931f9e640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f492c108aa0 0x7f492c19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4931f9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f492c112600 con 0x7f492c108150 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4931f9e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f492c112480 con 0x7f492c102810 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4931f9e640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f492c112780 con 0x7f492c108aa0 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c108150 0x7f492c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c108150 0x7f492c199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56826/0 (socket says 172.21.15.37:56826) 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 -- 172.21.15.37:0/404850070 learned_addr learned my addr 172.21.15.37:0/404850070 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f492bfff640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f492c108aa0 0x7f492c19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f492b7fe640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f492c102810 0x7f492c199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 -- 172.21.15.37:0/404850070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f492c108aa0 msgr2=0x7f492c19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f492c108aa0 0x7f492c19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 -- 172.21.15.37:0/404850070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f492c102810 msgr2=0x7f492c199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f492c102810 0x7f492c199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 -- 172.21.15.37:0/404850070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c19f000 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4923fff640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c108150 0x7f492c199630 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f491400d740 tx=0x7f491400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f49297fa640 1 -- 172.21.15.37:0/404850070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4914017070 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c19f2f0 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f49297fa640 1 -- 172.21.15.37:0/404850070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f491400de50 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.014+0000 7f49297fa640 1 -- 172.21.15.37:0/404850070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491400f620 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.015+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c06b920 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.016+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c103a90 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.017+0000 7f49297fa640 1 -- 172.21.15.37:0/404850070 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f491401a070 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.018+0000 7f49297fa640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49180b4ca0 0x7f49180b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.018+0000 7f492b7fe640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49180b4ca0 0x7f49180b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.018+0000 7f49297fa640 1 -- 172.21.15.37:0/404850070 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8499+0+0 (secure 0 0 0) 0x7f49140e4f30 con 0x7f492c108150 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.018+0000 7f492b7fe640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49180b4ca0 0x7f49180b71b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f491c000c00 tx=0x7f491c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:27.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.021+0000 7f49297fa640 1 -- 172.21.15.37:0/404850070 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f49140abd30 con 0x7f492c108150 2024-08-31T06:57:27.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.244+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f492c102c20 con 0x7f492c108150 2024-08-31T06:57:27.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.245+0000 7f49297fa640 1 -- 172.21.15.37:0/404850070 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f49140b4270 con 0x7f492c108150 2024-08-31T06:57:27.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:57:27.247 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:57:27.248 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:57:27.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49180b4ca0 msgr2=0x7f49180b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:27.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49180b4ca0 0x7f49180b71b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f491c000c00 tx=0x7f491c009680 comp rx=0 tx=0).stop 2024-08-31T06:57:27.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c108150 msgr2=0x7f492c199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c108150 0x7f492c199630 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f491400d740 tx=0x7f491400dc00 comp rx=0 tx=0).stop 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 shutdown_connections 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f49180b4ca0 0x7f49180b71b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f492c108150 0x7f492c199630 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f492c108aa0 0x7f492c19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 --2- 172.21.15.37:0/404850070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f492c102810 0x7f492c199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.247+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 >> 172.21.15.37:0/404850070 conn(0x7f492c0794b0 msgr2=0x7f492c106340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.248+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 shutdown_connections 2024-08-31T06:57:27.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:27.248+0000 7f4931f9e640 1 -- 172.21.15.37:0/404850070 wait complete. 2024-08-31T06:57:27.828 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:27 smithi037 ceph-mon[18612]: pgmap v648: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 7 op/s 2024-08-31T06:57:27.828 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:27 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/404850070' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:57:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:27 smithi106 ceph-mon[22134]: pgmap v648: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 7 op/s 2024-08-31T06:57:28.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:27 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/404850070' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:57:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:27 smithi066 ceph-mon[22244]: pgmap v648: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 716 B/s wr, 7 op/s 2024-08-31T06:57:28.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:27 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/404850070' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:57:28.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs dump --format=json 2024-08-31T06:57:28.491 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 -- 172.21.15.37:0/2518700916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 msgr2=0x7f5c54103d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 --2- 172.21.15.37:0/2518700916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 0x7f5c54103d10 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009900 tx=0x7f5c4402a410 comp rx=0 tx=0).stop 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 -- 172.21.15.37:0/2518700916 shutdown_connections 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 --2- 172.21.15.37:0/2518700916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c54109b90 0x7f5c541103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 --2- 172.21.15.37:0/2518700916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c54109240 0x7f5c54109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 --2- 172.21.15.37:0/2518700916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 0x7f5c54103d10 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 -- 172.21.15.37:0/2518700916 >> 172.21.15.37:0/2518700916 conn(0x7f5c5407b5f0 msgr2=0x7f5c5407ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 -- 172.21.15.37:0/2518700916 shutdown_connections 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.980+0000 7f5c5988d640 1 -- 172.21.15.37:0/2518700916 wait complete. 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.981+0000 7f5c5988d640 1 Processor -- start 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.981+0000 7f5c5988d640 1 -- start start 2024-08-31T06:57:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c5988d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 0x7f5c540754b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c5988d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c54109240 0x7f5c540759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c5988d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c54109b90 0x7f5c54075f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c5988d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54113700 con 0x7f5c54103900 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c5988d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54113580 con 0x7f5c54109240 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c5988d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f5c54113880 con 0x7f5c54109b90 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c52ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 0x7f5c540754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c52ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 0x7f5c540754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56838/0 (socket says 172.21.15.37:56838) 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c52ffd640 1 -- 172.21.15.37:0/3989741299 learned_addr learned my addr 172.21.15.37:0/3989741299 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c527fc640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c54109240 0x7f5c540759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c537fe640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c54109b90 0x7f5c54075f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c52ffd640 1 -- 172.21.15.37:0/3989741299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c54109b90 msgr2=0x7f5c54075f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c52ffd640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c54109b90 0x7f5c54075f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c52ffd640 1 -- 172.21.15.37:0/3989741299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c54109240 msgr2=0x7f5c540759f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c52ffd640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c54109240 0x7f5c540759f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.982+0000 7f5c52ffd640 1 -- 172.21.15.37:0/3989741299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c541a83e0 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.983+0000 7f5c52ffd640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 0x7f5c540754b0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009230 tx=0x7f5c44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.983+0000 7f5c5888b640 1 -- 172.21.15.37:0/3989741299 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4403f030 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.983+0000 7f5c5888b640 1 -- 172.21.15.37:0/3989741299 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c44003a80 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.983+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c541a8670 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.983+0000 7f5c5888b640 1 -- 172.21.15.37:0/3989741299 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44035070 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.983+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c541a8b50 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.984+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c54103d10 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.985+0000 7f5c5888b640 1 -- 172.21.15.37:0/3989741299 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f5c44042030 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.986+0000 7f5c5888b640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5c3c0b4ca0 0x7f5c3c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.987+0000 7f5c527fc640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5c3c0b4ca0 0x7f5c3c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.987+0000 7f5c5888b640 1 -- 172.21.15.37:0/3989741299 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8499+0+0 (secure 0 0 0) 0x7f5c441061e0 con 0x7f5c54103900 2024-08-31T06:57:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.987+0000 7f5c527fc640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5c3c0b4ca0 0x7f5c3c0b71b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5c48007350 tx=0x7f5c480072e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:28.990+0000 7f5c5888b640 1 -- 172.21.15.37:0/3989741299 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f5c440ccfe0 con 0x7f5c54103900 2024-08-31T06:57:29.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.212+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c540767b0 con 0x7f5c54103900 2024-08-31T06:57:29.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.212+0000 7f5c5888b640 1 -- 172.21.15.37:0/3989741299 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f5c440cc8e0 con 0x7f5c54103900 2024-08-31T06:57:29.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:57:29.215 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"btime":"2024-08-31T06:46:32:394354+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/305823266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":305823266},{"type":"v1","addr":"172.21.15.66:6833","nonce":305823266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14772,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2503140035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2503140035},{"type":"v1","addr":"172.21.15.37:6835","nonce":2503140035}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14784,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/103394929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":103394929},{"type":"v1","addr":"172.21.15.37:6837","nonce":103394929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14841,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/4551184","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":4551184},{"type":"v1","addr":"172.21.15.37:6839","nonce":4551184}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14853,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/407340451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":407340451},{"type":"v1","addr":"172.21.15.37:6841","nonce":407340451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24601,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6833/1558689933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":1558689933},{"type":"v1","addr":"172.21.15.106:6833","nonce":1558689933}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-31T06:44:43.326015+0000","modified":"2024-08-31T06:46:31.653316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24695,"mds_1":24658,"mds_2":24656},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24629":{"gid":24629,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.66:6835/298046856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":298046856},{"type":"v1","addr":"172.21.15.66:6835","nonce":298046856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6835/2636907745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2636907745},{"type":"v1","addr":"172.21.15.106:6835","nonce":2636907745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24643":{"gid":24643,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.106:6837/1095097353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1095097353},{"type":"v1","addr":"172.21.15.106:6837","nonce":1095097353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.66:6837/3257187794","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6836","nonce":3257187794},{"type":"v1","addr":"172.21.15.66:6837","nonce":3257187794}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24658":{"gid":24658,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.106:6839/1806859517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6838","nonce":1806859517},{"type":"v1","addr":"172.21.15.106:6839","nonce":1806859517}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6839/2855667585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6838","nonce":2855667585},{"type":"v1","addr":"172.21.15.66:6839","nonce":2855667585}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24658,24695,24656]},"id":1}]} 2024-08-31T06:57:29.215 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-08-31T06:57:29.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.214+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5c3c0b4ca0 msgr2=0x7f5c3c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5c3c0b4ca0 0x7f5c3c0b71b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5c48007350 tx=0x7f5c480072e0 comp rx=0 tx=0).stop 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 msgr2=0x7f5c540754b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 0x7f5c540754b0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009230 tx=0x7f5c44004270 comp rx=0 tx=0).stop 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 shutdown_connections 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f5c3c0b4ca0 0x7f5c3c0b71b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5c54109b90 0x7f5c54075f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c54109240 0x7f5c540759f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 --2- 172.21.15.37:0/3989741299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c54103900 0x7f5c540754b0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 >> 172.21.15.37:0/3989741299 conn(0x7f5c5407b5f0 msgr2=0x7f5c541073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 shutdown_connections 2024-08-31T06:57:29.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:29.215+0000 7f5c5988d640 1 -- 172.21.15.37:0/3989741299 wait complete. 2024-08-31T06:57:29.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd dump --format=json 2024-08-31T06:57:30.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:29 smithi106 ceph-mon[22134]: pgmap v649: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 610 B/s wr, 7 op/s 2024-08-31T06:57:30.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:29 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3989741299' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:57:30.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:29 smithi037 ceph-mon[18612]: pgmap v649: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 610 B/s wr, 7 op/s 2024-08-31T06:57:30.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:29 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3989741299' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:57:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:29 smithi066 ceph-mon[22244]: pgmap v649: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 610 B/s wr, 7 op/s 2024-08-31T06:57:30.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:29 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3989741299' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-31T06:57:30.157 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:30.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 -- 172.21.15.37:0/3095683361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54103920 msgr2=0x7efe54103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:30.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 --2- 172.21.15.37:0/3095683361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54103920 0x7efe54103d30 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7efe44009900 tx=0x7efe4402a410 comp rx=0 tx=0).stop 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 -- 172.21.15.37:0/3095683361 shutdown_connections 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 --2- 172.21.15.37:0/3095683361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe54109bb0 0x7efe541103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 --2- 172.21.15.37:0/3095683361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe54109260 0x7efe54109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 --2- 172.21.15.37:0/3095683361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54103920 0x7efe54103d30 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 -- 172.21.15.37:0/3095683361 >> 172.21.15.37:0/3095683361 conn(0x7efe540ff330 msgr2=0x7efe54101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 -- 172.21.15.37:0/3095683361 shutdown_connections 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 -- 172.21.15.37:0/3095683361 wait complete. 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.596+0000 7efe5a461640 1 Processor -- start 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe5a461640 1 -- start start 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe5a461640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe54103920 0x7efe5419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe5a461640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe54109260 0x7efe5419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe5a461640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54109bb0 0x7efe5419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe5a461640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe54113770 con 0x7efe54109bb0 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe5a461640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7efe541135f0 con 0x7efe54109260 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe5a461640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7efe541138f0 con 0x7efe54103920 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe589fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54109bb0 0x7efe5419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe589fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54109bb0 0x7efe5419fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56844/0 (socket says 172.21.15.37:56844) 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe589fe640 1 -- 172.21.15.37:0/2172652182 learned_addr learned my addr 172.21.15.37:0/2172652182 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe537fe640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe54109260 0x7efe5419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.597+0000 7efe53fff640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe54103920 0x7efe5419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe589fe640 1 -- 172.21.15.37:0/2172652182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe54103920 msgr2=0x7efe5419a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe589fe640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe54103920 0x7efe5419a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe589fe640 1 -- 172.21.15.37:0/2172652182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe54109260 msgr2=0x7efe5419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe589fe640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe54109260 0x7efe5419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe589fe640 1 -- 172.21.15.37:0/2172652182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe541a0190 con 0x7efe54109bb0 2024-08-31T06:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe589fe640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54109bb0 0x7efe5419fa60 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00eaa0 tx=0x7efe4c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe517fa640 1 -- 172.21.15.37:0/2172652182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c00cdb0 con 0x7efe54109bb0 2024-08-31T06:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe541a0480 con 0x7efe54109bb0 2024-08-31T06:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe517fa640 1 -- 172.21.15.37:0/2172652182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe4c005020 con 0x7efe54109bb0 2024-08-31T06:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe517fa640 1 -- 172.21.15.37:0/2172652182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0116d0 con 0x7efe54109bb0 2024-08-31T06:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.598+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe541a6be0 con 0x7efe54109bb0 2024-08-31T06:57:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.599+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe54103d30 con 0x7efe54109bb0 2024-08-31T06:57:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.602+0000 7efe517fa640 1 -- 172.21.15.37:0/2172652182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7efe4c0051d0 con 0x7efe54109bb0 2024-08-31T06:57:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.602+0000 7efe517fa640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe3c0b4ca0 0x7efe3c0b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.603+0000 7efe53fff640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe3c0b4ca0 0x7efe3c0b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.603+0000 7efe517fa640 1 -- 172.21.15.37:0/2172652182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8499+0+0 (secure 0 0 0) 0x7efe4c0e59f0 con 0x7efe54109bb0 2024-08-31T06:57:30.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.603+0000 7efe53fff640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe3c0b4ca0 0x7efe3c0b71b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efe44006010 tx=0x7efe44000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:30.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.607+0000 7efe517fa640 1 -- 172.21.15.37:0/2172652182 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7efe4c016030 con 0x7efe54109bb0 2024-08-31T06:57:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.796+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe5419b350 con 0x7efe54109bb0 2024-08-31T06:57:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.797+0000 7efe517fa640 1 -- 172.21.15.37:0/2172652182 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+23139 (secure 0 0 0) 0x7efe5419b350 con 0x7efe54109bb0 2024-08-31T06:57:30.800 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-31T06:57:30.800 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"22785f22-6763-11ef-bcd4-c7b262605968","created":"2024-08-31T06:36:16.871510+0000","modified":"2024-08-31T06:57:16.746900+0000","last_up_change":"2024-08-31T06:43:53.668930+0000","last_in_change":"2024-08-31T06:43:31.669573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-31T06:40:10.611808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-31T06:44:39.177728+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-31T06:44:41.318390+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded8d651-8305-4924-9bde-2e31cc2d088b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6803","nonce":1467269550}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6805","nonce":1467269550}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6809","nonce":1467269550}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":1467269550},{"type":"v1","addr":"172.21.15.37:6807","nonce":1467269550}]},"public_addr":"172.21.15.37:6803/1467269550","cluster_addr":"172.21.15.37:6805/1467269550","heartbeat_back_addr":"172.21.15.37:6809/1467269550","heartbeat_front_addr":"172.21.15.37:6807/1467269550","state":["exists","up"]},{"osd":1,"uuid":"b0189860-11da-4ba3-8356-3fddf0991b0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6801","nonce":2563390022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6803","nonce":2563390022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6807","nonce":2563390022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2563390022},{"type":"v1","addr":"172.21.15.66:6805","nonce":2563390022}]},"public_addr":"172.21.15.66:6801/2563390022","cluster_addr":"172.21.15.66:6803/2563390022","heartbeat_back_addr":"172.21.15.66:6807/2563390022","heartbeat_front_addr":"172.21.15.66:6805/2563390022","state":["exists","up"]},{"osd":2,"uuid":"62bc8710-4647-4a53-8009-cc6ceb86e34a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6801","nonce":863127215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6803","nonce":863127215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6807","nonce":863127215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":863127215},{"type":"v1","addr":"172.21.15.106:6805","nonce":863127215}]},"public_addr":"172.21.15.106:6801/863127215","cluster_addr":"172.21.15.106:6803/863127215","heartbeat_back_addr":"172.21.15.106:6807/863127215","heartbeat_front_addr":"172.21.15.106:6805/863127215","state":["exists","up"]},{"osd":3,"uuid":"1ed7aadd-17fe-413c-a360-6d43f4697865","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6811","nonce":2145517998}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6813","nonce":2145517998}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6817","nonce":2145517998}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2145517998},{"type":"v1","addr":"172.21.15.37:6815","nonce":2145517998}]},"public_addr":"172.21.15.37:6811/2145517998","cluster_addr":"172.21.15.37:6813/2145517998","heartbeat_back_addr":"172.21.15.37:6817/2145517998","heartbeat_front_addr":"172.21.15.37:6815/2145517998","state":["exists","up"]},{"osd":4,"uuid":"31f6e880-6ba2-491b-ace7-c98e9eab42b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6809","nonce":3848335265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6811","nonce":3848335265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6815","nonce":3848335265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":3848335265},{"type":"v1","addr":"172.21.15.66:6813","nonce":3848335265}]},"public_addr":"172.21.15.66:6809/3848335265","cluster_addr":"172.21.15.66:6811/3848335265","heartbeat_back_addr":"172.21.15.66:6815/3848335265","heartbeat_front_addr":"172.21.15.66:6813/3848335265","state":["exists","up"]},{"osd":5,"uuid":"673f5b17-3d81-4124-a3c0-cde3e717639e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6809","nonce":1132176908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6811","nonce":1132176908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6815","nonce":1132176908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":1132176908},{"type":"v1","addr":"172.21.15.106:6813","nonce":1132176908}]},"public_addr":"172.21.15.106:6809/1132176908","cluster_addr":"172.21.15.106:6811/1132176908","heartbeat_back_addr":"172.21.15.106:6815/1132176908","heartbeat_front_addr":"172.21.15.106:6813/1132176908","state":["exists","up"]},{"osd":6,"uuid":"b5ef0fd9-5a3c-4a0d-a0ab-a53930e9ae25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6819","nonce":1599298553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6821","nonce":1599298553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6825","nonce":1599298553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1599298553},{"type":"v1","addr":"172.21.15.37:6823","nonce":1599298553}]},"public_addr":"172.21.15.37:6819/1599298553","cluster_addr":"172.21.15.37:6821/1599298553","heartbeat_back_addr":"172.21.15.37:6825/1599298553","heartbeat_front_addr":"172.21.15.37:6823/1599298553","state":["exists","up"]},{"osd":7,"uuid":"14c76b06-4472-44a9-8c2c-76f68ce298b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6817","nonce":1684993072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6819","nonce":1684993072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6823","nonce":1684993072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":1684993072},{"type":"v1","addr":"172.21.15.66:6821","nonce":1684993072}]},"public_addr":"172.21.15.66:6817/1684993072","cluster_addr":"172.21.15.66:6819/1684993072","heartbeat_back_addr":"172.21.15.66:6823/1684993072","heartbeat_front_addr":"172.21.15.66:6821/1684993072","state":["exists","up"]},{"osd":8,"uuid":"bea2e85a-3910-4109-845e-556410d644b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6817","nonce":638315270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6819","nonce":638315270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6823","nonce":638315270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":638315270},{"type":"v1","addr":"172.21.15.106:6821","nonce":638315270}]},"public_addr":"172.21.15.106:6817/638315270","cluster_addr":"172.21.15.106:6819/638315270","heartbeat_back_addr":"172.21.15.106:6823/638315270","heartbeat_front_addr":"172.21.15.106:6821/638315270","state":["exists","up"]},{"osd":9,"uuid":"5c4c51ea-50dc-4c66-b1d9-df31b57d49fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6827","nonce":2705884500}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6829","nonce":2705884500}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6833","nonce":2705884500}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2705884500},{"type":"v1","addr":"172.21.15.37:6831","nonce":2705884500}]},"public_addr":"172.21.15.37:6827/2705884500","cluster_addr":"172.21.15.37:6829/2705884500","heartbeat_back_addr":"172.21.15.37:6833/2705884500","heartbeat_front_addr":"172.21.15.37:6831/2705884500","state":["exists","up"]},{"osd":10,"uuid":"efb68c30-0c02-405f-a72f-27e68fafd2dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6825","nonce":2946007622}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6827","nonce":2946007622}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6831","nonce":2946007622}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":2946007622},{"type":"v1","addr":"172.21.15.66:6829","nonce":2946007622}]},"public_addr":"172.21.15.66:6825/2946007622","cluster_addr":"172.21.15.66:6827/2946007622","heartbeat_back_addr":"172.21.15.66:6831/2946007622","heartbeat_front_addr":"172.21.15.66:6829/2946007622","state":["exists","up"]},{"osd":11,"uuid":"da1db38f-04d8-4166-bc6a-fe685341d706","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6825","nonce":2963314896}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6827","nonce":2963314896}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6831","nonce":2963314896}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2963314896},{"type":"v1","addr":"172.21.15.106:6829","nonce":2963314896}]},"public_addr":"172.21.15.106:6825/2963314896","cluster_addr":"172.21.15.106:6827/2963314896","heartbeat_back_addr":"172.21.15.106:6831/2963314896","heartbeat_front_addr":"172.21.15.106:6829/2963314896","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:19.582899+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:39:44.601618+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:08.580044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:34.606970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:40:59.547392+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:23.686500+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:41:48.028152+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:13.262624+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:42:37.230712+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:03.238621+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:28.774812+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-31T06:43:52.568963+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6801/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2470001977":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6800/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/927770183":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2248986445":"2024-09-01T06:36:48.914944+0000","172.21.15.37:0/2568176479":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/1863763988":"2024-09-01T06:36:48.914944+0000","172.21.15.37:6801/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/1769436059":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/644899001":"2024-09-01T06:37:14.112103+0000","172.21.15.37:0/3538486341":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/3404040012":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/2862953179":"2024-09-01T06:37:14.112103+0000","172.21.15.37:6800/3700278983":"2024-09-01T06:38:18.150139+0000","172.21.15.37:0/1887643079":"2024-09-01T06:38:18.150139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-31T06:57:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe3c0b4ca0 msgr2=0x7efe3c0b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe3c0b4ca0 0x7efe3c0b71b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7efe44006010 tx=0x7efe44000bc0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54109bb0 msgr2=0x7efe5419fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54109bb0 0x7efe5419fa60 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00eaa0 tx=0x7efe4c00ef60 comp rx=0 tx=0).stop 2024-08-31T06:57:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 shutdown_connections 2024-08-31T06:57:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7efe3c0b4ca0 0x7efe3c0b71b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe54109bb0 0x7efe5419fa60 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe54109260 0x7efe5419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 --2- 172.21.15.37:0/2172652182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe54103920 0x7efe5419a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 >> 172.21.15.37:0/2172652182 conn(0x7efe540ff330 msgr2=0x7efe54107a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 shutdown_connections 2024-08-31T06:57:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:30.800+0000 7efe5a461640 1 -- 172.21.15.37:0/2172652182 wait complete. 2024-08-31T06:57:31.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs fail cephfs 2024-08-31T06:57:31.716 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:32.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:31 smithi106 ceph-mon[22134]: pgmap v650: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:57:32.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:31 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/2172652182' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:57:32.098 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:31 smithi037 ceph-mon[18612]: pgmap v650: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:57:32.098 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:31 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/2172652182' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:57:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:31 smithi066 ceph-mon[22244]: pgmap v650: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-31T06:57:32.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:31 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/2172652182' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-31T06:57:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.188+0000 7f6f3a82f640 1 -- 172.21.15.37:0/1267917458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 msgr2=0x7f6f34102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.188+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/1267917458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 0x7f6f34102c50 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009900 tx=0x7f6f2402a410 comp rx=0 tx=0).stop 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 -- 172.21.15.37:0/1267917458 shutdown_connections 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/1267917458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f34108ad0 0x7f6f3410f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/1267917458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f34108180 0x7f6f34108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/1267917458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 0x7f6f34102c50 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 -- 172.21.15.37:0/1267917458 >> 172.21.15.37:0/1267917458 conn(0x7f6f340794f0 msgr2=0x7f6f34079900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 -- 172.21.15.37:0/1267917458 shutdown_connections 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 -- 172.21.15.37:0/1267917458 wait complete. 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 Processor -- start 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.189+0000 7f6f3a82f640 1 -- start start 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f3a82f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 0x7f6f3419a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f3a82f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f34108180 0x7f6f3419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f3a82f640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f34108ad0 0x7f6f3419f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f3a82f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f34112680 con 0x7f6f34102840 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f3a82f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f6f34112500 con 0x7f6f34108180 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f3a82f640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f6f34112800 con 0x7f6f34108ad0 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 0x7f6f3419a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 0x7f6f3419a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56864/0 (socket says 172.21.15.37:56864) 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 -- 172.21.15.37:0/3989137428 learned_addr learned my addr 172.21.15.37:0/3989137428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f337fe640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f34108180 0x7f6f3419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 -- 172.21.15.37:0/3989137428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f34108ad0 msgr2=0x7f6f3419f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f38dcc640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f34108ad0 0x7f6f3419f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f34108ad0 0x7f6f3419f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 -- 172.21.15.37:0/3989137428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f34108180 msgr2=0x7f6f3419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f34108180 0x7f6f3419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 -- 172.21.15.37:0/3989137428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f341a0010 con 0x7f6f34102840 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.190+0000 7f6f33fff640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 0x7f6f3419a160 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f6f2402a930 tx=0x7f6f24003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.191+0000 7f6f317fa640 1 -- 172.21.15.37:0/3989137428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2403f070 con 0x7f6f34102840 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.191+0000 7f6f317fa640 1 -- 172.21.15.37:0/3989137428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6f24003e40 con 0x7f6f34102840 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.191+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f341a02a0 con 0x7f6f34102840 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.191+0000 7f6f317fa640 1 -- 172.21.15.37:0/3989137428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24035030 con 0x7f6f34102840 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.191+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f341a0780 con 0x7f6f34102840 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.192+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f34103ac0 con 0x7f6f34102840 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.194+0000 7f6f317fa640 1 -- 172.21.15.37:0/3989137428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f6f24042070 con 0x7f6f34102840 2024-08-31T06:57:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.195+0000 7f6f317fa640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f1c0b4cd0 0x7f6f1c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.195+0000 7f6f337fe640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f1c0b4cd0 0x7f6f1c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.195+0000 7f6f317fa640 1 -- 172.21.15.37:0/3989137428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8499+0+0 (secure 0 0 0) 0x7f6f24106130 con 0x7f6f34102840 2024-08-31T06:57:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.195+0000 7f6f337fe640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f1c0b4cd0 0x7f6f1c0b71e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6f34079a20 tx=0x7f6f2800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.198+0000 7f6f317fa640 1 -- 172.21.15.37:0/3989137428 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f6f240ccf30 con 0x7f6f34102840 2024-08-31T06:57:32.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.420+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6f3419b290 con 0x7f6f34102840 2024-08-31T06:57:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.423+0000 7f6f317fa640 1 -- 172.21.15.37:0/3989137428 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f6f3419b290 con 0x7f6f34102840 2024-08-31T06:57:32.423 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-31T06:57:32.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.425+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f1c0b4cd0 msgr2=0x7f6f1c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.425+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f1c0b4cd0 0x7f6f1c0b71e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6f34079a20 tx=0x7f6f2800a2d0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.425+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 msgr2=0x7f6f3419a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.425+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 0x7f6f3419a160 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f6f2402a930 tx=0x7f6f24003c20 comp rx=0 tx=0).stop 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.426+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 shutdown_connections 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.426+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f6f1c0b4cd0 0x7f6f1c0b71e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.426+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f34108ad0 0x7f6f3419f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.426+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f34108180 0x7f6f3419a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.426+0000 7f6f3a82f640 1 --2- 172.21.15.37:0/3989137428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f34102840 0x7f6f3419a160 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.426+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 >> 172.21.15.37:0/3989137428 conn(0x7f6f340794f0 msgr2=0x7f6f341018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.426+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 shutdown_connections 2024-08-31T06:57:32.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:32.426+0000 7f6f3a82f640 1 -- 172.21.15.37:0/3989137428 wait complete. 2024-08-31T06:57:32.772 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a[18608]: 2024-08-31T06:57:32.421+0000 7f8aec6b1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T06:57:32.773 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b[52802]: ignoring --setuser ceph since I am not root 2024-08-31T06:57:32.773 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b[52802]: ignoring --setgroup ceph since I am not root 2024-08-31T06:57:32.773 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mds[52814]: -- 172.21.15.66:0/832109225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5626963cb860 con 0x56269a571180 2024-08-31T06:57:32.774 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b[52802]: starting mds.b at 2024-08-31T06:57:32.774 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c[53678]: ignoring --setuser ceph since I am not root 2024-08-31T06:57:32.774 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c[53678]: ignoring --setgroup ceph since I am not root 2024-08-31T06:57:32.774 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mds[53682]: -- 172.21.15.106:0/971978521 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55af13959860 con 0x55af17aff180 2024-08-31T06:57:32.774 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c[53678]: starting mds.c at 2024-08-31T06:57:32.775 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e[52198]: ignoring --setuser ceph since I am not root 2024-08-31T06:57:32.775 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e[52198]: ignoring --setgroup ceph since I am not root 2024-08-31T06:57:32.775 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mds[52202]: -- 172.21.15.66:0/4040482067 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a04345c20 con 0x559a084eb180 2024-08-31T06:57:32.775 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e[52198]: starting mds.e at 2024-08-31T06:57:32.775 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f[53378]: ignoring --setuser ceph since I am not root 2024-08-31T06:57:32.775 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f[53378]: ignoring --setgroup ceph since I am not root 2024-08-31T06:57:32.775 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mds[53382]: -- 172.21.15.106:0/643229574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56233d0e3860 con 0x562341289180 2024-08-31T06:57:32.775 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f[53378]: starting mds.f at 2024-08-31T06:57:32.776 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h[52501]: ignoring --setuser ceph since I am not root 2024-08-31T06:57:32.776 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h[52501]: ignoring --setgroup ceph since I am not root 2024-08-31T06:57:32.776 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mds[52505]: -- 172.21.15.66:0/1580712410 <== mon.2 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fa6091c20 con 0x563faa237180 2024-08-31T06:57:32.776 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h[52501]: starting mds.h at 2024-08-31T06:57:32.776 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i[53980]: ignoring --setuser ceph since I am not root 2024-08-31T06:57:32.776 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i[53980]: ignoring --setgroup ceph since I am not root 2024-08-31T06:57:32.776 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mds[53984]: -- 172.21.15.106:0/144162025 <== mon.1 v2:172.21.15.106:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558a99113860 con 0x558a9d2b9180 2024-08-31T06:57:32.776 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i[53980]: starting mds.i at 2024-08-31T06:57:33.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3989137428' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T06:57:33.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mon[22134]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T06:57:33.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mon[22134]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T06:57:33.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3989137428' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T06:57:33.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mon[22134]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T06:57:33.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:32 smithi106 ceph-mon[22134]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-31T06:57:33.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:32 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3989137428' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T06:57:33.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:32 smithi037 ceph-mon[18612]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T06:57:33.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:32 smithi037 ceph-mon[18612]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T06:57:33.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:32 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3989137428' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T06:57:33.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:32 smithi037 ceph-mon[18612]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T06:57:33.105 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:32 smithi037 ceph-mon[18612]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-31T06:57:33.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3989137428' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-31T06:57:33.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mon[22244]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-31T06:57:33.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mon[22244]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-31T06:57:33.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3989137428' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-31T06:57:33.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mon[22244]: osdmap e87: 12 total, 12 up, 12 in 2024-08-31T06:57:33.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:32 smithi066 ceph-mon[22244]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-31T06:57:33.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-31T06:57:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:33.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 -- 172.21.15.37:0/482009959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738108160 msgr2=0x7f7738108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 --2- 172.21.15.37:0/482009959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738108160 0x7f7738108570 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f772c009900 tx=0x7f772c02a3f0 comp rx=0 tx=0).stop 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 -- 172.21.15.37:0/482009959 shutdown_connections 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 --2- 172.21.15.37:0/482009959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738108160 0x7f7738108570 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 --2- 172.21.15.37:0/482009959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7738108ab0 0x7f773810f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 --2- 172.21.15.37:0/482009959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7738102820 0x7f7738102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 -- 172.21.15.37:0/482009959 >> 172.21.15.37:0/482009959 conn(0x7f77380794e0 msgr2=0x7f77380798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 -- 172.21.15.37:0/482009959 shutdown_connections 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.858+0000 7f773f117640 1 -- 172.21.15.37:0/482009959 wait complete. 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773f117640 1 Processor -- start 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773f117640 1 -- start start 2024-08-31T06:57:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773f117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738102820 0x7f773819a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773f117640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7738108160 0x7f773819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773f117640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7738108ab0 0x7f773819f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773f117640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7738112590 con 0x7f7738102820 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773f117640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f7738112410 con 0x7f7738108160 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773f117640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f7738112710 con 0x7f7738108ab0 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773ceb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738102820 0x7f773819a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773ceb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738102820 0x7f773819a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56876/0 (socket says 172.21.15.37:56876) 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f773ceb3640 1 -- 172.21.15.37:0/3431135060 learned_addr learned my addr 172.21.15.37:0/3431135060 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.859+0000 7f7737fff640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7738108160 0x7f773819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773d6b4640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7738108ab0 0x7f773819f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773ceb3640 1 -- 172.21.15.37:0/3431135060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7738108ab0 msgr2=0x7f773819f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773ceb3640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7738108ab0 0x7f773819f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773ceb3640 1 -- 172.21.15.37:0/3431135060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7738108160 msgr2=0x7f773819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773ceb3640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7738108160 0x7f773819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773ceb3640 1 -- 172.21.15.37:0/3431135060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77381a0040 con 0x7f7738102820 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773ceb3640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738102820 0x7f773819a190 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f772800c920 tx=0x7f772800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f7735ffb640 1 -- 172.21.15.37:0/3431135060 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728007c70 con 0x7f7738102820 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f7735ffb640 1 -- 172.21.15.37:0/3431135060 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7728007e10 con 0x7f7738102820 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f7735ffb640 1 -- 172.21.15.37:0/3431135060 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728018710 con 0x7f7738102820 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77381a0330 con 0x7f7738102820 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.860+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77381a6b50 con 0x7f7738102820 2024-08-31T06:57:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.861+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7738103aa0 con 0x7f7738102820 2024-08-31T06:57:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.863+0000 7f7735ffb640 1 -- 172.21.15.37:0/3431135060 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f772800f450 con 0x7f7738102820 2024-08-31T06:57:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.864+0000 7f7735ffb640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77200b4cd0 0x7f77200b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.864+0000 7f7737fff640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77200b4cd0 0x7f77200b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.864+0000 7f7735ffb640 1 -- 172.21.15.37:0/3431135060 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8713+0+0 (secure 0 0 0) 0x7f77280e57b0 con 0x7f7738102820 2024-08-31T06:57:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.864+0000 7f7737fff640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77200b4cd0 0x7f77200b71e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f772c005ec0 tx=0x7f772c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:33.868+0000 7f7735ffb640 1 -- 172.21.15.37:0/3431135060 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f7728014030 con 0x7f7738102820 2024-08-31T06:57:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: pgmap v652: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:57:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.106:6834/3755584390,v1:172.21.15.106:6836/3755584390] up:boot 2024-08-31T06:57:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.106:6835/1224896384,v1:172.21.15.106:6837/1224896384] up:boot 2024-08-31T06:57:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6834/1553714235,v1:172.21.15.66:6835/1553714235] up:boot 2024-08-31T06:57:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.106:6838/3714325001,v1:172.21.15.106:6839/3714325001] up:boot 2024-08-31T06:57:34.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6836/3800083074,v1:172.21.15.66:6837/3800083074] up:boot 2024-08-31T06:57:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: mds.? [v2:172.21.15.66:6838/595417661,v1:172.21.15.66:6839/595417661] up:boot 2024-08-31T06:57:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-31T06:57:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:57:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:57:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:57:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:57:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:57:34.066 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:33 smithi106 ceph-mon[22134]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:57:34.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.091+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7738102c30 con 0x7f7738102820 2024-08-31T06:57:34.092 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: pgmap v652: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.106:6834/3755584390,v1:172.21.15.106:6836/3755584390] up:boot 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.106:6835/1224896384,v1:172.21.15.106:6837/1224896384] up:boot 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6834/1553714235,v1:172.21.15.66:6835/1553714235] up:boot 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.106:6838/3714325001,v1:172.21.15.106:6839/3714325001] up:boot 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6836/3800083074,v1:172.21.15.66:6837/3800083074] up:boot 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: mds.? [v2:172.21.15.66:6838/595417661,v1:172.21.15.66:6839/595417661] up:boot 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:57:34.093 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:57:34.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:57:34.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:57:34.094 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:33 smithi037 ceph-mon[18612]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: pgmap v652: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.106:6834/3755584390,v1:172.21.15.106:6836/3755584390] up:boot 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.106:6835/1224896384,v1:172.21.15.106:6837/1224896384] up:boot 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6834/1553714235,v1:172.21.15.66:6835/1553714235] up:boot 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.106:6838/3714325001,v1:172.21.15.106:6839/3714325001] up:boot 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6836/3800083074,v1:172.21.15.66:6837/3800083074] up:boot 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: mds.? [v2:172.21.15.66:6838/595417661,v1:172.21.15.66:6839/595417661] up:boot 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-31T06:57:34.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-31T06:57:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-31T06:57:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-31T06:57:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-31T06:57:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-31T06:57:34.138 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:33 smithi066 ceph-mon[22244]: from='mgr.14223 172.21.15.37:0/4260031586' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-31T06:57:34.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.779+0000 7f7735ffb640 1 -- 172.21.15.37:0/3431135060 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f77280ac4e0 con 0x7f7738102820 2024-08-31T06:57:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77200b4cd0 msgr2=0x7f77200b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77200b4cd0 0x7f77200b71e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f772c005ec0 tx=0x7f772c0058d0 comp rx=0 tx=0).stop 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738102820 msgr2=0x7f773819a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738102820 0x7f773819a190 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f772800c920 tx=0x7f772800cde0 comp rx=0 tx=0).stop 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 shutdown_connections 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f77200b4cd0 0x7f77200b71e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7738108ab0 0x7f773819f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7738108160 0x7f773819a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 --2- 172.21.15.37:0/3431135060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738102820 0x7f773819a190 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.782+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 >> 172.21.15.37:0/3431135060 conn(0x7f77380794e0 msgr2=0x7f773806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.783+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 shutdown_connections 2024-08-31T06:57:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:34.783+0000 7f773f117640 1 -- 172.21.15.37:0/3431135060 wait complete. 2024-08-31T06:57:35.038 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:34 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3431135060' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:57:35.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:34 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3431135060' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:57:35.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:34 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3431135060' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-31T06:57:35.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-31T06:57:35.830 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:35.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:35 smithi037 ceph-mon[18612]: pgmap v653: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:57:35.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:35 smithi037 ceph-mon[18612]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T06:57:35.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:35 smithi037 ceph-mon[18612]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T06:57:35.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:35 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3431135060' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:57:35.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:35 smithi037 ceph-mon[18612]: fsmap 12 up:standby 2024-08-31T06:57:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:35 smithi106 ceph-mon[22134]: pgmap v653: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:57:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:35 smithi106 ceph-mon[22134]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T06:57:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:35 smithi106 ceph-mon[22134]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T06:57:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:35 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3431135060' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:57:36.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:35 smithi106 ceph-mon[22134]: fsmap 12 up:standby 2024-08-31T06:57:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:35 smithi066 ceph-mon[22244]: pgmap v653: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-08-31T06:57:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:35 smithi066 ceph-mon[22244]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-31T06:57:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:35 smithi066 ceph-mon[22244]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-31T06:57:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:35 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3431135060' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-31T06:57:36.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:35 smithi066 ceph-mon[22244]: fsmap 12 up:standby 2024-08-31T06:57:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 -- 172.21.15.37:0/2365532737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc264108b40 msgr2=0x7fc26410f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 --2- 172.21.15.37:0/2365532737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc264108b40 0x7fc26410f370 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc25c009ca0 tx=0x7fc25c02a8c0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 -- 172.21.15.37:0/2365532737 shutdown_connections 2024-08-31T06:57:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 --2- 172.21.15.37:0/2365532737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc264108b40 0x7fc26410f370 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 --2- 172.21.15.37:0/2365532737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2641081f0 0x7fc264108600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 --2- 172.21.15.37:0/2365532737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2641028b0 0x7fc264102cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 -- 172.21.15.37:0/2365532737 >> 172.21.15.37:0/2365532737 conn(0x7fc264079470 msgr2=0x7fc264079880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 -- 172.21.15.37:0/2365532737 shutdown_connections 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.277+0000 7fc26a14d640 1 -- 172.21.15.37:0/2365532737 wait complete. 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.278+0000 7fc26a14d640 1 Processor -- start 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.278+0000 7fc26a14d640 1 -- start start 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.278+0000 7fc26a14d640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2641028b0 0x7fc26419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.278+0000 7fc26a14d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2641081f0 0x7fc26419b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.278+0000 7fc26a14d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc264108b40 0x7fc26419bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.278+0000 7fc26a14d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc264112710 con 0x7fc2641081f0 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.278+0000 7fc26a14d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7fc264112590 con 0x7fc264108b40 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.278+0000 7fc26a14d640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7fc264112890 con 0x7fc2641028b0 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2641081f0 0x7fc26419b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:36.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2641081f0 0x7fc26419b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43432/0 (socket says 172.21.15.37:43432) 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 -- 172.21.15.37:0/3371907515 learned_addr learned my addr 172.21.15.37:0/3371907515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc263fff640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc264108b40 0x7fc26419bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc2637fe640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2641028b0 0x7fc26419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 -- 172.21.15.37:0/3371907515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2641028b0 msgr2=0x7fc26419b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2641028b0 0x7fc26419b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 -- 172.21.15.37:0/3371907515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc264108b40 msgr2=0x7fc26419bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc264108b40 0x7fc26419bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 -- 172.21.15.37:0/3371907515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2641a6350 con 0x7fc2641081f0 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc262ffd640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2641081f0 0x7fc26419b600 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc25800d750 tx=0x7fc25800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc260ff9640 1 -- 172.21.15.37:0/3371907515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258017070 con 0x7fc2641081f0 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2641a6640 con 0x7fc2641081f0 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc260ff9640 1 -- 172.21.15.37:0/3371907515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2580054b0 con 0x7fc2641081f0 2024-08-31T06:57:36.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc260ff9640 1 -- 172.21.15.37:0/3371907515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258004bc0 con 0x7fc2641081f0 2024-08-31T06:57:36.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.279+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2641a6b30 con 0x7fc2641081f0 2024-08-31T06:57:36.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.280+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc264102cc0 con 0x7fc2641081f0 2024-08-31T06:57:36.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.282+0000 7fc260ff9640 1 -- 172.21.15.37:0/3371907515 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7fc258009c30 con 0x7fc2641081f0 2024-08-31T06:57:36.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.283+0000 7fc260ff9640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc24c0b4cd0 0x7fc24c0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:36.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.283+0000 7fc2637fe640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc24c0b4cd0 0x7fc24c0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:36.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.283+0000 7fc260ff9640 1 -- 172.21.15.37:0/3371907515 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8713+0+0 (secure 0 0 0) 0x7fc2580e5410 con 0x7fc2641081f0 2024-08-31T06:57:36.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.283+0000 7fc2637fe640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc24c0b4cd0 0x7fc24c0b71e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc26406c460 tx=0x7fc254005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:36.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.286+0000 7fc260ff9640 1 -- 172.21.15.37:0/3371907515 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7fc2580ac0e0 con 0x7fc2641081f0 2024-08-31T06:57:36.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.475+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc26406bd10 con 0x7fc2641081f0 2024-08-31T06:57:36.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.781+0000 7fc260ff9640 1 -- 172.21.15.37:0/3371907515 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) ==== 181+0+0 (secure 0 0 0) 0x7fc26406bd10 con 0x7fc2641081f0 2024-08-31T06:57:36.783 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-08-31T06:57:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc24c0b4cd0 msgr2=0x7fc24c0b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc24c0b4cd0 0x7fc24c0b71e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc26406c460 tx=0x7fc254005f90 comp rx=0 tx=0).stop 2024-08-31T06:57:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2641081f0 msgr2=0x7fc26419b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2641081f0 0x7fc26419b600 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc25800d750 tx=0x7fc25800dc10 comp rx=0 tx=0).stop 2024-08-31T06:57:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 shutdown_connections 2024-08-31T06:57:36.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7fc24c0b4cd0 0x7fc24c0b71e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2641081f0 0x7fc26419b600 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc264108b40 0x7fc26419bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 --2- 172.21.15.37:0/3371907515 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2641028b0 0x7fc26419b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.784+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 >> 172.21.15.37:0/3371907515 conn(0x7fc264079470 msgr2=0x7fc2641062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.785+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 shutdown_connections 2024-08-31T06:57:36.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:36.785+0000 7fc26a14d640 1 -- 172.21.15.37:0/3371907515 wait complete. 2024-08-31T06:57:37.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:36 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3371907515' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:57:37.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:36 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3371907515' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:57:37.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:36 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3371907515' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:57:37.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6 shell --fsid 22785f22-6763-11ef-bcd4-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-31T06:57:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/mon.a/config 2024-08-31T06:57:38.046 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:37 smithi037 ceph-mon[18612]: pgmap v654: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-08-31T06:57:38.046 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:37 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/3371907515' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:57:38.047 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:37 smithi037 ceph-mon[18612]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T06:57:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:37 smithi106 ceph-mon[22134]: pgmap v654: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-08-31T06:57:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:37 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/3371907515' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:57:38.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:37 smithi106 ceph-mon[22134]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T06:57:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:37 smithi066 ceph-mon[22244]: pgmap v654: 97 pgs: 97 active+clean; 2.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-08-31T06:57:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:37 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/3371907515' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:57:38.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:37 smithi066 ceph-mon[22244]: osdmap e88: 12 total, 12 up, 12 in 2024-08-31T06:57:38.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.275+0000 7f4103fca640 1 -- 172.21.15.37:0/3611726588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc1047d0 msgr2=0x7f40fc104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:38.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.275+0000 7f4103fca640 1 --2- 172.21.15.37:0/3611726588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc1047d0 0x7f40fc104be0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009900 tx=0x7f40f802a410 comp rx=0 tx=0).stop 2024-08-31T06:57:38.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.275+0000 7f4103fca640 1 -- 172.21.15.37:0/3611726588 shutdown_connections 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.275+0000 7f4103fca640 1 --2- 172.21.15.37:0/3611726588 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40fc10dc30 0x7f40fc110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.275+0000 7f4103fca640 1 --2- 172.21.15.37:0/3611726588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40fc105120 0x7f40fc10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.275+0000 7f4103fca640 1 --2- 172.21.15.37:0/3611726588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc1047d0 0x7f40fc104be0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.275+0000 7f4103fca640 1 -- 172.21.15.37:0/3611726588 >> 172.21.15.37:0/3611726588 conn(0x7f40fc079510 msgr2=0x7f40fc079920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.276+0000 7f4103fca640 1 -- 172.21.15.37:0/3611726588 shutdown_connections 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.276+0000 7f4103fca640 1 -- 172.21.15.37:0/3611726588 wait complete. 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.276+0000 7f4103fca640 1 Processor -- start 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4103fca640 1 -- start start 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4103fca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40fc1047d0 0x7f40fc19a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4103fca640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40fc105120 0x7f40fc19a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4103fca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc10dc30 0x7f40fc19fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4103fca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc113740 con 0x7f40fc10dc30 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4103fca640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc1135c0 con 0x7f40fc1047d0 2024-08-31T06:57:38.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4103fca640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc1138c0 con 0x7f40fc105120 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4102567640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc10dc30 0x7f40fc19fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4102567640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc10dc30 0x7f40fc19fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43442/0 (socket says 172.21.15.37:43442) 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4102567640 1 -- 172.21.15.37:0/346314931 learned_addr learned my addr 172.21.15.37:0/346314931 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4101d66640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40fc1047d0 0x7f40fc19a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4101565640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40fc105120 0x7f40fc19a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4102567640 1 -- 172.21.15.37:0/346314931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40fc105120 msgr2=0x7f40fc19a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4102567640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40fc105120 0x7f40fc19a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4102567640 1 -- 172.21.15.37:0/346314931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40fc1047d0 msgr2=0x7f40fc19a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4102567640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40fc1047d0 0x7f40fc19a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4102567640 1 -- 172.21.15.37:0/346314931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc1a0160 con 0x7f40fc10dc30 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.277+0000 7f4101565640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40fc105120 0x7f40fc19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.278+0000 7f4102567640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc10dc30 0x7f40fc19fa30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009fd0 tx=0x7f40f400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:38.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.278+0000 7f40f2ffd640 1 -- 172.21.15.37:0/346314931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4017070 con 0x7f40fc10dc30 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.278+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc1a0450 con 0x7f40fc10dc30 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.278+0000 7f40f2ffd640 1 -- 172.21.15.37:0/346314931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40f4003e00 con 0x7f40fc10dc30 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.278+0000 7f40f2ffd640 1 -- 172.21.15.37:0/346314931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f4010460 con 0x7f40fc10dc30 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.278+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc1a6bb0 con 0x7f40fc10dc30 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.279+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc06c000 con 0x7f40fc10dc30 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.280+0000 7f40f2ffd640 1 -- 172.21.15.37:0/346314931 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) ==== 152708+0+0 (secure 0 0 0) 0x7f40f4003970 con 0x7f40fc10dc30 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.281+0000 7f40f2ffd640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40e80b4ca0 0x7f40e80b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.281+0000 7f4101d66640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40e80b4ca0 0x7f40e80b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.281+0000 7f40f2ffd640 1 -- 172.21.15.37:0/346314931 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8188+0+0 (secure 0 0 0) 0x7f40f40e5580 con 0x7f40fc10dc30 2024-08-31T06:57:38.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.282+0000 7f4101d66640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40e80b4ca0 0x7f40e80b71b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f40f80057c0 tx=0x7f40f80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-31T06:57:38.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.284+0000 7f40f2ffd640 1 -- 172.21.15.37:0/346314931 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196895 (secure 0 0 0) 0x7f40f40ac4c0 con 0x7f40fc10dc30 2024-08-31T06:57:38.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.471+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f40fc104be0 con 0x7f40fc10dc30 2024-08-31T06:57:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.788+0000 7f40f2ffd640 1 -- 172.21.15.37:0/346314931 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) ==== 169+0+0 (secure 0 0 0) 0x7f40f40abdc0 con 0x7f40fc10dc30 2024-08-31T06:57:38.790 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-08-31T06:57:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40e80b4ca0 msgr2=0x7f40e80b71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40e80b4ca0 0x7f40e80b71b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f40f80057c0 tx=0x7f40f80058d0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc10dc30 msgr2=0x7f40fc19fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-31T06:57:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc10dc30 0x7f40fc19fa30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009fd0 tx=0x7f40f400b260 comp rx=0 tx=0).stop 2024-08-31T06:57:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 shutdown_connections 2024-08-31T06:57:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:6800/1776458941,v1:172.21.15.37:6801/1776458941] conn(0x7f40e80b4ca0 0x7f40e80b71b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40fc10dc30 0x7f40fc19fa30 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40fc105120 0x7f40fc19a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.792+0000 7f4103fca640 1 --2- 172.21.15.37:0/346314931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40fc1047d0 0x7f40fc19a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-31T06:57:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.793+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 >> 172.21.15.37:0/346314931 conn(0x7f40fc079510 msgr2=0x7f40fc1005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-31T06:57:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.793+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 shutdown_connections 2024-08-31T06:57:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-31T06:57:38.793+0000 7f4103fca640 1 -- 172.21.15.37:0/346314931 wait complete. 2024-08-31T06:57:39.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:38 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/346314931' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:57:39.104 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:38 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/346314931' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:57:39.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:38 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/346314931' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-31T06:57:39.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:57:39.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:57:39.658 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T06:57:39.687 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-31T06:57:39.687 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T06:57:39.702 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T06:57:39.719 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-31T06:57:39.742 INFO:tasks.cephadm:Stopping all daemons... 2024-08-31T06:57:39.742 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-31T06:57:39.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.a 2024-08-31T06:57:39.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:39 smithi037 systemd[1]: Stopping Ceph mon.a for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:57:39.854 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:39 smithi037 ceph-mon[18612]: pgmap v656: 65 pgs: 65 active+clean; 577 KiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:57:39.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:39 smithi037 ceph-mon[18612]: from='client.? 172.21.15.37:0/346314931' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:57:39.855 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:39 smithi037 ceph-mon[18612]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T06:57:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:39 smithi106 ceph-mon[22134]: pgmap v656: 65 pgs: 65 active+clean; 577 KiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:57:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:39 smithi106 ceph-mon[22134]: from='client.? 172.21.15.37:0/346314931' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:57:40.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:39 smithi106 ceph-mon[22134]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T06:57:40.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:39 smithi066 ceph-mon[22244]: pgmap v656: 65 pgs: 65 active+clean; 577 KiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-31T06:57:40.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:39 smithi066 ceph-mon[22244]: from='client.? 172.21.15.37:0/346314931' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-31T06:57:40.137 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:39 smithi066 ceph-mon[22244]: osdmap e89: 12 total, 12 up, 12 in 2024-08-31T06:57:40.354 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a[18608]: 2024-08-31T06:57:40.032+0000 7f8af1ebc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:57:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a[18608]: 2024-08-31T06:57:40.032+0000 7f8af1ebc640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-31T06:57:40.355 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:40 smithi037 podman[98808]: 2024-08-31 06:57:40.063707022 +0000 UTC m=+0.133524535 container died e552e968c622837831f3d96ecbdd5d49809b884efeb2d4631c3cf7b62c69d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-31T06:57:40.717 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:40 smithi037 podman[98808]: 2024-08-31 06:57:40.45761963 +0000 UTC m=+0.527437144 container cleanup e552e968c622837831f3d96ecbdd5d49809b884efeb2d4631c3cf7b62c69d0ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-31T06:57:40.717 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 31 06:57:40 smithi037 bash[98808]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-a 2024-08-31T06:57:40.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.a.service' 2024-08-31T06:57:40.944 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:57:40.944 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-31T06:57:40.944 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-31T06:57:40.944 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.b 2024-08-31T06:57:41.268 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:40 smithi066 systemd[1]: Stopping Ceph mon.b for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:57:41.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-b[22240]: 2024-08-31T06:57:41.267+0000 7fcc6218a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:57:41.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-b[22240]: 2024-08-31T06:57:41.267+0000 7fcc6218a640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-31T06:57:41.637 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:41 smithi066 podman[56990]: 2024-08-31 06:57:41.420571543 +0000 UTC m=+0.270396020 container died 2e7cea2798aafed1a7f4cfc253ff5629a6e6e6932850a09bfeba9c80cf39423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-b, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-31T06:57:42.127 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:41 smithi066 podman[56990]: 2024-08-31 06:57:41.934016462 +0000 UTC m=+0.783840925 container cleanup 2e7cea2798aafed1a7f4cfc253ff5629a6e6e6932850a09bfeba9c80cf39423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T06:57:42.127 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:41 smithi066 bash[56990]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-b 2024-08-31T06:57:42.371 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.b.service' 2024-08-31T06:57:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:42 smithi066 podman[57002]: 2024-08-31 06:57:42.126784168 +0000 UTC m=+0.705215526 container remove 2e7cea2798aafed1a7f4cfc253ff5629a6e6e6932850a09bfeba9c80cf39423a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-08-31T06:57:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:42 smithi066 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.b.service: Deactivated successfully. 2024-08-31T06:57:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:42 smithi066 systemd[1]: Stopped Ceph mon.b for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:57:42.387 INFO:journalctl@ceph.mon.b.smithi066.stdout:Aug 31 06:57:42 smithi066 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.b.service: Consumed 12.898s CPU time. 2024-08-31T06:57:42.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:57:42.424 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-31T06:57:42.424 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-31T06:57:42.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.c 2024-08-31T06:57:42.734 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:42 smithi106 systemd[1]: Stopping Ceph mon.c for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:57:43.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:42 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-c[22130]: 2024-08-31T06:57:42.733+0000 7f050d799640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:57:43.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:42 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-c[22130]: 2024-08-31T06:57:42.733+0000 7f050d799640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-31T06:57:43.065 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:42 smithi106 podman[58274]: 2024-08-31 06:57:42.978683621 +0000 UTC m=+0.361059757 container died 2a0cc1389358f708254561dab03d0d7d3905310fc1fa1d76f389cc98fe1325eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:57:43.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:43 smithi106 podman[58274]: 2024-08-31 06:57:43.342057804 +0000 UTC m=+0.724433940 container cleanup 2a0cc1389358f708254561dab03d0d7d3905310fc1fa1d76f389cc98fe1325eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:57:43.565 INFO:journalctl@ceph.mon.c.smithi106.stdout:Aug 31 06:57:43 smithi106 bash[58274]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mon-c 2024-08-31T06:57:43.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mon.c.service' 2024-08-31T06:57:43.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:57:43.819 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-31T06:57:43.819 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-31T06:57:43.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.x 2024-08-31T06:57:44.105 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:57:43 smithi037 systemd[1]: Stopping Ceph mgr.x for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:57:44.472 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:57:44 smithi037 podman[98929]: 2024-08-31 06:57:44.182082311 +0000 UTC m=+0.168438320 container died ede2bad6208aefcc46b16f0641a867d187f5c201e8678e1b58477ea0225bc4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1) 2024-08-31T06:57:44.854 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:57:44 smithi037 podman[98929]: 2024-08-31 06:57:44.637470221 +0000 UTC m=+0.623826209 container cleanup ede2bad6208aefcc46b16f0641a867d187f5c201e8678e1b58477ea0225bc4a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d19e6118f7015f0047264006cb0c873528eb3ae6, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T06:57:44.855 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 31 06:57:44 smithi037 bash[98929]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-x 2024-08-31T06:57:45.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.x.service' 2024-08-31T06:57:45.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:57:45.151 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-31T06:57:45.151 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-31T06:57:45.151 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.y 2024-08-31T06:57:45.507 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:45 smithi066 systemd[1]: Stopping Ceph mgr.y for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:57:45.812 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:45 smithi066 podman[57114]: 2024-08-31 06:57:45.50729619 +0000 UTC m=+0.155122017 container died a99c2b7d2d8696ab0c9e43de79ba07db832653fe61b108bcbb2d79da707b632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-y, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-31T06:57:46.399 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:46 smithi066 podman[57114]: 2024-08-31 06:57:46.14481391 +0000 UTC m=+0.792639742 container cleanup a99c2b7d2d8696ab0c9e43de79ba07db832653fe61b108bcbb2d79da707b632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T06:57:46.399 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:46 smithi066 bash[57114]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-y 2024-08-31T06:57:46.399 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:46 smithi066 podman[57128]: 2024-08-31 06:57:46.371022748 +0000 UTC m=+0.858364427 container remove a99c2b7d2d8696ab0c9e43de79ba07db832653fe61b108bcbb2d79da707b632a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-y, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-31T06:57:46.399 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:46 smithi066 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-08-31T06:57:46.632 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.y.service' 2024-08-31T06:57:46.654 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:46 smithi066 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-08-31T06:57:46.654 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:46 smithi066 systemd[1]: Stopped Ceph mgr.y for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:57:46.654 INFO:journalctl@ceph.mgr.y.smithi066.stdout:Aug 31 06:57:46 smithi066 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.y.service: Consumed 7.593s CPU time. 2024-08-31T06:57:46.667 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:57:46.667 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-31T06:57:46.667 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-31T06:57:46.668 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.z 2024-08-31T06:57:46.984 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:57:46 smithi106 systemd[1]: Stopping Ceph mgr.z for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:57:47.315 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:57:46 smithi106 podman[58397]: 2024-08-31 06:57:46.983976186 +0000 UTC m=+0.126258425 container died d3a287e49e10309a4ff8048b83b2e2ca6fe867b0761e4a79258a2b4a13096d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-31T06:57:47.615 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:57:47 smithi106 podman[58397]: 2024-08-31 06:57:47.40476256 +0000 UTC m=+0.547044799 container cleanup d3a287e49e10309a4ff8048b83b2e2ca6fe867b0761e4a79258a2b4a13096d61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731) 2024-08-31T06:57:47.615 INFO:journalctl@ceph.mgr.z.smithi106.stdout:Aug 31 06:57:47 smithi106 bash[58397]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mgr-z 2024-08-31T06:57:47.768 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mgr.z.service' 2024-08-31T06:57:47.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:57:47.803 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-31T06:57:47.803 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-31T06:57:47.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.0 2024-08-31T06:57:48.102 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:47 smithi037 systemd[1]: Stopping Ceph osd.0 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:57:48.354 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0[37063]: 2024-08-31T06:57:48.100+0000 7f083f811640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:57:48.355 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0[37063]: 2024-08-31T06:57:48.100+0000 7f083f811640 -1 osd.0 89 *** Got signal Terminated *** 2024-08-31T06:57:48.355 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0[37063]: 2024-08-31T06:57:48.100+0000 7f083f811640 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:57:53.854 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:53 smithi037 podman[99053]: 2024-08-31 06:57:53.584261151 +0000 UTC m=+5.583662161 container died 7144e5345808a30a4fae0075064162e01283c470806c481f53f437b9e1f5ba50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-08-31T06:57:54.354 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:54 smithi037 podman[99053]: 2024-08-31 06:57:54.14294604 +0000 UTC m=+6.142347091 container cleanup 7144e5345808a30a4fae0075064162e01283c470806c481f53f437b9e1f5ba50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:57:54.355 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:54 smithi037 bash[99053]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0 2024-08-31T06:57:54.762 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:54 smithi037 podman[99068]: 2024-08-31 06:57:54.444549453 +0000 UTC m=+0.853790937 container remove 7144e5345808a30a4fae0075064162e01283c470806c481f53f437b9e1f5ba50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-31T06:57:55.105 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:54 smithi037 podman[99160]: 2024-08-31 06:57:54.762118213 +0000 UTC m=+0.112009165 container create 904706a5b4c472ce097021e2b56a639952e0249c3f910c2f0817e221eb3be847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:57:55.105 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:54 smithi037 podman[99160]: 2024-08-31 06:57:54.665824193 +0000 UTC m=+0.015715112 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:57:55.605 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:55 smithi037 podman[99160]: 2024-08-31 06:57:55.173572772 +0000 UTC m=+0.523463682 container init 904706a5b4c472ce097021e2b56a639952e0249c3f910c2f0817e221eb3be847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux ) 2024-08-31T06:57:55.605 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:55 smithi037 podman[99160]: 2024-08-31 06:57:55.177258275 +0000 UTC m=+0.527149184 container start 904706a5b4c472ce097021e2b56a639952e0249c3f910c2f0817e221eb3be847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:57:55.605 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:55 smithi037 podman[99160]: 2024-08-31 06:57:55.273623903 +0000 UTC m=+0.623514827 container attach 904706a5b4c472ce097021e2b56a639952e0249c3f910c2f0817e221eb3be847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T06:57:55.605 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 31 06:57:55 smithi037 podman[99160]: 2024-08-31 06:57:55.36869044 +0000 UTC m=+0.718581350 container died 904706a5b4c472ce097021e2b56a639952e0249c3f910c2f0817e221eb3be847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T06:57:55.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.0.service' 2024-08-31T06:57:56.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:57:56.005 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-31T06:57:56.006 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-31T06:57:56.006 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.1 2024-08-31T06:57:56.300 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:57:56 smithi066 systemd[1]: Stopping Ceph osd.1 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:57:56.637 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:57:56 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1[28023]: 2024-08-31T06:57:56.299+0000 7f6c7f971640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:57:56.637 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:57:56 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1[28023]: 2024-08-31T06:57:56.299+0000 7f6c7f971640 -1 osd.1 89 *** Got signal Terminated *** 2024-08-31T06:57:56.637 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:57:56 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1[28023]: 2024-08-31T06:57:56.299+0000 7f6c7f971640 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:02.000 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:01 smithi066 podman[57241]: 2024-08-31 06:58:01.710604351 +0000 UTC m=+5.507424343 container died b7dd8c7d297aec779003f63b3e83985e8f238d0cdc76404e3bfc7b37e2347773 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-31T06:58:02.366 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:02 smithi066 podman[57241]: 2024-08-31 06:58:02.098778306 +0000 UTC m=+5.895598297 container cleanup b7dd8c7d297aec779003f63b3e83985e8f238d0cdc76404e3bfc7b37e2347773 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-31T06:58:02.367 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:02 smithi066 bash[57241]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1 2024-08-31T06:58:02.637 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:02 smithi066 podman[57259]: 2024-08-31 06:58:02.366627903 +0000 UTC m=+0.645433392 container remove b7dd8c7d297aec779003f63b3e83985e8f238d0cdc76404e3bfc7b37e2347773 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1) 2024-08-31T06:58:02.986 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:02 smithi066 podman[57343]: 2024-08-31 06:58:02.620595805 +0000 UTC m=+0.016355972 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:58:02.987 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:02 smithi066 podman[57343]: 2024-08-31 06:58:02.73422921 +0000 UTC m=+0.129989404 container create 79e7a7cf9aaf546b37014206a733d3cfb74d4d0ea8f1868014cc0338741db1df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-31T06:58:02.988 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:02 smithi066 podman[57343]: 2024-08-31 06:58:02.986475119 +0000 UTC m=+0.382235271 container init 79e7a7cf9aaf546b37014206a733d3cfb74d4d0ea8f1868014cc0338741db1df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2) 2024-08-31T06:58:03.387 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:02 smithi066 podman[57343]: 2024-08-31 06:58:02.99222345 +0000 UTC m=+0.387983605 container start 79e7a7cf9aaf546b37014206a733d3cfb74d4d0ea8f1868014cc0338741db1df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-31T06:58:03.387 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:03 smithi066 podman[57343]: 2024-08-31 06:58:03.077995894 +0000 UTC m=+0.473756046 container attach 79e7a7cf9aaf546b37014206a733d3cfb74d4d0ea8f1868014cc0338741db1df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:58:03.387 INFO:journalctl@ceph.osd.1.smithi066.stdout:Aug 31 06:58:03 smithi066 podman[57343]: 2024-08-31 06:58:03.183710151 +0000 UTC m=+0.579470324 container died 79e7a7cf9aaf546b37014206a733d3cfb74d4d0ea8f1868014cc0338741db1df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:58:03.825 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.1.service' 2024-08-31T06:58:03.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:58:03.865 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-31T06:58:03.865 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-31T06:58:03.865 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.2 2024-08-31T06:58:04.160 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:03 smithi106 systemd[1]: Stopping Ceph osd.2 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:58:04.565 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2[28410]: 2024-08-31T06:58:04.157+0000 7f75a8e37640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:58:04.565 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2[28410]: 2024-08-31T06:58:04.157+0000 7f75a8e37640 -1 osd.2 89 *** Got signal Terminated *** 2024-08-31T06:58:04.565 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2[28410]: 2024-08-31T06:58:04.157+0000 7f75a8e37640 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:09.943 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:09 smithi106 podman[58523]: 2024-08-31 06:58:09.670147185 +0000 UTC m=+5.613340031 container died d9bef30a4d8e1a060e184847ff03cc6d3a48e56c729441fbb95becf7d2134328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T06:58:10.315 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:10 smithi106 podman[58523]: 2024-08-31 06:58:10.050558778 +0000 UTC m=+5.993751617 container cleanup d9bef30a4d8e1a060e184847ff03cc6d3a48e56c729441fbb95becf7d2134328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-31T06:58:10.315 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:10 smithi106 bash[58523]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2 2024-08-31T06:58:10.641 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:10 smithi106 podman[58541]: 2024-08-31 06:58:10.335132166 +0000 UTC m=+0.665786420 container remove d9bef30a4d8e1a060e184847ff03cc6d3a48e56c729441fbb95becf7d2134328 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1) 2024-08-31T06:58:10.938 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:10 smithi106 podman[58628]: 2024-08-31 06:58:10.543988156 +0000 UTC m=+0.015453739 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:58:10.938 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:10 smithi106 podman[58628]: 2024-08-31 06:58:10.644042384 +0000 UTC m=+0.115507966 container create 3ada7e83ca683a6140333e2bfa04f71a0885edf8ba96b2c8f2d1efa8ee2db9c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-08-31T06:58:10.938 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:10 smithi106 podman[58628]: 2024-08-31 06:58:10.938205966 +0000 UTC m=+0.409671555 container init 3ada7e83ca683a6140333e2bfa04f71a0885edf8ba96b2c8f2d1efa8ee2db9c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-31T06:58:11.315 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:10 smithi106 podman[58628]: 2024-08-31 06:58:10.941474127 +0000 UTC m=+0.412939710 container start 3ada7e83ca683a6140333e2bfa04f71a0885edf8ba96b2c8f2d1efa8ee2db9c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-31T06:58:11.315 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:11 smithi106 podman[58628]: 2024-08-31 06:58:11.021805131 +0000 UTC m=+0.493270721 container attach 3ada7e83ca683a6140333e2bfa04f71a0885edf8ba96b2c8f2d1efa8ee2db9c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:58:11.315 INFO:journalctl@ceph.osd.2.smithi106.stdout:Aug 31 06:58:11 smithi106 podman[58628]: 2024-08-31 06:58:11.128725702 +0000 UTC m=+0.600191286 container died 3ada7e83ca683a6140333e2bfa04f71a0885edf8ba96b2c8f2d1efa8ee2db9c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:58:11.713 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.2.service' 2024-08-31T06:58:11.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:58:11.750 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-31T06:58:11.751 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-31T06:58:11.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.3 2024-08-31T06:58:12.046 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:11 smithi037 systemd[1]: Stopping Ceph osd.3 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:58:12.355 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:12 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3[43633]: 2024-08-31T06:58:12.045+0000 7ff7483a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:58:12.355 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:12 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3[43633]: 2024-08-31T06:58:12.045+0000 7ff7483a1640 -1 osd.3 89 *** Got signal Terminated *** 2024-08-31T06:58:12.355 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:12 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3[43633]: 2024-08-31T06:58:12.045+0000 7ff7483a1640 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:15.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:14 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:14.649+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:16.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:15.661+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:16.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:15 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:15.670+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:16.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:16.538+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:16.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:16 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:16.672+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:17.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:16.639+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:17.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:17.122+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:17.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:17 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:17.555+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:17.855 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:17 smithi037 podman[99263]: 2024-08-31 06:58:17.55461505 +0000 UTC m=+5.609639602 container died 746585d73eeb990d54fb36152ce0976f5348bbee44fcbd667210974837de5214 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T06:58:17.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:17 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:17.648+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:18.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:17.599+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:18.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:17.723+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:18.305 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:18 smithi037 podman[99263]: 2024-08-31 06:58:18.054159381 +0000 UTC m=+6.109183922 container cleanup 746585d73eeb990d54fb36152ce0976f5348bbee44fcbd667210974837de5214 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T06:58:18.305 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:18 smithi037 bash[99263]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3 2024-08-31T06:58:18.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:18.149+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:18.589 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:18 smithi037 podman[99278]: 2024-08-31 06:58:18.30550879 +0000 UTC m=+0.747238014 container remove 746585d73eeb990d54fb36152ce0976f5348bbee44fcbd667210974837de5214 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-31T06:58:18.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:18 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:18.589+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:18.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:18 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:18.674+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:18.855 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:18 smithi037 podman[99367]: 2024-08-31 06:58:18.518251489 +0000 UTC m=+0.016001988 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:58:18.855 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:18 smithi037 podman[99367]: 2024-08-31 06:58:18.623244536 +0000 UTC m=+0.120995071 container create 9f8c47db69780b0fe88af6648fd61f0b49475732a86cc7a5640536a72eae6d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-31T06:58:19.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:18.687+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:19.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:18.648+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:19.355 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:19 smithi037 podman[99367]: 2024-08-31 06:58:19.001328824 +0000 UTC m=+0.499079316 container init 9f8c47db69780b0fe88af6648fd61f0b49475732a86cc7a5640536a72eae6d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:58:19.355 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:19 smithi037 podman[99367]: 2024-08-31 06:58:19.004655717 +0000 UTC m=+0.502406206 container start 9f8c47db69780b0fe88af6648fd61f0b49475732a86cc7a5640536a72eae6d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-31T06:58:19.355 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:19 smithi037 podman[99367]: 2024-08-31 06:58:19.084385115 +0000 UTC m=+0.582135612 container attach 9f8c47db69780b0fe88af6648fd61f0b49475732a86cc7a5640536a72eae6d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T06:58:19.355 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 31 06:58:19 smithi037 podman[99367]: 2024-08-31 06:58:19.203547101 +0000 UTC m=+0.701297599 container died 9f8c47db69780b0fe88af6648fd61f0b49475732a86cc7a5640536a72eae6d41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-31T06:58:19.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:19.164+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:19.796 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:19 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:19.559+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:19.797 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:19 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:19.703+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:19.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.3.service' 2024-08-31T06:58:19.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:58:19.858 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-31T06:58:19.858 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-31T06:58:19.858 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.4 2024-08-31T06:58:20.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:19.682+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:20.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:19.681+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:20.168 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:19 smithi066 systemd[1]: Stopping Ceph osd.4 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:58:20.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:20 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:20.184+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:20.637 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:20 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4[34470]: 2024-08-31T06:58:20.167+0000 7f24582af640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:58:20.637 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:20 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4[34470]: 2024-08-31T06:58:20.167+0000 7f24582af640 -1 osd.4 89 *** Got signal Terminated *** 2024-08-31T06:58:20.637 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:20 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4[34470]: 2024-08-31T06:58:20.167+0000 7f24582af640 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:21.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:20 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:20.716+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:21.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:20 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:20.682+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:21.104 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:20 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:20.744+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:21.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:20 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:20.607+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:21.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:21 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:21.225+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:21.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:21 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:21.794+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:21.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:21 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:21.573+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:22.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:21 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:21.754+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:22.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:21 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:21.634+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:22.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:22 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:22.204+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:22.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:22.747+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:22.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:22 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:22.567+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:22.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:22 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:22.531+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:23.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:22 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:22.620+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:23.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:22 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:22.620+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:23.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:22 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:22.767+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:23.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:22 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:22.767+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:23.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:23 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:23.134+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:23.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:23 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:23.209+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:23.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:23 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:23.545+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:23.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:23 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:23.735+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:23.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:23 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:23.735+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:23.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:23 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:23.533+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:24.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:23 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:23.599+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:24.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:23 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:23.599+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:24.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:23 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:23.748+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:24.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:23 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:23.748+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:24.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:24 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:24.085+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:24.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:24 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:24.181+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:24.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:24 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:24.541+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:24.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:24 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:24.541+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:24.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:24 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:24.695+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:24.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:24 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:24.695+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:24.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:24 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:24.560+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:24.887 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:24 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4[34470]: 2024-08-31T06:58:24.555+0000 7f245489a640 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.138032+0000 front 2024-08-31T06:58:01.138060+0000 (oldest deadline 2024-08-31T06:58:24.038169+0000) 2024-08-31T06:58:25.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:24 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:24.587+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:25.065 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:24 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:24.587+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:25.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:24 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:24.762+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:25.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:24 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:24.762+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:25.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:25 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:25.101+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:25.550 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:25 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:25.156+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:25.805 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:25 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:25.550+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:25.805 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:25 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:25.550+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:25.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:25 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:25.666+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:25.856 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:25 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:25.666+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:25.856 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:25 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:25.536+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:25.856 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:25 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:25.536+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:25.887 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:25 smithi066 podman[57457]: 2024-08-31 06:58:25.666777634 +0000 UTC m=+5.607608581 container died 04c2c6b723ff6f5b0682938e6ddf4c0876e5a1a8a502917a7992b3819fb72b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-31T06:58:25.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:25 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:25.518+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:26.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:25 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:25.805+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:26.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:25 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:25.805+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:26.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:26 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:26.128+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:26.387 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:26 smithi066 podman[57457]: 2024-08-31 06:58:26.150443543 +0000 UTC m=+6.091274482 container cleanup 04c2c6b723ff6f5b0682938e6ddf4c0876e5a1a8a502917a7992b3819fb72b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS) 2024-08-31T06:58:26.387 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:26 smithi066 bash[57457]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4 2024-08-31T06:58:26.542 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:26 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:26.116+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:26.769 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:26 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:26.545+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:26.769 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:26 smithi066 podman[57472]: 2024-08-31 06:58:26.426621617 +0000 UTC m=+0.754816175 container remove 04c2c6b723ff6f5b0682938e6ddf4c0876e5a1a8a502917a7992b3819fb72b76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:58:26.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:26 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:26.542+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:26.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:26 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:26.542+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:26.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:26 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:26.758+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:26.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:26 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:26.758+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:26.856 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:26 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:26.709+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:26.856 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:26 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:26.709+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:26.856 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:26 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:26.529+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:26.857 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:26 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:26.529+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:27.080 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:26 smithi066 podman[57560]: 2024-08-31 06:58:26.768958471 +0000 UTC m=+0.110611630 container create 074d4e27b642e4c99fb060cd103eb3fa96b9916f421c0a901d24ee3c23dff851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:58:27.080 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:26 smithi066 podman[57560]: 2024-08-31 06:58:26.674447734 +0000 UTC m=+0.016100908 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:58:27.080 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:26 smithi066 podman[57560]: 2024-08-31 06:58:26.996491487 +0000 UTC m=+0.338144646 container init 074d4e27b642e4c99fb060cd103eb3fa96b9916f421c0a901d24ee3c23dff851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T06:58:27.080 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:26 smithi066 podman[57560]: 2024-08-31 06:58:26.999781172 +0000 UTC m=+0.341434331 container start 074d4e27b642e4c99fb060cd103eb3fa96b9916f421c0a901d24ee3c23dff851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-08-31T06:58:27.080 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:27 smithi066 podman[57560]: 2024-08-31 06:58:27.079686376 +0000 UTC m=+0.421339534 container attach 074d4e27b642e4c99fb060cd103eb3fa96b9916f421c0a901d24ee3c23dff851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:58:27.387 INFO:journalctl@ceph.osd.4.smithi066.stdout:Aug 31 06:58:27 smithi066 podman[57560]: 2024-08-31 06:58:27.194654043 +0000 UTC m=+0.536307212 container died 074d4e27b642e4c99fb060cd103eb3fa96b9916f421c0a901d24ee3c23dff851 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:58:27.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:27 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:27.167+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:27.549 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:27 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:27.137+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:27.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:27 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:27.710+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:27.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:27 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:27.710+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:27.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:27 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:27.549+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:27.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:27 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:27.549+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:27.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:27 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:27.716+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:27.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:27 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:27.716+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:27.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:27 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:27.535+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:27.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:27 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:27.535+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:27.866 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:27 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:27.581+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:27.890 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.4.service' 2024-08-31T06:58:27.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:58:27.935 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-31T06:58:27.935 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-31T06:58:27.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.5 2024-08-31T06:58:28.245 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:27 smithi106 systemd[1]: Stopping Ceph osd.5 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:58:28.245 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:28 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:28.156+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:28.540 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:28 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:28.216+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:28.561 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:28 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:28.244+0000 7f7929e28640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:58:28.561 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:28 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:28.244+0000 7f7929e28640 -1 osd.5 89 *** Got signal Terminated *** 2024-08-31T06:58:28.561 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:28 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:28.244+0000 7f7929e28640 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:28.757 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:28 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:28.489+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:28.757 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:28 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:28.489+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:28.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:28 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:28.560+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:28.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:28 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:28.560+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:28.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:28 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:28.717+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:28.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:28 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:28.717+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:28.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:28 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:28.538+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:29.104 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:28 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:28.757+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:29.104 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:28 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:28.757+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:29.552 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:29 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:29.134+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:29.568 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:29 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:29.194+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:29.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:29 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:29.552+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:29.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:29 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:29.552+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:29.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:29 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:29.700+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:29.816 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:29 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:29.700+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:29.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:29 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:29.711+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:29.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:29 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:29.711+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:29.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:29 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:29.514+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:29.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:29 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:29.514+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:29.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:29 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:29.567+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:30.528 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:30 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:30.098+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:30.556 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:30 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:30.225+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:30.733 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:30 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:30.477+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:30.733 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:30 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:30.477+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:30.733 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:30 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:30.477+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:30.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:30 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:30.528+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:30.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:30 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:30.528+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:30.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:30 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:30.676+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:30.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:30 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:30.676+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:30.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:30 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:30.555+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:30.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:30 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:30.555+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:31.104 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:30 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:30.733+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:31.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:30 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:30.733+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:31.483 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:31 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:31.085+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:31.573 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:31 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:31.261+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:31.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:31 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:31.483+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:31.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:31 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:31.483+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:31.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:31 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:31.686+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:31.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:31 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:31.686+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:31.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:31 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:31.708+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:31.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:31 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:31.708+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:31.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:31 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:31.471+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:31.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:31 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:31.471+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:31.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:31 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:31.471+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:31.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:31 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:31.572+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:31.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:31 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:31.572+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:32.505 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:32.072+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:32.506 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:32.072+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:32.569 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:32.272+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:32.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:32.505+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.502715+0000 front 2024-08-31T06:57:49.502677+0000 (oldest deadline 2024-08-31T06:58:14.202849+0000) 2024-08-31T06:58:32.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:32.505+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:00.004205+0000 front 2024-08-31T06:58:00.004239+0000 (oldest deadline 2024-08-31T06:58:22.304245+0000) 2024-08-31T06:58:32.815 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5[35257]: 2024-08-31T06:58:32.505+0000 7f792240b640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.705760+0000 front 2024-08-31T06:58:08.705806+0000 (oldest deadline 2024-08-31T06:58:31.605852+0000) 2024-08-31T06:58:32.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:32.720+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:32.815 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:32 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:32.720+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:32.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:32.715+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:32.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:32.715+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:32.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:32.510+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:32.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:32.510+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:32.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:32.510+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:32.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:32.567+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:32.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:32 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:32.567+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:33.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:33 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:33.105+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:33.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:33 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:33.105+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:33.607 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:33 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:33.283+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:33.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:33 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:33.692+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:33.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:33 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:33.692+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:33.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:33 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:33.542+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:33.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:33 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:33.542+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:33.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:33 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:33.542+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:33.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:33 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:33.606+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:33.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:33 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:33.606+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:33.896 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:33 smithi106 podman[58743]: 2024-08-31 06:58:33.61686708 +0000 UTC m=+5.487830086 container died 790717593c2d813f0c047f760295b591defbe0eac2bda53dbd662bdc45e7ac3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-31T06:58:33.896 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:33 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:33.701+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:33.896 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:33 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:33.701+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:33.896 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:33 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:33.701+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:34.263 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:33 smithi106 podman[58743]: 2024-08-31 06:58:33.994986345 +0000 UTC m=+5.865949392 container cleanup 790717593c2d813f0c047f760295b591defbe0eac2bda53dbd662bdc45e7ac3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:58:34.264 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:33 smithi106 bash[58743]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5 2024-08-31T06:58:34.264 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:34 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:34.075+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:34.264 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:34 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:34.075+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:34.565 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:34 smithi106 podman[58759]: 2024-08-31 06:58:34.262899521 +0000 UTC m=+0.636628939 container remove 790717593c2d813f0c047f760295b591defbe0eac2bda53dbd662bdc45e7ac3d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-31T06:58:34.619 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:34 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:34.281+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:34.619 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:34 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:34.281+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:34.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:34 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:34.653+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:34.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:34 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:34.653+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:34.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:34 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:34.653+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:03.398023+0000 front 2024-08-31T06:58:03.397924+0000 (oldest deadline 2024-08-31T06:58:34.598623+0000) 2024-08-31T06:58:34.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:34 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:34.586+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:34.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:34 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:34.586+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:34.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:34 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:34.586+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:34.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:34 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:34.618+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:34.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:34 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:34.618+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:34.932 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:34 smithi106 podman[58849]: 2024-08-31 06:58:34.513219201 +0000 UTC m=+0.015577343 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:58:34.933 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:34 smithi106 podman[58849]: 2024-08-31 06:58:34.621919559 +0000 UTC m=+0.124277695 container create 1c9ae04aad3a14caffb120df744d554183824cc9731b5a10ebdbf8f93308e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.1) 2024-08-31T06:58:34.933 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:34 smithi106 podman[58849]: 2024-08-31 06:58:34.849347102 +0000 UTC m=+0.351705238 container init 1c9ae04aad3a14caffb120df744d554183824cc9731b5a10ebdbf8f93308e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-31T06:58:34.933 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:34 smithi106 podman[58849]: 2024-08-31 06:58:34.852573478 +0000 UTC m=+0.354931620 container start 1c9ae04aad3a14caffb120df744d554183824cc9731b5a10ebdbf8f93308e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:58:34.933 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:34 smithi106 podman[58849]: 2024-08-31 06:58:34.932521845 +0000 UTC m=+0.434879982 container attach 1c9ae04aad3a14caffb120df744d554183824cc9731b5a10ebdbf8f93308e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T06:58:34.933 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:34 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:34.716+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:34.933 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:34 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:34.716+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:34.933 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:34 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:34.716+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:35.315 INFO:journalctl@ceph.osd.5.smithi106.stdout:Aug 31 06:58:35 smithi106 podman[58849]: 2024-08-31 06:58:35.036959619 +0000 UTC m=+0.539317763 container died 1c9ae04aad3a14caffb120df744d554183824cc9731b5a10ebdbf8f93308e69a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-31T06:58:35.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:35 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:35.075+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:35.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:35 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:35.075+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:35.609 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.5.service' 2024-08-31T06:58:35.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:35 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:35.309+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:35.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:35 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:35.309+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:35.647 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:58:35.647 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-31T06:58:35.647 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-31T06:58:35.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.6 2024-08-31T06:58:35.950 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:35.614+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:35.950 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:35.614+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:35.950 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:35.614+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:35.950 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:35.691+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:35.950 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:35.691+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:35.950 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:35.691+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:03.398023+0000 front 2024-08-31T06:58:03.397924+0000 (oldest deadline 2024-08-31T06:58:34.598623+0000) 2024-08-31T06:58:35.950 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:35 smithi037 systemd[1]: Stopping Ceph osd.6 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:58:35.950 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:35.947+0000 7ff44c9b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:58:35.951 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:35.947+0000 7ff44c9b5640 -1 osd.6 89 *** Got signal Terminated *** 2024-08-31T06:58:35.951 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:35.947+0000 7ff44c9b5640 -1 osd.6 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:36.040 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:35 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:35.670+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:36.040 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:35 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:35.670+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:36.040 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:35 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:35.670+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:36.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:35 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:35.663+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:36.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:35 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:35.663+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:36.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:36 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:36.040+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:36.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:36 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:36.040+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:36.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:36 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:36.339+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:36.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:36 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:36.339+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:36.854 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:36 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:36.722+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:36.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:36 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:36.722+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:36.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:36 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:36.722+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:03.398023+0000 front 2024-08-31T06:58:03.397924+0000 (oldest deadline 2024-08-31T06:58:34.598623+0000) 2024-08-31T06:58:36.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:36 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:36.585+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:36.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:36 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:36.585+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:36.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:36 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:36.585+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:37.014 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:36 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:36.635+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:37.014 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:36 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:36.635+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:37.015 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:36 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:36.635+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:37.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:36 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:36.690+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:37.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:36 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:36.690+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:37.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:37 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:37.013+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:37.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:37 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:37.013+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:37.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:37 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:37.341+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:37.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:37 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:37.341+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:38.018 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:37 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:37.621+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:38.018 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:37 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:37.621+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:38.018 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:37 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:37.621+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:38.104 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:37 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:37.764+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:38.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:37 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:37.764+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:38.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:37 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:37.764+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:03.398023+0000 front 2024-08-31T06:58:03.397924+0000 (oldest deadline 2024-08-31T06:58:34.598623+0000) 2024-08-31T06:58:38.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:37 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:37.610+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:38.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:37 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:37.610+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:38.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:37 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:37.610+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:38.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:37 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:37.650+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:38.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:37 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:37.650+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:38.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:38.017+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:38.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:38.017+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:38.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:38 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:38.299+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:38.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:38 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:38.299+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:38.998 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:38.592+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:38.999 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:38.592+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:38.999 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:38.592+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:39.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:38 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:38.636+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:39.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:38 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:38.636+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:39.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:38 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:38.636+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:39.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:38 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:38.737+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:39.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:38 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:38.737+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:39.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:38 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:38.737+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:03.398023+0000 front 2024-08-31T06:58:03.397924+0000 (oldest deadline 2024-08-31T06:58:34.598623+0000) 2024-08-31T06:58:39.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:38 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:38.737+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:14.599051+0000 front 2024-08-31T06:58:14.599019+0000 (oldest deadline 2024-08-31T06:58:38.599618+0000) 2024-08-31T06:58:39.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:38 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:38.698+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:39.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:38 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:38.698+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:39.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:38 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:38.698+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:39.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:38.998+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:39.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:38.998+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:39.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:38 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:38.998+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:39.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:39 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:39.316+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:39.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:39 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:39.316+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:39.994 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:39 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:39.572+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:39.994 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:39 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:39.572+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:39.995 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:39 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:39.572+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:40.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:39 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:39.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:40.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:39 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:39.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:40.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:39 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:39.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:40.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:39 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:39.729+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:40.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:39 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:39.729+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:40.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:39 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:39.729+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:03.398023+0000 front 2024-08-31T06:58:03.397924+0000 (oldest deadline 2024-08-31T06:58:34.598623+0000) 2024-08-31T06:58:40.105 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:39 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:39.729+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:14.599051+0000 front 2024-08-31T06:58:14.599019+0000 (oldest deadline 2024-08-31T06:58:38.599618+0000) 2024-08-31T06:58:40.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:39 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:39.678+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:40.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:39 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:39.678+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:40.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:39 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:39.678+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:40.270 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:39 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:39.994+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:40.270 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:39 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:39.994+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:40.270 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:39 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:39.994+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:40.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:40 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:40.364+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:40.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:40 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:40.364+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:40.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:40.592+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:40.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:40.592+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:40.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:40.592+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:40.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:40.723+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:49.395456+0000 front 2024-08-31T06:57:49.395506+0000 (oldest deadline 2024-08-31T06:58:15.295582+0000) 2024-08-31T06:58:40.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:40.723+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:56.396833+0000 front 2024-08-31T06:57:56.397002+0000 (oldest deadline 2024-08-31T06:58:23.397358+0000) 2024-08-31T06:58:40.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:40.723+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:03.398023+0000 front 2024-08-31T06:58:03.397924+0000 (oldest deadline 2024-08-31T06:58:34.598623+0000) 2024-08-31T06:58:40.855 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:40 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6[50090]: 2024-08-31T06:58:40.723+0000 7ff448fa0640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:14.599051+0000 front 2024-08-31T06:58:14.599019+0000 (oldest deadline 2024-08-31T06:58:38.599618+0000) 2024-08-31T06:58:41.028 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:40 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:40.614+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:41.028 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:40 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:40.614+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:41.028 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:40 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:40.614+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:41.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:40 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:40.636+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:41.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:40 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:40.636+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:41.137 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:40 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:40.636+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:41.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:41 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:41.027+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:41.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:41 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:41.027+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:41.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:41 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:41.027+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:41.582 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:41 smithi037 podman[99468]: 2024-08-31 06:58:41.31252505 +0000 UTC m=+5.464911400 container died 4880ffe2b978830b40888f62ad4bf4b48a47235e5a018d034f39568c5f294304 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-31T06:58:41.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:41.373+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:41.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:41.373+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:41.637 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:41.616+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:41.638 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:41.616+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:41.638 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:41.616+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:41.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:41 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:41.631+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:41.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:41 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:41.631+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:41.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:41 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:41.631+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:41.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:41 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:41.631+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:42.019 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:41 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:41.610+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:42.019 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:41 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:41.610+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:42.019 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:41 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:41.610+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:42.150 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:41 smithi037 podman[99468]: 2024-08-31 06:58:41.865427858 +0000 UTC m=+6.017814250 container cleanup 4880ffe2b978830b40888f62ad4bf4b48a47235e5a018d034f39568c5f294304 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-31T06:58:42.150 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:41 smithi037 bash[99468]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6 2024-08-31T06:58:42.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:42 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:42.018+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:42.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:42 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:42.018+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:42.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:42 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:42.018+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:42.481 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:42 smithi037 podman[99483]: 2024-08-31 06:58:42.150213021 +0000 UTC m=+0.836651663 container remove 4880ffe2b978830b40888f62ad4bf4b48a47235e5a018d034f39568c5f294304 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-31T06:58:42.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:42 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:42.374+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:42.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:42 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:42.374+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:42.637 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:42 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:42.591+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:42.638 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:42 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:42.591+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:42.638 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:42 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:42.591+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:42.787 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:42 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:42.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:42.787 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:42 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:42.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:42.787 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:42 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:42.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:42.787 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:42 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:42.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:42.788 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:42 smithi037 podman[99576]: 2024-08-31 06:58:42.383743934 +0000 UTC m=+0.015807315 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:58:42.788 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:42 smithi037 podman[99576]: 2024-08-31 06:58:42.484479225 +0000 UTC m=+0.116542592 container create 03a6593c1bad5210747ec93b59151ea67b9de14c51917419e5db31cd20b4e6fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True) 2024-08-31T06:58:42.788 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:42 smithi037 podman[99576]: 2024-08-31 06:58:42.695334895 +0000 UTC m=+0.327398278 container init 03a6593c1bad5210747ec93b59151ea67b9de14c51917419e5db31cd20b4e6fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T06:58:42.788 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:42 smithi037 podman[99576]: 2024-08-31 06:58:42.698608605 +0000 UTC m=+0.330671981 container start 03a6593c1bad5210747ec93b59151ea67b9de14c51917419e5db31cd20b4e6fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731) 2024-08-31T06:58:43.038 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:42 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:42.625+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:43.038 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:42 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:42.625+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:43.038 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:42 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:42.625+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:43.104 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:42 smithi037 podman[99576]: 2024-08-31 06:58:42.786983665 +0000 UTC m=+0.419047036 container attach 03a6593c1bad5210747ec93b59151ea67b9de14c51917419e5db31cd20b4e6fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:58:43.104 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 31 06:58:42 smithi037 podman[99576]: 2024-08-31 06:58:42.903116555 +0000 UTC m=+0.535179926 container died 03a6593c1bad5210747ec93b59151ea67b9de14c51917419e5db31cd20b4e6fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-31T06:58:43.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:43 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:43.037+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:43.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:43 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:43.037+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:43.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:43 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:43.037+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:43.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:43.375+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:43.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:43.375+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:43.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:43.375+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:43.638 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:43.591+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:43.638 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:43.591+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:43.638 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:43.591+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:43.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.6.service' 2024-08-31T06:58:43.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:58:43.683 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-31T06:58:43.683 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-31T06:58:43.683 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.7 2024-08-31T06:58:43.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:43 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:43.628+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:43.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:43 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:43.628+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:43.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:43 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:43.628+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:43.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:43 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:43.628+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:43.994 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:43 smithi066 systemd[1]: Stopping Ceph osd.7 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:58:44.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:43 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:43.582+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:44.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:43 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:43.582+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:44.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:43 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:43.582+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:44.335 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:43.992+0000 7fe1ccb4a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:58:44.336 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:43.992+0000 7fe1ccb4a640 -1 osd.7 89 *** Got signal Terminated *** 2024-08-31T06:58:44.336 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:43 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:43.992+0000 7fe1ccb4a640 -1 osd.7 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:44.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:44 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:44.082+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:44.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:44 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:44.082+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:44.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:44 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:44.082+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:44.599 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:44 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:44.334+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:44.599 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:44 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:44.334+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:44.599 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:44 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:44.334+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:44.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:44 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:44.597+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:44.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:44 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:44.597+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:44.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:44 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:44.597+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:45.040 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:44 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:44.626+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:45.040 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:44 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:44.626+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:45.040 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:44 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:44.626+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:45.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:44 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:44.665+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:45.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:44 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:44.665+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:45.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:44 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:44.665+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:45.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:44 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:44.665+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:45.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:45 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:45.039+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:45.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:45 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:45.039+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:45.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:45 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:45.039+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:45.607 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:45.304+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:45.607 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:45.304+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:45.607 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:45.304+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:45.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:45.619+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:45.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:45.619+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:45.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:45.619+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:46.007 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:45 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:45.582+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:46.007 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:45 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:45.582+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:46.007 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:45 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:45.582+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:46.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:45 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:45.628+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:46.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:45 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:45.628+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:46.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:45 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:45.628+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:46.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:45 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:45.628+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:46.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:46 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:46.006+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:46.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:46 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:46.006+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:46.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:46 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:46.006+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:46.595 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:46 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:46.308+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:46.595 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:46 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:46.308+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:46.595 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:46 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:46.308+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:46.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:46 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:46.594+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:46.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:46 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:46.594+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:46.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:46 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:46.594+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:47.011 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:46 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:46.622+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:47.012 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:46 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:46.622+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:47.012 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:46 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:46.622+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:47.012 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:46 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:46.622+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:47.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:46 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:46.609+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:47.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:46 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:46.609+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:47.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:46 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:46.609+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:47.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:46 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:46.609+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:47.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:46 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:46.609+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:47.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:47 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:47.010+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:47.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:47 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:47.010+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:47.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:47 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:47.010+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:47.581 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:47 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:47.310+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:47.581 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:47 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:47.310+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:47.581 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:47 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:47.310+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:47.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:47 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:47.579+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:47.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:47 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:47.579+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:47.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:47 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:47.579+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:47.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:47 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:47.579+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:21.322376+0000 front 2024-08-31T06:58:21.322400+0000 (oldest deadline 2024-08-31T06:58:46.622532+0000) 2024-08-31T06:58:48.031 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:47 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:47.652+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:48.031 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:47 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:47.652+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:48.031 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:47 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:47.652+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:48.031 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:47 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:47.652+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:48.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:47 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:47.635+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:48.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:47 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:47.635+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:48.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:47 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:47.635+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:48.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:47 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:47.635+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:48.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:47 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:47.635+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:48.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:48 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:48.029+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:48.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:48 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:48.029+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:48.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:48 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:48.029+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:48.630 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:48.262+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:48.630 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:48.262+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:48.630 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:48.262+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:48.631 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:48.262+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:48.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:48.629+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.118342+0000 front 2024-08-31T06:58:01.118403+0000 (oldest deadline 2024-08-31T06:58:22.218499+0000) 2024-08-31T06:58:48.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:48.629+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.620039+0000 front 2024-08-31T06:58:08.620138+0000 (oldest deadline 2024-08-31T06:58:29.719856+0000) 2024-08-31T06:58:48.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:48.629+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.521872+0000 front 2024-08-31T06:58:15.521654+0000 (oldest deadline 2024-08-31T06:58:38.421598+0000) 2024-08-31T06:58:48.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:48 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7[41121]: 2024-08-31T06:58:48.629+0000 7fe1c9135640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:21.322376+0000 front 2024-08-31T06:58:21.322400+0000 (oldest deadline 2024-08-31T06:58:46.622532+0000) 2024-08-31T06:58:49.055 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:48 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:48.688+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:49.055 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:48 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:48.688+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:49.055 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:48 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:48.688+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:49.055 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:48 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:48.688+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:49.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:48.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:49.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:48.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:49.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:48.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:49.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:48.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:49.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:48 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:48.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:49.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:49 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:49.054+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:49.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:49 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:49.054+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:49.315 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:49 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:49.054+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:49.637 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:49 smithi066 podman[57661]: 2024-08-31 06:58:49.420321736 +0000 UTC m=+5.533205834 container died 52880b99c3b85a15665897c97bfc97f4fd18d079fc8e7b6c1ae8646472bc0b91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-08-31T06:58:49.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:49 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:49.297+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:49.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:49 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:49.297+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:49.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:49 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:49.297+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:49.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:49 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:49.297+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:49.945 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:49 smithi066 podman[57661]: 2024-08-31 06:58:49.71000084 +0000 UTC m=+5.822884935 container cleanup 52880b99c3b85a15665897c97bfc97f4fd18d079fc8e7b6c1ae8646472bc0b91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:58:49.945 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:49 smithi066 bash[57661]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7 2024-08-31T06:58:50.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:49 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:49.717+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:50.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:49 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:49.717+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:50.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:49 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:49.717+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:50.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:49 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:49.717+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:50.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:49 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:49.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:50.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:49 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:49.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:50.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:49 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:49.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:50.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:49 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:49.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:50.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:49 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:49.644+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:50.270 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:49 smithi066 podman[57688]: 2024-08-31 06:58:49.944375466 +0000 UTC m=+0.524344204 container remove 52880b99c3b85a15665897c97bfc97f4fd18d079fc8e7b6c1ae8646472bc0b91 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T06:58:50.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:50 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:50.099+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:50.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:50 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:50.099+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:50.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:50 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:50.099+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:50.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:50 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:50.099+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:24.791373+0000 front 2024-08-31T06:58:24.791262+0000 (oldest deadline 2024-08-31T06:58:49.491154+0000) 2024-08-31T06:58:50.572 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:50 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:50.320+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:50.572 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:50 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:50.320+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:50.572 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:50 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:50.320+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:50.573 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:50 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:50.320+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:50.573 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:50 smithi066 podman[57779]: 2024-08-31 06:58:50.27011631 +0000 UTC m=+0.112983662 container create 8dfdbc5874eda53744da6700d69c12adea415066c8b582847154842378375445 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-31T06:58:50.573 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:50 smithi066 podman[57779]: 2024-08-31 06:58:50.173562062 +0000 UTC m=+0.016429371 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:58:50.573 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:50 smithi066 podman[57779]: 2024-08-31 06:58:50.489212703 +0000 UTC m=+0.332080015 container init 8dfdbc5874eda53744da6700d69c12adea415066c8b582847154842378375445 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T06:58:50.573 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:50 smithi066 podman[57779]: 2024-08-31 06:58:50.49249618 +0000 UTC m=+0.335363502 container start 8dfdbc5874eda53744da6700d69c12adea415066c8b582847154842378375445 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-08-31T06:58:50.573 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:50 smithi066 podman[57779]: 2024-08-31 06:58:50.57228276 +0000 UTC m=+0.415150084 container attach 8dfdbc5874eda53744da6700d69c12adea415066c8b582847154842378375445 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-31T06:58:50.887 INFO:journalctl@ceph.osd.7.smithi066.stdout:Aug 31 06:58:50 smithi066 podman[57779]: 2024-08-31 06:58:50.691723336 +0000 UTC m=+0.534590656 container died 8dfdbc5874eda53744da6700d69c12adea415066c8b582847154842378375445 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T06:58:51.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:50 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:50.738+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:51.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:50 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:50.738+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:51.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:50 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:50.738+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:51.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:50 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:50.738+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:51.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:50 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:50.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:51.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:50 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:50.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:51.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:50 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:50.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:51.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:50 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:50.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:51.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:50 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:50.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:51.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.7.service' 2024-08-31T06:58:51.295 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:58:51.295 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-31T06:58:51.295 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-31T06:58:51.296 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.8 2024-08-31T06:58:51.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:51.121+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:51.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:51.121+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:51.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:51.121+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:51.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:51.121+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:24.791373+0000 front 2024-08-31T06:58:24.791262+0000 (oldest deadline 2024-08-31T06:58:49.491154+0000) 2024-08-31T06:58:51.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:51 smithi106 systemd[1]: Stopping Ceph osd.8 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:58:51.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:51 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:51.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:51.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:51 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:51.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:51.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:51 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:51.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:51.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:51 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:51.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:52.065 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:51.592+0000 7f390df48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:58:52.065 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:51.592+0000 7f390df48640 -1 osd.8 89 *** Got signal Terminated *** 2024-08-31T06:58:52.065 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:51.592+0000 7f390df48640 -1 osd.8 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:52.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:51.703+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:52.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:51.703+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:52.066 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:51.703+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:52.066 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:51 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:51.703+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:52.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:51 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:51.615+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:52.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:51 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:51.615+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:52.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:51 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:51.615+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:52.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:51 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:51.615+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:52.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:51 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:51.615+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:52.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:52.085+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:52.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:52.085+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:52.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:52.085+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:52.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:52.085+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:24.791373+0000 front 2024-08-31T06:58:24.791262+0000 (oldest deadline 2024-08-31T06:58:49.491154+0000) 2024-08-31T06:58:52.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:52 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:52.315+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:52.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:52 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:52.315+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:52.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:52 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:52.315+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:52.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:52 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:52.315+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:53.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:52.704+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:53.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:52.704+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:53.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:52.704+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:53.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:52 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:52.704+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:53.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:52 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:52.634+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:53.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:52 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:52.634+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:53.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:52 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:52.634+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:53.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:52 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:52.634+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:53.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:52 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:52.634+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:53.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:53 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:53.107+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:53.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:53 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:53.107+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:53.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:53 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:53.107+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:53.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:53 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:53.107+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:24.791373+0000 front 2024-08-31T06:58:24.791262+0000 (oldest deadline 2024-08-31T06:58:49.491154+0000) 2024-08-31T06:58:53.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:53 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:53.275+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:53.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:53 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:53.275+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:53.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:53 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:53.275+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:53.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:53 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:53.275+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:54.068 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:53 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:53.739+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:54.068 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:53 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:53.739+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:54.068 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:53 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:53.739+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:54.068 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:53 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:53.739+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:54.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:53.657+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:54.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:53.657+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:54.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:53.657+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:54.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:53.657+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:54.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:53 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:53.657+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:54.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:54 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:54.154+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:54.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:54 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:54.154+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:54.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:54 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:54.154+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:54.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:54 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:54.154+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:24.791373+0000 front 2024-08-31T06:58:24.791262+0000 (oldest deadline 2024-08-31T06:58:49.491154+0000) 2024-08-31T06:58:54.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:54 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:54.236+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:54.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:54 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:54.236+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:54.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:54 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:54.236+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:54.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:54 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:54.236+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:55.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:54 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:54.737+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:55.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:54 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:54.737+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:55.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:54 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:54.737+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:55.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:54 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:54.737+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:55.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:54 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:54.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:55.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:54 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:54.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:55.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:54 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:54.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:55.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:54 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:54.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:55.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:54 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:54.642+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:55.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:55 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:55.239+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:55.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:55 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:55.239+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:55.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:55 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:55.239+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:55.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:55 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:55.239+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:55.387 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:55 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:55.239+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:58:55.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:55 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:55.152+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:55.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:55 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:55.152+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:55.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:55 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:55.152+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:55.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:55 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:55.152+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:24.791373+0000 front 2024-08-31T06:58:24.791262+0000 (oldest deadline 2024-08-31T06:58:49.491154+0000) 2024-08-31T06:58:56.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:55 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:55.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:56.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:55 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:55.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:56.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:55 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:55.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:56.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:55 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:55.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:56.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:55 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:55.643+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:56.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:55 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:55.643+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:56.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:55 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:55.643+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:56.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:55 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:55.643+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:56.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:55 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:55.643+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:56.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:55 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:55.643+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:58:56.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:56.133+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:52.284686+0000 front 2024-08-31T06:57:52.284595+0000 (oldest deadline 2024-08-31T06:58:16.984589+0000) 2024-08-31T06:58:56.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:56.133+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:08.389058+0000 front 2024-08-31T06:58:08.389120+0000 (oldest deadline 2024-08-31T06:58:31.889227+0000) 2024-08-31T06:58:56.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:56.133+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:11.889636+0000 front 2024-08-31T06:58:11.889699+0000 (oldest deadline 2024-08-31T06:58:38.890238+0000) 2024-08-31T06:58:56.565 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8[41726]: 2024-08-31T06:58:56.133+0000 7f390652b640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:24.791373+0000 front 2024-08-31T06:58:24.791262+0000 (oldest deadline 2024-08-31T06:58:49.491154+0000) 2024-08-31T06:58:56.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:56 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:56.289+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:56.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:56 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:56.289+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:56.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:56 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:56.289+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:56.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:56 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:56.289+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:56.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:56 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:56.289+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:58:57.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:56.745+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:57.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:56.745+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:57.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:56.745+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:57.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:56.745+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:57.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:56 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:56.745+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:58:57.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:56.675+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:57.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:56.675+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:57.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:56.675+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:57.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:56.675+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:57.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:56.675+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:57.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:56 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:56.675+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:58:57.480 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:57 smithi106 podman[58964]: 2024-08-31 06:58:57.157717877 +0000 UTC m=+5.671436855 container died 2b1aa06ef031b766fa8ef09e0424b966e3b2ef88f89445760999b0cd07239759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-08-31T06:58:57.480 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:57 smithi106 podman[58964]: 2024-08-31 06:58:57.480204841 +0000 UTC m=+5.993923818 container cleanup 2b1aa06ef031b766fa8ef09e0424b966e3b2ef88f89445760999b0cd07239759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:58:57.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:57 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:57.329+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:57.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:57 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:57.329+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:57.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:57 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:57.329+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:57.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:57 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:57.329+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:57.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:57 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:57.329+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:58:57.754 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:57 smithi106 bash[58964]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8 2024-08-31T06:58:57.754 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:57 smithi106 podman[58979]: 2024-08-31 06:58:57.66471989 +0000 UTC m=+0.500436127 container remove 2b1aa06ef031b766fa8ef09e0424b966e3b2ef88f89445760999b0cd07239759 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:58:58.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:57 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:57.752+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:58.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:57 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:57.752+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:58.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:57 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:57.752+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:58.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:57 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:57.752+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:58.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:57 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:57.752+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:58:58.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:57 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:57.666+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:58.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:57 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:57.666+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:58.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:57 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:57.666+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:58.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:57 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:57.666+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:58.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:57 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:57.666+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:58.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:57 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:57.666+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:58:58.419 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:58 smithi106 podman[59067]: 2024-08-31 06:58:57.992161482 +0000 UTC m=+0.015449158 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:58:58.419 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:58 smithi106 podman[59067]: 2024-08-31 06:58:58.107131646 +0000 UTC m=+0.130419310 container create ba976e7c5185b296c8a63497eca8ce78c6915721df155d722c30df1b276228ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-08-31T06:58:58.419 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:58 smithi106 podman[59067]: 2024-08-31 06:58:58.334993831 +0000 UTC m=+0.358281494 container init ba976e7c5185b296c8a63497eca8ce78c6915721df155d722c30df1b276228ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-31T06:58:58.419 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:58 smithi106 podman[59067]: 2024-08-31 06:58:58.338164968 +0000 UTC m=+0.361452634 container start ba976e7c5185b296c8a63497eca8ce78c6915721df155d722c30df1b276228ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=) 2024-08-31T06:58:58.419 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:58 smithi106 podman[59067]: 2024-08-31 06:58:58.418095442 +0000 UTC m=+0.441383124 container attach ba976e7c5185b296c8a63497eca8ce78c6915721df155d722c30df1b276228ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1) 2024-08-31T06:58:58.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:58 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:58.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:58.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:58 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:58.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:58.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:58 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:58.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:58.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:58 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:58.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:58.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:58 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:58.295+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:58:58.771 INFO:journalctl@ceph.osd.8.smithi106.stdout:Aug 31 06:58:58 smithi106 podman[59067]: 2024-08-31 06:58:58.532355924 +0000 UTC m=+0.555643600 container died ba976e7c5185b296c8a63497eca8ce78c6915721df155d722c30df1b276228ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T06:58:59.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:58 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:58.770+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:58:59.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:58 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:58.770+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:58:59.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:58 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:58.770+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:58:59.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:58 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:58.770+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:58:59.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:58 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:58.770+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:58:59.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:58 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:58.637+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:59.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:58 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:58.637+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:59.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:58 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:58.637+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:59.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:58 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:58.637+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:59.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:58 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:58.637+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:59.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:58 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:58.637+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:58:59.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.8.service' 2024-08-31T06:58:59.174 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:58:59.174 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-31T06:58:59.174 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-31T06:58:59.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.9 2024-08-31T06:58:59.468 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 systemd[1]: Stopping Ceph osd.9 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:58:59.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:59 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:59.272+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:58:59.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:59 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:59.272+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:58:59.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:59 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:59.272+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:58:59.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:59 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:59.272+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:58:59.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:58:59 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:58:59.272+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:58:59.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.467+0000 7f2e7ecc0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:58:59.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.467+0000 7f2e7ecc0640 -1 osd.9 89 *** Got signal Terminated *** 2024-08-31T06:58:59.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.467+0000 7f2e7ecc0640 -1 osd.9 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:58:59.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.627+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:58:59.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.627+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:58:59.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.627+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:58:59.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.627+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:58:59.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.627+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:58:59.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:58:59 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:58:59.627+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:59:00.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:59 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:59.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:00.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:59 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:59.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:00.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:59 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:59.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:00.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:59 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:59.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:00.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:58:59 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:58:59.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:00.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:00 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:00.257+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:00.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:00 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:00.257+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:00.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:00 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:00.257+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:00.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:00 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:00.257+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:00.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:00 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:00.257+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:01.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:00.653+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:59:01.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:00.653+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:59:01.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:00.653+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:59:01.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:00.653+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:59:01.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:00.653+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:59:01.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:00 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:00.653+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:59:01.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:00 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:00.817+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:01.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:00 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:00.817+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:01.316 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:00 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:00.817+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:01.316 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:00 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:00.817+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:01.316 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:00 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:00.817+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:01.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:01 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:01.274+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:01.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:01 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:01.274+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:01.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:01 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:01.274+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:01.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:01 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:01.274+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:01.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:01 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:01.274+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:02.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:01 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:01.800+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:02.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:01 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:01.800+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:02.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:01 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:01.800+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:02.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:01 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:01.800+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:02.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:01 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:01.800+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:02.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:01 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:01.639+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:59:02.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:01 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:01.639+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:59:02.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:01 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:01.639+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:59:02.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:01 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:01.639+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:59:02.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:01 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:01.639+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:59:02.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:01 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:01.639+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:59:02.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:02 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:02.290+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:02.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:02 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:02.290+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:02.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:02 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:02.290+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:02.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:02 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:02.290+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:02.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:02 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:02.290+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:03.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:02 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:02.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:03.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:02 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:02.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:03.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:02 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:02.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:03.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:02 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:02.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:03.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:02 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:02.813+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:03.104 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:02 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:02.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:59:03.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:02 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:02.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:59:03.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:02 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:02.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:59:03.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:02 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:02.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:59:03.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:02 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:02.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:59:03.105 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:02 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:02.622+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:59:03.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:03 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:03.304+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:03.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:03 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:03.304+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:03.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:03 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:03.304+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:03.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:03 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:03.304+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:03.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:03 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:03.304+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:03.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:03 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:03.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:51.512160+0000 front 2024-08-31T06:57:51.512121+0000 (oldest deadline 2024-08-31T06:58:15.612285+0000) 2024-08-31T06:59:03.854 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:03 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:03.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.614475+0000 front 2024-08-31T06:57:59.614247+0000 (oldest deadline 2024-08-31T06:58:24.314349+0000) 2024-08-31T06:59:03.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:03 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:03.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.015358+0000 front 2024-08-31T06:58:09.015466+0000 (oldest deadline 2024-08-31T06:58:30.115262+0000) 2024-08-31T06:59:03.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:03 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:03.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:15.916538+0000 front 2024-08-31T06:58:15.916610+0000 (oldest deadline 2024-08-31T06:58:40.616786+0000) 2024-08-31T06:59:03.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:03 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:03.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:20.617492+0000 front 2024-08-31T06:58:20.617601+0000 (oldest deadline 2024-08-31T06:58:45.917355+0000) 2024-08-31T06:59:03.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:03 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9[56607]: 2024-08-31T06:59:03.602+0000 7f2e7b2ab640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.618285+0000 front 2024-08-31T06:58:30.618326+0000 (oldest deadline 2024-08-31T06:58:55.318181+0000) 2024-08-31T06:59:04.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:03 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:03.788+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:04.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:03 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:03.788+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:04.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:03 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:03.788+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:04.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:03 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:03.788+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:04.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:03 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:03.788+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:04.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:03 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:03.788+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:04.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:04 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:04.341+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:04.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:04 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:04.341+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:04.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:04 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:04.341+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:04.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:04 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:04.341+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:04.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:04 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:04.341+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:04.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:04 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:04.341+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:05.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:04.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:05.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:04.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:05.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:04.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:05.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:04.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:05.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:04.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:05.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:04 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:04.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:05.354 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:05 smithi037 podman[99679]: 2024-08-31 06:59:05.01040251 +0000 UTC m=+5.644176080 container died b8901635db205088994a69ac9b2512ea6579cb33041a95743c154c064b0afb7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1) 2024-08-31T06:59:05.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:05 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:05.380+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:05.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:05 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:05.380+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:05.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:05 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:05.380+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:05.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:05 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:05.380+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:05.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:05 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:05.380+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:05.638 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:05 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:05.380+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:05.752 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:05 smithi037 podman[99679]: 2024-08-31 06:59:05.509130573 +0000 UTC m=+6.142904132 container cleanup b8901635db205088994a69ac9b2512ea6579cb33041a95743c154c064b0afb7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T06:59:05.752 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:05 smithi037 bash[99679]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9 2024-08-31T06:59:06.060 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:05 smithi037 podman[99694]: 2024-08-31 06:59:05.751889543 +0000 UTC m=+0.731145888 container remove b8901635db205088994a69ac9b2512ea6579cb33041a95743c154c064b0afb7f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-31T06:59:06.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:05 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:05.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:06.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:05 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:05.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:06.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:05 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:05.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:06.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:05 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:05.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:06.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:05 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:05.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:06.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:05 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:05.824+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:06.354 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:06 smithi037 podman[99784]: 2024-08-31 06:59:05.96256811 +0000 UTC m=+0.015622274 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:59:06.354 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:06 smithi037 podman[99784]: 2024-08-31 06:59:06.060913482 +0000 UTC m=+0.113967633 container create c202e1f16dda8a86fc80b57a5204e58e831f5fb40b37666271c4fe54f1e6b8ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-31T06:59:06.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:06 smithi037 podman[99784]: 2024-08-31 06:59:06.455457383 +0000 UTC m=+0.508511535 container init c202e1f16dda8a86fc80b57a5204e58e831f5fb40b37666271c4fe54f1e6b8ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-31T06:59:06.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:06 smithi037 podman[99784]: 2024-08-31 06:59:06.458898691 +0000 UTC m=+0.511952849 container start c202e1f16dda8a86fc80b57a5204e58e831f5fb40b37666271c4fe54f1e6b8ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:59:06.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:06 smithi037 podman[99784]: 2024-08-31 06:59:06.538561112 +0000 UTC m=+0.591615264 container attach c202e1f16dda8a86fc80b57a5204e58e831f5fb40b37666271c4fe54f1e6b8ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-31T06:59:06.855 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 31 06:59:06 smithi037 podman[99784]: 2024-08-31 06:59:06.651133859 +0000 UTC m=+0.704188024 container died c202e1f16dda8a86fc80b57a5204e58e831f5fb40b37666271c4fe54f1e6b8ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-31T06:59:06.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:06 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:06.399+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:06.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:06 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:06.399+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:06.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:06 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:06.399+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:06.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:06 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:06.399+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:06.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:06 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:06.399+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:06.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:06 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:06.399+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:07.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:06 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:06.852+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:07.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:06 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:06.852+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:07.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:06 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:06.852+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:07.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:06 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:06.852+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:07.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:06 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:06.852+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:07.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:06 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:06.852+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:07.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.9.service' 2024-08-31T06:59:07.377 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:07.377 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-31T06:59:07.377 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-31T06:59:07.378 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.10 2024-08-31T06:59:07.687 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 systemd[1]: Stopping Ceph osd.10 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:07.687 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.442+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:07.688 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.442+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:07.688 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.442+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:07.688 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.442+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:07.688 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.442+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:07.688 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.442+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:07.688 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.685+0000 7fbf734b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:07.688 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.685+0000 7fbf734b7640 -1 osd.10 89 *** Got signal Terminated *** 2024-08-31T06:59:07.688 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:07 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:07.685+0000 7fbf734b7640 -1 osd.10 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:59:08.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:07 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:07.862+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:08.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:07 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:07.862+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:08.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:07 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:07.862+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:08.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:07 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:07.862+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:08.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:07 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:07.862+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:08.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:07 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:07.862+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:08.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:08 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:08.479+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:08 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:08.479+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:08 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:08.479+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:08 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:08.479+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:08 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:08.479+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:08.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:08 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:08.479+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:09.216 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:08 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:08.821+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:09.216 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:08 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:08.821+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:09.216 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:08 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:08.821+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:09.216 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:08 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:08.821+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:09.216 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:08 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:08.821+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:09.217 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:08 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:08.821+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:09.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:09 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:09.520+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:09.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:09 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:09.520+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:09.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:09 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:09.520+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:09.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:09 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:09.520+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:09.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:09 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:09.520+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:09.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:09 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:09.520+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:10.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:09 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:09.819+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:10.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:09 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:09.819+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:10.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:09 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:09.819+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:10.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:09 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:09.819+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:10.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:09 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:09.819+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:10.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:09 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:09.819+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:10.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:10 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:10.509+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:10.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:10 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:10.509+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:10.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:10 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:10.509+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:10.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:10 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:10.509+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:10.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:10 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:10.509+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:10.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:10 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:10.509+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:11.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:10 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:10.781+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:11.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:10 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:10.781+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:11.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:10 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:10.781+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:11.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:10 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:10.781+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:11.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:10 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:10.781+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:11.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:10 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:10.781+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:11.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:11 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:11.494+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:11.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:11 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:11.494+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:11.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:11 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:11.494+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:11.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:11 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:11.494+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:11.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:11 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:11.494+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:11.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:11 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:11.494+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:11.888 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:11 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:11.494+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:45.406141+0000 front 2024-08-31T06:58:45.406125+0000 (oldest deadline 2024-08-31T06:59:10.706102+0000) 2024-08-31T06:59:12.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:11 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:11.803+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:12.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:11 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:11.803+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:12.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:11 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:11.803+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:12.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:11 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:11.803+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:12.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:11 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:11.803+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:12.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:11 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:11.803+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:12.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:12 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:12.467+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:57:59.299682+0000 front 2024-08-31T06:57:59.299772+0000 (oldest deadline 2024-08-31T06:58:22.799911+0000) 2024-08-31T06:59:12.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:12 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:12.467+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:09.102125+0000 front 2024-08-31T06:58:09.102015+0000 (oldest deadline 2024-08-31T06:58:33.802141+0000) 2024-08-31T06:59:12.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:12 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:12.467+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-31T06:58:13.802981+0000 front 2024-08-31T06:58:13.803056+0000 (oldest deadline 2024-08-31T06:58:43.203262+0000) 2024-08-31T06:59:12.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:12 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:12.467+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:23.203618+0000 front 2024-08-31T06:58:23.203778+0000 (oldest deadline 2024-08-31T06:58:47.903701+0000) 2024-08-31T06:59:12.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:12 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:12.467+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:30.204780+0000 front 2024-08-31T06:58:30.204846+0000 (oldest deadline 2024-08-31T06:58:54.904538+0000) 2024-08-31T06:59:12.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:12 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:12.467+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:37.805720+0000 front 2024-08-31T06:58:37.805600+0000 (oldest deadline 2024-08-31T06:59:03.705327+0000) 2024-08-31T06:59:12.887 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:12 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10[47622]: 2024-08-31T06:59:12.467+0000 7fbf6faa2640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:45.406141+0000 front 2024-08-31T06:58:45.406125+0000 (oldest deadline 2024-08-31T06:59:10.706102+0000) 2024-08-31T06:59:13.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:12 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:12.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:13.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:12 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:12.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:13.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:12 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:12.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:13.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:12 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:12.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:13.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:12 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:12.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:13.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:12 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:12.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:13.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:12 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:12.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:46.981886+0000 front 2024-08-31T06:58:46.981863+0000 (oldest deadline 2024-08-31T06:59:12.782315+0000) 2024-08-31T06:59:13.296 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:13 smithi066 podman[57881]: 2024-08-31 06:59:13.041151268 +0000 UTC m=+5.465051532 container died ea5be2caaed1dea22d8a32b2e57187034a1667b83bf239e0563f6e059cf66d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True) 2024-08-31T06:59:13.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:13 smithi066 podman[57881]: 2024-08-31 06:59:13.402784362 +0000 UTC m=+5.826684627 container cleanup ea5be2caaed1dea22d8a32b2e57187034a1667b83bf239e0563f6e059cf66d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:59:13.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:13 smithi066 bash[57881]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10 2024-08-31T06:59:14.029 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:13 smithi066 podman[57899]: 2024-08-31 06:59:13.662005765 +0000 UTC m=+0.621540199 container remove ea5be2caaed1dea22d8a32b2e57187034a1667b83bf239e0563f6e059cf66d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T06:59:14.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:13 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:13.798+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:14.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:13 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:13.798+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:14.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:13 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:13.798+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:14.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:13 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:13.798+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:14.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:13 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:13.798+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:14.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:13 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:13.798+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:14.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:13 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:13.798+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:46.981886+0000 front 2024-08-31T06:58:46.981863+0000 (oldest deadline 2024-08-31T06:59:12.782315+0000) 2024-08-31T06:59:14.357 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:14 smithi066 podman[57983]: 2024-08-31 06:59:13.932576328 +0000 UTC m=+0.016431214 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:59:14.357 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:14 smithi066 podman[57983]: 2024-08-31 06:59:14.037673849 +0000 UTC m=+0.121528735 container create c23ced2fa77dcf8c2d54416a93b3bb354b50463f1c2682297f1198bcbe3a5723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:59:14.357 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:14 smithi066 podman[57983]: 2024-08-31 06:59:14.273466935 +0000 UTC m=+0.357321834 container init c23ced2fa77dcf8c2d54416a93b3bb354b50463f1c2682297f1198bcbe3a5723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:59:14.357 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:14 smithi066 podman[57983]: 2024-08-31 06:59:14.276962491 +0000 UTC m=+0.360817379 container start c23ced2fa77dcf8c2d54416a93b3bb354b50463f1c2682297f1198bcbe3a5723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:59:14.357 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:14 smithi066 podman[57983]: 2024-08-31 06:59:14.356896933 +0000 UTC m=+0.440751839 container attach c23ced2fa77dcf8c2d54416a93b3bb354b50463f1c2682297f1198bcbe3a5723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10-deactivate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-31T06:59:14.637 INFO:journalctl@ceph.osd.10.smithi066.stdout:Aug 31 06:59:14 smithi066 podman[57983]: 2024-08-31 06:59:14.472130039 +0000 UTC m=+0.555984928 container died c23ced2fa77dcf8c2d54416a93b3bb354b50463f1c2682297f1198bcbe3a5723 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-31T06:59:15.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:14 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:14.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:15.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:14 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:14.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:15.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:14 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:14.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:15.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:14 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:14.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:15.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:14 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:14.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:15.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:14 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:14.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:15.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:14 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:14.784+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:46.981886+0000 front 2024-08-31T06:58:46.981863+0000 (oldest deadline 2024-08-31T06:59:12.782315+0000) 2024-08-31T06:59:15.123 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.10.service' 2024-08-31T06:59:15.167 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:15.167 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-31T06:59:15.167 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-31T06:59:15.167 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.11 2024-08-31T06:59:15.565 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 systemd[1]: Stopping Ceph osd.11 for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:15.565 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.440+0000 7efd5b6f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:15.565 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.440+0000 7efd5b6f8640 -1 osd.11 89 *** Got signal Terminated *** 2024-08-31T06:59:15.565 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.440+0000 7efd5b6f8640 -1 osd.11 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-31T06:59:16.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:16.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:16.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:16.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:16.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:16.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:16.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:15 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:15.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:46.981886+0000 front 2024-08-31T06:58:46.981863+0000 (oldest deadline 2024-08-31T06:59:12.782315+0000) 2024-08-31T06:59:17.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:16.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:17.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:16.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:17.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:16.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:17.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:16.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:17.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:16.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:17.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:16.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:17.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:16 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:16.792+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:46.981886+0000 front 2024-08-31T06:58:46.981863+0000 (oldest deadline 2024-08-31T06:59:12.782315+0000) 2024-08-31T06:59:18.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:17.793+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:18.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:17.793+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:18.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:17.793+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:18.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:17.793+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:18.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:17.793+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:18.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:17.793+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:18.065 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:17 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:17.793+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:46.981886+0000 front 2024-08-31T06:58:46.981863+0000 (oldest deadline 2024-08-31T06:59:12.782315+0000) 2024-08-31T06:59:19.268 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:18.837+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:19.269 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:18.837+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:19.269 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:18.837+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:19.269 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:18.837+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:19.269 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:18.837+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:19.269 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:18.837+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:19.269 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:18.837+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:46.981886+0000 front 2024-08-31T06:58:46.981863+0000 (oldest deadline 2024-08-31T06:59:12.782315+0000) 2024-08-31T06:59:19.269 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:18 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:18.837+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6820 osd.8 since back 2024-08-31T06:58:52.782816+0000 front 2024-08-31T06:58:52.782846+0000 (oldest deadline 2024-08-31T06:59:18.082921+0000) 2024-08-31T06:59:20.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:19.887+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-31T06:57:47.572362+0000 front 2024-08-31T06:57:47.572275+0000 (oldest deadline 2024-08-31T06:58:16.972812+0000) 2024-08-31T06:59:20.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:19.887+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6804 osd.1 since back 2024-08-31T06:58:01.073811+0000 front 2024-08-31T06:58:01.073786+0000 (oldest deadline 2024-08-31T06:58:22.173932+0000) 2024-08-31T06:59:20.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:19.887+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6804 osd.2 since back 2024-08-31T06:58:07.876331+0000 front 2024-08-31T06:58:07.876557+0000 (oldest deadline 2024-08-31T06:58:33.176492+0000) 2024-08-31T06:59:20.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:19.887+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6812 osd.4 since back 2024-08-31T06:58:22.379017+0000 front 2024-08-31T06:58:22.378995+0000 (oldest deadline 2024-08-31T06:58:46.479114+0000) 2024-08-31T06:59:20.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:19.887+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6812 osd.5 since back 2024-08-31T06:58:31.180033+0000 front 2024-08-31T06:58:31.179920+0000 (oldest deadline 2024-08-31T06:58:56.480012+0000) 2024-08-31T06:59:20.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:19.887+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-31T06:58:38.781046+0000 front 2024-08-31T06:58:38.781096+0000 (oldest deadline 2024-08-31T06:59:02.880770+0000) 2024-08-31T06:59:20.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:19.887+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.66:6820 osd.7 since back 2024-08-31T06:58:46.981886+0000 front 2024-08-31T06:58:46.981863+0000 (oldest deadline 2024-08-31T06:59:12.782315+0000) 2024-08-31T06:59:20.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:19 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11[48710]: 2024-08-31T06:59:19.887+0000 7efd57ce3640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.106:6820 osd.8 since back 2024-08-31T06:58:52.782816+0000 front 2024-08-31T06:58:52.782846+0000 (oldest deadline 2024-08-31T06:59:18.082921+0000) 2024-08-31T06:59:21.125 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:20 smithi106 podman[59182]: 2024-08-31 06:59:20.823196539 +0000 UTC m=+5.462718427 container died 3521f4707fa5706f8febd63c219c9e6007865aceac8d7c77c64abc8f2ccaae8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-08-31T06:59:21.459 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:21 smithi106 podman[59182]: 2024-08-31 06:59:21.224163114 +0000 UTC m=+5.863685006 container cleanup 3521f4707fa5706f8febd63c219c9e6007865aceac8d7c77c64abc8f2ccaae8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-31T06:59:21.459 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:21 smithi106 bash[59182]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11 2024-08-31T06:59:21.759 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:21 smithi106 podman[59199]: 2024-08-31 06:59:21.458614208 +0000 UTC m=+0.623497702 container remove 3521f4707fa5706f8febd63c219c9e6007865aceac8d7c77c64abc8f2ccaae8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T06:59:22.062 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:21 smithi106 podman[59284]: 2024-08-31 06:59:21.759343495 +0000 UTC m=+0.105415535 container create 50ff7a5df6c81790bf91221a1115a8e336c71af6bc5452471d4ed4298b19bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-31T06:59:22.062 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:21 smithi106 podman[59284]: 2024-08-31 06:59:21.6696864 +0000 UTC m=+0.015758448 image pull 79f4cde5e36911a5dca995eeb98098c2c8aae81dd52a088ef2c867bc3363bad0 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61 2024-08-31T06:59:22.062 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:21 smithi106 podman[59284]: 2024-08-31 06:59:21.986765933 +0000 UTC m=+0.332837973 container init 50ff7a5df6c81790bf91221a1115a8e336c71af6bc5452471d4ed4298b19bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T06:59:22.062 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:21 smithi106 podman[59284]: 2024-08-31 06:59:21.990110113 +0000 UTC m=+0.336182155 container start 50ff7a5df6c81790bf91221a1115a8e336c71af6bc5452471d4ed4298b19bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, ceph=True, org.label-schema.license=GPLv2) 2024-08-31T06:59:22.062 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:22 smithi106 podman[59284]: 2024-08-31 06:59:22.061719528 +0000 UTC m=+0.407791584 container attach 50ff7a5df6c81790bf91221a1115a8e336c71af6bc5452471d4ed4298b19bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11-deactivate, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-31T06:59:22.315 INFO:journalctl@ceph.osd.11.smithi106.stdout:Aug 31 06:59:22 smithi106 podman[59308]: 2024-08-31 06:59:22.202497381 +0000 UTC m=+0.016057208 container died 50ff7a5df6c81790bf91221a1115a8e336c71af6bc5452471d4ed4298b19bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-31T06:59:22.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@osd.11.service' 2024-08-31T06:59:22.776 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:22.776 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-31T06:59:22.776 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-31T06:59:22.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.a 2024-08-31T06:59:23.061 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:59:22 smithi037 systemd[1]: Stopping Ceph mds.a for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:23.354 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:59:23 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a[63247]: 2024-08-31T06:59:23.060+0000 7febdb92f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:23.354 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:59:23 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a[63247]: 2024-08-31T06:59:23.060+0000 7febdb92f640 -1 mds.a *** got signal Terminated *** 2024-08-31T06:59:26.354 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:59:26 smithi037 podman[99886]: 2024-08-31 06:59:26.034556042 +0000 UTC m=+3.065018478 container died 9f3a20e44d8d481ab119deffd39cdf7143f664d0c4f7584c70f02261dabb5fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2) 2024-08-31T06:59:26.854 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:59:26 smithi037 podman[99886]: 2024-08-31 06:59:26.593961737 +0000 UTC m=+3.624424171 container cleanup 9f3a20e44d8d481ab119deffd39cdf7143f664d0c4f7584c70f02261dabb5fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-31T06:59:26.854 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 31 06:59:26 smithi037 bash[99886]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-a 2024-08-31T06:59:27.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.a.service' 2024-08-31T06:59:27.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:27.065 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-31T06:59:27.065 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-31T06:59:27.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.d 2024-08-31T06:59:27.354 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:59:27 smithi037 systemd[1]: Stopping Ceph mds.d for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:27.854 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:59:27 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d[62048]: 2024-08-31T06:59:27.389+0000 7f7626e78640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:27.855 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:59:27 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d[62048]: 2024-08-31T06:59:27.389+0000 7f7626e78640 -1 mds.d *** got signal Terminated *** 2024-08-31T06:59:31.604 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:59:31 smithi037 podman[100010]: 2024-08-31 06:59:31.224270921 +0000 UTC m=+3.943199212 container died db60f19020135f13e3bbbbd50285ffb04493bd6f9076dabf14b4d827a7739b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:59:32.105 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:59:31 smithi037 podman[100010]: 2024-08-31 06:59:31.914581637 +0000 UTC m=+4.633509964 container cleanup db60f19020135f13e3bbbbd50285ffb04493bd6f9076dabf14b4d827a7739b2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:59:32.105 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 31 06:59:31 smithi037 bash[100010]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-d 2024-08-31T06:59:32.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.d.service' 2024-08-31T06:59:32.327 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:32.327 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-31T06:59:32.327 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-31T06:59:32.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.g 2024-08-31T06:59:32.768 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:59:32 smithi037 systemd[1]: Stopping Ceph mds.g for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:33.104 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:59:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g[62846]: 2024-08-31T06:59:32.768+0000 7f36593c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:33.105 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:59:32 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g[62846]: 2024-08-31T06:59:32.768+0000 7f36593c4640 -1 mds.g *** got signal Terminated *** 2024-08-31T06:59:34.854 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:59:34 smithi037 podman[100130]: 2024-08-31 06:59:34.602400441 +0000 UTC m=+2.051788817 container died 0a980fe2706afb70a90052acabd0e1e9d147795921947b2a95ea0154ec35a836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-31T06:59:35.328 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:59:35 smithi037 podman[100130]: 2024-08-31 06:59:35.052080912 +0000 UTC m=+2.501469331 container cleanup 0a980fe2706afb70a90052acabd0e1e9d147795921947b2a95ea0154ec35a836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:59:35.328 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 31 06:59:35 smithi037 bash[100130]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-g 2024-08-31T06:59:35.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.g.service' 2024-08-31T06:59:35.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:35.524 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-31T06:59:35.525 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-31T06:59:35.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.j 2024-08-31T06:59:35.854 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:59:35 smithi037 systemd[1]: Stopping Ceph mds.j for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:35.854 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:59:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j[61650]: 2024-08-31T06:59:35.830+0000 7fd96f25c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:35.855 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:59:35 smithi037 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j[61650]: 2024-08-31T06:59:35.830+0000 7fd96f25c640 -1 mds.j *** got signal Terminated *** 2024-08-31T06:59:39.840 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:59:39 smithi037 podman[100253]: 2024-08-31 06:59:39.577955857 +0000 UTC m=+3.835824111 container died 659bc555155f922b21ee7abfea0cc896abd4073d87858b4665541cd837a524d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-31T06:59:40.104 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:59:39 smithi037 podman[100253]: 2024-08-31 06:59:39.997614434 +0000 UTC m=+4.255482679 container cleanup 659bc555155f922b21ee7abfea0cc896abd4073d87858b4665541cd837a524d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j, io.buildah.version=1.37.1, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:59:40.105 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:59:39 smithi037 bash[100253]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j 2024-08-31T06:59:40.666 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 31 06:59:40 smithi037 podman[100265]: 2024-08-31 06:59:40.399261836 +0000 UTC m=+0.819215042 container remove 659bc555155f922b21ee7abfea0cc896abd4073d87858b4665541cd837a524d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611) 2024-08-31T06:59:40.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.j.service' 2024-08-31T06:59:40.715 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:40.715 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-31T06:59:40.715 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-31T06:59:40.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.b 2024-08-31T06:59:41.020 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:59:40 smithi066 systemd[1]: Stopping Ceph mds.b for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:41.387 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:59:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b[52802]: 2024-08-31T06:59:41.019+0000 7faf051ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:41.387 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:59:41 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b[52802]: 2024-08-31T06:59:41.019+0000 7faf051ed640 -1 mds.b *** got signal Terminated *** 2024-08-31T06:59:44.803 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:59:44 smithi066 podman[58098]: 2024-08-31 06:59:44.52948886 +0000 UTC m=+3.615643549 container died e93d82a05c193195495f47d5aa4bf6853c2d1924b30a75a2dba1f795a5fdfbc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T06:59:45.137 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:59:44 smithi066 podman[58098]: 2024-08-31 06:59:44.902377222 +0000 UTC m=+3.988531898 container cleanup e93d82a05c193195495f47d5aa4bf6853c2d1924b30a75a2dba1f795a5fdfbc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-31T06:59:45.137 INFO:journalctl@ceph.mds.b.smithi066.stdout:Aug 31 06:59:44 smithi066 bash[58098]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-b 2024-08-31T06:59:45.323 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.b.service' 2024-08-31T06:59:45.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:45.360 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-31T06:59:45.360 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-31T06:59:45.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.e 2024-08-31T06:59:45.801 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:59:45 smithi066 systemd[1]: Stopping Ceph mds.e for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:46.137 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:59:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e[52198]: 2024-08-31T06:59:45.800+0000 7f8442ba1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:46.137 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:59:45 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e[52198]: 2024-08-31T06:59:45.800+0000 7f8442ba1640 -1 mds.e *** got signal Terminated *** 2024-08-31T06:59:48.790 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:59:48 smithi066 podman[58218]: 2024-08-31 06:59:48.533168414 +0000 UTC m=+2.948826555 container died 229e00a0a109994d5140090fab9eea1aa23b3a45fb526ce62ae6453ef3c20966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T06:59:49.137 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:59:48 smithi066 podman[58218]: 2024-08-31 06:59:48.889163954 +0000 UTC m=+3.304822086 container cleanup 229e00a0a109994d5140090fab9eea1aa23b3a45fb526ce62ae6453ef3c20966 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-31T06:59:49.137 INFO:journalctl@ceph.mds.e.smithi066.stdout:Aug 31 06:59:48 smithi066 bash[58218]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-e 2024-08-31T06:59:49.334 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.e.service' 2024-08-31T06:59:49.369 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:49.370 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-31T06:59:49.370 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-31T06:59:49.370 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.h 2024-08-31T06:59:49.802 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:59:49 smithi066 systemd[1]: Stopping Ceph mds.h for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:50.137 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:59:49 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h[52501]: 2024-08-31T06:59:49.801+0000 7f365a8e8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:50.137 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:59:49 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h[52501]: 2024-08-31T06:59:49.801+0000 7f365a8e8640 -1 mds.h *** got signal Terminated *** 2024-08-31T06:59:52.810 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:59:52 smithi066 podman[58352]: 2024-08-31 06:59:52.536353878 +0000 UTC m=+2.940835081 container died 3e711934342cd3f02932cfb0c90af3e1400e59e3324faa4967db2b4b34dc6ec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-31T06:59:53.137 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:59:52 smithi066 podman[58352]: 2024-08-31 06:59:52.918788141 +0000 UTC m=+3.323269337 container cleanup 3e711934342cd3f02932cfb0c90af3e1400e59e3324faa4967db2b4b34dc6ec4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.build-date=20240731) 2024-08-31T06:59:53.137 INFO:journalctl@ceph.mds.h.smithi066.stdout:Aug 31 06:59:52 smithi066 bash[58352]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-h 2024-08-31T06:59:53.304 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.h.service' 2024-08-31T06:59:53.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:53.338 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-31T06:59:53.338 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-31T06:59:53.338 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.k 2024-08-31T06:59:53.887 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:53 smithi066 systemd[1]: Stopping Ceph mds.k for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:53.887 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:53 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-k[51885]: 2024-08-31T06:59:53.646+0000 7fbd2cf9d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:53.887 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:53 smithi066 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-k[51885]: 2024-08-31T06:59:53.647+0000 7fbd2cf9d640 -1 mds.k *** got signal Terminated *** 2024-08-31T06:59:56.873 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:56 smithi066 podman[58472]: 2024-08-31 06:59:56.515136361 +0000 UTC m=+2.952900586 container died 767bbb02c09cf1618489c2e9fc36878ef9b1379e5b97d91d374437b07327e75a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-31T06:59:57.137 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:56 smithi066 podman[58472]: 2024-08-31 06:59:56.946400852 +0000 UTC m=+3.384165077 container cleanup 767bbb02c09cf1618489c2e9fc36878ef9b1379e5b97d91d374437b07327e75a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.license=GPLv2, ceph=True) 2024-08-31T06:59:57.137 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:56 smithi066 bash[58472]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-k 2024-08-31T06:59:57.380 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.k.service' 2024-08-31T06:59:57.403 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:57 smithi066 podman[58483]: 2024-08-31 06:59:57.13908853 +0000 UTC m=+0.615919561 container remove 767bbb02c09cf1618489c2e9fc36878ef9b1379e5b97d91d374437b07327e75a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True) 2024-08-31T06:59:57.403 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:57 smithi066 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.k.service: Deactivated successfully. 2024-08-31T06:59:57.403 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:57 smithi066 systemd[1]: Stopped Ceph mds.k for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T06:59:57.403 INFO:journalctl@ceph.mds.k.smithi066.stdout:Aug 31 06:59:57 smithi066 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.k.service: Consumed 1.122s CPU time. 2024-08-31T06:59:57.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T06:59:57.414 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-31T06:59:57.414 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-31T06:59:57.414 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.c 2024-08-31T06:59:57.815 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:59:57 smithi106 systemd[1]: Stopping Ceph mds.c for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T06:59:57.815 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:59:57 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c[53678]: 2024-08-31T06:59:57.690+0000 7f8f6229d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T06:59:57.815 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 06:59:57 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c[53678]: 2024-08-31T06:59:57.690+0000 7f8f6229d640 -1 mds.c *** got signal Terminated *** 2024-08-31T07:00:00.774 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 07:00:00 smithi106 podman[59388]: 2024-08-31 07:00:00.525708749 +0000 UTC m=+2.919994389 container died a3afd8b272e8ca3317c226527091b488725894155ddee4461735b97751d046b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.1, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-31T07:00:01.057 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 07:00:00 smithi106 podman[59388]: 2024-08-31 07:00:00.864825588 +0000 UTC m=+3.259111227 container cleanup a3afd8b272e8ca3317c226527091b488725894155ddee4461735b97751d046b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-31T07:00:01.058 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 07:00:00 smithi106 bash[59388]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c 2024-08-31T07:00:01.288 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.c.service' 2024-08-31T07:00:01.310 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 07:00:01 smithi106 podman[59413]: 2024-08-31 07:00:01.057607068 +0000 UTC m=+0.525562819 container remove a3afd8b272e8ca3317c226527091b488725894155ddee4461735b97751d046b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-c, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.1, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-08-31T07:00:01.310 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 07:00:01 smithi106 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.c.service: Deactivated successfully. 2024-08-31T07:00:01.310 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 07:00:01 smithi106 systemd[1]: Stopped Ceph mds.c for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T07:00:01.311 INFO:journalctl@ceph.mds.c.smithi106.stdout:Aug 31 07:00:01 smithi106 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.c.service: Consumed 2.371s CPU time. 2024-08-31T07:00:01.324 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T07:00:01.324 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-31T07:00:01.324 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-31T07:00:01.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.f 2024-08-31T07:00:01.565 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 07:00:01 smithi106 systemd[1]: Stopping Ceph mds.f for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T07:00:02.064 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 07:00:01 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f[53378]: 2024-08-31T07:00:01.660+0000 7fb79d9d2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T07:00:02.065 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 07:00:01 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f[53378]: 2024-08-31T07:00:01.660+0000 7fb79d9d2640 -1 mds.f *** got signal Terminated *** 2024-08-31T07:00:04.804 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 07:00:04 smithi106 podman[59524]: 2024-08-31 07:00:04.538132846 +0000 UTC m=+2.997165863 container died 3251a0d061b3416a002867f6cee86f2d43f874970e8898d6c7d699d3feaaa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f, ceph=True, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.1, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-31T07:00:05.065 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 07:00:04 smithi106 podman[59524]: 2024-08-31 07:00:04.877141537 +0000 UTC m=+3.336174554 container cleanup 3251a0d061b3416a002867f6cee86f2d43f874970e8898d6c7d699d3feaaa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.1) 2024-08-31T07:00:05.065 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 07:00:04 smithi106 bash[59524]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f 2024-08-31T07:00:05.065 INFO:journalctl@ceph.mds.f.smithi106.stdout:Aug 31 07:00:05 smithi106 podman[59536]: 2024-08-31 07:00:05.044925383 +0000 UTC m=+0.506843827 container remove 3251a0d061b3416a002867f6cee86f2d43f874970e8898d6c7d699d3feaaa438 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-f, CEPH_POINT_RELEASE=, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, io.buildah.version=1.37.1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T07:00:05.257 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.f.service' 2024-08-31T07:00:05.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T07:00:05.291 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-31T07:00:05.291 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-31T07:00:05.291 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.i 2024-08-31T07:00:05.565 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:05 smithi106 systemd[1]: Stopping Ceph mds.i for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T07:00:06.065 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:05 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i[53980]: 2024-08-31T07:00:05.621+0000 7fe312183640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T07:00:06.065 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:05 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i[53980]: 2024-08-31T07:00:05.621+0000 7fe312183640 -1 mds.i *** got signal Terminated *** 2024-08-31T07:00:08.807 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:08 smithi106 podman[59644]: 2024-08-31 07:00:08.52282414 +0000 UTC m=+3.013541285 container died 679d36093c9086e0e69a4cdb5c6446982ef67d989eecefaa3ab0e73562648006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i, maintainer=Guillaume Abrioux , io.buildah.version=1.37.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-31T07:00:09.065 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:08 smithi106 podman[59644]: 2024-08-31 07:00:08.897379046 +0000 UTC m=+3.388096191 container cleanup 679d36093c9086e0e69a4cdb5c6446982ef67d989eecefaa3ab0e73562648006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-31T07:00:09.065 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:08 smithi106 bash[59644]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i 2024-08-31T07:00:09.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.i.service' 2024-08-31T07:00:09.345 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:09 smithi106 podman[59657]: 2024-08-31 07:00:09.181983121 +0000 UTC m=+0.652289652 container remove 679d36093c9086e0e69a4cdb5c6446982ef67d989eecefaa3ab0e73562648006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-31T07:00:09.346 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:09 smithi106 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.i.service: Deactivated successfully. 2024-08-31T07:00:09.346 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:09 smithi106 systemd[1]: Stopped Ceph mds.i for 22785f22-6763-11ef-bcd4-c7b262605968. 2024-08-31T07:00:09.346 INFO:journalctl@ceph.mds.i.smithi106.stdout:Aug 31 07:00:09 smithi106 systemd[1]: ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.i.service: Consumed 1.968s CPU time. 2024-08-31T07:00:09.357 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T07:00:09.357 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-31T07:00:09.358 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-31T07:00:09.358 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.l 2024-08-31T07:00:09.676 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 07:00:09 smithi106 systemd[1]: Stopping Ceph mds.l for 22785f22-6763-11ef-bcd4-c7b262605968... 2024-08-31T07:00:10.065 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 07:00:09 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l[53078]: 2024-08-31T07:00:09.675+0000 7fbda9a9b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-31T07:00:10.065 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 07:00:09 smithi106 ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l[53078]: 2024-08-31T07:00:09.675+0000 7fbda9a9b640 -1 mds.l *** got signal Terminated *** 2024-08-31T07:00:13.961 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 07:00:13 smithi106 podman[59764]: 2024-08-31 07:00:13.69167464 +0000 UTC m=+4.120816447 container died 285bef8cfd45b3e29e692f69b06be0eeddc16f613d463f5b5d14ec58bde50f26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-31T07:00:14.269 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 07:00:14 smithi106 podman[59764]: 2024-08-31 07:00:14.059691813 +0000 UTC m=+4.488833622 container cleanup 285bef8cfd45b3e29e692f69b06be0eeddc16f613d463f5b5d14ec58bde50f26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e18f78946a0f2b5a73edfdd8c722a31841f880199baf0b88caf17994ffbc1a61, name=ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l, io.buildah.version=1.37.1, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-mchangir-testing-20240828.085847-main-debug-d19e611, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-31T07:00:14.269 INFO:journalctl@ceph.mds.l.smithi106.stdout:Aug 31 07:00:14 smithi106 bash[59764]: ceph-22785f22-6763-11ef-bcd4-c7b262605968-mds-l 2024-08-31T07:00:14.474 DEBUG:teuthology.orchestra.run.smithi106:> sudo pkill -f 'journalctl -f -n 0 -u ceph-22785f22-6763-11ef-bcd4-c7b262605968@mds.l.service' 2024-08-31T07:00:14.506 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-31T07:00:14.506 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-31T07:00:14.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22785f22-6763-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T07:00:14.717 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T07:00:17.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22785f22-6763-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T07:00:17.268 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T07:00:20.002 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22785f22-6763-11ef-bcd4-c7b262605968 --force --keep-logs 2024-08-31T07:00:20.203 INFO:teuthology.orchestra.run.smithi106.stdout:Deleting cluster with fsid: 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T07:00:22.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T07:00:22.579 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T07:00:22.614 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-31T07:00:22.640 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-31T07:00:22.643 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi037/crash 2024-08-31T07:00:22.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T07:00:22.676 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T07:00:22.677 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-08-31T07:00:22.679 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi066/crash 2024-08-31T07:00:22.679 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T07:00:22.772 INFO:teuthology.orchestra.run.smithi066.stderr:tar: /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T07:00:22.773 INFO:teuthology.orchestra.run.smithi066.stderr:tar: Error is not recoverable: exiting now 2024-08-31T07:00:22.775 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi106/crash 2024-08-31T07:00:22.775 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash -- . 2024-08-31T07:00:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:tar: /var/lib/ceph/22785f22-6763-11ef-bcd4-c7b262605968/crash: Cannot open: No such file or directory 2024-08-31T07:00:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:tar: Error is not recoverable: exiting now 2024-08-31T07:00:22.813 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-31T07:00:22.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T07:00:22.859 INFO:teuthology.orchestra.run.smithi037.stdout:2024-08-31T06:55:16.925601+0000 mon.a (mon.0) 1287 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-31T07:00:22.860 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-31T07:00:22.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[SEC\]' /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T07:00:22.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]' /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T07:00:22.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[WRN\]' /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-31T07:00:23.046 INFO:teuthology.orchestra.run.smithi037.stdout:2024-08-31T06:55:16.925601+0000 mon.a (mon.0) 1287 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT) 2024-08-31T07:00:23.047 INFO:tasks.cephadm:Compressing logs... 2024-08-31T07:00:23.047 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T07:00:23.090 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T07:00:23.092 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-31T07:00:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-31T07:00:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.0.log 2024-08-31T07:00:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.9.log 2024-08-31T07:00:23.113 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T07:00:23.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.0.log: /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T07:00:23.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.a.log 2024-08-31T07:00:23.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T07:00:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log: /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.a.log 2024-08-31T07:00:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.g.log 2024-08-31T07:00:23.115 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.a.log: 84.1%gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.6.log 2024-08-31T07:00:23.115 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T07:00:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T07:00:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:: No such file or directory 2024-08-31T07:00:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T07:00:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T07:00:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.i.log 2024-08-31T07:00:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log: /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.c.log 2024-08-31T07:00:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T07:00:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.11.log 2024-08-31T07:00:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.c.log: /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.2.log 2024-08-31T07:00:23.119 INFO:teuthology.orchestra.run.smithi106.stderr: 81.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T07:00:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.5.log 2024-08-31T07:00:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T07:00:23.120 INFO:teuthology.orchestra.run.smithi037.stderr: 95.0% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.a.log.gz 2024-08-31T07:00:23.121 INFO:teuthology.orchestra.run.smithi066.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.10.log 2024-08-31T07:00:23.121 INFO:teuthology.orchestra.run.smithi066.stderr:: No such file or directory 2024-08-31T07:00:23.121 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.1.log 2024-08-31T07:00:23.121 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.7.log 2024-08-31T07:00:23.121 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log 2024-08-31T07:00:23.121 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.b.log 2024-08-31T07:00:23.124 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.k.log 2024-08-31T07:00:23.124 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.4.log 2024-08-31T07:00:23.124 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log 2024-08-31T07:00:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.l.log 2024-08-31T07:00:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log: 90.3% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T07:00:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.8.log 2024-08-31T07:00:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.l.log: 87.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T07:00:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.z.log 2024-08-31T07:00:23.126 INFO:teuthology.orchestra.run.smithi037.stderr: 95.1% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.g.log.gz 2024-08-31T07:00:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T07:00:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.d.log 2024-08-31T07:00:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.x.log 2024-08-31T07:00:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.j.log 2024-08-31T07:00:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.x.log: 87.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T07:00:23.126 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T07:00:23.127 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.4.log: /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log 2024-08-31T07:00:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.3.log 2024-08-31T07:00:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-08-31T07:00:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.l.log.gz 2024-08-31T07:00:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.c.log 2024-08-31T07:00:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.z.log: 90.8% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T07:00:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.3.log: 95.1% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.d.log.gz 2024-08-31T07:00:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T07:00:23.131 INFO:teuthology.orchestra.run.smithi066.stderr: 90.3% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.audit.log.gz 2024-08-31T07:00:23.131 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.y.log 2024-08-31T07:00:23.131 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log: 81.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.cephadm.log.gz 2024-08-31T07:00:23.132 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log 2024-08-31T07:00:23.132 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.y.log: 95.0% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.k.log.gz 2024-08-31T07:00:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.log: 95.1% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.j.log.gz 2024-08-31T07:00:23.136 INFO:teuthology.orchestra.run.smithi106.stderr: 92.6% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.z.log.gz 2024-08-31T07:00:23.136 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.f.log 2024-08-31T07:00:23.136 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T07:00:23.137 INFO:teuthology.orchestra.run.smithi066.stderr: 91.0% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-volume.log.gz 2024-08-31T07:00:23.138 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.h.log 2024-08-31T07:00:23.138 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.b.log 2024-08-31T07:00:23.138 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.h.log: 92.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.y.log.gz 2024-08-31T07:00:23.138 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.e.log 2024-08-31T07:00:23.138 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.b.log: 87.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph.log.gz 2024-08-31T07:00:23.139 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-31T07:00:23.150 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/cephadm.log: 94.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T07:00:23.152 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T07:00:23.154 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-31T07:00:23.195 INFO:teuthology.orchestra.run.smithi106.stderr: 92.9% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.i.log.gz 2024-08-31T07:00:23.220 INFO:teuthology.orchestra.run.smithi066.stderr: 92.8% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.h.log.gz 2024-08-31T07:00:23.222 INFO:teuthology.orchestra.run.smithi106.stderr: 94.5% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.f.log.gz 2024-08-31T07:00:23.228 INFO:teuthology.orchestra.run.smithi066.stderr: 94.3% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.e.log.gz 2024-08-31T07:00:23.246 INFO:teuthology.orchestra.run.smithi106.stderr: 93.8% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.c.log.gz 2024-08-31T07:00:23.373 INFO:teuthology.orchestra.run.smithi037.stderr: 90.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mgr.x.log.gz 2024-08-31T07:00:23.421 INFO:teuthology.orchestra.run.smithi106.stderr: 91.7% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.c.log.gz 2024-08-31T07:00:23.435 INFO:teuthology.orchestra.run.smithi066.stderr: 91.7% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.b.log.gz 2024-08-31T07:00:23.592 INFO:teuthology.orchestra.run.smithi066.stderr: 92.8% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mds.b.log.gz 2024-08-31T07:00:24.375 INFO:teuthology.orchestra.run.smithi037.stderr: 90.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-mon.a.log.gz 2024-08-31T07:00:24.919 INFO:teuthology.orchestra.run.smithi106.stderr: 93.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.8.log.gz 2024-08-31T07:00:25.530 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.9.log.gz 2024-08-31T07:00:26.047 INFO:teuthology.orchestra.run.smithi066.stderr: 93.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.10.log.gz 2024-08-31T07:00:26.112 INFO:teuthology.orchestra.run.smithi066.stderr: 93.5% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.4.log.gz 2024-08-31T07:00:26.330 INFO:teuthology.orchestra.run.smithi106.stderr: 93.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.2.log.gz 2024-08-31T07:00:26.377 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.6.log.gz 2024-08-31T07:00:26.455 INFO:teuthology.orchestra.run.smithi066.stderr: 93.9% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.7.log.gz 2024-08-31T07:00:26.461 INFO:teuthology.orchestra.run.smithi066.stderr: 93.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.1.log.gz 2024-08-31T07:00:26.463 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-08-31T07:00:26.464 INFO:teuthology.orchestra.run.smithi066.stderr:real 0m3.355s 2024-08-31T07:00:26.464 INFO:teuthology.orchestra.run.smithi066.stderr:user 0m13.110s 2024-08-31T07:00:26.464 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m0.463s 2024-08-31T07:00:26.708 INFO:teuthology.orchestra.run.smithi106.stderr: 93.8% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.11.log.gz 2024-08-31T07:00:26.841 INFO:teuthology.orchestra.run.smithi106.stderr: 93.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.5.log.gz 2024-08-31T07:00:26.842 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-08-31T07:00:26.842 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m3.736s 2024-08-31T07:00:26.843 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m12.465s 2024-08-31T07:00:26.843 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.468s 2024-08-31T07:00:26.962 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.3.log.gz 2024-08-31T07:00:28.770 INFO:teuthology.orchestra.run.smithi037.stderr: 93.5% -- replaced with /var/log/ceph/22785f22-6763-11ef-bcd4-c7b262605968/ceph-osd.0.log.gz 2024-08-31T07:00:32.625 INFO:teuthology.orchestra.run.smithi037.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-08-31T07:00:32.627 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-08-31T07:00:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m9.525s 2024-08-31T07:00:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m25.327s 2024-08-31T07:00:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.876s 2024-08-31T07:00:32.628 INFO:tasks.cephadm:Archiving logs... 2024-08-31T07:00:32.628 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi037/log 2024-08-31T07:00:32.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T07:00:35.676 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi066/log 2024-08-31T07:00:35.677 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T07:00:37.449 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi106/log 2024-08-31T07:00:37.450 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-31T07:00:39.265 INFO:tasks.cephadm:Removing cluster... 2024-08-31T07:00:39.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22785f22-6763-11ef-bcd4-c7b262605968 --force 2024-08-31T07:00:39.474 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T07:00:39.737 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22785f22-6763-11ef-bcd4-c7b262605968 --force 2024-08-31T07:00:39.953 INFO:teuthology.orchestra.run.smithi066.stdout:Deleting cluster with fsid: 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T07:00:40.239 DEBUG:teuthology.orchestra.run.smithi106:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 22785f22-6763-11ef-bcd4-c7b262605968 --force 2024-08-31T07:00:40.438 INFO:teuthology.orchestra.run.smithi106.stdout:Deleting cluster with fsid: 22785f22-6763-11ef-bcd4-c7b262605968 2024-08-31T07:00:40.705 INFO:tasks.cephadm:Removing cephadm ... 2024-08-31T07:00:40.705 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T07:00:40.724 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T07:00:40.741 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-31T07:00:40.757 INFO:tasks.cephadm:Teardown complete 2024-08-31T07:00:40.757 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-31T07:00:40.768 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-31T07:00:40.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T07:00:40.771 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T07:00:40.784 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-31T07:00:40.873 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-31T07:00:40.883 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-31T07:00:40.883 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T07:00:40.886 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T07:00:40.889 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-31T07:00:40.901 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-08-31T07:00:40.902 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-08-31T07:00:40.903 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: ntpq: command not found 2024-08-31T07:00:40.906 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T07:00:40.907 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-08-31T07:00:40.907 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 -305us[ -288us] +/- 64ms 2024-08-31T07:00:40.907 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 +47us[ +65us] +/- 69ms 2024-08-31T07:00:40.907 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 42 +325us[ +343us] +/- 71ms 2024-08-31T07:00:40.907 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T07:00:40.908 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T07:00:40.908 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-08-31T07:00:40.908 INFO:teuthology.orchestra.run.smithi066.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 -326us[ -330us] +/- 64ms 2024-08-31T07:00:40.908 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 42 +78us[ +74us] +/- 69ms 2024-08-31T07:00:40.908 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +270us[ +266us] +/- 71ms 2024-08-31T07:00:40.908 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T07:00:40.909 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-31T07:00:40.909 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2024-08-31T07:00:40.909 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -294us[ -295us] +/- 64ms 2024-08-31T07:00:40.910 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 +63us[ +63us] +/- 69ms 2024-08-31T07:00:40.910 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +295us[ +294us] +/- 71ms 2024-08-31T07:00:40.910 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-31T07:00:40.910 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-31T07:00:40.920 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-31T07:00:40.921 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-31T07:00:40.979 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T07:00:41.054 DEBUG:teuthology.orchestra.run.smithi066:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T07:00:41.111 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-31T07:00:41.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T07:00:41.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T07:00:41.196 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T07:00:41.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T07:00:41.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-31T07:00:41.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T07:00:41.250 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-31T07:00:41.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-31T07:00:41.271 INFO:teuthology.task.internal:Duration was 1772.867676 seconds 2024-08-31T07:00:41.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-31T07:00:41.282 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-31T07:00:41.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T07:00:41.285 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T07:00:41.287 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-31T07:00:41.325 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T07:00:41.326 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T07:00:41.328 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-31T07:00:41.645 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-31T07:00:41.645 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-08-31T07:00:41.645 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T07:00:41.708 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-08-31T07:00:41.708 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T07:00:41.740 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-08-31T07:00:41.741 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-31T07:00:41.770 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-31T07:00:41.771 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T07:00:41.773 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T07:00:41.782 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-31T07:00:41.836 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-31T07:00:41.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T07:00:41.840 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T07:00:41.849 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-31T07:00:42.985 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-31T07:00:42.997 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-31T07:00:42.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T07:00:43.022 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T07:00:43.052 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-31T07:00:43.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-31T07:00:43.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T07:00:43.097 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T07:00:43.100 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-31T07:00:43.118 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-08-31T07:00:43.125 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-08-31T07:00:43.150 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-08-31T07:00:43.176 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T07:00:43.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T07:00:43.190 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T07:00:43.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T07:00:43.221 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-31T07:00:43.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-31T07:00:43.237 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-31T07:00:43.248 INFO:teuthology.task.internal:Transferring archived files... 2024-08-31T07:00:43.249 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi037 2024-08-31T07:00:43.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T07:00:43.306 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi066 2024-08-31T07:00:43.307 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T07:00:43.342 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-30_08:30:37-fs-wip-mchangir-testing-20240828.085847-main-debug-distro-default-smithi/7881426/remote/smithi106 2024-08-31T07:00:43.342 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-31T07:00:43.377 INFO:teuthology.task.internal:Removing archive directory... 2024-08-31T07:00:43.378 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T07:00:43.380 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T07:00:43.382 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-31T07:00:43.429 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-31T07:00:43.442 INFO:teuthology.task.internal:Not uploading archives. 2024-08-31T07:00:43.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-31T07:00:43.452 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-31T07:00:43.453 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T07:00:43.455 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T07:00:43.457 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-31T07:00:43.467 INFO:teuthology.orchestra.run.smithi037.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 07:00 /home/ubuntu/cephtest 2024-08-31T07:00:43.471 INFO:teuthology.orchestra.run.smithi066.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 07:00 /home/ubuntu/cephtest 2024-08-31T07:00:43.485 INFO:teuthology.orchestra.run.smithi106.stdout: 262217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 07:00 /home/ubuntu/cephtest 2024-08-31T07:00:43.486 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-31T07:00:43.498 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-31T07:00:43.525 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/fsync-tester}} duration: 1772.8676764965057 failure_reason: '"2024-08-31T06:55:16.925601+0000 mon.a (mon.0) 1287 : cluster [WRN] Health check failed: 1 OSD(s) experiencing slow operations in BlueStore (BLUESTORE_SLOW_OP_ALERT)" in cluster log' flavor: default owner: scheduled_mchangir@teuthology success: false 2024-08-31T07:00:43.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-31T07:00:43.614 INFO:teuthology.run:FAIL